2025-10-10T13:59:09.905042Z :BasicWriteSession INFO: Random seed for debugging is 1760104749904972
2025-10-10T13:59:10.352110Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559592343067869442:2077];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:10.353538Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T13:59:10.485189Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559592341920707288:2150];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:10.526485Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:10.493239Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002ea3/r3tmp/tmpUz0hWN/pdisk_1.dat
2025-10-10T13:59:10.551859Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:10.890557Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:10.951266Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:11.052763Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:11.094661Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:11.094757Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:11.097360Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:11.097441Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:11.106614Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T13:59:11.106814Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:11.126452Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:11.213442Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:11.225442Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 6798, node 1
2025-10-10T13:59:11.490695Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:11.497284Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:11.533837Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002ea3/r3tmp/yandexgjU5zD.tmp
2025-10-10T13:59:11.533858Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002ea3/r3tmp/yandexgjU5zD.tmp
2025-10-10T13:59:11.533981Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002ea3/r3tmp/yandexgjU5zD.tmp
2025-10-10T13:59:11.534093Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T13:59:11.580838Z INFO: TTestServer started on Port 4585 GrpcPort 6798
TClient is connected to server localhost:4585
PQClient connected to localhost:6798
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T13:59:12.185192Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-10T13:59:12.389971Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720657, at schemeshard: 72057594046644480
waiting...
waiting...
waiting...
2025-10-10T13:59:15.354403Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559592343067869442:2077];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:15.354478Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:15.465282Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559592341920707288:2150];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:15.465365Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:17.105265Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7559592368837674231:2324], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:17.107855Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=YjgzYWZmM2YtY2FhZGJmZTAtZDE3NTQ0YWMtYTU0NzZjNWY=, ActorId: [1:7559592368837674228:2322], ActorState: ExecuteState, TraceId: 01k776pd5p5qajk2gzfa8gay98, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:17.110772Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7559592367690511283:2296], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:17.112835Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=N2QzYjZkN2YtYmJlOTEyOS1jNDAwZTU4Yi05NTc1MzA5ZA==, ActorId: [2:7559592367690511281:2295], ActorState: ExecuteState, TraceId: 01k776pdbg63fxy8x24xmce797, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:17.112975Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:17.116277Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:17.116471Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:17.385668Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:17.656000Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:6798", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T13:59:18.200257Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k776pem00xv654ysvgzm38zb, Database: , SessionId: ydb://session/3?node_id=1&id=ODdiZmVjNDMtNDU2NjlmYjgtOTVlMDQ1YjEtNTg5Y2U4YTI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559592377427609243:2943] 
=== CheckClustersList. Ok
2025-10-10T13:59:23.626800Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:6798
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:23.820557Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6798
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T13:59:23.895336Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559592398902446215:3238] connected; active server actors: 1
2025-10-10T13:59:23.895544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T13:59:23.905367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T13:59:23.910163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T13:59:23.950107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:23.977960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:23.978272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T13:59:23.978318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:23.978372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T13:59:23.978996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592398902446245:2439], now have 1 active actors on pipe
2025-10-10T13:59:23.979024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592398902446214:3237], now have 1 active actors on pipe
2025-10-10T13:59:23.982233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T13:59:24.009473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.045420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.061214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592403197413576:3288], now have 1 active actors on pipe
2025-10-10T13:59:24.065508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.082415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.083511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:24.083585Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T13:59:24.083878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:24.084214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592402050250186:2384]
2025-10-10T13:59:24.095149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:24.095182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:24.095214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559592402050250186:2384]
2025-10-10T13:59:24.095243Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T13:59:24.096648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T13:59:24.096690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.096798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.096808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:24.096834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:24.096850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.096862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.096874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:24.096912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:24.097286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.097411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:24.118449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.118606Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760104764103, TxId 281474976720676
2025-10-10T13:59:24.118626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.118638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.118759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.119004Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:24.138396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:24.138728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:24.138759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.138772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.138791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.138820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:24.139200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T13:59:24.139313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:24.139652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.154984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.155100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.163335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.203487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.203522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.203535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.301266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.301291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.301301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.326528Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720679. Ctx: { TraceId: 01k776pmft36hhre3v2w4wst4f, Database: , SessionId: ydb://session/3?node_id=1&id=ZThkYjhjYzAtZGI2N2EwM2MtZmNlNmRmNTctYmExYTBkYg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-10T13:59:24.400705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.400730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.400740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720676
    CreateStep: 1760104764103
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720676
    CreateStep: 1760104764103
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:6798
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:24.421701Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T13:59:24.501666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.501689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.501699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.603004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.603029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.603041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.705278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.705306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.705318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.808648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.808669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.808677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.913258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.913287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.913297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:6798
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:24.933919Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T13:59:25.013423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.013447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.013454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.115460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.115486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.115496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.217224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.217252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.217262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.320269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.320306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.320319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.420772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.420813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.420826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:6798
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
2025-10-10T13:59:25.441320Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
=== Topic created, have version: 1
2025-10-10T13:59:25.459170Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T13:59:25.459626Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T13:59:25.459671Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:6798
2025-10-10T13:59:25.473418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:25.473463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T13:59:25.483794Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:25.484452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:25.484642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:53356
2025-10-10T13:59:25.484659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53356 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:25.484669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:25.486362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T13:59:25.486529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:25.486546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:25.486556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:25.486573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592407492381077:2483] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:25.488794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592407492381077:2483] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:25.520933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.520957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.520967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.621899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.621942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.621951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.699578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559592407492381077:2483] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:25.700231Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592407492381120:2483] connected; active server actors: 1
2025-10-10T13:59:25.700414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559592407492381077:2483] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T13:59:25.700430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592407492381077:2483] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:25.705682Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592407492381120:2483] disconnected; active server actors: 1
2025-10-10T13:59:25.705721Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592407492381120:2483] disconnected no session
2025-10-10T13:59:25.722023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.722057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.722065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.825258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.825286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.825295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.835202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592407492381077:2483] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:25.835239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592407492381077:2483] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:25.835257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592407492381077:2483] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:25.835291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:25.837119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592407492381138:2483], now have 1 active actors on pipe
2025-10-10T13:59:25.837805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.837838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.837961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T13:59:25.837999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.838019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.838032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:25.838076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.838114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:25.838181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.839128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.839152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.839228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.840492Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104765840 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:25.840650Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:25.841157Z :INFO: [] MessageGroupId [src] SessionId [src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0] Write session: close. Timeout = 0 ms
2025-10-10T13:59:25.841205Z :INFO: [] MessageGroupId [src] SessionId [src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0] Write session will now close
2025-10-10T13:59:25.841265Z :DEBUG: [] MessageGroupId [src] SessionId [src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0] Write session: aborting
2025-10-10T13:59:25.837457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T13:59:25.839494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0
2025-10-10T13:59:25.841704Z :INFO: [] MessageGroupId [src] SessionId [src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:25.841740Z :DEBUG: [] MessageGroupId [src] SessionId [src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0] Write session: destroy
2025-10-10T13:59:25.846153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0 grpc read done: success: 0 data: 
2025-10-10T13:59:25.846177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0 grpc read failed
2025-10-10T13:59:25.846202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0 grpc closed
2025-10-10T13:59:25.846218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|c76b9e7f-b5c700fe-d088fd5d-7ada66bd_0 is DEAD
2025-10-10T13:59:25.856687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:25.857118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559592407492381138:2483] destroyed
2025-10-10T13:59:25.857181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:25.857208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.857221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.857231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.895904Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T13:59:25.895935Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
Session was created
Got new write session event: ReadyToAcceptEvent
Got new write session event: ReadyToAcceptEvent
2025-10-10T13:59:25.926485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.926514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.926524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T13:59:25.973061Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:6798" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:6798" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:6798" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T13:59:26.005486Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:26.006293Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T13:59:26.011199Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T13:59:26.012207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:26.012238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T13:59:26.029312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.029340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.029349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.047396Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:26.047867Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T13:59:26.049284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:26.049442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53372
2025-10-10T13:59:26.049458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:53372 proto=topic  topic=test-topic durationSec=0
2025-10-10T13:59:26.049468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:26.051054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T13:59:26.051178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:26.051188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:26.051195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:26.051210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592411787348452:2496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:26.054650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592411787348452:2496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:26.062954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559592411787348452:2496] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:26.063705Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592411787348468:2496] connected; active server actors: 1
2025-10-10T13:59:26.063861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559592411787348452:2496] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T13:59:26.063878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592411787348452:2496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:26.064617Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592411787348468:2496] disconnected; active server actors: 1
2025-10-10T13:59:26.064635Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592411787348468:2496] disconnected no session
2025-10-10T13:59:26.073830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592411787348452:2496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:26.073863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592411787348452:2496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:26.073878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592411787348452:2496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:26.073933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:26.075027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T13:59:26.077204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592411787348480:2496], now have 1 active actors on pipe
2025-10-10T13:59:26.077268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.077283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.077343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:26.077373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.077386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.077395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:26.077419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.077446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:26.077476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:26.078312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.078337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.078390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:26.078757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0
2025-10-10T13:59:26.081261Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:26.081341Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104766081 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:26.081457Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T13:59:26.081703Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-10T13:59:26.082217Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:26.082268Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-10T13:59:26.082936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:26.083150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:26.083988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.084020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.084095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T13:59:26.084435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.084888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.084909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.085243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 96 offset: -1
2025-10-10T13:59:26.085290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:26.085331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.085365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.085375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:26.085493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T13:59:26.086248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 170 count 1 nextOffset 1 batches 1
2025-10-10T13:59:26.086277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.086664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 158 WTime 1760104766086
2025-10-10T13:59:26.086780Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:26.086872Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 158
2025-10-10T13:59:26.089336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 158 actorID [2:7559592397755282871:2384]
2025-10-10T13:59:26.089383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:26.089424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 103 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:26.089448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.089482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T13:59:26.089748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:26.089787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:26.089801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 158
2025-10-10T13:59:26.089807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.089817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.089827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.089855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:26.089912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T13:59:26.090059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T13:59:26.090727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.091404Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:26.091457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 158 count 1 last offset 0, current partition end offset: 1
2025-10-10T13:59:26.091480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:26.091528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 158 accessed 0 times before, last time 2025-10-10T13:59:26.000000Z
2025-10-10T13:59:26.091567Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T13:59:26.091619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:26.091793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 138 from pos 0 cbcount 1
2025-10-10T13:59:26.091882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104766085 queuesize 0 startOffset 0
2025-10-10T13:59:26.091938Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 3000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T13:59:26.091895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T13:59:26.091987Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T13:59:26.092023Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write session: acknoledged message 1
Got new write session event: AcksEvent: { seqNo : 1, State : EES_WRITTEN, offset : 0, partitionId : 0 } write stat: Write time 0.003000s minimal time in partition queue 0.000000s maximal time in partition queue 0.000000s partition quoted time 0.000000s topic quoted time 0.000000s
2025-10-10T13:59:26.092457Z :INFO: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T13:59:26.092481Z :INFO: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T13:59:26.092521Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T13:59:26.092850Z :INFO: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:26.092890Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T13:59:26.095028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559592411787348480:2496] destroyed
2025-10-10T13:59:26.093904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0 grpc read done: success: 0 data: 
2025-10-10T13:59:26.095060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:26.095083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.095092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.093933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0 grpc read failed
2025-10-10T13:59:26.093956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0 grpc closed
2025-10-10T13:59:26.093971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|b862e30f-60c1de3b-9ad0e38b-3f85d36e_0 is DEAD
2025-10-10T13:59:26.094630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:26.095099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.133381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.133409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.133422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.234977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.235001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.235041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.335663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.335693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.335702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.630612Z node 1 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [1:7559592411787348529:2501] TxId: 281474976720689. Ctx: { TraceId: 01k776pppr53mc0r8am60tg16g, Database: /Root, SessionId: ydb://session/3?node_id=1&id=YjkzYWVhNjAtZTk2NGE4MWEtYmRlMTI4NTYtOWYwOWYwYw==, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 2
2025-10-10T13:59:26.631291Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559592411787348536:2510], TxId: 281474976720689, task: 2. Ctx: { TraceId : 01k776pppr53mc0r8am60tg16g.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=1&id=YjkzYWVhNjAtZTk2NGE4MWEtYmRlMTI4NTYtOWYwOWYwYw==.  CurrentExecutionId : .  DatabaseId : /Root.  Database : /Root. }. Handle abort execution event from: [1:7559592411787348529:2501], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T13:59:26.631580Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559592411787348537:2511], TxId: 281474976720689, task: 4. Ctx: { TraceId : 01k776pppr53mc0r8am60tg16g.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=1&id=YjkzYWVhNjAtZTk2NGE4MWEtYmRlMTI4NTYtOWYwOWYwYw==.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7559592411787348529:2501], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T13:59:28.149199Z :CloseWriteSessionImmediately INFO: Random seed for debugging is 1760104768149180
2025-10-10T13:59:28.676118Z node 3 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639258 Duration# 0.006479s
2025-10-10T13:59:28.694365Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559592419991090348:2087];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:28.694434Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T13:59:28.781179Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:28.818503Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:28.845532Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559592416785905611:2078];send_to=[0:7307199536658146131:7762515];
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002ea3/r3tmp/tmpS3oMWc/pdisk_1.dat
2025-10-10T13:59:28.853452Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T13:59:28.930841Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:28.941247Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:28.948808Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:29.176780Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:29.258687Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:29.259934Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:29.260005Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:29.278985Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:29.279061Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:29.285223Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:29.289741Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T13:59:29.289863Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:29.292192Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 2402, node 3
2025-10-10T13:59:29.437857Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002ea3/r3tmp/yandexDopKMW.tmp
2025-10-10T13:59:29.437885Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002ea3/r3tmp/yandexDopKMW.tmp
2025-10-10T13:59:29.438036Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002ea3/r3tmp/yandexDopKMW.tmp
2025-10-10T13:59:29.438188Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T13:59:29.495796Z INFO: TTestServer started on Port 26893 GrpcPort 2402
2025-10-10T13:59:29.598352Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:29.744916Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:26893
PQClient connected to localhost:2402
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T13:59:29.857986Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-10T13:59:29.914655Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
2025-10-10T13:59:30.098956Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:33.701322Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559592419991090348:2087];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:33.701383Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:33.704155Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7559592441465927803:2322], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:33.704334Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=YjhmMGZhYzktOWNjNmQwNmItZWYyNDE4Yy1mMmYyMzY3Zg==, ActorId: [3:7559592441465927800:2320], ActorState: ExecuteState, TraceId: 01k776py081k142hdpc34f1tzs, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:33.704693Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:33.725704Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:33.804640Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7559592438260742374:2293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:33.809641Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=NDY3MTdkNmQtODJhNzRkZDItNjQ4OTNkMGItNmQ0ZmEwOGQ=, ActorId: [4:7559592438260742372:2292], ActorState: ExecuteState, TraceId: 01k776py3wed6qsfm335620g3k, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:33.810064Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:33.830989Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559592416785905611:2078];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:33.831057Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:33.892811Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:34.063845Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:2402", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T13:59:34.507493Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k776pyhvdt3je33wppwfcc5q, Database: , SessionId: ydb://session/3?node_id=3&id=M2E5NGEyMDMtNWE0NzU0MmItOGUwOTYwMjktYThmNjEwMzQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559592445760895491:2912] 
=== CheckClustersList. Ok
2025-10-10T13:59:40.283559Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:2402
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:40.425789Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:2402
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T13:59:40.485714Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559592471530699761:3204] connected; active server actors: 1
2025-10-10T13:59:40.485924Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T13:59:40.489308Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T13:59:40.490518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:40.494245Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T13:59:40.495554Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:40.495808Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T13:59:40.495837Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:40.495874Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T13:59:40.501894Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592471530699784:2435], now have 1 active actors on pipe
2025-10-10T13:59:40.501926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592471530699760:3203], now have 1 active actors on pipe
2025-10-10T13:59:40.503445Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.503217Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-10T13:59:40.518063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.528531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592471530699807:3240], now have 1 active actors on pipe
2025-10-10T13:59:40.529025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.539784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.540849Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:40.540894Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T13:59:40.541203Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:40.541441Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7559592468325513956:2375]
2025-10-10T13:59:40.544268Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:40.544618Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:40.544642Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7559592468325513956:2375]
2025-10-10T13:59:40.544667Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T13:59:40.545997Z node 4 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T13:59:40.546027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.546100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.546110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:40.546129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:40.546139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.546153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.546161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:40.546195Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:40.546534Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.546683Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:40.553176Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.553342Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760104780574, TxId 281474976710676
2025-10-10T13:59:40.553362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.553372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.553483Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.553643Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:40.556979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:40.557246Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:40.557271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.557281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.557292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.557329Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:40.557686Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T13:59:40.557769Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:40.558023Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.567228Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.567340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.570492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.648915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.648947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.648958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.704205Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k776q4pa2bq8871wbjr8y8q3, Database: , SessionId: ydb://session/3?node_id=3&id=NDNjNmY4MWUtMzlkNjcwZTYtYTcwODY1YS1hODU0MzE1Zg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T13:59:40.747725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.747771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.747783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760104780574
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760104780574
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:2402
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:40.857604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.857641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.857652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T13:59:40.861544Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-10T13:59:40.897549Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T13:59:40.897961Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T13:59:40.898002Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:2402
2025-10-10T13:59:40.942886Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:40.943834Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:40.943873Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T13:59:40.945994Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:40.946120Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:35672
2025-10-10T13:59:40.946135Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35672 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:40.946145Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:40.958510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.958538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.958559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.953095Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T13:59:40.953239Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:40.953247Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:40.953256Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:40.953272Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559592471530699939:2460] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:40.955943Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559592471530699939:2460] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:41.065267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.065306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.065319Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.163580Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559592471530699939:2460] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:41.166299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.166328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.166340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.166455Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592475825667278:2460] connected; active server actors: 1
2025-10-10T13:59:41.166694Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559592471530699939:2460] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T13:59:41.166715Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559592471530699939:2460] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:41.172830Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592475825667278:2460] disconnected; active server actors: 1
2025-10-10T13:59:41.172866Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592475825667278:2460] disconnected no session
2025-10-10T13:59:41.268725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.268766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.268781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.331675Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559592471530699939:2460] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:41.331723Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559592471530699939:2460] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:41.331739Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559592471530699939:2460] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:41.331770Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:41.337253Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592475825667311:2460], now have 1 active actors on pipe
2025-10-10T13:59:41.337293Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T13:59:41.341236Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.341280Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.341360Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T13:59:41.341397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.341419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.341428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:41.341467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.341503Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:41.341544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:41.342482Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.342511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.342571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:41.342859Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0
2025-10-10T13:59:41.345028Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104781344 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:41.345169Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:41.345370Z :INFO: [] MessageGroupId [src] SessionId [src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0] Write session: close. Timeout = 0 ms
2025-10-10T13:59:41.345407Z :INFO: [] MessageGroupId [src] SessionId [src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0] Write session will now close
2025-10-10T13:59:41.345458Z :DEBUG: [] MessageGroupId [src] SessionId [src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0] Write session: aborting
2025-10-10T13:59:41.345903Z :INFO: [] MessageGroupId [src] SessionId [src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:41.345943Z :DEBUG: [] MessageGroupId [src] SessionId [src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0] Write session: destroy
2025-10-10T13:59:41.348663Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0 grpc read done: success: 0 data: 
2025-10-10T13:59:41.348690Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0 grpc read failed
2025-10-10T13:59:41.348719Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0 grpc closed
2025-10-10T13:59:41.348735Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|469c201e-dd00daf8-c83dcd4-4bc09a1d_0 is DEAD
2025-10-10T13:59:41.358492Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:41.366116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559592475825667311:2460] destroyed
2025-10-10T13:59:41.366161Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:41.366189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.366200Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.366235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.369419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.369470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.369486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T13:59:41.469653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.469682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.469696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.569943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.569968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.569981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.673298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.673330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.673345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.842935Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710683, task: 1, CA Id [3:7559592475825667334:2478]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-10T13:59:41.880492Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710683, task: 1, CA Id [3:7559592475825667334:2478]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T13:59:42.001691Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710683, task: 1, CA Id [3:7559592475825667334:2478]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T13:59:42.206059Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710683, task: 1, CA Id [3:7559592475825667334:2478]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T13:59:42.413726Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710683, task: 1, CA Id [3:7559592475825667334:2478]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T13:59:42.620053Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710683, task: 1, CA Id [3:7559592475825667334:2478]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T14:56:28.293308Z :FallbackToSingleDb INFO: Random seed for debugging is 1760108188293235
2025-10-10T14:56:28.764558Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559607105960232505:2151];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:28.764652Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:56:28.797010Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-10T14:56:28.801854Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:56:28.826846Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559607107035186847:2150];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:28.828219Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e92/r3tmp/tmpk5Hbnc/pdisk_1.dat
2025-10-10T14:56:28.859563Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-10T14:56:28.860051Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:56:29.093224Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:29.123983Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:29.168262Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:56:29.211836Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:29.211961Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:29.213480Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:29.213574Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:29.239381Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:56:29.239812Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:56:29.242248Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 6016, node 1
2025-10-10T14:56:29.326956Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e92/r3tmp/yandex4NuybI.tmp
2025-10-10T14:56:29.326991Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e92/r3tmp/yandex4NuybI.tmp
2025-10-10T14:56:29.327238Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e92/r3tmp/yandex4NuybI.tmp
2025-10-10T14:56:29.327391Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:56:29.333685Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:56:29.343964Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:56:29.369068Z INFO: TTestServer started on Port 16430 GrpcPort 6016
TClient is connected to server localhost:16430
PQClient connected to localhost:6016
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:56:29.678954Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-10T14:56:29.788876Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
2025-10-10T14:56:29.849260Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:56:32.678293Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:32.680156Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7559607124215056236:2292], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:32.680200Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7559607123140102583:2321], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:32.690180Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=NDRhOTAyNGEtODg0MmEwN2QtM2JmMDNmOTUtNGQwNGU5YTY=, ActorId: [1:7559607123140102580:2319], ActorState: ExecuteState, TraceId: 01k779z8mdce6tnajjx0bcvpz2, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:32.681534Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=OTk1MWE2N2UtZTM4ODAyOS04N2E1ZGZkNy1iYzg0OWFiYw==, ActorId: [2:7559607124215056234:2291], ActorState: ExecuteState, TraceId: 01k779z8jzew17er75h1d57xt0, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:32.700932Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:32.701781Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:32.936686Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:33.191419Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:6016", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:56:33.574415Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k779z9h8dhbgahy2b3br65zs, Database: , SessionId: ydb://session/3?node_id=1&id=ZjcwMWM4MWItZGQyYzRkNDItYTk1YTc2MmYtNjBiZDhkOWM=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559607127435070268:2903] 
2025-10-10T14:56:33.761964Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559607105960232505:2151];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:33.762023Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:56:33.824872Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559607107035186847:2150];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:33.824936Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:56:39.380739Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:6016
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:39.533052Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6016
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:56:39.602901Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559607153204874610:3227] connected; active server actors: 1
2025-10-10T14:56:39.603154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:56:39.606829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:56:39.608550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:56:39.631644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:56:39.639543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:56:39.638488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:56:39.638816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:56:39.638872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:39.638919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:56:39.640189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607153204874637:2448], now have 1 active actors on pipe
2025-10-10T14:56:39.640211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607153204874609:3226], now have 1 active actors on pipe
2025-10-10T14:56:39.640800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:39.645857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:39.654010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607153204874669:3274], now have 1 active actors on pipe
2025-10-10T14:56:39.655565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:39.659913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:39.661081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:39.661194Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:39.661555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:39.661982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559607154279827899:2391]
2025-10-10T14:56:39.664931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:39.664956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:56:39.664985Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559607154279827899:2391]
2025-10-10T14:56:39.665051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:39.668112Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:56:39.668171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:39.668301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:39.668313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:39.668347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:39.668361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:39.668375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:39.668385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:39.668447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:39.669077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:39.669291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:39.675489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:39.675640Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108199696, TxId 281474976710679
2025-10-10T14:56:39.675665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:39.675678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:39.675818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:39.676088Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:39.679698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:39.679992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:39.680030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:39.680043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:39.680054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:39.680083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:39.680445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:56:39.680552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:39.680840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:39.693948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:39.694081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:39.697691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:39.740466Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710680. Ctx: { TraceId: 01k779zfnb9xxj1w86hbz4xym0, Database: , SessionId: ydb://session/3?node_id=1&id=MjFkZTJmMS1mYjgzNzEwLWIwNDkzNGViLWFkYzE0OTIz, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T14:56:39.768603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:39.768645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:39.768658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1760108199696
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1760108199696
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:6016
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:39.792533Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:39.870821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:39.870857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:39.870870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:39.969734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:39.969758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:39.969765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.070176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.070219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.070230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.171333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.171363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.171374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.272102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.272127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.272137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:6016
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:40.298139Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:40.372240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.372292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.372304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.473437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.473464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.473472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.573999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.574028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.574039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.674412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.674440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.674450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.776680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.776705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.776715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:6016
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:56:40.805249Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-10T14:56:40.815999Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:56:40.817442Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:56:40.817499Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:6016
2025-10-10T14:56:40.827208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:56:40.827242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:56:40.837457Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:40.838137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:40.838310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:45948
2025-10-10T14:56:40.838329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:45948 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:56:40.838342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:56:40.844891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:56:40.845097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:56:40.845122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:56:40.845156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:56:40.845184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559607157499842142:2488] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:56:40.847941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559607157499842142:2488] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:56:40.879536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.879567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.879577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.977955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.977989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.978000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.034560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559607157499842142:2488] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:56:41.034812Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607161794809477:2488] connected; active server actors: 1
2025-10-10T14:56:41.034915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559607157499842142:2488] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:56:41.034940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559607157499842142:2488] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:56:41.035354Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607161794809477:2488] disconnected; active server actors: 1
2025-10-10T14:56:41.035391Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607161794809477:2488] disconnected no session
2025-10-10T14:56:41.078281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.078303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.078314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.178621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.178649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.178658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.183134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559607157499842142:2488] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:56:41.183166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559607157499842142:2488] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:56:41.183177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559607157499842142:2488] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:56:41.183196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:56:41.185718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607161794809496:2488], now have 1 active actors on pipe
2025-10-10T14:56:41.189684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:41.189725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:41.189829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:56:41.189882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.189901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.189913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:41.189975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.190024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:56:41.190084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:41.190623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:41.190644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:41.190715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:41.191903Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760108201191 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:41.192039Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:56:41.189395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:56:41.190985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0
2025-10-10T14:56:41.195242Z :INFO: [] MessageGroupId [src] SessionId [src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0] Write session: close. Timeout = 0 ms
2025-10-10T14:56:41.195279Z :INFO: [] MessageGroupId [src] SessionId [src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0] Write session will now close
2025-10-10T14:56:41.195320Z :DEBUG: [] MessageGroupId [src] SessionId [src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0] Write session: aborting
2025-10-10T14:56:41.195783Z :INFO: [] MessageGroupId [src] SessionId [src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:56:41.195817Z :DEBUG: [] MessageGroupId [src] SessionId [src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0] Write session: destroy
2025-10-10T14:56:41.197054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0 grpc read done: success: 0 data: 
2025-10-10T14:56:41.197077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0 grpc read failed
2025-10-10T14:56:41.197106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0 grpc closed
2025-10-10T14:56:41.197141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|6f72efa0-1e7d87db-b7626b33-5e5efcaf_0 is DEAD
2025-10-10T14:56:41.198580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:56:41.199699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607161794809496:2488] destroyed
2025-10-10T14:56:41.199741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:56:41.199770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.199783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.199792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T14:56:41.224177Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-10T14:56:41.224320Z :INFO: [/Root] [] [80cf3a44-26ade5d9-c482629-234e4640] Open read subsessions to databases: { name: , endpoint: localhost:6016, path: /Root }
2025-10-10T14:56:41.224515Z :INFO: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] Starting read session
2025-10-10T14:56:41.224572Z :DEBUG: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] Starting single session
2025-10-10T14:56:41.225294Z :DEBUG: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:41.225460Z :DEBUG: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:41.225537Z :DEBUG: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:56:41.230069Z :DEBUG: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] [] Successfully connected. Initializing session
2025-10-10T14:56:41.230704Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:56:41.230727Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T14:56:41.262191Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:56:41.262519Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 read init: from# ipv6:[::1]:45968, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:56:41.262932Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 auth for : user
2025-10-10T14:56:41.265588Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 Handle describe topics response
2025-10-10T14:56:41.265737Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 auth is DEAD
2025-10-10T14:56:41.265823Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:56:41.266966Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:56:41.269281Z :INFO: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] [] Got InitResponse. ReadSessionId: shared/user_1_1_11413738546411715281_v1
2025-10-10T14:56:41.269469Z :DEBUG: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:41.269757Z :DEBUG: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:56:41.270886Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:56:41.271016Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 got read request: guid# 6eecd3dd-719891a8-93468b0f-c4ee880b
2025-10-10T14:56:41.271042Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607161794809506:2501] connected; active server actors: 1
2025-10-10T14:56:41.271120Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559607161794809506:2501] session shared/user_1_1_11413738546411715281_v1
2025-10-10T14:56:41.271208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:56:41.271275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:56:41.271326Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_11413738546411715281_v1" (Sender=[1:7559607161794809503:2501], Pipe=[1:7559607161794809506:2501], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:56:41.271353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:56:41.271405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:56:41.271456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_11413738546411715281_v1" (Sender=[1:7559607161794809503:2501], Pipe=[1:7559607161794809506:2501], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:56:41.271526Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_11413738546411715281_v1" sender [1:7559607161794809503:2501] lock partition 0 for ReadingSession "shared/user_1_1_11413738546411715281_v1" (Sender=[1:7559607161794809503:2501], Pipe=[1:7559607161794809506:2501], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T14:56:41.271582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:56:41.271613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000185s
2025-10-10T14:56:41.272699Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_11413738546411715281_v1" ClientId: "user" PipeClient { RawX1: 7559607161794809506 RawX2: 4503603922340293 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:56:41.272821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:56:41.273838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559607161794809509:2504]
2025-10-10T14:56:41.274102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607161794809509:2504], now have 1 active actors on pipe
2025-10-10T14:56:41.274202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:41.274225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:41.274255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_11413738546411715281_v1 on pipe: [1:7559607161794809509:2504]
2025-10-10T14:56:41.274328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.274350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.274361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:41.274365Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_11413738546411715281_v1:1 with generation 1
2025-10-10T14:56:41.274436Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_11413738546411715281_v1
2025-10-10T14:56:41.274449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.274591Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:41.278387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:41.278482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:41.278508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.278528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.278537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.278564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:41.278599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:56:41.278908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.278927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.278935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.279271Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760108201198 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:56:41.279336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:56:41.279465Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name:  Database path: /Root Database id:  CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:56:41.280527Z :INFO: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-10T14:56:41.280679Z :INFO: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] Closing read session. Close timeout: 0.010000s
2025-10-10T14:56:41.280725Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:56:41.280756Z :INFO: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] Counters: { Errors: 0 CurrentSessionLifetimeMs: 56 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:41.281213Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T14:56:41.281310Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:56:41.281354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:56:41.281381Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:56:41.281565Z :INFO: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] Closing read session. Close timeout: 0.000000s
2025-10-10T14:56:41.281592Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:56:41.281616Z :INFO: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] Counters: { Errors: 0 CurrentSessionLifetimeMs: 57 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:41.281644Z :INFO: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] Closing read session. Close timeout: 0.000000s
2025-10-10T14:56:41.281672Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:56:41.281701Z :INFO: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] Counters: { Errors: 0 CurrentSessionLifetimeMs: 57 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:41.281798Z :NOTICE: [/Root] [/Root] [2551c69f-346b7da-2976fb76-673eea83] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:56:41.285794Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:56:41.285831Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 grpc read failed
2025-10-10T14:56:41.285855Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 closed
2025-10-10T14:56:41.286109Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_11413738546411715281_v1 is DEAD
2025-10-10T14:56:41.287764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_11413738546411715281_v1
2025-10-10T14:56:41.287692Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607161794809506:2501] disconnected; active server actors: 1
2025-10-10T14:56:41.287823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607161794809509:2504] destroyed
2025-10-10T14:56:41.287718Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607161794809506:2501] client user disconnected session shared/user_1_1_11413738546411715281_v1
2025-10-10T14:56:41.287896Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_11413738546411715281_v1
2025-10-10T14:56:41.379423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.379461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.379470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.480465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.480493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.480501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.587534Z :FallbackToSingleDbAfterBadRequest INFO: Random seed for debugging is 1760108202587520
2025-10-10T14:56:42.873215Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559607167624553506:2157];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:42.873362Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e92/r3tmp/tmp8hNblu/pdisk_1.dat
2025-10-10T14:56:42.917533Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559607168925431956:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:42.918386Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:56:42.920925Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:56:42.923149Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:42.926701Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-10T14:56:42.941872Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:56:43.021964Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:43.063677Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:56:43.078329Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:43.078386Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:43.079794Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:43.079840Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:43.083450Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:56:43.083531Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:56:43.088826Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 8549, node 3
2025-10-10T14:56:43.149635Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:56:43.155963Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e92/r3tmp/yandexwlBT6k.tmp
2025-10-10T14:56:43.155986Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e92/r3tmp/yandexwlBT6k.tmp
2025-10-10T14:56:43.156108Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e92/r3tmp/yandexwlBT6k.tmp
2025-10-10T14:56:43.156254Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:56:43.176085Z INFO: TTestServer started on Port 15520 GrpcPort 8549
2025-10-10T14:56:43.186912Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:15520
PQClient connected to localhost:8549
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:56:43.331387Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:56:43.882709Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:56:43.923687Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:56:46.383806Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7559607184804423590:2321], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:46.386130Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=ZDE3ZTNhNzItZjc2ZjUyNTMtMjVhMTUxOTItMzAyYjRkZDI=, ActorId: [3:7559607184804423587:2319], ActorState: ExecuteState, TraceId: 01k779zp870k5c6fkbcckftr4v, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:46.386477Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:46.397750Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:46.490082Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7559607186105301486:2294], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:46.492445Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=NjY4N2Y0OC1iODExMmJmOC1lNzNmZGZmNy1kNjliYmU5MA==, ActorId: [4:7559607186105301482:2293], ActorState: ExecuteState, TraceId: 01k779zpbs0ymr728decbsj6fn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:46.492815Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:46.510583Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:46.649954Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:8549", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:56:46.970485Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k779zpp98ng8h88qbx9xyhnj, Database: , SessionId: ydb://session/3?node_id=3&id=NTE2NDMxMGQtYWEyOWYzMmMtMjZjMWQ2NjktNWUzZmNmZTM=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559607184804423979:2923] 
2025-10-10T14:56:47.873592Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559607167624553506:2157];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:47.873701Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:56:47.909031Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559607168925431956:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:47.909099Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:56:52.119984Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715673:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:8549
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:52.204087Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:8549
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:56:52.259348Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559607210574228231:3206] connected; active server actors: 1
2025-10-10T14:56:52.259533Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:56:52.260153Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:56:52.262790Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:56:52.285333Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:56:52.293716Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:56:52.293956Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:56:52.293987Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:52.294024Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:56:52.294409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607210574228259:2432], now have 1 active actors on pipe
2025-10-10T14:56:52.295694Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-10T14:56:52.301061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607210574228230:3205], now have 1 active actors on pipe
2025-10-10T14:56:52.301408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:52.307464Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:52.313534Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607210574228299:3254], now have 1 active actors on pipe
2025-10-10T14:56:52.316001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:52.319789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:52.320771Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:52.320809Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:52.321083Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:52.321308Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7559607211875105734:2376]
2025-10-10T14:56:52.323998Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:52.324015Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:56:52.324031Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7559607211875105734:2376]
2025-10-10T14:56:52.324053Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:52.327933Z node 4 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:56:52.327968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.328038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.328048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:52.328062Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:52.328070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.328078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.328088Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:52.328130Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:52.328659Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:52.328812Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:52.339303Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:52.339444Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108212359, TxId 281474976715676
2025-10-10T14:56:52.339462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.339473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.339607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.339792Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:52.343425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:52.343654Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:52.343676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.343684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.343693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.343720Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:52.344077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:56:52.344159Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:52.344381Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:52.352607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:52.352701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:52.357471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:52.426115Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715677. Ctx: { TraceId: 01k779zw1nf7r58qjd71jvhjmc, Database: , SessionId: ydb://session/3?node_id=3&id=ZTQ4NmIxNTQtMWQ4ZDc3Mi1hODdmYWZmZS0zNDZlMGRmNA==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T14:56:52.428966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.428990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.429001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760108212359
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760108212359
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:8549
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:52.469405Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:52.529633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.529661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.529671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.630121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.630145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.630159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.730515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.730540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.730552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.830715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.830748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.830758Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.931057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.931081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.931092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:8549
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:52.978819Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:53.033235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.033260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.033272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.138357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.138386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.138398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.237215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.237245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.237256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.337682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.337716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.337726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.437960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.437984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.437995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:8549
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:53.491957Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:56:53.521667Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:56:53.522433Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:56:53.522508Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:8549
2025-10-10T14:56:53.540234Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:53.538992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.539025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.539040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.542664Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:56:53.542699Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:56:53.543287Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:53.543378Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:47118
2025-10-10T14:56:53.543391Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:47118 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:56:53.543399Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:56:53.549216Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:56:53.549304Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:56:53.549314Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:56:53.549322Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:56:53.549339Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559607214869195774:2468] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:56:53.551322Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559607214869195774:2468] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:56:53.638721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.638756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.638774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.694088Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559607214869195774:2468] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:56:53.702053Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607214869195811:2468] connected; active server actors: 1
2025-10-10T14:56:53.702201Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559607214869195774:2468] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:56:53.702217Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559607214869195774:2468] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:56:53.703608Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607214869195811:2468] disconnected; active server actors: 1
2025-10-10T14:56:53.703632Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607214869195811:2468] disconnected no session
2025-10-10T14:56:53.739134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.739161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.739172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.843542Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559607214869195774:2468] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:56:53.843577Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559607214869195774:2468] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:56:53.843600Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559607214869195774:2468] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:56:53.843629Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:56:53.845223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.845250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.845261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.849949Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T14:56:53.851553Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607214869195830:2468], now have 1 active actors on pipe
2025-10-10T14:56:53.851643Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:53.851669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:53.851786Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:56:53.851822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.851846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.851859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:53.851902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.851951Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:56:53.852002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:53.853147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:53.853165Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:53.853223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:53.853519Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0
2025-10-10T14:56:53.857396Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760108213857 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:53.857536Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:56:53.857757Z :INFO: [] MessageGroupId [src] SessionId [src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0] Write session: close. Timeout = 0 ms
2025-10-10T14:56:53.857805Z :INFO: [] MessageGroupId [src] SessionId [src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0] Write session will now close
2025-10-10T14:56:53.857846Z :DEBUG: [] MessageGroupId [src] SessionId [src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0] Write session: aborting
2025-10-10T14:56:53.858390Z :INFO: [] MessageGroupId [src] SessionId [src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:56:53.858429Z :DEBUG: [] MessageGroupId [src] SessionId [src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0] Write session: destroy
PORTS 8549 24807
2025-10-10T14:56:53.859422Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0 grpc read done: success: 0 data: 
2025-10-10T14:56:53.859450Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0 grpc read failed
2025-10-10T14:56:53.859480Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0 grpc closed
2025-10-10T14:56:53.859494Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d44369a8-3be48033-d1f6bf8e-3ddf6ec9_0 is DEAD
2025-10-10T14:56:53.865531Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:56:53.869522Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559607214869195830:2468] destroyed
2025-10-10T14:56:53.869566Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:56:53.869592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.869604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.869615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T14:56:53.946265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.946293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.946303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.045246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.045268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.045276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.145635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.145661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.145673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.245952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.245982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.245994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.347042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.347077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.347091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.452724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.452759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.452773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.553207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.553238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.553248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.655820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.655854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.655866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.754548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.754583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.754594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.854870Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.854901Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.854911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:56:54.907630Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-10T14:56:54.907717Z :INFO: [/Root] [] [caa2a425-16b07e1b-93db7ebf-24b12b07] Open read subsessions to databases: { name: , endpoint: localhost:24807, path: /Root }
2025-10-10T14:56:54.907931Z :INFO: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Starting read session
2025-10-10T14:56:54.907970Z :DEBUG: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Starting single session
2025-10-10T14:56:54.908888Z :DEBUG: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:54.908954Z :DEBUG: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:54.909008Z :DEBUG: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:56:54.909233Z :ERROR: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] [] Got error. Status: CLIENT_CALL_UNIMPLEMENTED. Description: <main>: Error: GRpc error: (12):  <main>: Error: Grpc error response on endpoint localhost:24807 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:24807. 
2025-10-10T14:56:54.909299Z :DEBUG: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:54.909331Z :DEBUG: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:54.909471Z :INFO: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] [] Closing session to cluster: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:24807" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:24807     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:24807. " }
2025-10-10T14:56:54.921217Z :NOTICE: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:56:54.921305Z :DEBUG: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] [] Abort session to cluster
Got new read session event: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:24807" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:24807     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:24807. " }
2025-10-10T14:56:54.921504Z :INFO: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Closing read session. Close timeout: 0.010000s
2025-10-10T14:56:54.921578Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:56:54.921621Z :INFO: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Counters: { Errors: 1 CurrentSessionLifetimeMs: 13 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:54.921665Z :INFO: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Closing read session. Close timeout: 0.000000s
2025-10-10T14:56:54.921718Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:56:54.921760Z :INFO: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Counters: { Errors: 1 CurrentSessionLifetimeMs: 13 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:54.921817Z :INFO: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Closing read session. Close timeout: 0.000000s
2025-10-10T14:56:54.921858Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:56:54.921891Z :INFO: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Counters: { Errors: 1 CurrentSessionLifetimeMs: 13 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:54.921968Z :NOTICE: [/Root] [/Root] [da25c9b2-a8ee6279-d36e2718-55ed72bf] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:56:54.955324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.955358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.955372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.055897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.055926Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.055937Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.259510Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715686, task: 1, CA Id [3:7559607223459130511:2490]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-10T14:56:55.297283Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715686, task: 1, CA Id [3:7559607223459130511:2490]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T14:56:55.417226Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715686, task: 1, CA Id [3:7559607223459130511:2490]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T14:56:30.465697Z :GetAllStartPartitionSessions INFO: Random seed for debugging is 1760108190465607
2025-10-10T14:56:30.988144Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559607115466527992:2197];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:30.989793Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:56:31.070508Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:56:31.062820Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559607118616920973:2107];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:31.062897Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:56:31.107723Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e84/r3tmp/tmpqt9BSE/pdisk_1.dat
2025-10-10T14:56:31.335561Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:31.399835Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:31.449948Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:56:31.498426Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:31.498554Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:31.500055Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:31.500157Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:31.522919Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:56:31.523609Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:56:31.526355Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:56:31.554239Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 14969, node 1
2025-10-10T14:56:31.583703Z node 2 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.012372s
2025-10-10T14:56:31.640663Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:56:31.825841Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e84/r3tmp/yandex9a6OZU.tmp
2025-10-10T14:56:31.825904Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e84/r3tmp/yandex9a6OZU.tmp
2025-10-10T14:56:31.826087Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e84/r3tmp/yandex9a6OZU.tmp
2025-10-10T14:56:31.826205Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:56:31.860448Z INFO: TTestServer started on Port 16481 GrpcPort 14969
2025-10-10T14:56:31.997345Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:56:32.101352Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:16481
PQClient connected to localhost:14969
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:56:32.238983Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:56:35.211628Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:35.216415Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7559607132646398034:2321], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:35.219099Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=MTQxMGMxMTItZWY5NjMyZTktYmI5MWNmM2ItNjI1MTEyMg==, ActorId: [1:7559607132646398031:2319], ActorState: ExecuteState, TraceId: 01k779zb0e49a5s7n53ag1p0wp, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:35.219105Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7559607131501823118:2292], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:35.219331Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=MTQ1YjVmMzEtODg4ZmUyOTctNjJiMzU4NGEtY2M5M2ZiNDA=, ActorId: [2:7559607131501823116:2291], ActorState: ExecuteState, TraceId: 01k779zb0k3y7xy7sxrjs969fd, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:35.221584Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:35.221580Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:35.392110Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:35.515761Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:14969", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:56:35.858472Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k779zbt03q0cyrrq37gsahk4, Database: , SessionId: ydb://session/3?node_id=1&id=OTZlMWM3MTctYjM3YWQ4NTQtYTgzY2YwNzYtYjNlYmYwNWQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559607136941365723:2918] 
2025-10-10T14:56:35.982406Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559607115466527992:2197];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:35.982481Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:56:36.065246Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559607118616920973:2107];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:36.065331Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:56:41.924252Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 5 partitions
CallPersQueueGRPC request to localhost:14969
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:42.080411Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:14969
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 5
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:56:42.127095Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559607167006137367:3250] connected; active server actors: 1
2025-10-10T14:56:42.127483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [1, 2, 3, 4, 0]
2025-10-10T14:56:42.129072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:56:42.130072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) (1, 72075186224037892) (2, 72075186224037892) (3, 72075186224037892) (4, 72075186224037892) 
2025-10-10T14:56:42.148497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:56:42.151553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:56:42.151780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:56:42.151819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:42.151858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:56:42.152166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607167006137392:2449], now have 1 active actors on pipe
2025-10-10T14:56:42.152199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607167006137366:3249], now have 1 active actors on pipe
2025-10-10T14:56:42.153009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:56:42.153971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:42.157315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:42.164902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607167006137421:3290], now have 1 active actors on pipe
2025-10-10T14:56:42.165466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:42.168949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:42.171972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:42.172022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:42.172039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:42.172055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:42.172071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:42.172112Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:42.172128Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][2][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:42.172140Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][3][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:42.172153Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:42.172165Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][4][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:42.173826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:42.174237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [2:7559607165861562076:2392]
2025-10-10T14:56:42.177406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:42.177440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:1:Initializer] Initializing completed.
2025-10-10T14:56:42.177462Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 1 generation 1 [2:7559607165861562076:2392]
2025-10-10T14:56:42.177495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:42.179458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-10-10T14:56:42.179511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.179630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.179644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-10T14:56:42.179673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-10T14:56:42.179684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.179694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.179708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-10T14:56:42.179745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:42.180200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:42.180376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][2][StateInit] bootstrapping 2 [2:7559607165861562077:2392]
2025-10-10T14:56:42.182370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:42.182397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:2:Initializer] Initializing completed.
2025-10-10T14:56:42.182412Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][2][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 2 generation 1 [2:7559607165861562077:2392]
2025-10-10T14:56:42.182431Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][2][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 2 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:42.183393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][2][StateIdle] Process pending events. Count 1
2025-10-10T14:56:42.183417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.183477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.183485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-10T14:56:42.183498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-10T14:56:42.183507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.183515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.183522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-10T14:56:42.183546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:42.183675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:42.183824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][3][StateInit] bootstrapping 3 [2:7559607165861562078:2392]
2025-10-10T14:56:42.186479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:42.186503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:3:Initializer] Initializing completed.
2025-10-10T14:56:42.186518Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][3][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 3 generation 1 [2:7559607165861562078:2392]
2025-10-10T14:56:42.186539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][3][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 3 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:42.187522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][3][StateIdle] Process pending events. Count 1
2025-10-10T14:56:42.187553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.187616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.187625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-10T14:56:42.187646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-10T14:56:42.187661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.187670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.187678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-10T14:56:42.187702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:42.187844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:42.188011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][4][StateInit] bootstrapping 4 [2:7559607165861562079:2392]
2025-10-10T14:56:42.189867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:42.189895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:4:Initializer] Initializing completed.
2025-10-10T14:56:42.189910Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][4][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 4 generation 1 [2:7559607165861562079:2392]
2025-10-10T14:56:42.189930Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][4][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 4 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:42.190939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][4][StateIdle] Process pending events. Count 1
2025-10-10T14:56:42.190972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.191033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.191042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-10T14:56:42.191056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-10T14:56:42.191065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.191073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.191081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-10T14:56:42.191104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:42.191293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:42.191487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559607165861562080:2392]
2025-10-10T14:56:42.193523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:42.193548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:56:42.193564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559607165861562080:2392]
2025-10-10T14:56:42.193589Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:42.194545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:56:42.194579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.194648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.194657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:42.194670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:42.194678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.194685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.194692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:42.194714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:42.194994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.195151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.195301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.195512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.195763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:42.195849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.206253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:42.206428Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108202209, TxId 281474976710679
2025-10-10T14:56:42.206451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.206460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.206597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.206847Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108202209, TxId 281474976710679
2025-10-10T14:56:42.206861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.206868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.206933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.207022Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][2][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108202209, TxId 281474976710679
2025-10-10T14:56:42.207033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.207039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.207089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.207164Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][3][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108202209, TxId 281474976710679
2025-10-10T14:56:42.207172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.207178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.207222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.207300Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][4][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108202209, TxId 281474976710679
2025-10-10T14:56:42.207310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.207316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.207364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.207483Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:42.207527Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:42.207541Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:42.207555Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:42.207569Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:42.219475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:42.219809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:42.219848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.219859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.219871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.219902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.219924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:42.220057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:42.220068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.220075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.220081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.220093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.220109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:42.220243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:42.220253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.220261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.220268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.220279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.220294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:42.220412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:42.220424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.220430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.220436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.220447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.220462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:42.220575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:42.220586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.220593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.220600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.220612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-10T14:56:42.221256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 5 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 2 PartitionIds: 3 PartitionIds: 4 PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:56:42.221374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:42.221751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:42.235427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:42.235551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:42.237752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:42.281241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.281277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.281289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.284032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.284058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.284067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.288128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.288154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.288163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.290530Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710680. Ctx: { TraceId: 01k779zj4v6qjsg6z3w7fpsq3h, Database: , SessionId: ydb://session/3?node_id=1&id=ZTliZjY3OGUtNzZmMzIyODYtMzdkYmNmMDEtZDg0ODE5YTE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T14:56:42.291834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.291855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.291865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.294794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.294811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.294819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1760108202209
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1760108202209
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 2
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 3
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 4
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 5
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 5
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:14969
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:42.340511Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-10T14:56:42.381370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.381391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.381400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.384356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.384372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.384379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.388443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.388459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.388466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.392304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.392322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.392328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.395114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.395134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.395142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.483397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.483423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.483433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.484712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.484724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.484732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.488805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.488824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.488833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.492394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.492411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.492419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.495475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.495501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.495510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.583515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.583543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.583552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.585045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.585067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.585076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.589154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.589176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.589185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.592747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.592768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.592777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.595788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.595807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.595816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.683932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.683958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.683968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.685403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.685423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.685431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.689550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.689572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.689582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.693164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.693185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.693193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.696183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.696207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.696215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.784257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.784288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.784301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.785729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.785749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.785758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.789871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.789890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.789956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.793447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.793467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.793475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.796518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.796538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.796545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14969
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:42.847149Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:42.885272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.885298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.885307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.889516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.889542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.889553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.893243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.893266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.893275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.897323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.897346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.897355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.897403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.897411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.897416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.985818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.985845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.985857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:42.989857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.989884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.989903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:42.993656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.993691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.993700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:42.997780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.997815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.997825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:42.997870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.997878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.997884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.086370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.086398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.086407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.089914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.089947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.089957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.094008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.094039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.094047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:43.098102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.098133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.098141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:43.098202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.098210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.098215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.186743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.186776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.186785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.190301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.190322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.190330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.195138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.195166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.195175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:43.198555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.198573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.198581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:43.198638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.198645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.198651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.289246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.289293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.289303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.293229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.293258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.293268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.297242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.297268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.297278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:43.301339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.301361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.301369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:43.301416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.301424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.301430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14969
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:43.351715Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 5
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:56:43.359680Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:56:43.360371Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:56:43.360410Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:14969
2025-10-10T14:56:43.369683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:56:43.369714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:56:43.389977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.390007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.390018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.393480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.393518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.393528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.395843Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:43.396465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:43.396562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.396591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.396600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:43.396628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:60788
2025-10-10T14:56:43.396654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60788 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:56:43.396663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:56:43.398256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:56:43.398446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:56:43.398469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:56:43.398477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:56:43.398491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559607171301104902:2488] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:56:43.400501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559607171301104902:2488] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:56:43.401181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.401236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.401252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:43.401295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.401302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.401308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.490338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.490368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.490376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.493911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.493936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.493946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.496941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.496966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.496986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:43.501723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.501749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.501757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:43.501801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.501814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.501820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.563697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559607171301104902:2488] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:56:43.564361Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607171301104939:2488] connected; active server actors: 1
2025-10-10T14:56:43.564433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559607171301104902:2488] (SourceId=src, PreferedPartition=(NULL)) Received partition 2 from PQRB for SourceId=src
2025-10-10T14:56:43.564450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559607171301104902:2488] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:56:43.564752Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607171301104939:2488] disconnected; active server actors: 1
2025-10-10T14:56:43.564771Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607171301104939:2488] disconnected no session
2025-10-10T14:56:43.590687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.590717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.590739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.594317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.594346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.594357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.597388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.597429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.597443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:43.601946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.601972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.601983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:43.602036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.602043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.602049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.691025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.691050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.691061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.693912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559607171301104902:2488] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:56:43.693957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559607171301104902:2488] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=2, SeqNo=(NULL)
2025-10-10T14:56:43.693980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559607171301104902:2488] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:56:43.694007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 2 expectedGeneration: (NULL)
2025-10-10T14:56:43.694708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.694734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.694744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.694814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607171301104962:2488], now have 1 active actors on pipe
2025-10-10T14:56:43.694842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=2) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:56:43.695169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:43.695216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-10-10T14:56:43.695333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|87d08a7c-bf8f1c7-9200d25b-a1735720_0 generated for partition 2 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:56:43.695374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.695397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.695414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-10T14:56:43.695450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.695490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][2][StateIdle] TPartition::ReplyOwnerOk. Partition: 2
2025-10-10T14:56:43.695548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:43.696029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:43.696054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-10-10T14:56:43.696151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:43.696380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 2 MaxSeqNo: 0 sessionId: src|87d08a7c-bf8f1c7-9200d25b-a1735720_0
2025-10-10T14:56:43.697276Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760108203697 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:43.697399Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|87d08a7c-bf8f1c7-9200d25b-a1735720_0" topic: "test-topic" cluster: "dc1" partition_id: 2 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:56:43.697650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.697670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.697679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:43.698387Z :INFO: [] MessageGroupId [src] SessionId [src|87d08a7c-bf8f1c7-9200d25b-a1735720_0] Write session: close. Timeout = 0 ms
2025-10-10T14:56:43.698430Z :INFO: [] MessageGroupId [src] SessionId [src|87d08a7c-bf8f1c7-9200d25b-a1735720_0] Write session will now close
2025-10-10T14:56:43.698472Z :DEBUG: [] MessageGroupId [src] SessionId [src|87d08a7c-bf8f1c7-9200d25b-a1735720_0] Write session: aborting
2025-10-10T14:56:43.699318Z :INFO: [] MessageGroupId [src] SessionId [src|87d08a7c-bf8f1c7-9200d25b-a1735720_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:56:43.699364Z :DEBUG: [] MessageGroupId [src] SessionId [src|87d08a7c-bf8f1c7-9200d25b-a1735720_0] Write session is aborting and will not restart
2025-10-10T14:56:43.699499Z :DEBUG: [] MessageGroupId [src] SessionId [src|87d08a7c-bf8f1c7-9200d25b-a1735720_0] Write session: destroy
2025-10-10T14:56:43.702257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.702279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.702297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:43.702334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.702340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.702347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.702416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607171301104962:2488] destroyed
2025-10-10T14:56:43.702464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][2][StateIdle] TPartition::DropOwner.
2025-10-10T14:56:43.702506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.702677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.701057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|87d08a7c-bf8f1c7-9200d25b-a1735720_0 grpc read done: success: 0 data: 
2025-10-10T14:56:43.702702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.701081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|87d08a7c-bf8f1c7-9200d25b-a1735720_0 grpc read failed
2025-10-10T14:56:43.701110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|87d08a7c-bf8f1c7-9200d25b-a1735720_0 grpc closed
2025-10-10T14:56:43.701152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|87d08a7c-bf8f1c7-9200d25b-a1735720_0 is DEAD
2025-10-10T14:56:43.701641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=2) Received event: NActors::TEvents::TEvPoison
Session was created
2025-10-10T14:56:43.791451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.791481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.791491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.794930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.794965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.794974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.799742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.799774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.799783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:43.802615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.802642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.802651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:43.802694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.802701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.802707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.891670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.891694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.891706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.895261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.895291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.895299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:43.899974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.899997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.900008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:43.902981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.903002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.903011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:43.903044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.903051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.903068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.992108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.992142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.992151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:43.995656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.995682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.995701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.000263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.000289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.000306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.003367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.003404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.003415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.003461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.003478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.003486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.092906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.092928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.092936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.095982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.095999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.096007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.100612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.100643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.100652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.103677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.103696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.103707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.103746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.103761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.103767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.198421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.198453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.198462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.198557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.198564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.198570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.208923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.208954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.208966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.209014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.209021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.209027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.209053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.209061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.209067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.301255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.301282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.301294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.301338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.301346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.301352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.309023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.309049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.309058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.309101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.309108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.309113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.309180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.309187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.309195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.401336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.401362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.401372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.401419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.401426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.401440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.410863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.410885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.410895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.410944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.410951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.410956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.410981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.410986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.410991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.501513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.501549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.501559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.501622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.501628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.501633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.512215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.512237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.512246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.512302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.512309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.512314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.512342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.512349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.512356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.603830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.603863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.603872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.603929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.603935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.603940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.612603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.612651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.612661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.612729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.612738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.612743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.612769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.612776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.612781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.704249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.704282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.704294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.704344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.704352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.704359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.712976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.712998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.713006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.713046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.713053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.713059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.713085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.713091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.713096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:56:44.722972Z :INFO: [/Root] [] [dccb680c-ed3a60c8-51d4bddc-2a6d1f03] Open read subsessions to databases: { name: dc1, endpoint: localhost:14969, path: /Root }, { name: dc2, endpoint: localhost:14969, path: /Root }
2025-10-10T14:56:44.735454Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] Starting read session
2025-10-10T14:56:44.735527Z :DEBUG: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] Starting single session
2025-10-10T14:56:44.736120Z :DEBUG: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:44.736213Z :DEBUG: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:44.736308Z :DEBUG: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:56:44.739263Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] Starting read session
2025-10-10T14:56:44.739302Z :DEBUG: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] Starting single session
2025-10-10T14:56:44.739422Z :DEBUG: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:44.739451Z :DEBUG: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:44.739473Z :DEBUG: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:56:44.742982Z :DEBUG: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] [] Successfully connected. Initializing session
2025-10-10T14:56:44.743196Z :DEBUG: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] Successfully connected. Initializing session
2025-10-10T14:56:44.744141Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:56:44.744165Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T14:56:44.744291Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:56:44.744297Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-10T14:56:44.772425Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:56:44.772438Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:56:44.772747Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 read init: from# ipv6:[::1]:60808, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:56:44.772839Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 read init: from# ipv6:[::1]:60808, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:56:44.773366Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 auth for : user
2025-10-10T14:56:44.774132Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 auth for : user
2025-10-10T14:56:44.774498Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 Handle describe topics response
2025-10-10T14:56:44.776501Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] Got InitResponse. ReadSessionId: shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.776560Z :DEBUG: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:44.776778Z :DEBUG: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:56:44.774687Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 auth is DEAD
2025-10-10T14:56:44.774710Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:56:44.774826Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 Handle describe topics response
2025-10-10T14:56:44.774898Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 auth is DEAD
2025-10-10T14:56:44.774954Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:56:44.775896Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:56:44.775943Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:56:44.777001Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607175596072334:2513] connected; active server actors: 1
2025-10-10T14:56:44.777032Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607175596072335:2514] connected; active server actors: 1
2025-10-10T14:56:44.777055Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559607175596072334:2513] session shared/user_1_1_605696387690373123_v1
2025-10-10T14:56:44.777113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:56:44.777207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:56:44.777221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 1
2025-10-10T14:56:44.777240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-10-10T14:56:44.777716Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] [] Got InitResponse. ReadSessionId: shared/user_1_1_605696387690373123_v1
2025-10-10T14:56:44.777753Z :DEBUG: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:56:44.777981Z :DEBUG: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:56:44.777253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 2
2025-10-10T14:56:44.777273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=3 (Status=Free, Partitions=[2])
2025-10-10T14:56:44.777304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 3
2025-10-10T14:56:44.777328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=4 (Status=Free, Partitions=[3])
2025-10-10T14:56:44.777338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 4
2025-10-10T14:56:44.777379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=5 (Status=Free, Partitions=[4])
2025-10-10T14:56:44.777431Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:56:44.777460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:56:44.777521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=5, UnradableFamilies=5 [5 (4), 4 (3), 3 (2), 2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-10T14:56:44.777570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=5 (Status=Free, Partitions=[4]) for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:56:44.777650Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 5 status Active partitions [4] session "shared/user_1_1_605696387690373123_v1" sender [1:7559607175596072328:2513] lock partition 4 for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T14:56:44.777693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=4 (Status=Free, Partitions=[3]) for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=1)
2025-10-10T14:56:44.777723Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 4 status Active partitions [3] session "shared/user_1_1_605696387690373123_v1" sender [1:7559607175596072328:2513] lock partition 3 for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=2) generation 1 step 2
2025-10-10T14:56:44.777760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=3 (Status=Free, Partitions=[2]) for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=2)
2025-10-10T14:56:44.777824Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_1_605696387690373123_v1" sender [1:7559607175596072328:2513] lock partition 2 for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=3) generation 1 step 3
2025-10-10T14:56:44.777906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=3)
2025-10-10T14:56:44.777957Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_605696387690373123_v1" sender [1:7559607175596072328:2513] lock partition 1 for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=4) generation 1 step 4
2025-10-10T14:56:44.777986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=4)
2025-10-10T14:56:44.778033Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_605696387690373123_v1" sender [1:7559607175596072328:2513] lock partition 0 for ReadingSession "shared/user_1_1_605696387690373123_v1" (Sender=[1:7559607175596072328:2513], Pipe=[1:7559607175596072334:2513], Partitions=[], ActiveFamilyCount=5) generation 1 step 5
2025-10-10T14:56:44.778069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=1, desiredFamilyCount=5, allowPlusOne=0
2025-10-10T14:56:44.778107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000562s
2025-10-10T14:56:44.779041Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 assign: record# { Partition: 4 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_605696387690373123_v1" ClientId: "user" PipeClient { RawX1: 7559607175596072334 RawX2: 4503603922340305 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:56:44.779171Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 assign: record# { Partition: 3 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_1_605696387690373123_v1" ClientId: "user" PipeClient { RawX1: 7559607175596072334 RawX2: 4503603922340305 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:56:44.779219Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:56:44.779292Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 assign: record# { Partition: 2 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_1_605696387690373123_v1" ClientId: "user" PipeClient { RawX1: 7559607175596072334 RawX2: 4503603922340305 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:56:44.779348Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 got read request: guid# 25638ea-be70fc91-2c3bbd57-ab3a2097
2025-10-10T14:56:44.779389Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_1_605696387690373123_v1" ClientId: "user" PipeClient { RawX1: 7559607175596072334 RawX2: 4503603922340305 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:56:44.779397Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559607175596072335:2514] session shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.779431Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_56828798322072933_v1" (Sender=[1:7559607175596072329:2514], Pipe=[1:7559607175596072335:2514], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:56:44.779455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:56:44.779466Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_1_605696387690373123_v1" ClientId: "user" PipeClient { RawX1: 7559607175596072334 RawX2: 4503603922340305 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:56:44.779491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:56:44.779501Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:56:44.779510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-10T14:56:44.779562Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 got read request: guid# 10b133d3-3284c82e-886d286f-6f964f43
2025-10-10T14:56:44.779567Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_605696387690373123_v1" sender [1:7559607175596072328:2513]  release partitions [0]. Target status Free
2025-10-10T14:56:44.779609Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_605696387690373123_v1" sender [1:7559607175596072328:2513]  release partitions [1]. Target status Free
2025-10-10T14:56:44.779640Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_1_605696387690373123_v1" sender [1:7559607175596072328:2513]  release partitions [2]. Target status Free
2025-10-10T14:56:44.779646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2)
2025-10-10T14:56:44.779660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000155s
2025-10-10T14:56:44.779698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-10T14:56:44.779754Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 gone release: partition# 0
2025-10-10T14:56:44.779765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1)
2025-10-10T14:56:44.779785Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-10T14:56:44.779815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-10T14:56:44.779824Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-10T14:56:44.779853Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-10T14:56:44.779861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-10T14:56:44.779913Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 gone release: partition# 1
2025-10-10T14:56:44.779926Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-10T14:56:44.779940Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-10T14:56:44.779956Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-10T14:56:44.779994Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 gone release: partition# 2
2025-10-10T14:56:44.780011Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-10T14:56:44.780029Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-10T14:56:44.780042Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-10T14:56:44.780587Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7559607175596072334:2513] session shared/user_1_1_605696387690373123_v1 partition 0
2025-10-10T14:56:44.780633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:56:44.780656Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7559607175596072334:2513] session shared/user_1_1_605696387690373123_v1 partition 1
2025-10-10T14:56:44.780692Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7559607175596072334:2513] session shared/user_1_1_605696387690373123_v1 partition 2
2025-10-10T14:56:44.780744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=3 [3 (2), 2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-10T14:56:44.780798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=3 (Status=Free, Partitions=[2]) for ReadingSession "shared/user_1_2_56828798322072933_v1" (Sender=[1:7559607175596072329:2514], Pipe=[1:7559607175596072335:2514], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:56:44.780857Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_2_56828798322072933_v1" sender [1:7559607175596072329:2514] lock partition 2 for ReadingSession "shared/user_1_2_56828798322072933_v1" (Sender=[1:7559607175596072329:2514], Pipe=[1:7559607175596072335:2514], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-10T14:56:44.780897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_2_56828798322072933_v1" (Sender=[1:7559607175596072329:2514], Pipe=[1:7559607175596072335:2514], Partitions=[], ActiveFamilyCount=1)
2025-10-10T14:56:44.780946Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_2_56828798322072933_v1" sender [1:7559607175596072329:2514] lock partition 1 for ReadingSession "shared/user_1_2_56828798322072933_v1" (Sender=[1:7559607175596072329:2514], Pipe=[1:7559607175596072335:2514], Partitions=[], ActiveFamilyCount=2) generation 1 step 7
2025-10-10T14:56:44.780976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_56828798322072933_v1" (Sender=[1:7559607175596072329:2514], Pipe=[1:7559607175596072335:2514], Partitions=[], ActiveFamilyCount=2)
2025-10-10T14:56:44.781008Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_56828798322072933_v1" sender [1:7559607175596072329:2514] lock partition 0 for ReadingSession "shared/user_1_2_56828798322072933_v1" (Sender=[1:7559607175596072329:2514], Pipe=[1:7559607175596072335:2514], Partitions=[], ActiveFamilyCount=3) generation 1 step 8
2025-10-10T14:56:44.781040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-10T14:56:44.781058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000300s
2025-10-10T14:56:44.781698Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 assign: record# { Partition: 2 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_2_56828798322072933_v1" ClientId: "user" PipeClient { RawX1: 7559607175596072335 RawX2: 4503603922340306 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:56:44.781828Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_2_56828798322072933_v1" ClientId: "user" PipeClient { RawX1: 7559607175596072335 RawX2: 4503603922340306 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:56:44.781929Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 8 Session: "shared/user_1_2_56828798322072933_v1" ClientId: "user" PipeClient { RawX1: 7559607175596072335 RawX2: 4503603922340306 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:56:44.781981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1)
2025-10-10T14:56:44.782030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2)
2025-10-10T14:56:44.782068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3)
2025-10-10T14:56:44.782261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607175596072343:2520], now have 1 active actors on pipe
2025-10-10T14:56:44.782298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607175596072345:2519], now have 1 active actors on pipe
2025-10-10T14:56:44.782449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607175596072351:2524], now have 1 active actors on pipe
2025-10-10T14:56:44.782470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607175596072352:2525], now have 1 active actors on pipe
2025-10-10T14:56:44.782483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607175596072353:2526], now have 1 active actors on pipe
2025-10-10T14:56:44.782400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559607175596072343:2520]
2025-10-10T14:56:44.782401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559607175596072345:2519]
2025-10-10T14:56:44.782532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559607175596072351:2524]
2025-10-10T14:56:44.782598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559607175596072352:2525]
2025-10-10T14:56:44.782667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:44.782654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559607175596072353:2526]
2025-10-10T14:56:44.782687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 3
2025-10-10T14:56:44.782716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_605696387690373123_v1 on pipe: [1:7559607175596072343:2520]
2025-10-10T14:56:44.782768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:44.782783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-10-10T14:56:44.782791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_56828798322072933_v1 on pipe: [1:7559607175596072351:2524]
2025-10-10T14:56:44.782830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:44.782841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-10T14:56:44.782851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_605696387690373123_v1 on pipe: [1:7559607175596072345:2519]
2025-10-10T14:56:44.782886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.782908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.782918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-10T14:56:44.782962Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user session is set to 0 (startOffset 0) session shared/user_1_1_605696387690373123_v1
2025-10-10T14:56:44.782978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.783083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.783098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.783105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-10T14:56:44.783124Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user session is set to 0 (startOffset 0) session shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.783130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.783175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:44.783185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-10T14:56:44.783194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_56828798322072933_v1 on pipe: [1:7559607175596072352:2525]
2025-10-10T14:56:44.783211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:44.783216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:44.783224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_56828798322072933_v1 on pipe: [1:7559607175596072353:2526]
2025-10-10T14:56:44.783242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.783252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.783257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-10T14:56:44.783279Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user session is set to 0 (startOffset 0) session shared/user_1_1_605696387690373123_v1
2025-10-10T14:56:44.783283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.783318Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:44.783356Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:44.783382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.783390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.783400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-10T14:56:44.783416Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user session is set to 0 (startOffset 0) session shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.783421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.783471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.783479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.783499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:44.783517Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.783521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.783551Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:44.783644Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:44.783660Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:44.784437Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_605696387690373123_v1:2 with generation 1
2025-10-10T14:56:44.784462Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_56828798322072933_v1:1 with generation 1
2025-10-10T14:56:44.784480Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_605696387690373123_v1:1 with generation 1
2025-10-10T14:56:44.784506Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_56828798322072933_v1:2 with generation 1
2025-10-10T14:56:44.784519Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_56828798322072933_v1:3 with generation 1
2025-10-10T14:56:44.789455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:44.789522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:44.789541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.789547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.789552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.789573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-10T14:56:44.789599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 3 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:56:44.790061Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760108204712 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:56:44.790105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:56:44.790183Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 3 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:56:44.791166Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 3. Read offset: (NULL)
2025-10-10T14:56:44.791575Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-10-10T14:56:44.791713Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:56:44.791767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:56:44.791808Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:56:44.794518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:44.794578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:44.794594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.794600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.794605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.794622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-10T14:56:44.794636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:44.794655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:44.794662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.794677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.794684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.794691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-10T14:56:44.794700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:44.794723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:44.794729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.794732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.794735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.794742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-10T14:56:44.794749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:44.794767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:44.794776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.794779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.794782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.794788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:44.794807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:56:44.794852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:56:44.794880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:56:44.794895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:56:44.795269Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760108204704 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:56:44.795305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 2 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:56:44.795714Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760108204712 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:56:44.795750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:56:44.796664Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 2. Read offset: (NULL)
2025-10-10T14:56:44.795843Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760108204704 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:56:44.795857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:56:44.795915Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760108204712 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:56:44.795928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:56:44.795972Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 sending to client partition status
2025-10-10T14:56:44.796246Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 sending to client partition status
2025-10-10T14:56:44.796355Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 sending to client partition status
2025-10-10T14:56:44.796483Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 4 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:56:44.797376Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 4. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 1 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:56:44.797654Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 1. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 3 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:56:44.797812Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] [] Confirm partition stream create. Partition stream id: 3. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-10T14:56:44.801458Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] Closing read session. Close timeout: 0.010000s
2025-10-10T14:56:44.801519Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:3:0:0 -:test-topic:1:2:0:0 -:test-topic:2:1:0:0
2025-10-10T14:56:44.801554Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 66 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:44.801522Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T14:56:44.801954Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] Closing read session. Close timeout: 0.010000s
2025-10-10T14:56:44.801990Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:4:2:0:0 -:test-topic:3:1:0:0
2025-10-10T14:56:44.802019Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] Counters: { Errors: 0 CurrentSessionLifetimeMs: 62 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:44.801680Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:56:44.801722Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T14:56:44.801828Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:56:44.801858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:56:44.801880Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:56:44.801991Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-10-10T14:56:44.802038Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:56:44.802085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:56:44.802358Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] Closing read session. Close timeout: 0.000000s
2025-10-10T14:56:44.802408Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:3:0:0 -:test-topic:1:2:0:0 -:test-topic:2:1:0:0
2025-10-10T14:56:44.802443Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 67 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:44.802482Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] Closing read session. Close timeout: 0.000000s
2025-10-10T14:56:44.802507Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:4:2:0:0 -:test-topic:3:1:0:0
2025-10-10T14:56:44.802525Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] Counters: { Errors: 0 CurrentSessionLifetimeMs: 63 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:44.802545Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] Closing read session. Close timeout: 0.000000s
2025-10-10T14:56:44.802575Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:4:2:0:0 -:test-topic:3:1:0:0
2025-10-10T14:56:44.802600Z :INFO: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] Counters: { Errors: 0 CurrentSessionLifetimeMs: 63 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:44.802671Z :NOTICE: [/Root] [/Root] [109fb7ab-372ee469-2f347f1-c9edde02] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:56:44.803428Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] Closing read session. Close timeout: 0.000000s
2025-10-10T14:56:44.803456Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:3:0:0 -:test-topic:1:2:0:0 -:test-topic:2:1:0:0
2025-10-10T14:56:44.803473Z :INFO: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 68 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:44.803503Z :NOTICE: [/Root] [/Root] [64950f54-805a4746-f4bee329-169eb2a4] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:56:44.802232Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:56:44.802282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:56:44.804647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.804676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.804685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.804723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.802297Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:56:44.804729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.813298Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:56:44.804733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.814550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.814138Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 grpc read failed
2025-10-10T14:56:44.814561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.814175Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 grpc closed
2025-10-10T14:56:44.814568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.814600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.817331Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_605696387690373123_v1 is DEAD
2025-10-10T14:56:44.814604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.817875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.829652Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 3 } }
2025-10-10T14:56:44.817953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.817960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.829731Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 grpc closed
2025-10-10T14:56:44.817965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.829779Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_56828798322072933_v1 is DEAD
2025-10-10T14:56:44.831061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.831095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607175596072352:2525] destroyed
2025-10-10T14:56:44.830740Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607175596072334:2513] disconnected; active server actors: 1
2025-10-10T14:56:44.831114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.830768Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607175596072334:2513] client user disconnected session shared/user_1_1_605696387690373123_v1
2025-10-10T14:56:44.831125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607175596072351:2524] destroyed
2025-10-10T14:56:44.830843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:56:44.831140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_605696387690373123_v1
2025-10-10T14:56:44.830884Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607175596072335:2514] disconnected; active server actors: 1
2025-10-10T14:56:44.831152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607175596072343:2520] destroyed
2025-10-10T14:56:44.831162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_605696387690373123_v1
2025-10-10T14:56:44.831179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607175596072345:2519] destroyed
2025-10-10T14:56:44.831193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.831204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607175596072353:2526] destroyed
2025-10-10T14:56:44.831247Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.831260Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.831271Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_605696387690373123_v1
2025-10-10T14:56:44.831281Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_605696387690373123_v1
2025-10-10T14:56:44.831290Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.830895Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607175596072335:2514] client user disconnected session shared/user_1_2_56828798322072933_v1
2025-10-10T14:56:44.904921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.904948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.904958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:44.905001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.905008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.905012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:44.914645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.914667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.914676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:44.914716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.914722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.914729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:44.918351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.918373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.918383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.005322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.005353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.005363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-10T14:56:45.005426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.005433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.005438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-10T14:56:45.015049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.015084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.015094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-10T14:56:45.015152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.015159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.015164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-10T14:56:45.021367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.021393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.021402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.320550Z :PreferredDatabaseNoFallback INFO: Random seed for debugging is 1760108206320531
2025-10-10T14:56:46.684053Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559607186164011774:2078];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:46.684172Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:56:46.702877Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559607183972864937:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:46.703092Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e84/r3tmp/tmptvzdfO/pdisk_1.dat
2025-10-10T14:56:46.724656Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:56:46.731041Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:46.733833Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:56:46.741763Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:46.824699Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:56:46.858040Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:46.858122Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:46.862173Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:46.862247Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:46.863966Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:56:46.865714Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:56:46.866516Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 13264, node 3
2025-10-10T14:56:46.941225Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:56:46.943342Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e84/r3tmp/yandextGug4K.tmp
2025-10-10T14:56:46.943371Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e84/r3tmp/yandextGug4K.tmp
2025-10-10T14:56:46.943514Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e84/r3tmp/yandextGug4K.tmp
2025-10-10T14:56:46.943674Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:56:46.945591Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:56:46.979213Z INFO: TTestServer started on Port 10308 GrpcPort 13264
TClient is connected to server localhost:10308
PQClient connected to localhost:13264
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:56:47.171520Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:56:47.713873Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:56:47.720478Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:56:50.321595Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7559607201152734426:2292], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:50.324686Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=ZjhmOTJlODEtYWQ1NWE4YzYtNGM3M2U0OTktYTkyZDIwMjc=, ActorId: [4:7559607201152734424:2291], ActorState: ExecuteState, TraceId: 01k779zt2y7jabpe901mfczsn8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:50.325567Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:50.415937Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7559607203343881928:2321], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:50.417381Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=MjQ5MmQ4OS02NDcxMGNjZC01NDlhOWVhZC00ZDM5ZWVjNw==, ActorId: [3:7559607203343881925:2319], ActorState: ExecuteState, TraceId: 01k779zt6q0trtkb32tf47b87n, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:50.417816Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:50.454412Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:50.569257Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:50.833385Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:13264", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:56:51.212326Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k779zts98wf1g2a9vet4m7ba, Database: , SessionId: ydb://session/3?node_id=3&id=YzE1ZWJmNWYtNjlkMDU5YTMtYTk0NTczZDMtY2NkNDEwMzY=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559607207638849614:2906] 
2025-10-10T14:56:51.684374Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559607186164011774:2078];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:51.684437Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:56:51.702801Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559607183972864937:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:51.702872Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:56:57.500951Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:13264
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:57.617587Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:13264
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:56:57.708731Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559607233408653958:3235] connected; active server actors: 1
2025-10-10T14:56:57.708914Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:56:57.720688Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:56:57.734161Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:56:57.749930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:56:57.756414Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:56:57.756737Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:56:57.756770Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:57.756819Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:56:57.758931Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607233408653957:3234], now have 1 active actors on pipe
2025-10-10T14:56:57.758974Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607233408653995:2450], now have 1 active actors on pipe
2025-10-10T14:56:57.760231Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-10T14:56:57.760964Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:57.769728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:57.790725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607233408654038:3293], now have 1 active actors on pipe
2025-10-10T14:56:57.791054Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:57.803710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:57.804742Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:57.804788Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:57.805089Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:57.805295Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7559607231217506098:2393]
2025-10-10T14:56:57.808086Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:57.808110Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:56:57.808132Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7559607231217506098:2393]
2025-10-10T14:56:57.808157Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:57.811795Z node 4 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:56:57.811865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.811947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.811959Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:57.811976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:57.811987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.811999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.812008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:57.812041Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:57.812375Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:57.812514Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:57.824025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:57.824208Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108217826, TxId 281474976715679
2025-10-10T14:56:57.824243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.824253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.824373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.824567Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:57.828606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:57.828884Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:57.828907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.828916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.828926Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.828950Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:57.829306Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:56:57.829392Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:57.829662Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:57.841719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:57.841877Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:57.853862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:57.910875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.910919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.910933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.937013Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k77a01bcbxt2dydf7jy4gcv1, Database: , SessionId: ydb://session/3?node_id=3&id=NGZjN2JkNWYtMzIwODI0MGEtOWQ2MjZlOGItZWM3MDI2YzA=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760108217826
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760108217826
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:13264
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:57.993345Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:58.013274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.013305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.013318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.113648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.113676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.113690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.213932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.213963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.213982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.317670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.317700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.317713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.418850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.418895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.418906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13264
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:58.515211Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:56:58.519891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.519915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.519927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.554441Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:56:58.554987Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:56:58.555033Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:13264
2025-10-10T14:56:58.574068Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:58.575420Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:56:58.575461Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:56:58.576110Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:58.576249Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:60330
2025-10-10T14:56:58.576272Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60330 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:56:58.576281Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:56:58.583189Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:56:58.583346Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:56:58.583357Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:56:58.583366Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:56:58.583383Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559607237703621476:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:56:58.614622Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559607237703621476:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:56:58.620407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.620443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.620455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.725332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.725371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.725383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.789323Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559607237703621476:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:56:58.790155Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607237703621518:2481] connected; active server actors: 1
2025-10-10T14:56:58.790411Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559607237703621476:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:56:58.790429Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559607237703621476:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:56:58.790690Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607237703621518:2481] disconnected; active server actors: 1
2025-10-10T14:56:58.790715Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607237703621518:2481] disconnected no session
2025-10-10T14:56:58.825844Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.825872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.825883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.927376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.927405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.927416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.945440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607237703621538:2481], now have 1 active actors on pipe
2025-10-10T14:56:58.943693Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559607237703621476:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:56:58.943741Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559607237703621476:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:56:58.943758Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559607237703621476:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:56:58.943790Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:56:58.946002Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T14:56:58.946202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:58.946235Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:58.946325Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|c547d7c1-134827d4-38ef3655-b383d5dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:56:58.946361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.946401Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.946428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:58.946470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.946522Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:56:58.946569Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:58.947170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:58.947193Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:58.947252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:58.947526Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|c547d7c1-134827d4-38ef3655-b383d5dd_0
2025-10-10T14:56:58.948232Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760108218948 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:58.948367Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|c547d7c1-134827d4-38ef3655-b383d5dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:56:58.950931Z :INFO: [] MessageGroupId [src] SessionId [src|c547d7c1-134827d4-38ef3655-b383d5dd_0] Write session: close. Timeout = 0 ms
2025-10-10T14:56:58.950995Z :INFO: [] MessageGroupId [src] SessionId [src|c547d7c1-134827d4-38ef3655-b383d5dd_0] Write session will now close
2025-10-10T14:56:58.951036Z :DEBUG: [] MessageGroupId [src] SessionId [src|c547d7c1-134827d4-38ef3655-b383d5dd_0] Write session: aborting
2025-10-10T14:56:58.951559Z :INFO: [] MessageGroupId [src] SessionId [src|c547d7c1-134827d4-38ef3655-b383d5dd_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:56:58.951609Z :DEBUG: [] MessageGroupId [src] SessionId [src|c547d7c1-134827d4-38ef3655-b383d5dd_0] Write session: destroy
2025-10-10T14:56:58.978001Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|c547d7c1-134827d4-38ef3655-b383d5dd_0 grpc closed
2025-10-10T14:56:58.978032Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|c547d7c1-134827d4-38ef3655-b383d5dd_0 is DEAD
2025-10-10T14:56:58.990083Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559607237703621538:2481] destroyed
2025-10-10T14:56:58.989696Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:56:58.990139Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:56:58.990163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.990174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.990185Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
====TYdbPqTestRetryPolicy()
====ExpectBreakDown
2025-10-10T14:56:59.027515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.027545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.027557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
=== Session was created, waiting for retries
>>> Ready to answer: ok
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-10-10T14:56:59.092650Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:56:59.128978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.129008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.129020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.233318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.233351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.233364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.336868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.336902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.336913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.437324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.437354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.437367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.539090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.539117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.539129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.639480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.639511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.639524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.741382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.741412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.741424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.841546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.841577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.841589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.948159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.948193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.948207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.052371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.052399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.052411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.153683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.153710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.153731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.254146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.254173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.254186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.355178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.355203Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.355213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.457002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.457030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.457042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.557537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.557568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.557580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.657664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.657700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.657712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.759148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.759177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.759189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.861368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.861403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.861417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.962661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.962693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.962706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.062685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.062737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.062753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:01.093886Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:01.164547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.164576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.164585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.266163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.266198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.266210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.369257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.369293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.369307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.469218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.469252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.469274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.570662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.570694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.570706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.673698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.673727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.673741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.775176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.775207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.775220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.806745Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:57:01.806776Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:57:01.877612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.877656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.877668Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.977938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.977972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.977985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.078012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.078049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.078062Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.179872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.179899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.179911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.279190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.279221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.279235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.381545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.381581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.381594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.484136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.484170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.484196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.585326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.585359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.585371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.685861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.685923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.685956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.789256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.789291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.789302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.813403Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:02.889542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.889577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.889592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.993261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.993292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.993304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:03.097376Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:03.097265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.097302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.097315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
=== In the next federation discovery response dc2 will be available
2025-10-10T14:57:03.198455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.198491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.198502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.298598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.298629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.298642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.405339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.405367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.405379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.505579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.505605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.505616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.607199Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.607233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.607246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.709437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.709467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.709482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.813358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.813394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.813407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.914953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.914985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.914997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.015755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.015787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.015800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.116405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.116433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.116446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.224972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.225003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.225014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.322950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.322983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.322997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.425491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.425538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.425552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.527171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.527203Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.527213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.629574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.629605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.629616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.732325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.732359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.732371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.832061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.832085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.832093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.933235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.933268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.933280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.033251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.033283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.033296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:05.105252Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:05.137337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.137369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.137381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.241639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.241682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.241694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.342109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.342143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.342154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.442708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.442742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.442755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.545366Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.545396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.545408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.645646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.645689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.645701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.746005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.746047Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.746060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.849021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.849053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.849068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.955176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.955203Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.955213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.053918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.053948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.053961Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.155815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.155846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.155859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.257245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.257287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.257300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.360998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.361025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.361034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.465271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.465311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.465324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.563896Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.563925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.563934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.668277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.668308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.668321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.768358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.768385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.768397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.870415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.870448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.870462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.970737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.970769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.970782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.077313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.077354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.077368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:07.109440Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:07.177888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.177919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.177933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.278280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.278309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.278323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.381277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.381313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.381326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.481897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.481933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.481946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.589256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.589296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.589307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.693238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.693270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.693282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.793243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.793276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.793288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.817416Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:07.893631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.893659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.893670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.995625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.995661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.995673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.096014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.096050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.096063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.196414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.196448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.196462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.299367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.299403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.299416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.399050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.399079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.399090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.502240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.502274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.502285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.602566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.602594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.602605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.705315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.705345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.705357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.807005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.807039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.807059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.908841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.908875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.908886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.008902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.008949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.008962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:09.113253Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:09.119393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.119426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.119439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.216265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.216294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.216319Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.317046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.317085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.317097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.417632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.417664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.417677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.519059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.519096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.519107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.619293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.619327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.619338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.721709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.721737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.721749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.825477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.825510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.825523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.925258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.925287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.925298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.027191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.027232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.027245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.127184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.127228Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.127240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.227489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.227525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.227541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.327817Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.327856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.327869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.429223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.429256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.429269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.530752Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.530785Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.530796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.634886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.634914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.634927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.734452Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.734481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.734493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.835761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.835789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.835802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.937317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.937349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.937361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.036888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.036920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.036931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:11.116341Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:11.141238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.141274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.141285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.241243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.241273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.241285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.344878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.344910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.344923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.445474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.445507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.445521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.548519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.548570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.548586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.647311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.647343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.647354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.749592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.749626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.749639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.853288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.853330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.853344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.954147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.954172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.954185Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.056108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.056138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.056150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.157420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.157447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.157460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.259437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.259471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.259479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.361459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.361485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.361495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.461941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.461973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.461986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.562868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.562902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.562914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.665951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.665983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.665999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.768889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.768919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.768929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.815839Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:12.868912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.868955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.868968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.969482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.969518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.969531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.069566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.069605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.069619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:13.117374Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:13.173274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.173311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.173324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.277109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.277155Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.277169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.378500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.378532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.378542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.481289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.481324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.481335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.582692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.582725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.582738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.684130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.684165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.684194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.784348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.784379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.784390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.885241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.885271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.885284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.986541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.986568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.986578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.086915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.086950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.086963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.187276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.187308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.187331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.288401Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.288426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.288435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.388527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.388573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.388587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.488863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.488894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.488905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.589816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.589849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.589862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.690388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.690428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.690441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.791908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.791939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.791963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.893276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.893311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.893325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.993745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.993783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.993796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.093952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.093981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.093994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:15.124303Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:15.194434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.194460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.194473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.294643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.294676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.294688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.395402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.395435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.395448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.495487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.495521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.495533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.595985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.596014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.596038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.696163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.696206Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.696218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.796702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.796750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.796765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.897318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.897350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.897363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.997714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.997747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.997762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.099068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.099107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.099119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.200549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.200579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.200589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.303558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.303592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.303604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.405241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.405278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.405289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.508771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.508808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.508821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.606469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.606502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.606515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.706870Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.706907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.706920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.813247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.813287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.813302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.917265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.917302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.917316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.016782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.016818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.016840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.118097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.118128Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.118138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:17.126286Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:17.218340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.218386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.218398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.318714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.318747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.318761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.419051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.419085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.419098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.521048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.521080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.521102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.621257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.621299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.621312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.721820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.721852Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.721865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.817640Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:17.822196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.822221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.822232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.922281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.922309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.922330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.025630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.025662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.025674Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.129235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.129266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.129278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.231372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.231403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.231415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.331870Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.331896Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.331909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.437523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.437562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.437575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.541264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.541298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.541312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.644706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.644738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.644751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.745099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.745158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.745170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.845428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.845462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.845476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.945861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.945890Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.945904Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.046490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.046523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.046546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:19.129499Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:19.147064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.147094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.147106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.249280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.249312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.249325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.349807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.349841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.349856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.453408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.453444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.453458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.557276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.557313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.557325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.657726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.657787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.657800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.760284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.760321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.760336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.859436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.859467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.859480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.961288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.961325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.961337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.060939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.060965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.060978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.161337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.161369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.161388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.265332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.265365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.265376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.365586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.365614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.365637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.465952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.465979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.465991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.566671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.566716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.566731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.669736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.669781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.669796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.773374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.773406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.773417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.873914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.873942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.873955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.973930Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.973962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.973972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.077408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.077437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.077449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:21.130395Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:21.180099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.180129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.180153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.285266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.285303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.285317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.385009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.385042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.385057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.485402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.485431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.485444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.585660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.585690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.585705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.688590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.688623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.688636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.789471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.789507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.789519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.889805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.889835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.889855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.990170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.990201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.990214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.091763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.091799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.091814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.191865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.191895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.191906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.294503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.294538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.294550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.394339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.394370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.394381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.496611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.496644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.496655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.599675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.599706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.599717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.699773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.699803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.699816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.801284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.801318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.801332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.825325Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:22.901432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.901461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.901474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.003880Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.003919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.003933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.103836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.103869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.103881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:23.133318Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:23.204116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.204153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.204167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.305597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.305629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.305642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.409245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.409277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.409288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.513274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.513312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.513328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.612759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.612793Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.612806Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.717829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.717863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.717876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.821311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.821341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.821353Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.925320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.925360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.925371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.025396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.025429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.025443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.126611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.126640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.126650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.229274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.229311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.229324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.333666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.333702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.333716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.439256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.439302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.439314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.549259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.549292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.549305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.652682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.652712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.652724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.753253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.753286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.753296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.853254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.853283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.853296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.953610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.953638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.953650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.057258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.057291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.057303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:25.134391Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:25.161233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.161268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.161278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.265145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.265188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.265201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.365475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.365507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.365518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.466159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.466199Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.466213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.569245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.569280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.569294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.672095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.672132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.672145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.771778Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.771810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.771825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.872159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.872188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.872201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.972516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.972541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.972553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.073331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.073361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.073373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.177254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.177285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.177303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.279883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.279911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.279923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.380605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.380650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.380663Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.481256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.481291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.481303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.581324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.581360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.581372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.681591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.681622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.681634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.782963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.782996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.783009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.883344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.883376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.883389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.984042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.984086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.984099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.084578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.084622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.084635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-10T14:57:27.137395Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-10T14:57:27.184928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.184958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.184980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.285301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.285336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.285358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.386094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.386124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.386138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.488879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.488914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.488929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.594481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.594517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.594529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.700960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.700996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.701008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.737229Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:57:27.737320Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T14:57:27.742006Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:57:27.748401Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:57:27.749055Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:57:27.749997Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-10T14:57:27.801523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.801551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.801565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.822219Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:27.902112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.902146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.902170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.003098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.003133Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.003145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.105261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.105291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.105305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.207929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.207955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.207966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.313204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.313237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.313250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.417240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.417275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.417287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.521431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.521468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.521481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.622884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.622912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.622926Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.722928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.722965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.722980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.829258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.829289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.829302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.932033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.932066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.932080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.035189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.035222Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.035235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
=== Waiting for repair
>>> Ready to answer: ok
2025-10-10T14:57:29.137102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.137145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.137157Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.141593Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:13264" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:13264" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:13264" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
=== Closing the session
2025-10-10T14:57:29.162957Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:57:29.163368Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:57:29.178585Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:57:29.178736Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:57:29.179061Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:57:29.179640Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T14:57:29.179679Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session will now close
2025-10-10T14:57:29.179736Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:57:29.180118Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T14:57:29.180170Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:57:29.179268Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:57:29.179302Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T14:57:29.184057Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:57:29.184129Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId:  grpc closed
2025-10-10T14:57:29.184141Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId:  is DEAD
2025-10-10T14:57:29.237026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.237054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.237066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.337403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.337435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.337446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.461248Z node 3 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [3:7559607370847609216:2730] TxId: 281474976715736. Ctx: { TraceId: 01k77a0zw5e91t0cx8m3tksjtw, Database: /Root, SessionId: ydb://session/3?node_id=3&id=MjUwMTI0MDAtY2NhYTA4ZWQtMTc1MmVkYzQtNGY5MDI4N2M=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 4
2025-10-10T14:57:29.462294Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [3:7559607370847609225:2741], TxId: 281474976715736, task: 2. Ctx: { TraceId : 01k77a0zw5e91t0cx8m3tksjtw.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=3&id=MjUwMTI0MDAtY2NhYTA4ZWQtMTc1MmVkYzQtNGY5MDI4N2M=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [3:7559607370847609216:2730], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T14:57:29.465910Z node 3 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [3:7559607370847609227:2742], TxId: 281474976715736, task: 4. Ctx: { TraceId : 01k77a0zw5e91t0cx8m3tksjtw.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=3&id=MjUwMTI0MDAtY2NhYTA4ZWQtMTc1MmVkYzQtNGY5MDI4N2M=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [3:7559607370847609216:2730], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T13:59:09.725322Z :PropagateSessionClosed INFO: Random seed for debugging is 1760104749725244
2025-10-10T13:59:10.175430Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559592342999938801:2074];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:10.175500Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T13:59:10.316443Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:10.320350Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559592341422025245:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:10.320519Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002eb1/r3tmp/tmpq0qZ9Q/pdisk_1.dat
2025-10-10T13:59:10.383858Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:10.608205Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:10.610815Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:10.793662Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:10.916604Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:10.930085Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:10.937059Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:10.937210Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:10.939360Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:10.939453Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:10.971398Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T13:59:10.971579Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:10.972123Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 62043, node 1
2025-10-10T13:59:11.247952Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:11.364991Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:11.385287Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002eb1/r3tmp/yandexTX2iPE.tmp
2025-10-10T13:59:11.385316Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002eb1/r3tmp/yandexTX2iPE.tmp
2025-10-10T13:59:11.385495Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002eb1/r3tmp/yandexTX2iPE.tmp
2025-10-10T13:59:11.385631Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T13:59:11.411509Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:11.413289Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:11.544076Z INFO: TTestServer started on Port 5719 GrpcPort 62043
TClient is connected to server localhost:5719
PQClient connected to localhost:62043
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T13:59:12.344567Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T13:59:15.181303Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559592342999938801:2074];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:15.181383Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:15.321840Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559592341422025245:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:15.321914Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:16.905799Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:16.914944Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7559592368769743621:2325], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:16.916637Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7559592367191829315:2295], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:16.917364Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=OGQ0OWYzMTItMzgxZDc0M2ItZmM0NGMxYTgtNDBjNTNhYmM=, ActorId: [2:7559592367191829313:2294], ActorState: ExecuteState, TraceId: 01k776pd61dbbd5x7esvbd96mj, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:16.917364Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=MzNlYWVhNzAtOGQwMTQzZTgtNTI3NDhmOWQtODdmNjRkNGE=, ActorId: [1:7559592368769743612:2323], ActorState: ExecuteState, TraceId: 01k776pd90evaeyzs8xyyawgc8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:16.921390Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:16.955808Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:17.137996Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:17.399529Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:62043", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T13:59:17.791349Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k776pe9p3njgp4afpmnywmdq, Database: , SessionId: ydb://session/3?node_id=1&id=NjdmOTU1YjgtZmQ5NDExNGMtYjYyZjU4LWRlMWM1NDQ3, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559592373064711312:2934] 
=== CheckClustersList. Ok
2025-10-10T13:59:23.303523Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715673:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:62043
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:62043
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-10-10T13:59:23.506482Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T13:59:23.608907Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559592398834515592:3230] connected; active server actors: 1
2025-10-10T13:59:23.609083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T13:59:23.613732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T13:59:23.621302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T13:59:23.645284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:23.654522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:23.654824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T13:59:23.654866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:23.654919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T13:59:23.656450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592398834515604:2442], now have 1 active actors on pipe
2025-10-10T13:59:23.656473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592398834515591:3229], now have 1 active actors on pipe
2025-10-10T13:59:23.662402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T13:59:23.663127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:23.681441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:23.692161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592398834515645:3272], now have 1 active actors on pipe
2025-10-10T13:59:23.696830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:23.701242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:23.702527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:23.702631Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T13:59:23.702996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:23.703340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592397256600924:2384]
2025-10-10T13:59:23.709747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:23.709786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:23.709811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559592397256600924:2384]
2025-10-10T13:59:23.709848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T13:59:23.719542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T13:59:23.719621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:23.719955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:23.719979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:23.720017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:23.720031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:23.720048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:23.720062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:23.720103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:23.720776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:23.720957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:23.734459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:23.734625Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760104763732, TxId 281474976715676
2025-10-10T13:59:23.734646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:23.734665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:23.734825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:23.736111Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:23.742803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:23.743096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:23.743138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:23.743153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:23.743174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:23.743206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:23.743568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T13:59:23.743662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:23.743972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:23.760864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:23.760984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:23.770771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:23.821247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:23.821278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:23.821296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:23.893210Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715677. Ctx: { TraceId: 01k776pm6x0tc7fqye0jdcmces, Database: , SessionId: ydb://session/3?node_id=1&id=ZTIzZmRjYjMtZTUyNGNlM2ItYzgwYjQ0OTQtZTYxOTgwNzk=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T13:59:23.925250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:23.925283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:23.925294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760104763732
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760104763732
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:62043
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T13:59:23.942446Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-10T13:59:24.027180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.029002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.053655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.129230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.129260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.129269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.233231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.233270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.233282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.339275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.339325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.339344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.440980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.441007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.441016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:62043
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:24.464990Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T13:59:24.482837Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T13:59:24.483360Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T13:59:24.483398Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:24.545263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.545304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.545317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.575037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:24.575075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T13:59:24.607116Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:24.614085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:24.614276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:40046
2025-10-10T13:59:24.614293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40046 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:24.614305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:24.616409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T13:59:24.616605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:24.616622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:24.616635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:24.616657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592403129483087:2475] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:24.619625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592403129483087:2475] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:24.645393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.645428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.645438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.745549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.745576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.745585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.846957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.846988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.846996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.927500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559592403129483087:2475] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:24.939539Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592403129483127:2475] connected; active server actors: 1
2025-10-10T13:59:24.939901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559592403129483087:2475] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T13:59:24.939924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592403129483087:2475] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:24.948978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.949006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.949017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.960881Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592403129483127:2475] disconnected; active server actors: 1
2025-10-10T13:59:24.962149Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592403129483127:2475] disconnected no session
2025-10-10T13:59:25.049347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.049377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.049387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.113900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592403129483087:2475] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:25.113959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592403129483087:2475] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:25.113987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592403129483087:2475] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:25.114023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:25.116109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592407424450442:2475], now have 1 active actors on pipe
2025-10-10T13:59:25.116431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T13:59:25.116782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.116816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.116936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|41962c5c-9a00a665-7a178425-d81b9b92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T13:59:25.116991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.117010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.117029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:25.117068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.117117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:25.117194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.118453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.118480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.118563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.119019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|41962c5c-9a00a665-7a178425-d81b9b92_0
2025-10-10T13:59:25.120136Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104765120 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:25.120278Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|41962c5c-9a00a665-7a178425-d81b9b92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:25.120587Z :INFO: [] MessageGroupId [src] SessionId [src|41962c5c-9a00a665-7a178425-d81b9b92_0] Write session: close. Timeout = 0 ms
2025-10-10T13:59:25.120622Z :INFO: [] MessageGroupId [src] SessionId [src|41962c5c-9a00a665-7a178425-d81b9b92_0] Write session will now close
2025-10-10T13:59:25.120681Z :DEBUG: [] MessageGroupId [src] SessionId [src|41962c5c-9a00a665-7a178425-d81b9b92_0] Write session: aborting
2025-10-10T13:59:25.121080Z :INFO: [] MessageGroupId [src] SessionId [src|41962c5c-9a00a665-7a178425-d81b9b92_0] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:25.121114Z :DEBUG: [] MessageGroupId [src] SessionId [src|41962c5c-9a00a665-7a178425-d81b9b92_0] Write session: destroy
2025-10-10T13:59:25.155412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|41962c5c-9a00a665-7a178425-d81b9b92_0 grpc read done: success: 0 data: 
2025-10-10T13:59:25.155452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|41962c5c-9a00a665-7a178425-d81b9b92_0 grpc read failed
2025-10-10T13:59:25.155496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|41962c5c-9a00a665-7a178425-d81b9b92_0 grpc closed
2025-10-10T13:59:25.155512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|41962c5c-9a00a665-7a178425-d81b9b92_0 is DEAD
2025-10-10T13:59:25.150596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.150622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.150631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.165709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:25.169408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559592407424450442:2475] destroyed
2025-10-10T13:59:25.169455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:25.169489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.169505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.169548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Ready to answer: ok
2025-10-10T13:59:25.253225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.263560Z :INFO: [/Root] [] [893b8d43-788f82d6-93e5eb72-525b6f4a] Open read subsessions to databases: { name: dc1, endpoint: localhost:62043, path: /Root }, { name: dc2, endpoint: localhost:62043, path: /Invalid }
2025-10-10T13:59:25.253257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.253268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.368943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.368972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.368982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.401466Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Starting read session
2025-10-10T13:59:25.401550Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Starting single session
2025-10-10T13:59:25.402795Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T13:59:25.402836Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T13:59:25.402878Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T13:59:25.418193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-10T13:59:25.429319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-10T13:59:25.429350Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Successfully connected. Initializing session
2025-10-10T13:59:25.429421Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T13:59:25.429900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:25.429455Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T13:59:25.467206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.467231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.467242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.478900Z :INFO: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Starting read session
2025-10-10T13:59:25.478965Z :DEBUG: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Starting single session
2025-10-10T13:59:25.479117Z :DEBUG: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T13:59:25.479149Z :DEBUG: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T13:59:25.479193Z :DEBUG: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T13:59:25.479346Z :ERROR: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. 
2025-10-10T13:59:25.479415Z :DEBUG: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T13:59:25.479466Z :DEBUG: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T13:59:25.479592Z :INFO: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:25.496986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:25.498081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:25.498108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T13:59:25.498488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:25.498633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:25.498647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:25.498657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:25.502394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T13:59:25.502512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:25.502527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:25.502536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:25.502550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:25.504898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:25.524633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:25.525705Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592407424450517:2500] connected; active server actors: 1
2025-10-10T13:59:25.525826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T13:59:25.525841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:25.533255Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592407424450517:2500] disconnected; active server actors: 1
2025-10-10T13:59:25.533293Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592407424450517:2500] disconnected no session
2025-10-10T13:59:25.546817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:25.546854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:25.546868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:25.546896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:25.553899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592407424450528:2500], now have 1 active actors on pipe
2025-10-10T13:59:25.554253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T13:59:25.554614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.554643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.554707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:25.554738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.554752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.554761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:25.554798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.554832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:25.554907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.555616Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T13:59:25.555914Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 read init: from# ipv6:[::1]:40068, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T13:59:25.555811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.555832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.555886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.556275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0
2025-10-10T13:59:25.556350Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 auth for : user
2025-10-10T13:59:25.557641Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 Handle describe topics response
2025-10-10T13:59:25.557795Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 auth is DEAD
2025-10-10T13:59:25.557867Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 auth ok: topics# 1, initDone# 0
2025-10-10T13:59:25.559011Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T13:59:25.560641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104765560 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:25.560752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:25.563381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 1 to 1
2025-10-10T13:59:25.564395Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got InitResponse. ReadSessionId: shared/user_1_1_16497766247954288857_v1
2025-10-10T13:59:25.564446Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T13:59:25.564662Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T13:59:25.559503Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592407424450534:2494] connected; active server actors: 1
2025-10-10T13:59:25.559595Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559592407424450534:2494] session shared/user_1_1_16497766247954288857_v1
2025-10-10T13:59:25.559651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T13:59:25.559722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T13:59:25.559763Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_16497766247954288857_v1" (Sender=[1:7559592407424450469:2494], Pipe=[1:7559592407424450534:2494], Partitions=[], ActiveFamilyCount=0)
2025-10-10T13:59:25.559794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T13:59:25.559841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T13:59:25.559893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_16497766247954288857_v1" (Sender=[1:7559592407424450469:2494], Pipe=[1:7559592407424450534:2494], Partitions=[], ActiveFamilyCount=0)
2025-10-10T13:59:25.559955Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_16497766247954288857_v1" sender [1:7559592407424450469:2494] lock partition 0 for ReadingSession "shared/user_1_1_16497766247954288857_v1" (Sender=[1:7559592407424450469:2494], Pipe=[1:7559592407424450534:2494], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T13:59:25.560028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T13:59:25.560062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000193s
2025-10-10T13:59:25.561009Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_16497766247954288857_v1" ClientId: "user" PipeClient { RawX1: 7559592407424450534 RawX2: 4503603922340286 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T13:59:25.561106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T13:59:25.565685Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T13:59:25.565825Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 got read request: guid# 74f9213f-d77ac74b-4eea68aa-f2dc9071
2025-10-10T13:59:25.567347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592407424450537:2507], now have 1 active actors on pipe
2025-10-10T13:59:25.567907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.567935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.567967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_16497766247954288857_v1 on pipe: [1:7559592407424450537:2507]
2025-10-10T13:59:25.568023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.568050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.568060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:25.568120Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_16497766247954288857_v1
2025-10-10T13:59:25.568138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.568265Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:25.568789Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_16497766247954288857_v1:1 with generation 1
2025-10-10T13:59:25.567643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7559592407424450537:2507]
2025-10-10T13:59:25.570206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:25.572164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:25.572220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-10T13:59:25.576291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:25.576370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:25.576397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.576421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.576439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.576476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:25.576512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T13:59:25.578635Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T13:59:25.578685Z :DEBUG: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:25.579198Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760104765554 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T13:59:25.579252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T13:59:25.579336Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 sending to client partition status
2025-10-10T13:59:25.588035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:25.591285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.591319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.591392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T13:59:25.590747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:25.593545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 2 to 2
2025-10-10T13:59:25.591727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:25.603370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:25.603421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-10T13:59:25.605500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.605542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.606464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-10T13:59:25.606986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-10T13:59:25.608180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-10T13:59:25.608706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-10T13:59:25.608951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-10T13:59:25.608986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-10T13:59:25.609444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:25.609523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.609569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.609587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T13:59:25.609710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T13:59:25.609746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-10T13:59:25.609767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-10T13:59:25.609786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-10T13:59:25.609807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-10T13:59:25.625568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:25.628498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T13:59:25.672974Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-10T13:59:25.677292Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T13:59:25.677499Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T13:59:25.677565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T13:59:25.677610Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T13:59:25.684462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 3 to 3
2025-10-10T13:59:25.684212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-10T13:59:25.684322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.686564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:25.686617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-10T13:59:25.686569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1760104765684
2025-10-10T13:59:25.688903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.688939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.688981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:25.689023Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:25.689193Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-10T13:59:25.689390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-10T13:59:25.690550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:25.710563Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:25.732907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 4 to 4
2025-10-10T13:59:25.726222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.726271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.728278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-10T13:59:25.733905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-10T13:59:25.738224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-10T13:59:25.738928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-10T13:59:25.740181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-10T13:59:25.740207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-10T13:59:25.740727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:25.740803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:25.748221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:25.748269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-10T13:59:25.750983Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T13:59:25.751009Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:25.752554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:25.754258Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-10T13:59:25.754297Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-10T13:59:25.754380Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-10T13:59:25.754406Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1TEvPartitionReady. Aval parts: 1
2025-10-10T13:59:25.754452Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 performing read request: guid# 9d9b76e-b78dd889-39a89124-8057622d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T13:59:25.754519Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 9d9b76e-b78dd889-39a89124-8057622d
2025-10-10T13:59:25.752613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:25.752663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:25.752685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:25.752730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T13:59:25.752741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:25.752757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-10T13:59:25.752765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:25.752781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-10T13:59:25.752788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:25.752804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-10T13:59:25.752823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:25.752841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-10T13:59:25.753551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:25.753585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:25.753605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.753642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.753655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T13:59:25.753774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T13:59:25.753809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-10T13:59:25.753827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-10T13:59:25.753846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-10T13:59:25.753860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-10T13:59:25.754054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T13:59:25.759116Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:25.797142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:25.799467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:25.821530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 5 to 5
2025-10-10T13:59:25.823606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:25.823657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-10T13:59:25.833744Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:25.862853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 6 to 6
2025-10-10T13:59:25.864865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:25.864916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-10T13:59:25.886179Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:25.904071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-10T13:59:25.904195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.905375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1760104765905
2025-10-10T13:59:25.911900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 7 to 7
2025-10-10T13:59:25.914087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:25.914141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-10T13:59:25.911528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:25.911681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T13:59:25.911883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.911910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.911989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:25.912033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.912049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.912075Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:25.912194Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-10-10T13:59:25.912466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T13:59:25.912720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-10T13:59:25.912736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:25.912782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-10T13:59:25.912882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-10T13:59:25.000000Z
2025-10-10T13:59:25.912911Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T13:59:25.912958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T13:59:25.913118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-10T13:59:25.913606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-10T13:59:25.917466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:25.917574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:25.921816Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:25.923425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-10T13:59:25.923530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:25.941719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 140 }
2025-10-10T13:59:25.942074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 1
2025-10-10T13:59:25.952212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:25.953056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:25.960589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:25.964445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:25.965873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:25.967380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:25.967915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T13:59:25.968045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-10T13:59:25.000000Z
2025-10-10T13:59:25.968124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-10T13:59:25.968355Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-10T13:59:25.981451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.981498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.982221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-10T13:59:25.982910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-10T13:59:25.988642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-10T13:59:25.989415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-10T13:59:25.989654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-10T13:59:25.989674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-10T13:59:25.990755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:25.990896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:25.997464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:25.999136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:26.008548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:26.010101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:26.010704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T13:59:26.010876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.010897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.010929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:26.010993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.011340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.011391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:26.015419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 8 to 8
2025-10-10T13:59:26.018169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:26.018216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-10T13:59:26.019283Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:26.052661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 9 to 9
2025-10-10T13:59:26.054590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:26.054631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-10T13:59:26.055678Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:26.072241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 10 to 10
2025-10-10T13:59:26.074067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:26.074112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-10T13:59:26.075159Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:26.085098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-10T13:59:26.087909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 11 to 11
2025-10-10T13:59:26.087587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:26.087659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:26.087709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:26.087731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.087763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T13:59:26.087776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.087794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-10T13:59:26.087801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.087817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-10T13:59:26.087826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.087845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-10T13:59:26.087863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.087885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-10T13:59:26.088497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T13:59:26.090159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.090216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.099022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:26.099067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-10T13:59:26.099109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528011[B] reached maximum (20971520[B])
2025-10-10T13:59:26.099672Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:26.090227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T13:59:26.090330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T13:59:26.090367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-10T13:59:26.090390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-10T13:59:26.090409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-10T13:59:26.090431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-10T13:59:26.140056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-10-10T13:59:26.140162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.141050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00004? size 2253219 WTime 1760104766137
2025-10-10T13:59:26.147335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:26.147457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-10T13:59:26.147528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.147543Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:26.147646Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 2253219
2025-10-10T13:59:26.154085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.154163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.172827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 332 queued_in_partition_duration_ms: 12 }
2025-10-10T13:59:26.174012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 2
2025-10-10T13:59:26.174059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275210[B]
2025-10-10T13:59:26.182539Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104765608 CreateTimestampMS: 1760104765561 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-10T13:59:26.184697Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-10T13:59:26.184755Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 9d9b76e-b78dd889-39a89124-8057622d has messages 1
2025-10-10T13:59:26.185827Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 read done: guid# 9d9b76e-b78dd889-39a89124-8057622d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-10T13:59:26.185866Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 response to read: guid# 9d9b76e-b78dd889-39a89124-8057622d
2025-10-10T13:59:26.230400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 12 to 12
2025-10-10T13:59:26.241491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:26.241543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-10T13:59:26.242686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.242735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.243237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-10-10T13:59:26.243722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-10T13:59:26.244213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-10T13:59:26.244690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-10T13:59:26.244926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-10T13:59:26.244948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-10T13:59:26.249881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:26.249979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.250004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.269544Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 Process answer. Aval parts: 0
2025-10-10T13:59:26.269673Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-10T13:59:26.269713Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-10T13:59:26.269876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:26.288575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:26.290127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.290162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.290212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-10T13:59:26.309422Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-10T13:59:26.297776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.301552Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1760104765608, sizeLag# 2253219
2025-10-10T13:59:26.301571Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1TEvPartitionReady. Aval parts: 1
2025-10-10T13:59:26.317222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:26.333409Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-10T13:59:26.333482Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 2252976 to budget
2025-10-10T13:59:26.328348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.328404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.328921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-10T13:59:26.349956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528012[B] reached maximum (20971520[B])
2025-10-10T13:59:26.343051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-10T13:59:26.371451Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-10T13:59:26.371530Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:26.371567Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-10T13:59:26.371739Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T13:59:26.371788Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:26.382599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:26.390898Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-10T13:59:26.391020Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 got read request: guid# 35c31774-9a65aaa0-4eeb6789-9dba7ba8
2025-10-10T13:59:26.391079Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 performing read request: guid# 847c7781-4cd5304d-fe463774-3d68e2a8, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T13:59:26.391142Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 847c7781-4cd5304d-fe463774-3d68e2a8
2025-10-10T13:59:26.392025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-10T13:59:26.392572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-10T13:59:26.392816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-10T13:59:26.409245Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T13:59:26.414451Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1007 BytesRead: 2252801 MessagesRead: 1 BytesReadCompressed: 2252801 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:26.392837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-10T13:59:26.406189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.406308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.406330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.438380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.406428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.406441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.406475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:26.406534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.406935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-10T13:59:26.406998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 2 max time lag 0ms effective offset 1
2025-10-10T13:59:26.407234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 2
2025-10-10T13:59:26.407249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-10T13:59:26.407292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-10T13:59:26.000000Z
2025-10-10T13:59:26.407314Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-10T13:59:26.407369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:26.409248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:26.410095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-10T13:59:26.412891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:26.414081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:26.457089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-10T13:59:25.561000Z WriteTime: 2025-10-10T13:59:25.608000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:40068", "logtype": "unknown", "_ip": "ipv6:[::1]:40068" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:26.469678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T13:59:26.470988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T13:59:26.527286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:26.540276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:26.560856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:26.572318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.572373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.572963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-10T13:59:26.575640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-10T13:59:26.578282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-10T13:59:26.578821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-10T13:59:26.579080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-10T13:59:26.579101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-10-10T13:59:26.579995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.580214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.580238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.580263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:26.580317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.580364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 2253219 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:26.580430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:26.580471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:26.580482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T13:59:26.580488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.580510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-10T13:59:26.580520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.580535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-10T13:59:26.580543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.580560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-10T13:59:26.580567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.580582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-10T13:59:26.580603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.580617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-10T13:59:26.582098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.582174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.582185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T13:59:26.582281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-10T13:59:26.582316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-10T13:59:26.582333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-10T13:59:26.582350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-10T13:59:26.582366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-10T13:59:26.608433Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104765753 CreateTimestampMS: 1760104765590 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-10T13:59:26.617323Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-10-10T13:59:26.617382Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 847c7781-4cd5304d-fe463774-3d68e2a8 has messages 1
2025-10-10T13:59:26.618242Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 read done: guid# 847c7781-4cd5304d-fe463774-3d68e2a8, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-10T13:59:26.618266Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 response to read: guid# 847c7781-4cd5304d-fe463774-3d68e2a8
2025-10-10T13:59:26.631590Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 Process answer. Aval parts: 0
2025-10-10T13:59:26.643435Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-10T13:59:26.643714Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-10T13:59:26.643748Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 2252978 to budget
2025-10-10T13:59:26.656765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-10-10T13:59:26.656907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-10T13:59:26.656936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-10T13:59:26.656954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-10T13:59:26.656967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-10T13:59:26.656982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-10T13:59:26.690085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 4506426 count 2 nextOffset 5 batches 9
2025-10-10T13:59:26.690232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-10T13:59:26.690267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-10T13:59:26.690284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-10T13:59:26.690302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-10T13:59:26.690317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-10T13:59:26.708592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 6759623 count 3 nextOffset 6 batches 13
2025-10-10T13:59:26.708697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.709582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,3 HeadOffset 3 endOffset 3 curOffset 6 d0000000000_00000000000000000003_00000_0000000003_00012? size 6759613 WTime 1760104766707
2025-10-10T13:59:26.715016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:26.715124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-10T13:59:26.715206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-10T13:59:26.715264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.715278Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:26.715365Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 3 size 6759613
2025-10-10T13:59:26.754604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 3 size 6759613 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:26.754670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:26.754711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758730 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:26.754730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.754758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-10T13:59:26.754756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-10T13:59:26.754772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.754791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-10T13:59:26.754799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.754817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-10T13:59:26.754825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.754843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-10T13:59:26.754861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.754878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-10T13:59:26.754886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.754901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-10T13:59:26.754910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.754928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-10T13:59:26.754936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.754953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-10T13:59:26.754960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.754976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-10T13:59:26.754986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.755001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-10T13:59:26.755009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.755025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-10T13:59:26.755031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.755047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-10T13:59:26.755054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.755069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-10T13:59:26.755077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.755092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-10T13:59:26.755102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.755116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-10T13:59:26.757923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.757949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.757959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.758016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-10T13:59:26.758027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-10T13:59:26.758035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-10T13:59:26.758043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000003_00012?
2025-10-10T13:59:26.758055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 13519270 bytes
2025-10-10T13:59:26.758142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-10T13:59:26.758216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-10T13:59:26.758259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-10T13:59:26.758284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:26.758323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-10T13:59:26.758462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-10T13:59:26.758638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-10T13:59:26.758781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000003_00012?
2025-10-10T13:59:26.758898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:26.758937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-10T13:59:25.000000Z
2025-10-10T13:59:26.758954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-10T13:59:26.000000Z
2025-10-10T13:59:26.758971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-10T13:59:26.000000Z
2025-10-10T13:59:26.758987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 3 parts_count 12 source 1 size 6759613 accessed 0 times before, last time 2025-10-10T13:59:26.000000Z
2025-10-10T13:59:26.759018Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-10-10T13:59:26.759113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:26.759139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-10T13:59:26.759155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:26.760227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T13:59:26.761243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-10T13:59:26.761269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-10T13:59:26.761286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-10T13:59:26.761305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 3 parts 12 suffix '63'
2025-10-10T13:59:26.761434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-10T13:59:26.762711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-10T13:59:26.763931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-10T13:59:26.764840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-10T13:59:26.815343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-10T13:59:26.815461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-10T13:59:26.815471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:26.822893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T13:59:26.824268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-10T13:59:26.825594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-10T13:59:26.831233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-10T13:59:26.831932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-10T13:59:26.852480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.852546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.852581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.852597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.852613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.856661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-10T13:59:26.856838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-10T13:59:26.856871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:26.871946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T13:59:26.870123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:26.877386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 490 queued_in_partition_duration_ms: 78 }
2025-10-10T13:59:26.877456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 3
2025-10-10T13:59:26.877483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275211[B]
2025-10-10T13:59:26.880652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 13 to 13
2025-10-10T13:59:26.890952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:26.891006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-10T13:59:26.891042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528013[B] reached maximum (20971520[B])
2025-10-10T13:59:26.889825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:26.890118Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-10T13:59:26.890143Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-10T13:59:26.890285Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1760104765753, sizeLag# 2253219
2025-10-10T13:59:26.890299Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1TEvPartitionReady. Aval parts: 1
2025-10-10T13:59:26.892232Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T13:59:26.892499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-10T13:59:26.893875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-10T13:59:26.895339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-10T13:59:26.895966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:26.916516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 172 queued_in_partition_duration_ms: 332 }
2025-10-10T13:59:26.916579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 4
2025-10-10T13:59:26.916607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275212[B]
2025-10-10T13:59:26.917927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 97 queued_in_partition_duration_ms: 250 }
2025-10-10T13:59:26.917982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 5
2025-10-10T13:59:26.925412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 65 queued_in_partition_duration_ms: 109 }
2025-10-10T13:59:26.925462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 6
2025-10-10T13:59:26.947122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 14 to 14
2025-10-10T13:59:26.971055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:26.971112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-10T13:59:26.974451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-10T13:59:26.974572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000003_00000_0000000003_00012?
2025-10-10T13:59:26.974586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:26.975684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-10T13:59:26.979936Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-10T13:59:26.980016Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:26.980051Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-10T13:59:26.980328Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T13:59:26.980373Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:26.982168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-10T13:59:26.989903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-10T13:59:26.989687Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-10T13:59:26.989849Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 got read request: guid# 2d41e2d6-3110349a-c9b0251e-f6465508
2025-10-10T13:59:26.989900Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 performing read request: guid# 1d86315a-aeb826fe-51f97163-3647782a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T13:59:26.989992Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 1d86315a-aeb826fe-51f97163-3647782a
2025-10-10T13:59:26.992796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-10T13:59:25.590000Z WriteTime: 2025-10-10T13:59:25.753000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40068", "server": "ipv6:[::1]:40068" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:27.032762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 15 to 15
2025-10-10T13:59:27.034908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:27.034951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-10T13:59:27.035476Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:27.062445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 16 to 16
2025-10-10T13:59:27.064669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:27.064714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-10T13:59:27.064746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528016[B] reached maximum (20971520[B])
2025-10-10T13:59:27.070241Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:27.094766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-10T13:59:27.094794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592407424450498:2500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:27.133005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-10T13:59:27.134755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-10T13:59:27.134852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1760104767134
2025-10-10T13:59:27.146777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-10T13:59:27.146858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-10T13:59:27.147977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-10T13:59:27.149064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-10T13:59:27.150380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-10T13:59:27.151981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-10T13:59:27.175502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 3 PackedSize 2970341 count 2 nextOffset 5 batches 6
2025-10-10T13:59:27.175604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-10T13:59:27.176902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-10T13:59:27.178107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-10T13:59:27.179232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-10T13:59:27.179740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-10T13:59:27.194211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 3 PackedSize 5223538 count 3 nextOffset 6 batches 10
2025-10-10T13:59:27.195406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,3 HeadOffset 0 endOffset 0 curOffset 6 d0000000000_00000000000000000003_00003_0000000003_00009| size 5223528 WTime 1760104767193
2025-10-10T13:59:27.200494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.200527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.200538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.204149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.204199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.204792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-10T13:59:27.205647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-10-10T13:59:27.206166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-10T13:59:27.206639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-10T13:59:27.206879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-10T13:59:27.206902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-10T13:59:27.207393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.207416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.207495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.207507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.207548Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:27.207662Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-10T13:59:27.207725Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 3 size 5223528
2025-10-10T13:59:27.207760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.207822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.207854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.207864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T13:59:27.207962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-10T13:59:27.208001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-10T13:59:27.208016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-10T13:59:27.208031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-10T13:59:27.208046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-10T13:59:27.225930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 2253229 count 1 nextOffset 7 batches 5
2025-10-10T13:59:27.226051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.226881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00004? size 2253219 WTime 1760104767226
2025-10-10T13:59:27.229548Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:27.229653Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 2253219
2025-10-10T13:59:27.229691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-10T13:59:27.229901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 1 size 524288 endOffset 6 max time lag 0ms effective offset 2
2025-10-10T13:59:27.230061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 2253219 count 1 last offset 2, current partition end offset: 6
2025-10-10T13:59:27.230074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-10T13:59:27.230133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-10T13:59:26.000000Z
2025-10-10T13:59:27.230159Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-10T13:59:27.230207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:27.231873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:27.232973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:27.233797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-10T13:59:27.235400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:27.233722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:27.236907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:27.237580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T13:59:27.237721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-10T13:59:27.246137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:27.248405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:27.304393Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104766089 CreateTimestampMS: 1760104765682 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 2 }
2025-10-10T13:59:27.315172Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 6
2025-10-10T13:59:27.315231Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 3 ReadGuid 1d86315a-aeb826fe-51f97163-3647782a has messages 1
2025-10-10T13:59:27.315698Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 6, WTime# 1760104766089, sizeLag# 2253329
2025-10-10T13:59:27.315715Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1TEvPartitionReady. Aval parts: 0
2025-10-10T13:59:27.315760Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 read done: guid# 1d86315a-aeb826fe-51f97163-3647782a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252977
2025-10-10T13:59:27.315787Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 response to read: guid# 1d86315a-aeb826fe-51f97163-3647782a
2025-10-10T13:59:27.336701Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 Process answer. Aval parts: 1
2025-10-10T13:59:27.355315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.355356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.355837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-10T13:59:27.356279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-10T13:59:27.356693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-10T13:59:27.357100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-10T13:59:27.379375Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got ReadResponse, serverBytesSize = 2252977, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728689
2025-10-10T13:59:27.388785Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-10T13:59:27.388854Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 2252977 to budget
2025-10-10T13:59:27.394018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-10T13:59:27.394060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-10T13:59:27.395544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.395570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.395613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.395629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.395686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.395723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-10T13:59:27.397789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:27.411587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:27.431886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:27.450068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.450129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.450753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-10T13:59:27.451912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-10T13:59:27.453999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-10T13:59:27.454575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-10T13:59:27.454817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-10T13:59:27.454842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-10T13:59:27.455784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.455808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.455839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.455900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.455938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-10T13:59:27.461726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:27.469083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:27.471811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:27.487561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.487622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.488161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-10T13:59:27.488657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-10T13:59:27.501924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-10T13:59:27.502665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-10T13:59:27.502927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-10T13:59:27.502949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-10T13:59:27.504078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.504105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.504154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.504170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.504226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.504265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-10T13:59:27.504563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:27.515740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.515787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.516970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:27.517740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-10T13:59:27.520521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:27.524016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-10T13:59:27.524545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-10T13:59:27.525041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-10T13:59:27.525300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-10T13:59:27.525331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-10T13:59:27.526218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.526249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.526283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.526345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.526386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-10T13:59:27.526781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:27.552332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.552380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.552975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-10T13:59:27.553534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-10T13:59:27.554069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-10T13:59:27.554586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-10T13:59:27.554901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-10T13:59:27.554935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-10T13:59:27.565878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.565977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.601794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.609665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:27.609704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 3 size 5223528 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:27.609753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:27.609769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T13:59:27.621902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:27.621940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 3 parts 9 suffix '124' size 5223528
2025-10-10T13:59:27.622486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:27.626518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.626553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:27.639629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:27.640147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.640194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.640257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-10-10T13:59:27.641341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 2253219 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:27.641389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:27.641436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:27.641457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:27.641484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-10T13:59:27.641495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:27.641510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-10T13:59:27.641520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:27.641536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-10T13:59:27.641546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:27.641563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-10T13:59:27.641584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:27.641603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-10T13:59:27.642486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.642568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.642578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-10T13:59:27.642670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-10T13:59:27.642706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-10T13:59:27.642723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-10T13:59:27.642740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-10T13:59:27.642757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-10T13:59:27.644144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T13:59:27.644770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:27.669996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:27.672421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:27.683752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 2253229 count 1 nextOffset 8 batches 5
2025-10-10T13:59:27.683900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-10T13:59:27.683936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-10T13:59:27.683956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-10T13:59:27.683976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-10T13:59:27.683998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-10T13:59:27.696666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 4506426 count 2 nextOffset 9 batches 9
2025-10-10T13:59:27.696815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-10T13:59:27.696852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-10T13:59:27.696868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-10T13:59:27.696887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-10T13:59:27.696904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-10T13:59:27.710233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 6759623 count 3 nextOffset 10 batches 13
2025-10-10T13:59:27.710361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-10T13:59:27.710395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-10T13:59:27.710413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-10T13:59:27.710429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-10T13:59:27.800727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 11 partNo 3 result is x0000000000_00000000000000000007_00000_0000000003_00015? size 8295635
2025-10-10T13:59:27.800807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-10T13:59:27.800882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00000_0000000003_00015? new key d0000000000_00000000000000000007_00000_0000000003_00015? size 8295635 WTime 1760104767800
2025-10-10T13:59:27.817516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 3 PackedSize 717145 count 1 nextOffset 11 batches 2
2025-10-10T13:59:27.817616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-10T13:59:27.817651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-10T13:59:27.817667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-10T13:59:27.817694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-10T13:59:27.817712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-10T13:59:27.828952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 3 PackedSize 2970343 count 2 nextOffset 12 batches 6
2025-10-10T13:59:27.829051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.830032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,2 HeadOffset 7 endOffset 7 curOffset 12 d0000000000_00000000000000000010_00003_0000000002_00005? size 2970333 WTime 1760104767829
2025-10-10T13:59:27.832657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:27.832893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-10T13:59:27.834842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:27.835924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.835964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.836621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-10T13:59:27.837116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-10T13:59:27.837616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-10T13:59:27.838103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-10T13:59:27.838354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-10T13:59:27.838377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-10T13:59:27.839499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 432 }
2025-10-10T13:59:27.839557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 7
2025-10-10T13:59:27.839592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275215[B]
2025-10-10T13:59:27.839339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.839376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.839421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.839458Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:27.839588Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 3 size 8295635
2025-10-10T13:59:27.839735Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 3 count 2 size 2970333
2025-10-10T13:59:27.839792Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-10T13:59:27.839821Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-10-10T13:59:27.839844Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00004?(+) to d0000000000_00000000000000000002_00000_0000000001_00004?(+)
2025-10-10T13:59:27.839875Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000003_00012?(+) to d0000000000_00000000000000000003_00000_0000000003_00012?(+)
2025-10-10T13:59:27.839935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.840033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.840367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-10T13:59:27.842790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 17 to 17
2025-10-10T13:59:27.844095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:27.854018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:27.871393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:27.871446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-10T13:59:27.884243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528017[B] reached maximum (20971520[B])
2025-10-10T13:59:27.888977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:27.889696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.889749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.893186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-10T13:59:27.893729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-10T13:59:27.899771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-10T13:59:27.900189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-10T13:59:27.903816Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-10T13:59:27.903883Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:27.903913Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252977, ReadSizeServerDelta = -1728689
2025-10-10T13:59:27.904150Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T13:59:27.904198Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:27.900437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-10T13:59:27.900475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-10T13:59:27.901596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.901629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.901659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.901725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.901764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-10T13:59:27.905230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:27.913264Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252977 } }
2025-10-10T13:59:27.913461Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 got read request: guid# 1698066c-eeeb8ae0-6d564391-6d3adc93
2025-10-10T13:59:27.927891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.913510Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 performing read request: guid# 5b756edb-7f2f3c2b-95d4b14a-1846adb, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T13:59:27.913570Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 5b756edb-7f2f3c2b-95d4b14a-1846adb
2025-10-10T13:59:27.929193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:27.927966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.930116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-10-10T13:59:27.930762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-10T13:59:27.933386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:27.934114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-10T13:59:27.934818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-10T13:59:27.935233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-10T13:59:27.935280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-10T13:59:27.936673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.936710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.936806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.936820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.936846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.936907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.936979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-10T13:59:27.937039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 3 size 524288 endOffset 7 max time lag 0ms effective offset 3
2025-10-10T13:59:27.937299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 0 count 0 last offset 0, current partition end offset: 7
2025-10-10T13:59:27.938524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-10T13:59:25.682000Z WriteTime: 2025-10-10T13:59:26.089000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40068", "_ip": "ipv6:[::1]:40068", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:27.978798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-10T13:59:27.978889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.980223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:27.988374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.988422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.988951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-10T13:59:27.985824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:27.993562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-10T13:59:27.994123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-10T13:59:27.994623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-10T13:59:27.994866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-10T13:59:27.994888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-10T13:59:27.995984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 3 parts_count 15 source 1 size 8295635 accessed 0 times before, last time 2025-10-10T13:59:27.000000Z
2025-10-10T13:59:27.996022Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-10T13:59:27.996708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0'
2025-10-10T13:59:27.998918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:27.998951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:27.998985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:27.999044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:27.999077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:28.043551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 3 count 0 size 1536000 from pos 0 cbcount 3
2025-10-10T13:59:28.045907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-10T13:59:28.046106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.046158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.046209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.046254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 3 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.046285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295635 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.046312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 2 size 2970333 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.046401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-10T13:59:28.048016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T13:59:28.049117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T13:59:28.050321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T13:59:28.051285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-10T13:59:28.051869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.057404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:28.057481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11264552 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:28.057503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-10T13:59:28.057550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-10T13:59:28.057576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-10T13:59:28.057603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-10T13:59:28.057651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-10T13:59:28.057680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-10T13:59:28.057716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-10T13:59:28.057742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-10T13:59:28.057780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-10T13:59:28.057811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-10T13:59:28.057847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-10T13:59:28.057874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-10T13:59:28.057912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-10T13:59:28.057938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-10T13:59:28.057982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.057999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-10T13:59:28.058009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-10T13:59:28.058032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-10T13:59:28.058056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-10T13:59:28.058079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-10T13:59:28.058107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-10T13:59:28.058134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-10T13:59:28.058161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-10T13:59:28.058185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-10T13:59:28.058210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-10T13:59:28.058245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.058267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-10T13:59:28.064466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.064556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.064566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-10T13:59:28.064668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-10T13:59:28.064706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-10T13:59:28.064722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-10T13:59:28.064740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-10T13:59:28.064760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-10T13:59:28.083529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 15 suffix '63' size 8295635
2025-10-10T13:59:28.083582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:28.096972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 2253230 count 1 nextOffset 13 batches 5
2025-10-10T13:59:28.097102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-10T13:59:28.097160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-10T13:59:28.097185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-10T13:59:28.097205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-10T13:59:28.097222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-10T13:59:28.113899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 4506428 count 2 nextOffset 14 batches 9
2025-10-10T13:59:28.114038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-10T13:59:28.114077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-10T13:59:28.114107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-10T13:59:28.114127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-10T13:59:28.114148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-10T13:59:28.123622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 6759626 count 3 nextOffset 15 batches 13
2025-10-10T13:59:28.123738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-10T13:59:28.123774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-10T13:59:28.123793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-10T13:59:28.123813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-10T13:59:28.214656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 16 partNo 3 result is x0000000000_00000000000000000012_00000_0000000003_00015? size 8295638
2025-10-10T13:59:28.214732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-10T13:59:28.214785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000012_00000_0000000003_00015? new key d0000000000_00000000000000000012_00000_0000000003_00015? size 8295638 WTime 1760104768214
2025-10-10T13:59:28.223418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 1 NewHead: Offset 15 PartNo 3 PackedSize 717145 count 1 nextOffset 16 batches 2
2025-10-10T13:59:28.223509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.224390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 15,1 HeadOffset 12 endOffset 12 curOffset 16 d0000000000_00000000000000000015_00003_0000000001_00001? size 717135 WTime 1760104768224
2025-10-10T13:59:28.225295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00004?
2025-10-10T13:59:28.225315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000003_00015?
2025-10-10T13:59:28.225325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00003_0000000002_00005?
2025-10-10T13:59:28.225333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 13519187 bytes
2025-10-10T13:59:28.225439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-10T13:59:28.225463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.225561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-10T13:59:28.225637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-10T13:59:28.225684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-10T13:59:28.225729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-10T13:59:28.225777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-10T13:59:28.228949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.228979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.229760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.229831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.229857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.229883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.229906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.233903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 414 queued_in_partition_duration_ms: 249 }
2025-10-10T13:59:28.234001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 8
2025-10-10T13:59:28.234058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275216[B]
2025-10-10T13:59:28.235536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 374 queued_in_partition_duration_ms: 229 }
2025-10-10T13:59:28.235571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 9
2025-10-10T13:59:28.237615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 363 queued_in_partition_duration_ms: 191 }
2025-10-10T13:59:28.237663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 10
2025-10-10T13:59:28.235796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-10T13:59:28.236688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-10T13:59:28.237403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-10T13:59:28.238393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-10T13:59:28.238667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-10T13:59:28.238692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-10T13:59:28.239853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.239877Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:28.239998Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 3 size 8295638
2025-10-10T13:59:28.240072Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 3 count 1 size 717135
2025-10-10T13:59:28.240112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T13:59:28.240128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00004?
2025-10-10T13:59:28.245717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 354 queued_in_partition_duration_ms: 177 }
2025-10-10T13:59:28.245794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 11
2025-10-10T13:59:28.240229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000003_00015?
2025-10-10T13:59:28.240338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00003_0000000002_00005?
2025-10-10T13:59:28.240458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T13:59:28.240492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:28.240548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.240707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-10T13:59:27.000000Z
2025-10-10T13:59:28.240725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 3 parts_count 15 source 1 size 8295635 accessed 0 times before, last time 2025-10-10T13:59:28.000000Z
2025-10-10T13:59:28.240742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 3 count 2 parts_count 5 source 1 size 2970333 accessed 0 times before, last time 2025-10-10T13:59:28.000000Z
2025-10-10T13:59:28.240783Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-10T13:59:28.240934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:28.240957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000006_00000_0000000001_00004?
2025-10-10T13:59:28.240971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:28.241401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63'
2025-10-10T13:59:28.241425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 15 suffix '63'
2025-10-10T13:59:28.241446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 2 parts 5 suffix '63'
2025-10-10T13:59:28.263608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 240 queued_in_partition_duration_ms: 251 }
2025-10-10T13:59:28.263668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 12
2025-10-10T13:59:28.275943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 18 to 18
2025-10-10T13:59:28.278809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-10T13:59:28.282251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-10T13:59:28.283068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:28.283109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-10T13:59:28.288976Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:28.301752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-10T13:59:28.307702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 19 to 19
2025-10-10T13:59:28.313778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:28.313831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-10T13:59:28.313904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-10T13:59:28.318781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-10T13:59:28.343198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:28.347698Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:28.361199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:28.371943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 2253229 count 1 nextOffset 7 batches 5
2025-10-10T13:59:28.380154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 20 to 20
2025-10-10T13:59:28.382109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:28.382156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-10T13:59:28.391071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000007_00000_0000000003_00015?
2025-10-10T13:59:28.391102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:28.402536Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:28.410233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-10T13:59:28.411531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-10T13:59:28.417569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 21 to 21
2025-10-10T13:59:28.423095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:28.423144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-10T13:59:28.435431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-10T13:59:28.438402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-10T13:59:28.440305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-10T13:59:28.442057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-10T13:59:28.442122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1760104768439
2025-10-10T13:59:28.459882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-10T13:59:28.459977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-10T13:59:28.461110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-10T13:59:28.462293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-10T13:59:28.463361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-10T13:59:28.464874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-10T13:59:28.470886Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:28.482156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 22 to 22
2025-10-10T13:59:28.483898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:28.483942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-10T13:59:28.492625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:28.493394Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:28.500130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 3994395 count 2 nextOffset 9 batches 8
2025-10-10T13:59:28.500350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-10T13:59:28.507288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-10T13:59:28.508353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-10T13:59:28.509375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-10T13:59:28.509854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-10T13:59:28.527037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 6247592 count 3 nextOffset 10 batches 12
2025-10-10T13:59:28.530067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-10T13:59:28.530110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-10T13:59:28.530128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-10T13:59:28.537357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00003_0000000002_00005?
2025-10-10T13:59:28.537387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:28.538379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-10T13:59:28.539861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-10T13:59:28.573474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295579
2025-10-10T13:59:28.573549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295579 WTime 1760104768570
2025-10-10T13:59:28.575663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-10-10T13:59:28.575721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-10T13:59:28.576893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-10T13:59:28.577990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-10T13:59:28.579016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-10T13:59:28.579530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-10T13:59:28.588385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-10-10T13:59:28.589538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,2 HeadOffset 3 endOffset 6 curOffset 12 d0000000000_00000000000000000010_00004_0000000002_00004| size 2458306 WTime 1760104768587
2025-10-10T13:59:28.595133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 26214400 endOffset 12 max time lag 0ms effective offset 3
2025-10-10T13:59:28.595181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 0 blobs, size 0 count 0 last offset 3, current partition end offset: 12
2025-10-10T13:59:28.598824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1088: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. All data is from uncompacted head.
2025-10-10T13:59:28.598890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 0 blobs
2025-10-10T13:59:28.600701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.600774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.600799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.600881Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:28.601009Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-10T13:59:28.601109Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295579
2025-10-10T13:59:28.601429Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 2 size 2458306
2025-10-10T13:59:28.601521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 3
2025-10-10T13:59:28.609182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-10T13:59:28.611112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.611612Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 12 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104766581 CreateTimestampMS: 1760104765730 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 12084983 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 12 StartOffset: 0 } Cookie: 3 }
2025-10-10T13:59:28.615926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 3 size 8295638 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.615973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 717135 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.616032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:28.616086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:28.616111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-10T13:59:28.616162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-10T13:59:28.616196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-10T13:59:28.616226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-10T13:59:28.616271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-10T13:59:28.616302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-10T13:59:28.616332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.614446Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 12
2025-10-10T13:59:28.616357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-10T13:59:28.616366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-10T13:59:28.616399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-10T13:59:28.616436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-10T13:59:28.616467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-10T13:59:28.616497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-10T13:59:28.616529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-10T13:59:28.616563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-10T13:59:28.616601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-10T13:59:28.616635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-10T13:59:28.616664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-10T13:59:28.616694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-10T13:59:28.616724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-10T13:59:28.616760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.616782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-10T13:59:28.617227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.617266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.617276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T13:59:28.617373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-10T13:59:28.617413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-10T13:59:28.617435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-10T13:59:28.617456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-10T13:59:28.617481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-10T13:59:28.622512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 3 parts 9 suffix '124' size 5223528
2025-10-10T13:59:28.622579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:28.622607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:28.614556Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 12 ReadOffset 4 ReadGuid 5b756edb-7f2f3c2b-95d4b14a-1846adb has messages 1
2025-10-10T13:59:28.615386Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 12, WTime# 1760104766581, sizeLag# 12084983
2025-10-10T13:59:28.615407Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1TEvPartitionReady. Aval parts: 0
2025-10-10T13:59:28.615449Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 read done: guid# 5b756edb-7f2f3c2b-95d4b14a-1846adb, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-10T13:59:28.615476Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 response to read: guid# 5b756edb-7f2f3c2b-95d4b14a-1846adb
2025-10-10T13:59:28.623671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:28.626047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:28.631643Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 Process answer. Aval parts: 1
2025-10-10T13:59:28.659514Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-10T13:59:28.659764Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-10T13:59:28.659804Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 2252978 to budget
2025-10-10T13:59:28.664760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2253230 count 1 nextOffset 17 batches 5
2025-10-10T13:59:28.664859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.665792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 16,1 HeadOffset 16 endOffset 16 curOffset 17 d0000000000_00000000000000000016_00000_0000000001_00004? size 2253220 WTime 1760104768665
2025-10-10T13:59:28.672052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T13:59:28.672210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-10T13:59:28.672296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-10T13:59:28.672350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-10T13:59:28.672407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-10T13:59:28.674927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.675003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.675031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.675060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.679420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 552 queued_in_partition_duration_ms: 225 }
2025-10-10T13:59:28.679463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 13
2025-10-10T13:59:28.679503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:28.680347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 519 queued_in_partition_duration_ms: 194 }
2025-10-10T13:59:28.680388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 14
2025-10-10T13:59:28.684302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 23 to 23
2025-10-10T13:59:28.687312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:28.687362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-10T13:59:28.687450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.687506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.688232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-10T13:59:28.688869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-10T13:59:28.691687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-10T13:59:28.692345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-10T13:59:28.692896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-10T13:59:28.692923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-10T13:59:28.693587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.693623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.693679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 5223528 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:28.693700Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:28.695117Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:28.695261Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 1 size 2253220
2025-10-10T13:59:28.695330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:28.695397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.695421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.695467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 30827595 CachedBlobs 6
2025-10-10T13:59:28.695616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-10T13:59:28.696275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.709765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:28.715756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:28.718024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.718075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.724913Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-10-10T13:59:28.724994Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:28.725029Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-10T13:59:28.725300Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T13:59:28.725359Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:28.727100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-10T13:59:28.727330Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-10T13:59:28.727498Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 got read request: guid# bc92beef-ec26c169-baaba3d-a4d15973
2025-10-10T13:59:28.727554Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 performing read request: guid# 71c68130-7c9ee58e-e3e43987-ec5acabe, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 9, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T13:59:28.727637Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 9 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 12 ClientCommitOffset 0 committedOffset 0 Guid 71c68130-7c9ee58e-e3e43987-ec5acabe
2025-10-10T13:59:28.730941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 501 queued_in_partition_duration_ms: 178 }
2025-10-10T13:59:28.730981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 15
2025-10-10T13:59:28.731101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-10T13:59:28.732459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 491 queued_in_partition_duration_ms: 126 }
2025-10-10T13:59:28.732524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 16
2025-10-10T13:59:28.732239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-10T13:59:28.732962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-10T13:59:28.736200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-10T13:59:28.736256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-10T13:59:28.737724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T13:59:28.737848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.737871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.737956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.737969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.738248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:28.738326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.738771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-10T13:59:28.738927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 9 size 524288 endOffset 16 max time lag 0ms effective offset 4
2025-10-10T13:59:28.738970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 0 blobs, size 0 count 0 last offset 4, current partition end offset: 16
2025-10-10T13:59:28.739508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-10T13:59:25.730000Z WriteTime: 2025-10-10T13:59:26.581000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:40068", "logtype": "unknown", "_ip": "ipv6:[::1]:40068", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:28.762170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1088: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. All data is from uncompacted head.
2025-10-10T13:59:28.762228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 0 blobs
2025-10-10T13:59:28.764491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:28.766945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:28.775162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.775215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.775851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-10T13:59:28.776418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-10T13:59:28.776988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-10T13:59:28.778827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-10T13:59:28.779118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-10T13:59:28.779149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-10T13:59:28.779996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-10T13:59:28.780128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.780150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.780184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:28.780252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.781689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 24 to 24
2025-10-10T13:59:28.783811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:28.783857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-10T13:59:28.788428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-10T13:59:28.788480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.788575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-10T13:59:28.788764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 4
2025-10-10T13:59:28.788813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 0 blobs, size 0 count 0 last offset 4, current partition end offset: 16
2025-10-10T13:59:28.791703Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:28.792836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.795489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1088: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. All data is from uncompacted head.
2025-10-10T13:59:28.795573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 0 blobs
2025-10-10T13:59:28.795754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.795804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 4
2025-10-10T13:59:28.803458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:28.807304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:28.809487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 25 to 25
2025-10-10T13:59:28.812166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:28.812206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-10T13:59:28.814366Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104766656 CreateTimestampMS: 1760104765809 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 23862959 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 4 }
2025-10-10T13:59:28.816785Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 16
2025-10-10T13:59:28.818381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.818427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.816838Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 5 ReadGuid 71c68130-7c9ee58e-e3e43987-ec5acabe has messages 1
2025-10-10T13:59:28.817104Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 16, WTime# 1760104766656, sizeLag# 23862959
2025-10-10T13:59:28.817157Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1TEvPartitionReady. Aval parts: 0
2025-10-10T13:59:28.817221Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 read done: guid# 71c68130-7c9ee58e-e3e43987-ec5acabe, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-10T13:59:28.817263Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 response to read: guid# 71c68130-7c9ee58e-e3e43987-ec5acabe
2025-10-10T13:59:28.822299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-10T13:59:28.826487Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:28.825375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-10T13:59:28.826370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-10T13:59:28.827090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-10T13:59:28.827403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-10T13:59:28.827433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-10T13:59:28.828113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.828145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.828191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:28.828257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.828903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-10T13:59:28.830519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.835380Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 Process answer. Aval parts: 1
2025-10-10T13:59:28.847648Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-10T13:59:28.855501Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-10T13:59:28.855574Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 2252978 to budget
2025-10-10T13:59:28.855539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:28.858063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 26 to 26
2025-10-10T13:59:28.858078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:28.860319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:28.860403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-10T13:59:28.857530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.857581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.858160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-10T13:59:28.858723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-10T13:59:28.859282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-10T13:59:28.859807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-10T13:59:28.860063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-10T13:59:28.860088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-10T13:59:28.861184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.861205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.861236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:28.861297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.861347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 1 size 2253220 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.861400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.861426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.861448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 2 size 2458306 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:28.861500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:28.864944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:28.861543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:28.861569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.861597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-10T13:59:28.861610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.861645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-10T13:59:28.861659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.861683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-10T13:59:28.861692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.861709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-10T13:59:28.861731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.861751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-10T13:59:28.861854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T13:59:28.861924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:28.862005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-10T13:59:28.862085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-10T13:59:28.862145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 15 suffix '63' size 8295635
2025-10-10T13:59:28.862208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-10T13:59:28.862260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 2 parts 4 suffix '124' size 2458306
2025-10-10T13:59:28.869062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.869206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.869217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-10T13:59:28.869332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-10T13:59:28.869380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-10T13:59:28.869399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-10T13:59:28.869419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-10T13:59:28.869438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-10T13:59:28.876568Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-10-10T13:59:28.876637Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:28.876670Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-10T13:59:28.876972Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T13:59:28.877016Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:28.878015Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-10T13:59:28.878183Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 got read request: guid# 6aa670e0-cf5b064d-f7e89b9f-c0c594e3
2025-10-10T13:59:28.878235Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 performing read request: guid# afa0d247-3bf8484c-bf2f82aa-d0843564, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 13, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T13:59:28.878300Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 13 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid afa0d247-3bf8484c-bf2f82aa-d0843564
2025-10-10T13:59:28.878794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-10T13:59:28.878940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-10T13:59:28.878978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-10T13:59:28.878996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-10T13:59:28.879018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-10T13:59:28.879041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-10T13:59:25.809000Z WriteTime: 2025-10-10T13:59:26.656000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40068", "server": "ipv6:[::1]:40068" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:28.906321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-10T13:59:28.906437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-10T13:59:28.906480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-10T13:59:28.906505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-10T13:59:28.906526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-10T13:59:28.906552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-10T13:59:28.914726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-10T13:59:28.914846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-10T13:59:28.914882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-10T13:59:28.914912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-10T13:59:28.914932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-10T13:59:28.965276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 21 partNo 3 result is x0000000000_00000000000000000017_00000_0000000003_00015? size 8295638
2025-10-10T13:59:28.965345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-10T13:59:28.965399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000017_00000_0000000003_00015? new key d0000000000_00000000000000000017_00000_0000000003_00015? size 8295638 WTime 1760104768965
2025-10-10T13:59:28.971136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 1 NewHead: Offset 20 PartNo 3 PackedSize 717145 count 1 nextOffset 21 batches 2
2025-10-10T13:59:28.971238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-10T13:59:28.971276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-10T13:59:28.971292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-10T13:59:28.971315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-10T13:59:28.971335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-10T13:59:28.979524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 3 PackedSize 2970343 count 2 nextOffset 22 batches 6
2025-10-10T13:59:28.979627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.980613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 20,2 HeadOffset 17 endOffset 17 curOffset 22 d0000000000_00000000000000000020_00003_0000000002_00005? size 2970333 WTime 1760104768975
2025-10-10T13:59:28.983373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T13:59:28.983461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:28.983477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T13:59:28.987565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.987619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000012_00000_0000000003_00015?
2025-10-10T13:59:28.987634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000015_00003_0000000001_00001?
2025-10-10T13:59:28.987647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00000_0000000001_00004?
2025-10-10T13:59:28.987662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 11265993 bytes
2025-10-10T13:59:28.987721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-10T13:59:28.987822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-10T13:59:28.987870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 9
2025-10-10T13:59:28.987889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 6 size 2253219 cause it's been evicted from L2. Actual L1 size: 8
2025-10-10T13:59:28.987905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295635 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T13:59:28.987920Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:28.993810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.993847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.993904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:28.993924Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:28.994056Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 8295638
2025-10-10T13:59:28.994148Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 3 count 2 size 2970333
2025-10-10T13:59:28.994192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T13:59:28.994217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000012_00000_0000000003_00015?
2025-10-10T13:59:28.994345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000015_00003_0000000001_00001?
2025-10-10T13:59:28.994491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00000_0000000001_00004?
2025-10-10T13:59:28.994661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T13:59:28.994836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-10T13:59:28.000000Z
2025-10-10T13:59:28.994867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-10T13:59:28.000000Z
2025-10-10T13:59:28.994888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-10T13:59:28.000000Z
2025-10-10T13:59:28.994920Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-10T13:59:28.995055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:28.995079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000012_00000_0000000003_00015?
2025-10-10T13:59:28.995091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:28.996112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-10T13:59:28.997225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 3 parts 15 suffix '63'
2025-10-10T13:59:28.997253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 3 count 1 parts 1 suffix '63'
2025-10-10T13:59:28.997277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 4 suffix '63'
2025-10-10T13:59:28.993254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.993362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.998710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-10T13:59:29.001069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-10T13:59:29.001569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 245 queued_in_partition_duration_ms: 377 }
2025-10-10T13:59:29.005796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 17
2025-10-10T13:59:29.005835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:29.010417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-10T13:59:29.015319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:29.019943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:29.022520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 27 to 27
2025-10-10T13:59:29.024557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:29.024597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-10T13:59:29.025760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-10T13:59:29.029818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:29.030351Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:29.066284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 2253230 count 1 nextOffset 13 batches 5
2025-10-10T13:59:29.067174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-10T13:59:29.068687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-10T13:59:29.071070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-10T13:59:29.072180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-10T13:59:29.080784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-10T13:59:29.088759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 4506428 count 2 nextOffset 14 batches 9
2025-10-10T13:59:29.088871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-10T13:59:29.090383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-10T13:59:29.091577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-10T13:59:29.117927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988760
2025-10-10T13:59:29.119167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-10T13:59:29.119786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-10T13:59:29.119847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988760 WTime 1760104769115
2025-10-10T13:59:29.140929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-10-10T13:59:29.154965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-10T13:59:29.155016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-10T13:59:29.155034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-10T13:59:29.155743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000015_00003_0000000001_00001?
2025-10-10T13:59:29.155756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:29.156875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-10T13:59:29.159247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-10T13:59:29.188838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-10-10T13:59:29.188954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000016_00000_0000000001_00004?
2025-10-10T13:59:29.188966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:29.189956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-10T13:59:29.191103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-10T13:59:29.192230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-10T13:59:29.198608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-10T13:59:29.199182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-10T13:59:29.208252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 5735568 count 3 nextOffset 17 batches 11
2025-10-10T13:59:29.213583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,3 HeadOffset 10 endOffset 12 curOffset 17 d0000000000_00000000000000000014_00002_0000000003_00010| size 5735558 WTime 1760104769211
2025-10-10T13:59:29.223056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 5 count 13 size 524288 endOffset 17 max time lag 0ms effective offset 5
2025-10-10T13:59:29.224255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 2 blobs, size 8295579 count 5 last offset 7, current partition end offset: 17
2025-10-10T13:59:29.225053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-10T13:59:29.228673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:29.228711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:29.229444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-10-10T13:59:29.229970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-10-10T13:59:29.230535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-10-10T13:59:29.231012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-10-10T13:59:29.231250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-10-10T13:59:29.231275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
2025-10-10T13:59:29.232043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:29.232071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:29.232151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:29.232194Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:29.232319Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988760
2025-10-10T13:59:29.232396Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 3 size 5735558
2025-10-10T13:59:29.232452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 3 count 4 parts_count 14 source 1 size 7988778 accessed 0 times before, last time 2025-10-10T13:59:28.000000Z
2025-10-10T13:59:29.232475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 1 count 3 parts_count 15 source 1 size 8295579 accessed 0 times before, last time 2025-10-10T13:59:28.000000Z
2025-10-10T13:59:29.232569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0'
2025-10-10T13:59:29.232595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0'
2025-10-10T13:59:29.233240Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 2 blobs are from cache.
2025-10-10T13:59:29.233614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:29.233673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:29.234680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-10-10T13:59:29.245571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 4 count 1 size 717094 from pos 1 cbcount 2
2025-10-10T13:59:29.246815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.247984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.250179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.250717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T13:59:29.251709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:29.252750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.254542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.264954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.265580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T13:59:29.266554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:29.268168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.269323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.270431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.271877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:29.273046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.274342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.275350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.276729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:29.278005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.279113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.280231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:29.280762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-10T13:59:29.284741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-10T13:59:29.285605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-10T13:59:29.286011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-10-10T13:59:29.286134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 3 size 8295638 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:29.286160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 2 size 2970333 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:29.289455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:29.289491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 2 parts 4 suffix '124' size 2458306
2025-10-10T13:59:29.289520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:29.289552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:29.289581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:29.290598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:29.298421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:29.304442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:29.338650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:29.338722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11264555 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:29.338745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.338783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-10T13:59:29.338798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.338820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-10-10T13:59:29.338832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.338853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-10-10T13:59:29.338864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.338883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-10-10T13:59:29.338905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.338924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-10-10T13:59:29.338937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.338960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-10T13:59:29.338971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.338991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-10-10T13:59:29.339001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-10-10T13:59:29.339030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-10-10T13:59:29.339059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-10-10T13:59:29.339089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-10T13:59:29.339119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-10-10T13:59:29.339149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-10-10T13:59:29.339177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-10-10T13:59:29.339206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-10-10T13:59:29.339234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-10T13:59:29.339262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-10-10T13:59:29.339290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-10-10T13:59:29.339321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-10-10T13:59:29.339355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-10-10T13:59:29.339383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-10T13:59:29.339409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-10-10T13:59:29.339437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-10-10T13:59:29.339467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-10-10T13:59:29.339497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:29.339515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-10-10T13:59:29.343992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:29.344055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:29.344067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T13:59:29.344179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-10T13:59:29.344228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-10T13:59:29.344250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-10T13:59:29.344273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-10T13:59:29.344295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-10T13:59:29.356280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-10T13:59:29.356384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:29.357604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 22,1 HeadOffset 22 endOffset 22 curOffset 23 d0000000000_00000000000000000022_00000_0000000001_00004? size 2253220 WTime 1760104769357
2025-10-10T13:59:29.360404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T13:59:29.373826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 12 size 8295638 cause it's been evicted from L2. Actual L1 size: 8
2025-10-10T13:59:29.373864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 2970333 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T13:59:29.373882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 2458306 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:29.373904Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:29.394985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:29.395044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:29.396061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-10-10T13:59:29.396928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-10-10T13:59:29.397867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-10-10T13:59:29.400604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-10-10T13:59:29.407058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-10-10T13:59:29.407113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-10-10T13:59:29.407738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:29.407768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:29.407879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:29.407965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-10T13:59:29.408058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-10T13:59:29.408119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-10T13:59:29.408181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-10T13:59:29.408245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-10T13:59:29.408275Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:29.408417Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 1 size 2253220
2025-10-10T13:59:29.408451Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00004?(+) to d0000000000_00000000000000000006_00000_0000000001_00004?(+)
2025-10-10T13:59:29.408480Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000003_00015?(+) to d0000000000_00000000000000000007_00000_0000000003_00015?(+)
2025-10-10T13:59:29.408494Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00003_0000000002_00005?(+) to d0000000000_00000000000000000010_00003_0000000002_00005?(+)
2025-10-10T13:59:29.408507Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000003_00009|(+) to d0000000000_00000000000000000003_00003_0000000003_00009|(+)
2025-10-10T13:59:29.408546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:29.408619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:29.408823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-10T13:59:29.437948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:29.438007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 3 size 5735558 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:29.438056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:29.438070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T13:59:29.438276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 15 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:29.438306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T13:59:29.438336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-10T13:59:29.438369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-10T13:59:29.438396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 3 parts 10 suffix '124' size 5735558
2025-10-10T13:59:29.507836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:29.507897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00000_0000000003_00015?
2025-10-10T13:59:29.507912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00003_0000000002_00005?
2025-10-10T13:59:29.507923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11265971 bytes
2025-10-10T13:59:29.508047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 15 size 717135 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T13:59:29.508063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:29.508077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 16 size 2253220 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T13:59:29.508092Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:29.512108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:29.520085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:29.520192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:29.520225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:29.520256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:29.520287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:29.520319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:29.517008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-10T13:59:29.517051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000017_00000_0000000003_00015?
2025-10-10T13:59:29.517218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000020_00003_0000000002_00005?
2025-10-10T13:59:29.517354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-10T13:59:29.518009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 17 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-10T13:59:29.000000Z
2025-10-10T13:59:29.518030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 3 count 2 parts_count 5 source 1 size 2970333 accessed 0 times before, last time 2025-10-10T13:59:29.000000Z
2025-10-10T13:59:29.518059Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-10T13:59:29.518119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 3 parts 15 suffix '63'
2025-10-10T13:59:29.518145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 3 count 2 parts 5 suffix '63'
2025-10-10T13:59:29.518186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:29.518211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000017_00000_0000000003_00015?
2025-10-10T13:59:29.518222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:29.519281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-10T13:59:29.520467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-10T13:59:29.554057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-10T13:59:29.598621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 464 queued_in_partition_duration_ms: 175 }
2025-10-10T13:59:29.598696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 18
2025-10-10T13:59:29.598735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:29.598320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-10T13:59:29.602333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 28 to 28
2025-10-10T13:59:29.603018Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 17 Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104766689 CreateTimestampMS: 1760104765860 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104767207 CreateTimestampMS: 1760104765905 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104767642 CreateTimestampMS: 1760104765962 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104767682 CreateTimestampMS: 1760104766050 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760104767693 CreateTimestampMS: 1760104766069 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 3994842 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 17 StartOffset: 0 } Cookie: 5 }
2025-10-10T13:59:29.611240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:29.611298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-10T13:59:29.618207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-10T13:59:29.636584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:29.637532Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:29.652589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 458 queued_in_partition_duration_ms: 138 }
2025-10-10T13:59:29.652674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 19
2025-10-10T13:59:29.652722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:29.653800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 428 queued_in_partition_duration_ms: 136 }
2025-10-10T13:59:29.653862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 20
2025-10-10T13:59:29.654674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 420 queued_in_partition_duration_ms: 87 }
2025-10-10T13:59:29.654720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 21
2025-10-10T13:59:29.655505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 364 queued_in_partition_duration_ms: 108 }
2025-10-10T13:59:29.655541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 22
2025-10-10T13:59:29.687955Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 17
2025-10-10T13:59:29.695838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 29 to 29
2025-10-10T13:59:29.696825Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 ReadOffset 10 ReadGuid afa0d247-3bf8484c-bf2f82aa-d0843564 has messages 1
2025-10-10T13:59:29.716725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:29.720257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:29.726639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:29.726695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-10T13:59:29.729311Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 17, WTime# 1760104767693, sizeLag# 3994842
2025-10-10T13:59:29.729351Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1TEvPartitionReady. Aval parts: 0
2025-10-10T13:59:29.729429Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 read done: guid# afa0d247-3bf8484c-bf2f82aa-d0843564, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 11264823
2025-10-10T13:59:29.729466Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 response to read: guid# afa0d247-3bf8484c-bf2f82aa-d0843564
2025-10-10T13:59:29.739188Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:29.794737Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 Process answer. Aval parts: 1
2025-10-10T13:59:29.821472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-10T13:59:29.821586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-10T13:59:29.856961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 30 to 30
2025-10-10T13:59:29.859434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:29.859491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-10T13:59:29.880616Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:29.883571Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got ReadResponse, serverBytesSize = 11264823, now ReadSizeBudget = 0, ReadSizeServerDelta = -10740535
2025-10-10T13:59:29.883876Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-10T13:59:29.883917Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 11264823 to budget
2025-10-10T13:59:29.885058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988778
2025-10-10T13:59:29.908862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-10T13:59:29.914252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-10T13:59:29.915562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-10T13:59:29.922489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-10T13:59:29.922599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988778 WTime 1760104769918
2025-10-10T13:59:29.928964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 31 to 31
2025-10-10T13:59:29.957709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:29.957766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-10T13:59:29.963447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-10T13:59:29.963560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-10T13:59:29.965031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-10T13:59:29.967738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-10T13:59:29.969188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-10T13:59:29.969858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-10T13:59:29.999415Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (5-5)
2025-10-10T13:59:29.999493Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:30.001231Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-10T13:59:30.001290Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:30.058531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-10T13:59:25.860000Z WriteTime: 2025-10-10T13:59:26.689000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40068", "server": "ipv6:[::1]:40068" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:30.079840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-10T13:59:30.079894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-10T13:59:30.079911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-10T13:59:30.080251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000020_00003_0000000002_00005?
2025-10-10T13:59:30.080266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:30.086238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-10T13:59:30.087978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-10T13:59:30.108221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-10-10T13:59:30.111277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 32 to 32
2025-10-10T13:59:30.121300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:30.121362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-10T13:59:30.128465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-10T13:59:30.130103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-10T13:59:30.131367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-10T13:59:30.135835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:30.136445Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:30.163393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-10T13:59:30.254779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295638
2025-10-10T13:59:30.255308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-10T13:59:30.255376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295638 WTime 1760104770255
2025-10-10T13:59:30.274927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-10T13:59:30.275867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,1 HeadOffset 14 endOffset 17 curOffset 22 d0000000000_00000000000000000021_00003_0000000001_00001| size 717135 WTime 1760104770271
2025-10-10T13:59:30.296515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.296580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.297104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-10-10T13:59:30.302306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-10-10T13:59:30.302813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-10-10T13:59:30.303301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-10-10T13:59:30.303523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-10-10T13:59:30.303546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
2025-10-10T13:59:30.304011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.304087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.304109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.304162Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:30.304286Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988778
2025-10-10T13:59:30.304361Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295638
2025-10-10T13:59:30.304438Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 1 size 717135
2025-10-10T13:59:30.304613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 1 size 2253220 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:30.304670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:30.304732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.304874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:30.304924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:30.304944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.304972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-10T13:59:30.304984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.305002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-10-10T13:59:30.305012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.305030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-10-10T13:59:30.305039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.305059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-10-10T13:59:30.305081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.305101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-10-10T13:59:30.305477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-10T13:59:30.305512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T13:59:30.310931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:30.311007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:30.311018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T13:59:30.311125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-10T13:59:30.311168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-10T13:59:30.311185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-10T13:59:30.311204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-10T13:59:30.311221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-10T13:59:30.340083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2253230 count 1 nextOffset 24 batches 5
2025-10-10T13:59:30.340236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-10T13:59:30.340279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-10T13:59:30.340303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-10T13:59:30.340324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-10T13:59:30.340347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-10T13:59:30.360708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4506428 count 2 nextOffset 25 batches 9
2025-10-10T13:59:30.360832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:30.365482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 23,2 HeadOffset 23 endOffset 23 curOffset 25 d0000000000_00000000000000000023_00000_0000000002_00008? size 4506418 WTime 1760104770360
2025-10-10T13:59:30.377868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T13:59:30.378029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-10T13:59:30.378203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-10T13:59:30.378249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295579 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T13:59:30.378266Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:30.384814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:30.384884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:30.387343Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:30.387499Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 2 size 4506418
2025-10-10T13:59:30.387528Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000012_00000_0000000003_00015?(+) to d0000000000_00000000000000000012_00000_0000000003_00015?(+)
2025-10-10T13:59:30.387541Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000015_00003_0000000001_00001?(+) to d0000000000_00000000000000000015_00003_0000000001_00001?(+)
2025-10-10T13:59:30.387556Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00000_0000000001_00004?(+) to d0000000000_00000000000000000016_00000_0000000001_00004?(+)
2025-10-10T13:59:30.387568Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00004_0000000002_00004|(+) to d0000000000_00000000000000000010_00004_0000000002_00004|(+)
2025-10-10T13:59:30.400205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 956 queued_in_partition_duration_ms: 113 }
2025-10-10T13:59:30.400263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 23
2025-10-10T13:59:30.400301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:30.402328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.415118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 33 to 33
2025-10-10T13:59:30.417103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:30.417619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-10T13:59:30.417695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.417746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.430507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-10-10T13:59:30.431093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-10-10T13:59:30.431689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-10-10T13:59:30.432249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-10-10T13:59:30.432525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-10-10T13:59:30.432554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-10-10T13:59:30.472098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:30.472181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.473327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:30.488900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.488939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.489000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-10T13:59:30.485276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:30.489427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:30.503417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:30.506515Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (6-6)
2025-10-10T13:59:30.506585Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:30.507921Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-10T13:59:30.507969Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:30.521415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.521462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.527839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-10-10T13:59:30.520971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:30.537526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-10-10T13:59:30.539712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-10-10T13:59:30.542296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-10-10T13:59:30.546386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-10-10T13:59:30.546429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-10-10T13:59:30.546914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.546968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:30.547029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-10T13:59:25.905000Z WriteTime: 2025-10-10T13:59:27.207000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40068", "server": "ipv6:[::1]:40068", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:30.555270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:30.555796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.555838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.555902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-10-10T13:59:30.556141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:30.582383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.582439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.584101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:30.586534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:30.587073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-10-10T13:59:30.592363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-10-10T13:59:30.592924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-10-10T13:59:30.593473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-10-10T13:59:30.593730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-10-10T13:59:30.593758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-10-10T13:59:30.594581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.594608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.594664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:30.594728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.594767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-10T13:59:30.595004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:30.609211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:30.611718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:30.614843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.614906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.615480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-10-10T13:59:30.616040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
2025-10-10T13:59:30.616596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-10-10T13:59:30.617168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-10-10T13:59:30.617427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-10-10T13:59:30.617463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-10-10T13:59:30.618331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.618365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.618434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:30.618501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.618943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-10T13:59:30.628078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:30.628111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:30.628138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 717135 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:30.628185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:30.628201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T13:59:30.630788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.630833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:30.631138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-10T13:59:30.631177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-10T13:59:30.631219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 3 parts 10 suffix '124' size 5735558
2025-10-10T13:59:30.631248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-10T13:59:30.631293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-10-10T13:59:30.629323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:30.632105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988760 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T13:59:30.632132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 5735558 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:30.632149Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:30.659601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:30.661943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:30.665427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.676782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.676836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.677407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-10-10T13:59:30.677903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-10-10T13:59:30.678400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-10-10T13:59:30.678911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
2025-10-10T13:59:30.679148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-10-10T13:59:30.679184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-10-10T13:59:30.679631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.679655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.679834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 2 size 4506418 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:30.679923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:30.679991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.680024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:30.680073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:30.680095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-10T13:59:30.680137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-10-10T13:59:30.680165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-10-10T13:59:30.680193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-10-10T13:59:30.680232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-10-10T13:59:30.680263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-10T13:59:30.680293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-10-10T13:59:30.680321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-10-10T13:59:30.680348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-10-10T13:59:30.680377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:30.680395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-10-10T13:59:30.680845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:30.680934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:30.690115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:30.690220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:30.690233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-10T13:59:30.690351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-10T13:59:30.690391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-10T13:59:30.690410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-10T13:59:30.690431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-10T13:59:30.690448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-10T13:59:30.705103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 2253230 count 1 nextOffset 26 batches 5
2025-10-10T13:59:30.708319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-10T13:59:30.708383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-10T13:59:30.708407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-10T13:59:30.708428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-10T13:59:30.708451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-10T13:59:30.732445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 4506428 count 2 nextOffset 27 batches 9
2025-10-10T13:59:30.742530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-10T13:59:30.742598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-10T13:59:30.742620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-10T13:59:30.742642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-10T13:59:30.742666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-10T13:59:30.756571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 6759626 count 3 nextOffset 28 batches 13
2025-10-10T13:59:30.756729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-10T13:59:30.756769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-10T13:59:30.756792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-10T13:59:30.756811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-10T13:59:30.912153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 29 partNo 3 result is x0000000000_00000000000000000025_00000_0000000003_00015? size 8295638
2025-10-10T13:59:30.912232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-10T13:59:30.912285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00000_0000000003_00015? new key d0000000000_00000000000000000025_00000_0000000003_00015? size 8295638 WTime 1760104770908
2025-10-10T13:59:30.916039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 3 PackedSize 717145 count 1 nextOffset 29 batches 2
2025-10-10T13:59:30.916136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-10T13:59:30.916175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-10T13:59:30.916194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-10T13:59:30.916215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-10T13:59:30.916235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-10T13:59:30.932535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 3 PackedSize 2970343 count 2 nextOffset 30 batches 6
2025-10-10T13:59:30.932644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:30.933749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 28,2 HeadOffset 25 endOffset 25 curOffset 30 d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333 WTime 1760104770933
2025-10-10T13:59:30.936708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:30.936812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-10T13:59:30.936915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-10T13:59:30.936973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-10T13:59:30.937014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 17 size 8295638 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:30.937029Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:30.937569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:30.937711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:30.937796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:30.942361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:30.942390Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:30.942506Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 3 size 8295638
2025-10-10T13:59:30.942582Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 3 count 2 size 2970333
2025-10-10T13:59:30.942608Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000017_00000_0000000003_00015?(+) to d0000000000_00000000000000000017_00000_0000000003_00015?(+)
2025-10-10T13:59:30.942621Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000020_00003_0000000002_00005?(+) to d0000000000_00000000000000000020_00003_0000000002_00005?(+)
2025-10-10T13:59:30.942631Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00002_0000000003_00010|(+) to d0000000000_00000000000000000014_00002_0000000003_00010|(+)
2025-10-10T13:59:30.949748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 367 queued_in_partition_duration_ms: 904 }
2025-10-10T13:59:30.949805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 24
2025-10-10T13:59:30.949841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:30.953643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 34 to 34
2025-10-10T13:59:30.957048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:30.957102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-10T13:59:30.968027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:30.968087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:30.977754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:30.978682Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:30.977718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:30.985275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 341 queued_in_partition_duration_ms: 35 }
2025-10-10T13:59:30.985378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 25
2025-10-10T13:59:30.985416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:30.996696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-10-10T13:59:31.003346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-10-10T13:59:30.996144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:31.006707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-10-10T13:59:31.009914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-10-10T13:59:31.014001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 35 to 35
2025-10-10T13:59:31.017257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.011820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-10-10T13:59:31.011863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-10-10T13:59:31.012482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.012509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.012543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:31.012612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.012657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-10T13:59:31.019950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:31.019999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-10T13:59:31.037800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:31.040291Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (7-7)
2025-10-10T13:59:31.040361Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:31.047095Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-10T13:59:31.047172Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:31.045585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-10T13:59:25.962000Z WriteTime: 2025-10-10T13:59:27.642000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:40068", "server": "ipv6:[::1]:40068" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:31.073251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:31.075633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:31.081553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.081608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.082275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-10-10T13:59:31.082842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-10-10T13:59:31.083391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-10-10T13:59:31.083997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-10-10T13:59:31.089799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.086939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-10-10T13:59:31.086982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-10-10T13:59:31.087475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.087503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.087780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:31.087846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.087977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 20 count 2 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:31.088038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295638 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:31.088064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:31.088131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-10-10T13:59:31.088172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:31.088219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11264555 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:31.088241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.088256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 20 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:31.088273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-10T13:59:31.088296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.088345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-10-10T13:59:31.088375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.088435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-10-10T13:59:31.088468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.088517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-10-10T13:59:31.088565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.088617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-10-10T13:59:31.088642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.088690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-10T13:59:31.088712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.088759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-10-10T13:59:31.088790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.088841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-10-10T13:59:31.088864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.088912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-10-10T13:59:31.088946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-10-10T13:59:31.089032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-10T13:59:31.089108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-10-10T13:59:31.089226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-10-10T13:59:31.089297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-10-10T13:59:31.089347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-10-10T13:59:31.089380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:31.089407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-10T13:59:31.089418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T13:59:31.089442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-10-10T13:59:31.089454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:31.089477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-10-10T13:59:31.089487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-10-10T13:59:31.089521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-10-10T13:59:31.089557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-10T13:59:31.089589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-10-10T13:59:31.089622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-10-10T13:59:31.089657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-10-10T13:59:31.089692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.089713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-10-10T13:59:31.090966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:31.091024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:31.091036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T13:59:31.091145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-10T13:59:31.091186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-10T13:59:31.091206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-10T13:59:31.091227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-10T13:59:31.100820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-10T13:59:31.101281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:31.110123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 2253230 count 1 nextOffset 31 batches 5
2025-10-10T13:59:31.110271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-10T13:59:31.110319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-10T13:59:31.110337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-10T13:59:31.110358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-10T13:59:31.110379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-10T13:59:31.127573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 4506428 count 2 nextOffset 32 batches 9
2025-10-10T13:59:31.122799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:31.130809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:31.131863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 30,2 HeadOffset 30 endOffset 30 curOffset 32 d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418 WTime 1760104771130
2025-10-10T13:59:31.136128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000001_00004?
2025-10-10T13:59:31.136145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000023_00000_0000000002_00008?
2025-10-10T13:59:31.136159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-10T13:59:31.136170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 15055276 bytes
2025-10-10T13:59:31.136334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-10T13:59:31.136423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-10T13:59:31.136480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-10T13:59:31.136546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 2253220 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:31.136562Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:31.136951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-10T13:59:31.137008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-10T13:59:31.138100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.138179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.138214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.138248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.138282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.141364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 397 queued_in_partition_duration_ms: 217 }
2025-10-10T13:59:31.141421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 26
2025-10-10T13:59:31.141454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:31.144915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 36 to 36
2025-10-10T13:59:31.152314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.152553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.153373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-10-10T13:59:31.153918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-10-10T13:59:31.154448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
2025-10-10T13:59:31.154980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-10-10T13:59:31.155217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-10-10T13:59:31.155242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-10-10T13:59:31.168653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:31.168714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-10T13:59:31.173914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.173959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.173995Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:31.174144Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 2 size 4506418
2025-10-10T13:59:31.174193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-10T13:59:31.174212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000001_00004?
2025-10-10T13:59:31.174331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000023_00000_0000000002_00008?
2025-10-10T13:59:31.174452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-10T13:59:31.174594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-10T13:59:31.174626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.174639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:31.174694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.174867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 22 partno 0 count 1 parts_count 4 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:31.174898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-10T13:59:30.000000Z
2025-10-10T13:59:31.174918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-10T13:59:31.000000Z
2025-10-10T13:59:31.174967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 3 from KV
2025-10-10T13:59:31.175023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-10-10T13:59:31.175847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 2 parts 8 suffix '63'
2025-10-10T13:59:31.175872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 3 parts 15 suffix '63'
2025-10-10T13:59:31.175893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 22 partno 0 count 1 parts_count 4
2025-10-10T13:59:31.178394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.190129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:31.191157Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:31.192168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 379 queued_in_partition_duration_ms: 165 }
2025-10-10T13:59:31.192235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 27
2025-10-10T13:59:31.192271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:31.192994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.193580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 347 queued_in_partition_duration_ms: 145 }
2025-10-10T13:59:31.193615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 28
2025-10-10T13:59:31.193213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.193784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-10-10T13:59:31.194252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-10-10T13:59:31.194389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:31.195276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-10-10T13:59:31.197997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:31.201704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-10-10T13:59:31.206080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-10-10T13:59:31.206135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-10-10T13:59:31.206738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.206764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.206813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:31.206885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.206929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-10-10T13:59:31.209836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.222146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:31.233229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:31.236660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.236728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.242906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 333 queued_in_partition_duration_ms: 136 }
2025-10-10T13:59:31.242984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 29
2025-10-10T13:59:31.243731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 173 queued_in_partition_duration_ms: 235 }
2025-10-10T13:59:31.243767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 30
2025-10-10T13:59:31.246458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 37 to 37
2025-10-10T13:59:31.248229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:31.248273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:31.253299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-10-10T13:59:31.253832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-10-10T13:59:31.254324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
2025-10-10T13:59:31.254788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-10-10T13:59:31.255008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-10-10T13:59:31.255036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-10-10T13:59:31.255655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.255681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.255717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:31.255791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.277941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2025-10-10T13:59:31.277976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:31.278050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 22 count 1 size 2253220 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:31.279282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.279319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-10T13:59:31.279741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:31.279770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000022_00000_0000000001_00004?
2025-10-10T13:59:31.279780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:31.280869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-10T13:59:31.281434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-10T13:59:31.281476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T13:59:31.281911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.284626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-10T13:59:31.285942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-10T13:59:31.292062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-10T13:59:31.292800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-10T13:59:31.301982Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (8-8)
2025-10-10T13:59:31.302080Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:31.302214Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-10T13:59:31.305310Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-10T13:59:26.050000Z WriteTime: 2025-10-10T13:59:27.682000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40068", "server": "ipv6:[::1]:40068", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:31.313235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:31.315776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:31.339629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 38 to 38
2025-10-10T13:59:31.353197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:31.353280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-10T13:59:31.357196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-10T13:59:31.357321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000023_00000_0000000002_00008?
2025-10-10T13:59:31.357333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:31.358457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-10T13:59:31.359427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-10T13:59:31.361736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-10T13:59:31.378459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-10T13:59:31.390976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-10T13:59:31.412985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-10-10T13:59:31.413099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-10T13:59:31.422269Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:31.426236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-10T13:59:31.427452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-10T13:59:31.428578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-10T13:59:31.431625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-10T13:59:31.450390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6759626 count 3 nextOffset 25 batches 13
2025-10-10T13:59:31.453337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-10T13:59:31.453366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:31.455381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-10T13:59:31.456484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 39 to 39
2025-10-10T13:59:31.458628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:31.458675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-10T13:59:31.467444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-10T13:59:31.499004Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (9-9)
2025-10-10T13:59:31.499089Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-10T13:59:31.499121Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In ContinueReadingDataImpl, ReadSizeBudget = 11264823, ReadSizeServerDelta = -10740535
2025-10-10T13:59:31.499386Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T13:59:31.499426Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-10T13:59:26.069000Z WriteTime: 2025-10-10T13:59:27.693000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:40068", "logtype": "unknown", "server": "ipv6:[::1]:40068", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:31.516783Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 grpc read done: success# 1, data# { read_request { bytes_size: 11264823 } }
2025-10-10T13:59:31.516965Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 got read request: guid# 9c24d7fa-27f326fc-1472422d-f886f049
2025-10-10T13:59:31.517018Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 performing read request: guid# a8c5bc74-89c283a0-9ef51948-b6ea7e9, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T13:59:31.517089Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 17 ClientCommitOffset 0 committedOffset 0 Guid a8c5bc74-89c283a0-9ef51948-b6ea7e9
2025-10-10T13:59:31.526788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 40 to 40
2025-10-10T13:59:31.528922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:31.528970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-10T13:59:31.557598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:31.558113Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:31.611307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988782
2025-10-10T13:59:31.612497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-10T13:59:31.613785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-10T13:59:31.615309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-10T13:59:31.615376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988782 WTime 1760104771613
2025-10-10T13:59:31.647398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-10-10T13:59:31.653465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-10T13:59:31.654693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-10T13:59:31.656056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-10T13:59:31.658423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-10T13:59:31.660078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-10T13:59:31.686416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-10-10T13:59:31.686528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-10T13:59:31.687909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-10T13:59:31.697225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-10T13:59:31.698674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-10T13:59:31.699252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-10T13:59:31.709395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 6247595 count 3 nextOffset 28 batches 12
2025-10-10T13:59:31.712833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-10T13:59:31.712867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-10T13:59:31.712884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-10T13:59:31.722409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:537: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,3 HeadOffset 21 endOffset 22 curOffset 28 d0000000000_00000000000000000025_00001_0000000003_00011| size 6247585 WTime 1760104771722
2025-10-10T13:59:31.732518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:31.733521Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:31.739114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.739167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.739758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-10-10T13:59:31.740305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-10-10T13:59:31.740855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-10-10T13:59:31.741417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-10-10T13:59:31.741704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-10-10T13:59:31.741730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-10-10T13:59:31.742747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.742771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.743549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.743648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.743668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.743713Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:31.743831Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988782
2025-10-10T13:59:31.743911Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 6247585
2025-10-10T13:59:31.743979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:31.744031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:31.744095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.744242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:31.744290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:31.744312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-10T13:59:31.744354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-10-10T13:59:31.744388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-10-10T13:59:31.744417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-10-10T13:59:31.744462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-10-10T13:59:31.744493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-10T13:59:31.744526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-10-10T13:59:31.744556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-10-10T13:59:31.744584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-10-10T13:59:31.744617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:31.744638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-10-10T13:59:31.745880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:31.745955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:31.745965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-10T13:59:31.746083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-10T13:59:31.746125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-10T13:59:31.746147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-10T13:59:31.746168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-10T13:59:31.746188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-10T13:59:31.749392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:31.765377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 2253230 count 1 nextOffset 33 batches 5
2025-10-10T13:59:31.765512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-10T13:59:31.765560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-10T13:59:31.765582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-10T13:59:31.765604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-10T13:59:31.765623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-10T13:59:31.773995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 4506428 count 2 nextOffset 34 batches 9
2025-10-10T13:59:31.774143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-10T13:59:31.774181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-10T13:59:31.774205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-10T13:59:31.774226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-10T13:59:31.774249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-10T13:59:31.782679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 6759626 count 3 nextOffset 35 batches 13
2025-10-10T13:59:31.782993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-10T13:59:31.783036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-10T13:59:31.783057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-10T13:59:31.783078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-10T13:59:31.843155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 36 partNo 3 result is x0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
2025-10-10T13:59:31.843241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-10T13:59:31.843305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000032_00000_0000000003_00015? new key d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638 WTime 1760104771841
2025-10-10T13:59:31.848391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 1 NewHead: Offset 35 PartNo 3 PackedSize 717145 count 1 nextOffset 36 batches 2
2025-10-10T13:59:31.848461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:31.849832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 35,1 HeadOffset 32 endOffset 32 curOffset 36 d0000000000_00000000000000000035_00003_0000000001_00001? size 717135 WTime 1760104771849
2025-10-10T13:59:31.850690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T13:59:31.850833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-10T13:59:31.851007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-10T13:59:31.851064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-10T13:59:31.851107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.851125Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:31.851236Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 0 count 3 size 8295638
2025-10-10T13:59:31.851321Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 3 count 1 size 717135
2025-10-10T13:59:31.851370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 8 size 524288 endOffset 32 max time lag 0ms effective offset 10
2025-10-10T13:59:31.851756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 2 blobs, size 7988760 count 4 last offset 10, current partition end offset: 32
2025-10-10T13:59:31.851774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-10T13:59:31.851939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 1 count 3 parts_count 15 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:31.851956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:31.851986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 12. Have to read 2 of 2 from KV
2025-10-10T13:59:31.855381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.855455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.855504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.853770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 1 count 3 parts_count 15
2025-10-10T13:59:31.853796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-10T13:59:31.870858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.881844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.885402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 653 queued_in_partition_duration_ms: 81 }
2025-10-10T13:59:31.885467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 31
2025-10-10T13:59:31.885503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:31.889705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:31.892294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:31.909103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-10-10T13:59:31.913976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-10-10T13:59:31.921748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 41 to 41
2025-10-10T13:59:31.920058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-10-10T13:59:31.920688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-10-10T13:59:31.920992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-10-10T13:59:31.921021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-10-10T13:59:31.925467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.925517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.925556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:31.925625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.925672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-10-10T13:59:31.928953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:31.949597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:31.949659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-10T13:59:31.951613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:31.960828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:31.966527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:31.975211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:31.976083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:31.976158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:31.979008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 631 queued_in_partition_duration_ms: 23 }
2025-10-10T13:59:31.981648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 32
2025-10-10T13:59:31.982075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:31.989320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-10-10T13:59:31.993794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-10-10T13:59:32.017930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-10-10T13:59:32.021730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-10-10T13:59:32.022011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-10-10T13:59:32.022047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-10-10T13:59:32.023802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:32.023831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:32.023891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:32.023956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.023999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-10-10T13:59:32.027284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:32.034885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:32.059851Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:32.067873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:32.067923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:32.068480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-10-10T13:59:32.069009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-10-10T13:59:32.078151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:32.082988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-10-10T13:59:32.083577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
2025-10-10T13:59:32.083828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-10-10T13:59:32.083853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-10-10T13:59:32.084953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.085014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:32.085035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:32.085060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:32.085114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.085174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-10T13:59:32.090852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:32.096923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 42 to 42
2025-10-10T13:59:32.111889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:32.111945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-10T13:59:32.112224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:32.114480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:32.114530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:32.115143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-10-10T13:59:32.119239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
2025-10-10T13:59:32.119806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-10-10T13:59:32.122644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:32.143322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-10-10T13:59:32.148918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:32.151753Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:32.149443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-10-10T13:59:32.149488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-10-10T13:59:32.150393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:32.150416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:32.150448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:32.150510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.150550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-10T13:59:32.153399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:32.169713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:32.169763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:32.174145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-10-10T13:59:32.173358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:32.177855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-10-10T13:59:32.179662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-10-10T13:59:32.180480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-10-10T13:59:32.180436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:32.180893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-10-10T13:59:32.180922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-10-10T13:59:32.182166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:32.182231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.182284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988782 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:32.182312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 6247585 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:32.182374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:32.182387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:458: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-10T13:59:32.183204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-10T13:59:32.183252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-10-10T13:59:32.183285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-10-10T13:59:32.183313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:32.183342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:32.183371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 11 suffix '124' size 6247585
2025-10-10T13:59:32.254181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.254223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:32.254428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:32.254454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:32.254505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 23 size 4506418 cause it's been evicted from L2. Actual L1 size: 8
2025-10-10T13:59:32.254520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 717135 cause it's been evicted from L2. Actual L1 size: 7
2025-10-10T13:59:32.254535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295638 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:32.254548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 2970333 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T13:59:32.254560Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:32.257061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.329253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-10T13:59:32.329319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-10T13:59:32.329331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:32.329342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:32.329385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:32.329410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:32.329547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-10-10T13:59:32.333408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:32.333444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-10T13:59:32.333476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-10T13:59:32.333498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:32.333522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-10T13:59:32.335247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:32.375683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-10T13:59:32.382840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-10T13:59:32.384207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:32.393332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:32.394587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:32.395187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-10T13:59:32.396280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:32.407630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:32.408756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:32.409865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:32.411353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-10T13:59:32.412534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:32.428356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:32.429522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:32.430125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-10T13:59:32.442551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-10T13:59:32.443005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 30 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:32.443024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 2253220 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T13:59:32.443035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 8295638 cause it's been evicted from L2. Actual L1 size: 4
2025-10-10T13:59:32.443050Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:32.480902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:32.482535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:32.483104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-10-10T13:59:32.483624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-10-10T13:59:32.484107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-10-10T13:59:32.484603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-10-10T13:59:32.484852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-10-10T13:59:32.484874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-10-10T13:59:32.492379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.492609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-10T13:59:32.492755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:32.492779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:32.492834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:32.492913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.496721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-10-10T13:59:32.496770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:32.496800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:32.523221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:32.523316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:32.523352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-10T13:59:32.523427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-10-10T13:59:32.523472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-10-10T13:59:32.523514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-10-10T13:59:32.523579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-10-10T13:59:32.523629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-10T13:59:32.523673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-10-10T13:59:32.523707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-10-10T13:59:32.523746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-10-10T13:59:32.523786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-10-10T13:59:32.523826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-10T13:59:32.523866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-10-10T13:59:32.523913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-10-10T13:59:32.523953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.523978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-10-10T13:59:32.523999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.524020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-10-10T13:59:32.524037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.524086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-10T13:59:32.524097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.524115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-10-10T13:59:32.524122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.524142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-10-10T13:59:32.524156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.524183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-10-10T13:59:32.524197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:32.524225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-10-10T13:59:32.557925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:32.558045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:32.558070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (30)
2025-10-10T13:59:32.558192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-10T13:59:32.558237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-10T13:59:32.558258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-10T13:59:32.558276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-10T13:59:32.558295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-10T13:59:32.646909Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 32 Result { Offset: 10 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 11 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760104767702 CreateTimestampMS: 1760104766085 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 12 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760104767817 CreateTimestampMS: 1760104766175 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 13 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760104768062 CreateTimestampMS: 1760104766878 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 14 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760104768096 CreateTimestampMS: 1760104766943 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 18446744073705455828 RealReadOffset: 13 WaitQuotaTimeMs: 0 EndOffset: 32 StartOffset: 0 } Cookie: 10 }
2025-10-10T13:59:32.689990Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 14 endOffset 32
2025-10-10T13:59:32.690062Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 32 ReadOffset 14 ReadGuid a8c5bc74-89c283a0-9ef51948-b6ea7e9 has messages 1
2025-10-10T13:59:32.691616Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 14, endOffset# 32, WTime# 1760104768096, sizeLag# 18446744073705455828
2025-10-10T13:59:32.691635Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1TEvPartitionReady. Aval parts: 0
2025-10-10T13:59:32.691691Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 read done: guid# a8c5bc74-89c283a0-9ef51948-b6ea7e9, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011864
2025-10-10T13:59:32.691722Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 response to read: guid# a8c5bc74-89c283a0-9ef51948-b6ea7e9
2025-10-10T13:59:32.727156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 2253230 count 1 nextOffset 37 batches 5
2025-10-10T13:59:32.727306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-10T13:59:32.727349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-10T13:59:32.727374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-10T13:59:32.727397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-10T13:59:32.727417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-10T13:59:32.741404Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 Process answer. Aval parts: 1
2025-10-10T13:59:32.774812Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got ReadResponse, serverBytesSize = 9011864, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487576
2025-10-10T13:59:32.777226Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-10)
2025-10-10T13:59:32.777329Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 9011864 to budget
2025-10-10T13:59:32.805081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4506428 count 2 nextOffset 38 batches 9
2025-10-10T13:59:32.805365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-10T13:59:32.805425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-10T13:59:32.805447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-10T13:59:32.805467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-10T13:59:32.805489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-10T13:59:32.826457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 6759626 count 3 nextOffset 39 batches 13
2025-10-10T13:59:32.826592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-10T13:59:32.826633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-10T13:59:32.826654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-10T13:59:32.826674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-10T13:59:32.887479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 40 partNo 3 result is x0000000000_00000000000000000036_00000_0000000003_00015? size 8295638
2025-10-10T13:59:32.887551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-10T13:59:32.887615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000036_00000_0000000003_00015? new key d0000000000_00000000000000000036_00000_0000000003_00015? size 8295638 WTime 1760104772887
2025-10-10T13:59:32.914125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 1 NewHead: Offset 39 PartNo 3 PackedSize 717145 count 1 nextOffset 40 batches 2
2025-10-10T13:59:32.914237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T13:59:32.914274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-10T13:59:32.914296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-10T13:59:32.914319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-10T13:59:32.914339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-10T13:59:32.928997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 39 PartNo 3 PackedSize 2970343 count 2 nextOffset 41 batches 6
2025-10-10T13:59:32.929290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T13:59:32.929335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-10T13:59:32.929357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-10T13:59:32.929381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-10T13:59:32.929402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-10T13:59:32.941215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 39 PartNo 3 PackedSize 5223541 count 3 nextOffset 42 batches 10
2025-10-10T13:59:32.941322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:32.942434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 39,3 HeadOffset 36 endOffset 36 curOffset 42 d0000000000_00000000000000000039_00003_0000000003_00009? size 5223531 WTime 1760104772941
2025-10-10T13:59:32.947934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:32.947969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:32.947984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:32.947997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:32.948009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:32.948126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7988782 cause it's been evicted from L2. Actual L1 size: 5
2025-10-10T13:59:32.948144Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:32.951060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-10-10T13:59:32.951166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-10T13:59:32.951225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-10T13:59:32.951284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-10T13:59:32.951330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:32.951370Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:32.951491Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 3 size 8295638
2025-10-10T13:59:32.951565Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 3 count 3 size 5223531
2025-10-10T13:59:32.951591Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000001_00004?(+) to d0000000000_00000000000000000022_00000_0000000001_00004?(+)
2025-10-10T13:59:32.951603Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000002_00008?(+) to d0000000000_00000000000000000023_00000_0000000002_00008?(+)
2025-10-10T13:59:32.951616Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000003_00015?(+) to d0000000000_00000000000000000025_00000_0000000003_00015?(+)
2025-10-10T13:59:32.951630Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000001_00001|(+) to d0000000000_00000000000000000021_00003_0000000001_00001|(+)
2025-10-10T13:59:32.951660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:32.951679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:32.951804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:32.951944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:32.952099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:32.952203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:32.952409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:32.952427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:32.952456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 32 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-10T13:59:32.000000Z
2025-10-10T13:59:32.952478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 35 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-10T13:59:32.000000Z
2025-10-10T13:59:32.952529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 4 from KV
2025-10-10T13:59:32.952640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63'
2025-10-10T13:59:32.952666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63'
2025-10-10T13:59:32.952685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:32.952697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:32.957250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:32.957340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:32.957378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:32.957444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:32.961384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 779 queued_in_partition_duration_ms: 568 }
2025-10-10T13:59:32.961443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 33
2025-10-10T13:59:32.961483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:32.967593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 43 to 43
2025-10-10T13:59:32.970041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:32.970114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-10T13:59:32.977905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:32.980840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 755 queued_in_partition_duration_ms: 560 }
2025-10-10T13:59:32.980906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 34
2025-10-10T13:59:32.980935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage got back to normal 20275218[B]
2025-10-10T13:59:32.982227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 746 queued_in_partition_duration_ms: 518 }
2025-10-10T13:59:32.982272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 35
2025-10-10T13:59:32.983499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 743 queued_in_partition_duration_ms: 35 }
2025-10-10T13:59:32.983542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: acknoledged message 36
2025-10-10T13:59:32.986389Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-10-10T13:59:32.986455Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-10T13:59:26.085000Z WriteTime: 2025-10-10T13:59:27.702000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40068", "logtype": "unknown", "server": "ipv6:[::1]:40068" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:32.989224Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-11)
2025-10-10T13:59:32.996895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:32.999913Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:33.002170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:33.002653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:33.002708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:33.002775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-10-10T13:59:33.003131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:33.015747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:33.015801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:33.020227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-10-10T13:59:33.020791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-10-10T13:59:33.021356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-10-10T13:59:33.021695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 44 to 44
2025-10-10T13:59:33.021948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-10-10T13:59:33.022228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-10-10T13:59:33.022256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-10-10T13:59:33.024031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:33.024108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:33.024825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:33.024880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-10T13:59:33.039861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 4 from KV. Status 1
2025-10-10T13:59:33.040352Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:33.043271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:33.047489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:33.047547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:33.047602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:33.047658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592397256600906:2384]
2025-10-10T13:59:33.047834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:33.047864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:33.047877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:33.048020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 11 suffix '124' size 6247585
2025-10-10T13:59:33.048065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:33.048098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:33.049590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:33.060661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-10T13:59:33.066051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 45 to 45
2025-10-10T13:59:33.068055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:33.068106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-10T13:59:33.082866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-10T13:59:33.091218Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (11-11)
2025-10-10T13:59:33.091297Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-10T13:59:33.095109Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (12-12)
2025-10-10T13:59:33.095176Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Returning serverBytesSize = 0 to budget
2025-10-10T13:59:33.115695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-10T13:59:26.175000Z WriteTime: 2025-10-10T13:59:27.817000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:40068", "server": "ipv6:[::1]:40068", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-10T13:59:33.148664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write 1 messages with Id from 46 to 46
2025-10-10T13:59:33.150530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: try to update token
2025-10-10T13:59:33.150583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-10T13:59:33.155200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-10T13:59:33.155714Z :NOTICE: [/Invalid] [/Invalid] [d87d70d6-8c696e16-ac98f2fa-d2228962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:62043" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:62043. " }
2025-10-10T13:59:33.380560Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::CreateFormedBlob(unsigned int, bool)+8175 (0x3DA673EF)
NKikimr::NPQ::TPartitionedBlob::Add(NKikimr::NPQ::TClientBlob&&)+3293 (0x3DA699AD)
NKikimr::NPQ::TPartition::ExecRequestForCompaction(NKikimr::NPQ::TWriteMsg&, NKikimr::NPQ::TPartition::TProcessParametersBase&, NKikimr::TEvKeyValue::TEvRequest*, TInstant)+7225 (0x3DD0F959)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+2371 (0x3DD1C513)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:33.394579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 6247585 cause it's been evicted from L2. Actual L1 size: 6
2025-10-10T13:59:33.394626Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-10T13:59:33.397117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:33.397182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:33.397883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_16497766247954288857_v1
2025-10-10T13:59:33.397938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:33.397964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:33.397978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:33.397995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:33.398010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:33.398024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:33.398058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:33.398089Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:33.399641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592407424450537:2507]
2025-10-10T13:59:33.405001Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_16497766247954288857_v1
2025-10-10T13:59:33.399821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:33.401465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:33.408966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0
2025-10-10T13:59:33.409581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0 is DEAD
2025-10-10T13:59:33.413658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:33.413743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session will restart in 0.009230s
2025-10-10T13:59:33.413989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: Do CDS request
2025-10-10T13:59:33.414051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:33.433516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:33.434948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:33.434980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-10T13:59:33.440804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:33.440939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:33.440953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:33.440963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:33.444964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-10T13:59:33.445089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:33.445099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:33.445108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:33.445145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592441784189389:2577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:33.447290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592441784189389:2577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:33.458271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592441784189389:2577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:33.465777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:33.467926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:33.467365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592441784189389:2577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:33.467404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592441784189389:2577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:33.467419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592441784189389:2577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:33.467457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:33.468889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:33.468917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:33.468961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:33.469226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:33.469388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592440206274552:2496]
2025-10-10T13:59:33.471462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:33.474374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:33.474610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:33.476039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:33.476399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:33.476407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:33.476411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:33.476417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:33.476422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:33.476428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:33.476434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000001_00001|
2025-10-10T13:59:33.476439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:33.476445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:33.476451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000022_00000_0000000001_00004?
2025-10-10T13:59:33.476457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000023_00000_0000000002_00008?
2025-10-10T13:59:33.476462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-10T13:59:33.476468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:33.476490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:33.476497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[14]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:33.476504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[15]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:33.476564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:33.476697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:33.476735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:33.476770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:33.476802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:33.476835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:33.476868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000001_00001|
2025-10-10T13:59:33.476905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:574: replace key d0000000000_00000000000000000021_00003_0000000001_00001| to d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:33.476939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:33.476973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:603: ignore key d0000000000_00000000000000000022_00000_0000000001_00004?
2025-10-10T13:59:33.477009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:603: ignore key d0000000000_00000000000000000023_00000_0000000002_00008?
2025-10-10T13:59:33.477046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:593: ignore key d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-10T13:59:33.477080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:33.477113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:33.477169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:33.477203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:33.477255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:33.477330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:33.477397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:33.477437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:33.477472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:33.478906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:33.478972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:33.479025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:33.479064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:33.479108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:33.479143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:33.479182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:33.479216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000001_00001|
2025-10-10T13:59:33.479261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000021_00003_0000000001_00001| will be deleted
2025-10-10T13:59:33.479278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:33.479319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:33.479350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000022_00000_0000000001_00004?
2025-10-10T13:59:33.479386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000022_00000_0000000001_00004? will be deleted
2025-10-10T13:59:33.479397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000023_00000_0000000002_00008?
2025-10-10T13:59:33.479432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000023_00000_0000000002_00008? will be deleted
2025-10-10T13:59:33.479443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00000_0000000003_00015?
2025-10-10T13:59:33.479478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:665: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000025_00000_0000000003_00015? will be deleted
2025-10-10T13:59:33.479487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:33.479527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:33.479561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:33.479615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:33.479645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:33.479681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:33.479711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:33.479750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:33.479780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:33.479819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:33.480208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:33.501333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592441784189431:2507]
2025-10-10T13:59:33.517066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:33.534876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:33.534936Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:33.534962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:33.534988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:33.535015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7559592440206274552:2496]
2025-10-10T13:59:33.535076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:33.535161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:33.535181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:33.535194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:33.535212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:33.535358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:33.535384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:33.535407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:33.537805Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:33.537844Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000003_00015?(+) to d0000000000_00000000000000000025_00000_0000000003_00015?(+)
2025-10-10T13:59:33.537858Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000002_00008?(+) to d0000000000_00000000000000000023_00000_0000000002_00008?(+)
2025-10-10T13:59:33.537867Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000001_00004?(+) to d0000000000_00000000000000000022_00000_0000000001_00004?(+)
2025-10-10T13:59:33.537876Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000001_00001|(+) to d0000000000_00000000000000000021_00003_0000000001_00001|(+)
2025-10-10T13:59:33.538040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:33.538049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:33.538060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:33.538085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:33.538103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:33.539365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-10-10T13:59:33.539461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7559592441784189431:2507]
2025-10-10T13:59:33.539536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-10-10T13:59:33.540390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:33.540420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:33.540537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:33.540681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:33.540872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:33.540973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:33.541016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592441784189361:2442], now have 1 active actors on pipe
2025-10-10T13:59:33.541042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592441784189431:2507], now have 1 active actors on pipe
2025-10-10T13:59:33.541060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592441784189423:2577], now have 1 active actors on pipe
2025-10-10T13:59:33.541149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:33.541172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:33.541285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:33.541297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:33.541307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:33.541319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:33.541357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:33.541455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:33.541492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:33.541526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:33.541673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:33.541689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:33.542295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:33.542319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:33.543015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:33.543035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:33.543046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:33.543054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:33.543078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:33.558747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:33.558797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:33.558824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:33.558848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:33.558860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:33.558898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:33.558949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:33.558988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T13:59:33.559024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:33.560133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:33.560163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:33.560219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:33.560555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 36 sessionId: src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0
2025-10-10T13:59:33.565807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e0d691-9a6edf1a-a74d6e20-b16f3458_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:33.639958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:33.639989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:33.640000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:33.644086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0] Write session: try to update token
2025-10-10T13:59:33.644156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:33.737156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:33.737188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:33.737202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:33.737211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:33.737220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:33.737252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:33.737276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:33.737297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:33.737315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:33.737427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:33.737452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:33.737480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:33.737498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:33.737506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:33.737525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:33.737535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:33.764365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:33.840377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:33.904569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:33.975126Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:34.007315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:34.007366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:34.007430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:34.007442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:34.007481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592440206274546:2496]
2025-10-10T13:59:34.007863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-10T13:59:34.007913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:34.009494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:34.013309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:34.013469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592441784189431:2507]
2025-10-10T13:59:34.013549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:34.053328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0
2025-10-10T13:59:34.053731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0 is DEAD
2025-10-10T13:59:34.057370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:34.057435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0] Write session will restart in 0.007305s
2025-10-10T13:59:34.057580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0] Write session: Do CDS request
2025-10-10T13:59:34.057612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:34.070493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:34.073160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:34.075938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:34.077032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:34.077049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:34.077095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:34.077365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:34.077601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592444501241946:2506]
2025-10-10T13:59:34.079839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:34.082399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:34.082598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:34.098397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:34.098960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:34.098966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:34.098972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:34.098977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:34.098982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:34.098986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:34.098990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:34.098995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:34.099000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:34.099004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:34.099009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:34.099013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:34.099053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:34.099131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:34.099164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:34.099193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:34.099224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:34.099254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:34.099285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:34.099335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:34.099368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:34.099397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:34.099428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:34.099458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:34.099494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:34.099548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:34.099600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:34.099642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:34.099675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:34.099715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:34.099746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:34.099785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:34.099820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:34.099863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:34.099897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:34.099938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:34.099971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:34.100011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:34.100045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:34.100094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:34.100137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:34.100173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:34.100201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:34.100234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:34.100264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:34.100301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:34.100330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:34.100377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:34.100704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:34.133646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592446079156785:2507]
2025-10-10T13:59:34.133731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:34.133748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-10T13:59:34.137799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:34.137940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:34.137954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:34.137964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:34.143156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-10T13:59:34.143264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:34.143273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:34.143281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:34.143297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592446079156789:2588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:34.151219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592446079156789:2588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:34.155258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:34.169444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592446079156789:2588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:34.180633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:34.180679Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:34.180696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:34.180714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:34.180745Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3 [2:7559592444501241946:2506]
2025-10-10T13:59:34.180799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:34.180854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:34.180866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:34.180876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:34.180886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:34.180942Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:34.180962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:34.180982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:34.183588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:34.183614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:34.183639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:34.183650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:34.183661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:34.184022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:34.184038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:34.184164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:34.184345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:34.184559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:34.184660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:34.184719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.184729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.184739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.184748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.184789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:34.184859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:34.185056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:34.185071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:34.185518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.185550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:34.185852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:34.185878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:34.185887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:34.185895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:34.185895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592446079156785:2507], now have 1 active actors on pipe
2025-10-10T13:59:34.185911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:34.186421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592446079156764:2442], now have 1 active actors on pipe
2025-10-10T13:59:34.189451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592446079156789:2588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:34.189489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592446079156789:2588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:34.189506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592446079156789:2588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:34.189533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:34.189985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3
2025-10-10T13:59:34.190802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3, pipe: [1:7559592446079156785:2507]
2025-10-10T13:59:34.195428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592446079156817:2588], now have 1 active actors on pipe
2025-10-10T13:59:34.195672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3
2025-10-10T13:59:34.195908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:34.195948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:34.196021Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:34.196060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:34.196082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:34.196093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:34.196128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:34.196174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:34.196225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:34.196704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:34.196728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:34.196789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:34.197183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 36 sessionId: src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0
2025-10-10T13:59:34.201941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fd1c88-1b49ef58-5f3fec16-4e665912_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:34.322964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0] Write session: try to update token
2025-10-10T13:59:34.323038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:34.344359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:34.344396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:34.344436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.344571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:34.344584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:34.344595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:34.344655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:34.353326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:34.401912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:34.425887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:34.455298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:34.456530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:34.458140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:34.458533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:34.458546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:34.458558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:34.458620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:34.645438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:34.645470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:34.645481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:34.689233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:34.704549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:34.704579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:34.704591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:34.704601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:34.704609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:34.704644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.704665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.704682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.704701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592444501241940:2506]
2025-10-10T13:59:34.704837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:34.704861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:34.704870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:34.705946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:34.708694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:34.708726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:34.708754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:34.708778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:34.727217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:34.968711Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:34.974500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:34.974549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:34.979092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:34.979128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:34.981412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:34.981650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592446079156785:2507]
2025-10-10T13:59:34.994151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:34.991398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: error at write: Disconnected sessionId: src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0
2025-10-10T13:59:34.991791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0 is DEAD
2025-10-10T13:59:34.996201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:34.996230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0] Write session will restart in 0.009320s
2025-10-10T13:59:34.996339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0] Write session: Do CDS request
2025-10-10T13:59:34.996373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:35.064479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:35.064510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-10T13:59:35.065525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:35.075939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:35.076084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:35.076102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:35.076112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:35.082479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-10T13:59:35.082611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:35.082621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:35.082630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:35.082647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592450374124185:2598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:35.085072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592450374124185:2598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:35.085801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592450374124188:2507]
2025-10-10T13:59:35.081307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:35.081865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:35.082565Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:35.082582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:35.082622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:35.082828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:35.082981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592448796209340:2517]
2025-10-10T13:59:35.084930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:35.087158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:35.087342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:35.088666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:35.088966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:35.088973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:35.088980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:35.088986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:35.088991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:35.088998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:35.089004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:35.089011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:35.089016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.089022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.089028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.089034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.089077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:35.089189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:35.089228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:35.089263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:35.089298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:35.089345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:35.089381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:35.089416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:35.089452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.089489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.089525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.089558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.089591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:35.089647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:35.089697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:35.089745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:35.089785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:35.089827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:35.089870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:35.089914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:35.089963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:35.089999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:35.090034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:35.090078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:35.090126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:35.090166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:35.090199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:35.090590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:35.090639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.090681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.090716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.090758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.090799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.090845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.090880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.090923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.091300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:35.106710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592450374124185:2598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:35.127785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592450374124185:2598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:35.127826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592450374124185:2598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:35.127844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592450374124185:2598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:35.127875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:35.158676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:35.173550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:35.173592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:35.173604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:35.173620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:35.173640Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 4 [2:7559592448796209340:2517]
2025-10-10T13:59:35.173688Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:35.173740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:35.173754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:35.173765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:35.173775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:35.173820Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:35.173839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:35.173861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:35.175926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.175938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.175948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.175957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.175966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:35.178366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:35.178390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.178506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.178666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.178839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.178933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:35.178984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592450374124188:2507], now have 1 active actors on pipe
2025-10-10T13:59:35.179004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592450374124218:2598], now have 1 active actors on pipe
2025-10-10T13:59:35.179022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592446079156869:2442], now have 1 active actors on pipe
2025-10-10T13:59:35.179067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:35.179091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:35.179183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592448796209334:2517]
2025-10-10T13:59:35.179196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592448796209334:2517]
2025-10-10T13:59:35.179208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592448796209334:2517]
2025-10-10T13:59:35.179218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592448796209334:2517]
2025-10-10T13:59:35.179254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:35.179350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:35.179383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:35.179399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:35.179408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:35.179443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:35.179490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:35.179541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:35.179697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:35.179713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:35.179838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:35.179887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592448796209334:2517]
2025-10-10T13:59:35.179903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:35.177629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 4, pipe: [1:7559592450374124188:2507]
2025-10-10T13:59:35.177727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 4
2025-10-10T13:59:35.177788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 4
2025-10-10T13:59:35.181643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:35.181664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:35.181675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:35.181684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:35.181706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:35.186028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:35.186066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:35.186160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:35.186615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 36 sessionId: src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0
2025-10-10T13:59:35.187865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edeb1c60-8f9e7a85-1f7e0927-58507d27_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:35.233323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0] Write session: try to update token
2025-10-10T13:59:35.233398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:35.324400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:35.324430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:35.324440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:35.324498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:35.324510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:35.324522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:35.324531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:35.324541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:35.324574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592448796209334:2517]
2025-10-10T13:59:35.324597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592448796209334:2517]
2025-10-10T13:59:35.324619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592448796209334:2517]
2025-10-10T13:59:35.324638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592448796209334:2517]
2025-10-10T13:59:35.324778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:35.324802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.324812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:35.325624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:35.325655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:35.325677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:35.325696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:35.341728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:35.453248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:35.504900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:35.534253Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:35.536574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:35.536607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:35.539855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592450374124188:2507]
2025-10-10T13:59:35.540017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:35.540046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:35.540490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:35.554781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: error at write: Disconnected sessionId: src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0
2025-10-10T13:59:35.563482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0 is DEAD
2025-10-10T13:59:35.591888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:35.591940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0] Write session will restart in 0.007075s
2025-10-10T13:59:35.592071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0] Write session: Do CDS request
2025-10-10T13:59:35.592107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:35.615986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:35.616024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-10T13:59:35.623496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:35.626322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:35.626484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:35.626502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:35.626513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:35.628456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-10T13:59:35.628568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:35.628577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:35.628585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:35.628601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592450374124265:2604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:35.632195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592450374124265:2604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:35.644671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:35.646834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592450374124281:2507]
2025-10-10T13:59:35.650687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:35.652504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:35.653315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:35.653332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:35.653377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:35.653625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:35.653777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592448796209421:2527]
2025-10-10T13:59:35.655954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:35.656927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592450374124265:2604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:35.658754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:35.658976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:35.660243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:35.660529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:35.660537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:35.660544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:35.660549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:35.660555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:35.660561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:35.660565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:35.660571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:35.660577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.660583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.660589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.660594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.660636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:35.660730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:35.660770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:35.660808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:35.660845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:35.660883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:35.660922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:35.660960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:35.661000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.661037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.661074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.661110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.661170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:35.661227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:35.661273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:35.661312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:35.661347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:35.661388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:35.661424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:35.661465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:35.661500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:35.661541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:35.661580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:35.661620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:35.661656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:35.661694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:35.661727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:35.661769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:35.661803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.661841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.661873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.661914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.661948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.661985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.662017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.662055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.662398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:35.685229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592450374124265:2604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:35.685278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592450374124265:2604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:35.685296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592450374124265:2604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:35.685326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:35.719007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:35.732879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:35.732932Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:35.732950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:35.732970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:35.732995Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 5 [2:7559592448796209421:2527]
2025-10-10T13:59:35.733049Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:35.733120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:35.733152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:35.733165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:35.733180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:35.733233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:35.733255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:35.733276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:35.734651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.734667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.734679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.734690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.734699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:35.734962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:35.734978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:35.735104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:35.735271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:35.735463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:35.735566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:35.735644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:35.735657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:35.735669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:35.735683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:35.735728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:35.735809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:35.735979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:35.735994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:35.736134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:35.736155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:35.737255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:35.737284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:35.737296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:35.737306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:35.737333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:35.740281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 5
2025-10-10T13:59:35.740382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 5
2025-10-10T13:59:35.740451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 5, pipe: [1:7559592450374124281:2507]
2025-10-10T13:59:35.738298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592450374124306:2604], now have 1 active actors on pipe
2025-10-10T13:59:35.738339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592450374124239:2442], now have 1 active actors on pipe
2025-10-10T13:59:35.738359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592450374124281:2507], now have 1 active actors on pipe
2025-10-10T13:59:35.740724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:35.740752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:35.740834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:35.740875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:35.740894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:35.740904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:35.740945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:35.740993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:35.741039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:35.744067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e33779-a85c5e0d-d0726e6a-bf9793c4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:35.742675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:35.742711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:35.742786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:35.743110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 36 sessionId: src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0
2025-10-10T13:59:35.779156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0] Write session: try to update token
2025-10-10T13:59:35.779230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:35.894852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:35.894888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:35.894899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:35.894958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:35.894971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:35.895006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:35.895123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:35.895433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:35.896897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:35.925702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:35.926885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:35.927963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:35.936767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:35.944946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:35.945486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:35.997446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:35.997475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:35.997485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:36.015263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:36.057549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:36.057592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:36.057636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:36.057648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:36.057658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:36.057665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:36.057673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:36.057722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:36.057744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:36.057763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:36.057782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592448796209414:2527]
2025-10-10T13:59:36.057943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:36.057965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:36.057976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:36.058948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:36.061724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:36.061759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:36.061783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:36.061805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:36.323436Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:36.330002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T13:59:36.331631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:36.376595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:36.376750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592450374124281:2507]
2025-10-10T13:59:36.376874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:36.376888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:36.377042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 6 reason: error at write: Disconnected sessionId: src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0
2025-10-10T13:59:36.389482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0 is DEAD
2025-10-10T13:59:36.394275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:36.394335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0] Write session will restart in 0.005457s
2025-10-10T13:59:36.394507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0] Write session: Do CDS request
2025-10-10T13:59:36.394551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:36.410848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:36.410715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:36.413239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:36.414105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:36.414158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:36.414205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:36.414734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:36.414987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592453091176793:2531]
2025-10-10T13:59:36.418610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:36.421115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:36.421174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-10T13:59:36.423006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:36.423141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:36.423158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:36.423168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:36.423981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:36.424276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:36.427733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:36.428164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:36.428174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:36.428180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:36.425205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-10T13:59:36.428186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:36.428192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:36.428198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:36.428204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:36.428210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:36.425318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:36.425328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:36.425338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:36.425353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592454669091657:2618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:36.428013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592454669091657:2618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:36.428216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:36.428222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:36.428229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:36.428235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:36.428278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:36.428373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:36.428426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:36.428493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:36.428567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:36.428655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:36.428726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:36.428794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:36.428851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:36.428903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:36.428961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:36.429013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:36.429056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:36.429193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:36.429258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:36.429319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:36.429370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:36.429429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:36.429481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:36.429531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:36.429584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:36.429636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:36.429676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:36.429738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:36.429792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:36.429842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:36.429883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:36.429931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:36.429975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:36.430022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:36.430065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:36.430110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:36.430170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:36.430242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:36.430329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:36.430418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:36.430904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:36.441955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592454669091657:2618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:36.462718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592454669091657:2618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:36.462756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592454669091657:2618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:36.462774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592454669091657:2618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:36.462804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:36.474095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592454669091689:2507]
2025-10-10T13:59:36.477355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:36.500908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:36.500941Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:36.500951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:36.500966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:36.500982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 6 [2:7559592453091176793:2531]
2025-10-10T13:59:36.501025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:36.501072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:36.501082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:36.501091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:36.501100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:36.501389Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:36.501419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:36.501441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:36.504580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:36.504605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:36.504621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:36.504639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:36.504652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:36.504933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:36.504951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:36.505107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:36.505354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:36.505578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:36.505784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:36.505873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592454669091687:2618], now have 1 active actors on pipe
2025-10-10T13:59:36.505900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592454669091689:2507], now have 1 active actors on pipe
2025-10-10T13:59:36.505924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592454669091634:2442], now have 1 active actors on pipe
2025-10-10T13:59:36.505954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.505970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.505991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.506005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.506041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:36.506118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:36.506296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:36.506315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:36.506439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.506459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:36.506612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:36.506620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:36.506626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:36.506633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:36.506647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:36.514386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:36.514430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:36.514510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:36.514059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 6
2025-10-10T13:59:36.514544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:36.514563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:36.514161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 6, pipe: [1:7559592454669091689:2507]
2025-10-10T13:59:36.514575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:36.514249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 6
2025-10-10T13:59:36.514616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:36.514664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:36.514717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:36.515564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:36.515591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:36.515656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:36.516454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 36 sessionId: src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0
2025-10-10T13:59:36.517741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba5eb94-29c5b63d-c1726d57-a49789a6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:36.543305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0] Write session: try to update token
2025-10-10T13:59:36.543375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:36.650870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:36.650906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:36.650918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:36.650973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:36.650986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:36.650998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:36.651007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:36.651017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:36.651049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.651072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.651096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.651116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.651355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:36.651378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:36.651388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:36.651977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:36.652016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:36.652043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:36.652076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:36.653663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:36.779775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:36.818724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:36.863793Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:36.911452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:36.911501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:36.911561Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:36.911573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:36.911611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592453091176788:2531]
2025-10-10T13:59:36.914484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592454669091689:2507]
2025-10-10T13:59:36.914546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:36.915379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:36.915404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:36.912835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:36.921874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:36.928248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 7 reason: error at write: Disconnected sessionId: src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0
2025-10-10T13:59:36.928620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0 is DEAD
2025-10-10T13:59:36.929908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:36.929982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0] Write session will restart in 0.006368s
2025-10-10T13:59:36.930100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0] Write session: Do CDS request
2025-10-10T13:59:36.930128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:36.942889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:36.942923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-10T13:59:36.945776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:36.961783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:36.961927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:36.961942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:36.961953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:36.966985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-10T13:59:36.967143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:36.967153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:36.967161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:36.967178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592454669091745:2627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:36.970391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592454669091745:2627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:36.999356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592454669091745:2627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:37.014644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592458964059062:2507]
2025-10-10T13:59:37.029857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592454669091745:2627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:37.029895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592454669091745:2627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:37.029912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592454669091745:2627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:37.029943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:37.063758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:37.073694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:37.074645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:37.074665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:37.074717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:37.075001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:37.075182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592457386144191:2543]
2025-10-10T13:59:37.081436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:37.085476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:37.085723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:37.086954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:37.087278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:37.087283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:37.087287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:37.087293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:37.087298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:37.087303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:37.087308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:37.087315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:37.087323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.087329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.087336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.087342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.087387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:37.087482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:37.087524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:37.087563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:37.087601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:37.087639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:37.087676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:37.087712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:37.087746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.087784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.087823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.087857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.087895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:37.087957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:37.088012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:37.088061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:37.088108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:37.088155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:37.088192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:37.088239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:37.088280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:37.088328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:37.088365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:37.088408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:37.088448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:37.088493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:37.088527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:37.088573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:37.088618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.088663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.088698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.088742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.088782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.088828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.088863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.088908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.093428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:37.169788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:37.186813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:37.186861Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:37.186877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:37.186895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:37.186919Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 7 [2:7559592457386144191:2543]
2025-10-10T13:59:37.186976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:37.187041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:37.187057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:37.187067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:37.187077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:37.187130Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:37.187150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:37.187174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:37.188472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.188488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.188501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.188513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.188527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:37.188808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:37.188827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.188969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.189159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.190330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 7, pipe: [1:7559592458964059062:2507]
2025-10-10T13:59:37.190449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 7
2025-10-10T13:59:37.190526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 7
2025-10-10T13:59:37.191900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.192034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:37.192123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592458964059062:2507], now have 1 active actors on pipe
2025-10-10T13:59:37.192148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592458964059068:2627], now have 1 active actors on pipe
2025-10-10T13:59:37.192165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592454669091728:2442], now have 1 active actors on pipe
2025-10-10T13:59:37.192191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.192204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.192216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.192227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.192268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:37.192347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:37.192509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:37.192526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:37.192654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.192674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:37.193326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:37.193338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:37.193348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:37.193358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:37.193381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:37.194106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:37.194131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:37.194240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75c7b53e-4650cdbb-466cc169-1df63207_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:37.194273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:37.194293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:37.194304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:37.194342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:37.194397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:37.194445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:37.201491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:37.201535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:37.201617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:37.202348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 36 sessionId: src_id|75c7b53e-4650cdbb-466cc169-1df63207_0
2025-10-10T13:59:37.203512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdbaa5-56a84d52-8d3aba42-b075d745_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75c7b53e-4650cdbb-466cc169-1df63207_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:37.241427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c7b53e-4650cdbb-466cc169-1df63207_0] Write session: try to update token
2025-10-10T13:59:37.241497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c7b53e-4650cdbb-466cc169-1df63207_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:37.263150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:37.263186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:37.263228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.263359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:37.263598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:37.266586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:37.270971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:37.274385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:37.323066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:37.325318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:37.325818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:37.325835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:37.325848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:37.325989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:37.362237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:37.362271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:37.362288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:37.362300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:37.362313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:37.362357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.362387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.362412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.362436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592457386144183:2543]
2025-10-10T13:59:37.362603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:37.362633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.362646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:37.363127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:37.363164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:37.363193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:37.363222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:37.389866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:37.457248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: src_id|75c7b53e-4650cdbb-466cc169-1df63207_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:37.485899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:37.554654Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:37.565641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:37.565686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:37.569463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:37.570311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592458964059062:2507]
2025-10-10T13:59:37.570458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:37.570485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:37.575837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:37.596074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 8 reason: error at write: Disconnected sessionId: src_id|75c7b53e-4650cdbb-466cc169-1df63207_0
2025-10-10T13:59:37.596342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: src_id|75c7b53e-4650cdbb-466cc169-1df63207_0 is DEAD
2025-10-10T13:59:37.613903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c7b53e-4650cdbb-466cc169-1df63207_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:37.613969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c7b53e-4650cdbb-466cc169-1df63207_0] Write session will restart in 0.006879s
2025-10-10T13:59:37.614076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c7b53e-4650cdbb-466cc169-1df63207_0] Write session: Do CDS request
2025-10-10T13:59:37.614111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c7b53e-4650cdbb-466cc169-1df63207_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:37.633506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:37.634263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75c7b53e-4650cdbb-466cc169-1df63207_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:37.635396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:37.636802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:37.636833Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:37.636882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:37.637236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:37.637445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592457386144272:2552]
2025-10-10T13:59:37.639857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:37.641139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:37.641384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:37.642631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:37.642948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:37.642956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:37.642963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:37.642971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:37.642976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:37.642982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:37.642987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:37.642994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:37.643002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.643010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.643017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.643023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.643069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:37.643175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:37.643221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:37.643265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:37.643309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:37.643350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:37.643391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:37.643433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:37.643473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.643531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.643570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.643605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.643644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:37.643707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:37.643760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:37.643802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:37.643841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:37.643885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:37.643923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:37.643964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:37.644004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:37.644051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:37.644087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:37.644129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:37.644164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:37.644203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:37.644237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:37.644283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:37.644324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.644375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.644417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.644468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.644511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.644560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.644596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.644642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.645043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:37.651148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:37.651180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-10T13:59:37.652038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:37.652170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:37.652185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:37.652195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:37.653703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-10T13:59:37.653823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:37.653840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:37.653850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:37.653868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592458964059147:2638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:37.656660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592458964059147:2638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:37.664230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592458964059147:2638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:37.669200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592458964059171:2507]
2025-10-10T13:59:37.677401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592458964059147:2638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:37.677439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592458964059147:2638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:37.677458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592458964059147:2638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:37.677487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:37.683452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:37.699204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:37.699252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:37.699272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:37.699293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:37.699318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 8 [2:7559592457386144272:2552]
2025-10-10T13:59:37.699376Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:37.699438Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:37.699453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:37.699466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:37.699477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:37.699526Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:37.699548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:37.699570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:37.702353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.702381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.702397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.702410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.702423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:37.702701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:37.702720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.702875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:37.703067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:37.703303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:37.703428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:37.703499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592457386144267:2552]
2025-10-10T13:59:37.703515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592457386144267:2552]
2025-10-10T13:59:37.703528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592457386144267:2552]
2025-10-10T13:59:37.703543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592457386144267:2552]
2025-10-10T13:59:37.703585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:37.703669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:37.703868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:37.703885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:37.704006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592457386144267:2552]
2025-10-10T13:59:37.704027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:37.704832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:37.704853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:37.704866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:37.704879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:37.704903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:37.705649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592458964059171:2507], now have 1 active actors on pipe
2025-10-10T13:59:37.705684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592458964059176:2638], now have 1 active actors on pipe
2025-10-10T13:59:37.705710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592458964059114:2442], now have 1 active actors on pipe
2025-10-10T13:59:37.706626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 8, pipe: [1:7559592458964059171:2507]
2025-10-10T13:59:37.706747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 8
2025-10-10T13:59:37.706836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 8
2025-10-10T13:59:37.707249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:37.707281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:37.707363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:37.707397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:37.707415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:37.707427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:37.707462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:37.707506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:37.707552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:37.708451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:37.708477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:37.708540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:37.709471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 36 sessionId: src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0
2025-10-10T13:59:37.710391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75c7b53e-4650cdbb-466cc169-1df63207_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:37.751028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0] Write session: try to update token
2025-10-10T13:59:37.751083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:37.794270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:37.794300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:37.794313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:37.794322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:37.794333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:37.794368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592457386144267:2552]
2025-10-10T13:59:37.794397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592457386144267:2552]
2025-10-10T13:59:37.794423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592457386144267:2552]
2025-10-10T13:59:37.794446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592457386144267:2552]
2025-10-10T13:59:37.794602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:37.794629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:37.794641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:37.795617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:37.795648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:37.795678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:37.795706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:37.799555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:37.867647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:37.891714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:38.011551Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:38.024080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:38.024132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:38.027714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:38.032026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:38.032286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592458964059171:2507]
2025-10-10T13:59:38.032440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:38.053652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 9 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0
2025-10-10T13:59:38.054010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0 is DEAD
2025-10-10T13:59:38.057364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:38.057428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0] Write session will restart in 0.009824s
2025-10-10T13:59:38.057536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0] Write session: Do CDS request
2025-10-10T13:59:38.057573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:38.073070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:38.078999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:38.079034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-10T13:59:38.079495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:38.079620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:38.079637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:38.079646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:38.083176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-10T13:59:38.083293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:38.083302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:38.083311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:38.083327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592463259026523:2647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:38.086544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592463259026523:2647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:38.093908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592463259026523:2647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:38.100480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:38.109225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592463259026523:2647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:38.109267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592463259026523:2647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:38.109285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592463259026523:2647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:38.109319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:38.110152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:38.110979Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:38.111003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:38.111047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:38.111307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:38.111471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592461681111653:2555]
2025-10-10T13:59:38.114145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:38.115392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:38.115614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:38.116932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:38.117274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:38.117281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:38.117288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:38.117297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:38.117302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:38.117308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:38.117315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:38.117322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:38.117330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.117336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.117343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.117350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.117401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:38.117509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:38.117560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:38.117605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:38.117651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:38.117700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:38.117749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:38.117796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:38.117842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.117891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.117938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.117986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.118029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:38.118100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:38.118771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:38.118846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:38.118906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:38.118962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:38.119008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:38.119066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:38.119117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:38.119171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:38.119215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:38.119267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:38.119315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:38.119372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:38.119419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:38.119469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:38.119517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.119570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.119613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.119666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.119706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.119761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.119803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.119858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.120333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:38.137252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592463259026568:2507]
2025-10-10T13:59:38.156366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:38.177755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:38.177804Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:38.177819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:38.177839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:38.177862Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 9 [2:7559592461681111653:2555]
2025-10-10T13:59:38.177921Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:38.177978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:38.178001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:38.178013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:38.178025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:38.178069Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:38.178096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:38.178122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:38.179351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.179378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.179392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.179407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.179419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:38.179682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:38.179699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.179853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.180025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.180223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.180333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:38.180405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592461681111646:2555]
2025-10-10T13:59:38.180419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592461681111646:2555]
2025-10-10T13:59:38.180433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592461681111646:2555]
2025-10-10T13:59:38.180444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592461681111646:2555]
2025-10-10T13:59:38.180775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:38.180787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:38.180798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:38.180810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:38.183182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 9
2025-10-10T13:59:38.183270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 9, pipe: [1:7559592463259026568:2507]
2025-10-10T13:59:38.183339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 9
2025-10-10T13:59:38.193207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:38.193345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:38.193537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:38.193564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:38.193615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592463259026500:2442], now have 1 active actors on pipe
2025-10-10T13:59:38.193639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592463259026568:2507], now have 1 active actors on pipe
2025-10-10T13:59:38.193661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592463259026562:2647], now have 1 active actors on pipe
2025-10-10T13:59:38.193716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:38.193737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:38.193881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592461681111646:2555]
2025-10-10T13:59:38.193917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:38.193983Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:38.194012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:38.194028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:38.194039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:38.194070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:38.194109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:38.194249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:38.194492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:38.196140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:38.196173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:38.196237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:38.196525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0
2025-10-10T13:59:38.197342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3013f4bd-a7475356-cafe87b4-f84e14c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:38.264121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0] Write session: try to update token
2025-10-10T13:59:38.264180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:38.278143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:38.278185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:38.278197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:38.373483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:38.373516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:38.373531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:38.373543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:38.373553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:38.373588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592461681111646:2555]
2025-10-10T13:59:38.373616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592461681111646:2555]
2025-10-10T13:59:38.373638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592461681111646:2555]
2025-10-10T13:59:38.373659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592461681111646:2555]
2025-10-10T13:59:38.373797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:38.373825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.373837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:38.374872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:38.377447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:38.377482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:38.377514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:38.377563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:38.504720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:38.524275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:38.618940Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:38.621606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:38.621653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:38.629526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:38.629692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592463259026568:2507]
2025-10-10T13:59:38.629767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:38.629778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:38.650537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:38.663818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:38.663884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0] Write session will restart in 0.007287s
2025-10-10T13:59:38.664074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0] Write session: Do CDS request
2025-10-10T13:59:38.664129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:38.662734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 10 reason: error at write: Disconnected sessionId: src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0
2025-10-10T13:59:38.663046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0 is DEAD
2025-10-10T13:59:38.678689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:38.681002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:38.681032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 11
2025-10-10T13:59:38.689434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:38.689574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 11 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:38.689591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=11 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:38.689602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:38.691213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 11 sessionId:  describe result for acl check
2025-10-10T13:59:38.691335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:38.691346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:38.691356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:38.691376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592463259026604:2652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:38.706572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592463259026604:2652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:38.726698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:38.730408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592463259026635:2507]
2025-10-10T13:59:38.730026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:38.732160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592463259026604:2652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:38.730829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:38.730846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:38.730886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:38.731134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:38.731303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592461681111733:2566]
2025-10-10T13:59:38.739189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:38.754380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592463259026604:2652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:38.754424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592463259026604:2652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:38.754443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592463259026604:2652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:38.754475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 11 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:38.752717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:38.752986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:38.754248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:38.754565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:38.754572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:38.754579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:38.754585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:38.754591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:38.754597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:38.754604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:38.754610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:38.754616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.754621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.754627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.754633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.754677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:38.754773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:38.754814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:38.754851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:38.754888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:38.754925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:38.754959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:38.754993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:38.755027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.755061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.755095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.755132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.755168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:38.755226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:38.755278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:38.755326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:38.755369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:38.755413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:38.755453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:38.756309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:38.756377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:38.756433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:38.756472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:38.756521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:38.756570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:38.756619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:38.756660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:38.756706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:38.756749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.756796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.756837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.756888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.756928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.756976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.757014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.757060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.757486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:38.800109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:38.833488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:38.833536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:38.833554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:38.833574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:38.833599Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 10 [2:7559592461681111733:2566]
2025-10-10T13:59:38.833654Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:38.833716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:38.833733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:38.833748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:38.833758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:38.833810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:38.833835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:38.833858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:38.835685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.835710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.835721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.835733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.835744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:38.837210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 10, pipe: [1:7559592463259026635:2507]
2025-10-10T13:59:38.837301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 10
2025-10-10T13:59:38.837300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 10
2025-10-10T13:59:38.836588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:38.836612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:38.836736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:38.836886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:38.837069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:38.841276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2b029d-3051c9b4-5cae1825-726b558e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:38.837183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:38.837266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592463259026635:2507], now have 1 active actors on pipe
2025-10-10T13:59:38.837286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592463259026589:2442], now have 1 active actors on pipe
2025-10-10T13:59:38.837301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592463259026649:2652], now have 1 active actors on pipe
2025-10-10T13:59:38.837322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592461681111727:2566]
2025-10-10T13:59:38.840335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 11 partition: 0 MaxSeqNo: 36 sessionId: src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0
2025-10-10T13:59:38.837333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592461681111727:2566]
2025-10-10T13:59:38.837344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592461681111727:2566]
2025-10-10T13:59:38.837354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592461681111727:2566]
2025-10-10T13:59:38.837393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:38.837471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:38.837509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:38.837525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:38.837538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:38.837552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:38.837649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:38.837666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:38.837865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:38.837883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:38.837917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592461681111727:2566]
2025-10-10T13:59:38.837949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:38.838070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:38.838102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:38.838119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:38.838128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:38.838169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:38.838225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:38.838310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:38.838423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:38.839929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:38.839948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:38.840022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:38.924237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0] Write session: try to update token
2025-10-10T13:59:38.924301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:38.941456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:38.941482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:38.941497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:39.080151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:39.080184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:39.080196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:39.080250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:39.080264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:39.080275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:39.080283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:39.080294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:39.080331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592461681111727:2566]
2025-10-10T13:59:39.080355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592461681111727:2566]
2025-10-10T13:59:39.080375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592461681111727:2566]
2025-10-10T13:59:39.080394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592461681111727:2566]
2025-10-10T13:59:39.080548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:39.080581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:39.080592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:39.081267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:39.081307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:39.081336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:39.081366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:39.127305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:39.158508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId: src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:39.194363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:39.366625Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:39.380355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:39.380412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:39.385263Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:39.385431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592463259026635:2507]
2025-10-10T13:59:39.385532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:39.385702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:39.385717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:39.465926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:39.481782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:39.482824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:39.482842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:39.482889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:39.483176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:39.483365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592465976079126:2576]
2025-10-10T13:59:39.486197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 11 reason: error at write: Disconnected sessionId: src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0
2025-10-10T13:59:39.486083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:39.487502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:39.487603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0] Write session will restart in 0.009491s
2025-10-10T13:59:39.487803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0] Write session: Do CDS request
2025-10-10T13:59:39.487858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:39.486520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 11 sessionId: src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0 is DEAD
2025-10-10T13:59:39.493469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:39.493744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:39.495103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:39.495553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:39.495575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:39.495592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:39.495606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:39.495624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:39.495641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:39.495660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:39.495676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:39.495690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:39.495708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:39.495722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:39.495742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:39.495841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:39.496045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:39.496154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:39.496247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:39.496338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:39.496423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:39.496514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:39.496610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:39.496703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:39.496811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:39.496915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:39.497018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:39.497112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:39.500491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592467553994018:2507]
2025-10-10T13:59:39.498719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:39.498854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:39.498957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:39.499055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:39.499154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:39.499263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:39.499375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:39.499492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:39.499609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:39.499716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:39.499847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:39.499956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:39.500079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:39.500183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:39.500250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:39.500301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:39.500353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:39.500396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:39.500450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:39.500494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:39.500544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:39.500587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:39.500638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:39.501034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:39.507323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:39.513256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:39.513292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 12
2025-10-10T13:59:39.513722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:39.513831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 12 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:39.513844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=12 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:39.513855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:39.515154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 12 sessionId:  describe result for acl check
2025-10-10T13:59:39.515255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:39.515265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:39.515274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:39.515291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592467553994024:2665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:39.517675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592467553994024:2665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:39.557046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592467553994024:2665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:39.578317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592467553994024:2665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:39.578361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592467553994024:2665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:39.578377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592467553994024:2665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:39.578405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 12 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:39.582231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:39.604499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:39.604541Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:39.604558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:39.604578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:39.604601Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 11 [2:7559592465976079126:2576]
2025-10-10T13:59:39.604654Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:39.604711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:39.604726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:39.604739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:39.604750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:39.604795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:39.604816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:39.604837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:39.606152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:39.606167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:39.606179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:39.606204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:39.606214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:39.606496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:39.606513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:39.606633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:39.606800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:39.607003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:39.607104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:39.607172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:39.607188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:39.607202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:39.607214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:39.607256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:39.607327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:39.607484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:39.607502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:39.607626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:39.607644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:39.610415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 11, pipe: [1:7559592467553994018:2507]
2025-10-10T13:59:39.610513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 11
2025-10-10T13:59:39.610577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 11
2025-10-10T13:59:39.608579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:39.608599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:39.608610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:39.608619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:39.608640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:39.613469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592467553994018:2507], now have 1 active actors on pipe
2025-10-10T13:59:39.613520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592467553994058:2665], now have 1 active actors on pipe
2025-10-10T13:59:39.613550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592467553993986:2442], now have 1 active actors on pipe
2025-10-10T13:59:39.613624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:39.613650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:39.613742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:39.613777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:39.613793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:39.613805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:39.613845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:39.613890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:39.613936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:39.621295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:39.621343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:39.621419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:39.624978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 12 partition: 0 MaxSeqNo: 36 sessionId: src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0
2025-10-10T13:59:39.625982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9884d90c-ef2d6604-e528909b-893cd4e3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:39.695563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0] Write session: try to update token
2025-10-10T13:59:39.695615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:39.705332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:39.705364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:39.705376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:39.781314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:39.781345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:39.781359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:39.781368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:39.781378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:39.781411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:39.781436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:39.781457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:39.781475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:39.781562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:39.781594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:39.781631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:39.781659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:39.781664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:39.781687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:39.781696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:39.782734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:39.931898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId: src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:39.954985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:40.119954Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:40.147240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592467553994018:2507]
2025-10-10T13:59:40.147342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:40.147353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:40.149373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:40.144073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:40.144129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:40.144190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:40.144203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:40.144241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592465976079120:2576]
2025-10-10T13:59:40.145629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:40.164946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:40.250094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592471848961422:2507]
2025-10-10T13:59:40.254334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:40.257623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:40.258493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:40.258509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:40.258553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:40.258823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:40.258988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592470271046528:2588]
2025-10-10T13:59:40.260958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:40.262496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:40.262735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:40.265195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:40.269176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 12 reason: error at write: Disconnected sessionId: src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0
2025-10-10T13:59:40.269559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 12 sessionId: src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0 is DEAD
2025-10-10T13:59:40.272171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:40.272216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0] Write session will restart in 0.008071s
2025-10-10T13:59:40.272319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0] Write session: Do CDS request
2025-10-10T13:59:40.272356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:40.265596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:40.265614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:40.265619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:40.265624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:40.265629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:40.265634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:40.265639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:40.265644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:40.265649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.265654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.265660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.265666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.265707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:40.265804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:40.265843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:40.265883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:40.265922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:40.265962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:40.266009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:40.266051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:40.266088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.266129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.266169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.266225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.266262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:40.266324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:40.266411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:40.266514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:40.266598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:40.266684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:40.266761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:40.266849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:40.266929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:40.267014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:40.267085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:40.267177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:40.267246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:40.267333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:40.267408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:40.267498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:40.267586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.267676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.267758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.267848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.267928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.268015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.268089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.268179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.268896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:40.284020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:40.284052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 13
2025-10-10T13:59:40.284904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:40.285470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:40.285585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 13 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:40.285599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=13 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:40.285607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:40.290236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 13 sessionId:  describe result for acl check
2025-10-10T13:59:40.290352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:40.290362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:40.290370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:40.290386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592471848961430:2674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:40.305872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592471848961430:2674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:40.346550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592471848961430:2674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:40.358756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:40.386662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592471848961430:2674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:40.386704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592471848961430:2674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:40.386719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592471848961430:2674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:40.386748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 13 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:40.392021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:40.392307Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:40.392328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:40.392344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:40.392366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 12 [2:7559592470271046528:2588]
2025-10-10T13:59:40.392416Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:40.392472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:40.392487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.392497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.392506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.392550Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:40.392570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:40.392591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:40.394756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.394771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.394783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.394797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.394807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:40.396692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 12
2025-10-10T13:59:40.396782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 12, pipe: [1:7559592471848961422:2507]
2025-10-10T13:59:40.397288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:40.397314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.397444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.397610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.397788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.397883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:40.397964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592471848961396:2442], now have 1 active actors on pipe
2025-10-10T13:59:40.397999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592471848961422:2507], now have 1 active actors on pipe
2025-10-10T13:59:40.398019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592471848961459:2674], now have 1 active actors on pipe
2025-10-10T13:59:40.398079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:40.398100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:40.398134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592470271046522:2588]
2025-10-10T13:59:40.398148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592470271046522:2588]
2025-10-10T13:59:40.398160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592470271046522:2588]
2025-10-10T13:59:40.398171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592470271046522:2588]
2025-10-10T13:59:40.398223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:40.398294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:40.398447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:40.398463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:40.398522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:40.398552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.398570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.398579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:40.398615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.398655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:40.398782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592470271046522:2588]
2025-10-10T13:59:40.398801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:40.398852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:40.396849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 12
2025-10-10T13:59:40.399781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:40.399805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:40.399817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:40.399828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:40.399852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:40.405545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:40.405581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:40.405660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:40.406018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 13 partition: 0 MaxSeqNo: 36 sessionId: src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0
2025-10-10T13:59:40.406986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ec5fec-9d2336c7-41bf98cd-611360ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:40.443246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0] Write session: try to update token
2025-10-10T13:59:40.443301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:40.492463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.492496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.492509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.648765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:40.648801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:40.648814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:40.648822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:40.648839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:40.648876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592470271046522:2588]
2025-10-10T13:59:40.648898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592470271046522:2588]
2025-10-10T13:59:40.648915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592470271046522:2588]
2025-10-10T13:59:40.648931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592470271046522:2588]
2025-10-10T13:59:40.649084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.649095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.649104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.649159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:40.649184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.649195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:40.649793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:40.649822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:40.649850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:40.649879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:40.650165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:40.684968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId: src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:40.758900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:40.852001Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:40.855992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:40.856047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:40.860826Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:40.861031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592471848961422:2507]
2025-10-10T13:59:40.861155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:40.861166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:40.883187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 13 reason: error at write: Disconnected sessionId: src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0
2025-10-10T13:59:40.883536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 13 sessionId: src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0 is DEAD
2025-10-10T13:59:40.888242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:40.888288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0] Write session will restart in 0.005771s
2025-10-10T13:59:40.888404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0] Write session: Do CDS request
2025-10-10T13:59:40.888436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:40.923351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:40.924031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:40.924113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:40.924126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 14
2025-10-10T13:59:40.929577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:40.929726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 14 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:40.929741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=14 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:40.929751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:40.932769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 14 sessionId:  describe result for acl check
2025-10-10T13:59:40.932899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:40.932909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:40.932919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:40.932934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592471848961524:2688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:40.935484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592471848961524:2688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:40.950756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592471848961524:2688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:40.953239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:40.956271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:40.957015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:40.957031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:40.957070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:40.957334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:40.957505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592470271046615:2597]
2025-10-10T13:59:40.959532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:40.959628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592471848961549:2507]
2025-10-10T13:59:40.960810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:40.961006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:40.962133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:40.962428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:40.962434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:40.962440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:40.962446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:40.962453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:40.962459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:40.962465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:40.962470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:40.962477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.962483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.962489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.962494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.962533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:40.962622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:40.962662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:40.962698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:40.962734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:40.962770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:40.962805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:40.962841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:40.962876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.962916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.962954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.962995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.963026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:40.963077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:40.963129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:40.963174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:40.963213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:40.963258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:40.963295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:40.963341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:40.963380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:40.963447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:40.963486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:40.963529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:40.963567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:40.963611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:40.963649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:40.963693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:40.963730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.963775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:40.963814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.963859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:40.963899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.963944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:40.963981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.964027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:40.964395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:40.972428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592471848961524:2688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:40.972469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592471848961524:2688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:40.972485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592471848961524:2688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:40.972515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 14 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:41.001493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:41.018567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:41.018606Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:41.018621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:41.018637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:41.022816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 13
2025-10-10T13:59:41.022895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 13, pipe: [1:7559592471848961549:2507]
2025-10-10T13:59:41.022963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 13
2025-10-10T13:59:41.018658Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 13 [2:7559592470271046615:2597]
2025-10-10T13:59:41.018705Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:41.018758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:41.018772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.018781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.018790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.018833Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:41.018856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:41.018875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:41.021118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.021149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:41.021160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:41.021173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:41.021183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:41.021427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:41.021441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.021564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:41.021738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:41.021971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:41.022068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:41.022152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592471848961512:2442], now have 1 active actors on pipe
2025-10-10T13:59:41.022173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592471848961549:2507], now have 1 active actors on pipe
2025-10-10T13:59:41.022189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592471848961559:2688], now have 1 active actors on pipe
2025-10-10T13:59:41.022211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.022239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.022250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.022261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.022299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:41.022369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:41.022517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:41.022533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:41.022713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.022730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:41.023129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:41.023141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:41.023151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:41.023160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:41.023184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:41.040737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.040783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.040868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f850b0e0-63d347a6-eca33794-42650d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:41.040902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.040921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.040932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:41.040970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.041015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:41.041089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:41.048756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.048803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.048881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:41.057670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 14 partition: 0 MaxSeqNo: 36 sessionId: src_id|f850b0e0-63d347a6-eca33794-42650d9_0
2025-10-10T13:59:41.061375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a50186f-fc52ab28-c1e92901-87ce066d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f850b0e0-63d347a6-eca33794-42650d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:41.112171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f850b0e0-63d347a6-eca33794-42650d9_0] Write session: try to update token
2025-10-10T13:59:41.112223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f850b0e0-63d347a6-eca33794-42650d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:41.121233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.121267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.121277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.180521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:41.180553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:41.180565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:41.180579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:41.180590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:41.180628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.180653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.180670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.180690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.181942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:41.181977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:41.182007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:41.182034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:41.200782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:41.211003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.211034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:41.216181Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:41.292825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId: src_id|f850b0e0-63d347a6-eca33794-42650d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:41.339328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:41.395231Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:41.399329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:41.399357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:41.399405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592470271046609:2597]
2025-10-10T13:59:41.399561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.399586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.399869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:41.400929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:41.403006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:41.403348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592471848961549:2507]
2025-10-10T13:59:41.404847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:41.458777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:41.460885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:41.461661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:41.461688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:41.461731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:41.462115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:41.462310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592474566013999:2603]
2025-10-10T13:59:41.465544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:41.465883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 14 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f850b0e0-63d347a6-eca33794-42650d9_0
2025-10-10T13:59:41.466174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 14 sessionId: src_id|f850b0e0-63d347a6-eca33794-42650d9_0 is DEAD
2025-10-10T13:59:41.469762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850b0e0-63d347a6-eca33794-42650d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:41.469823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850b0e0-63d347a6-eca33794-42650d9_0] Write session will restart in 0.008230s
2025-10-10T13:59:41.470033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850b0e0-63d347a6-eca33794-42650d9_0] Write session: Do CDS request
2025-10-10T13:59:41.470084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850b0e0-63d347a6-eca33794-42650d9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:41.467401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:41.467937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:41.470322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:41.470959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:41.470972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:41.470986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:41.471002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:41.471015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:41.471030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:41.471048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:41.471062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:41.471074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.471088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:41.471097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:41.471112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:41.471212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:41.471435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:41.471547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:41.471652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:41.471738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:41.471846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:41.480419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:41.480498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:41.480541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.480587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:41.480630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:41.480672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:41.480729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:41.480794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:41.480850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:41.480896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:41.480938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:41.480986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:41.481030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:41.481077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:41.481121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:41.481195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:41.481236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:41.481284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:41.481323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:41.481371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:41.481409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:41.481470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:41.481514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.481557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.481596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:41.481641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:41.481681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:41.481731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:41.481771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:41.481820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:41.482220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:41.494334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f850b0e0-63d347a6-eca33794-42650d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:41.495836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:41.495877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 15
2025-10-10T13:59:41.496516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:41.496674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 15 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:41.496690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=15 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:41.496700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:41.498166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 15 sessionId:  describe result for acl check
2025-10-10T13:59:41.498298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:41.498309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:41.498317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:41.498333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592476143928930:2696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:41.501484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592476143928930:2696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:41.503407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592476143928938:2507]
2025-10-10T13:59:41.512356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592476143928930:2696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:41.513112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:41.533138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:41.533183Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:41.533201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:41.533219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:41.533243Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 14 [2:7559592474566013999:2603]
2025-10-10T13:59:41.533297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:41.533356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:41.533370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.533382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.533393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.533441Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:41.533461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:41.533482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:41.535062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.535087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:41.535098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:41.535113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:41.535124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:41.535377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:41.535394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.535523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:41.535681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:41.535896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:41.536003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:41.536076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.536090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.536102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.536114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.536157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:41.536232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:41.536413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:41.536431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:41.536596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.536617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:41.537902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 14, pipe: [1:7559592476143928938:2507]
2025-10-10T13:59:41.537076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:41.537094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:41.537106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:41.537115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:41.537151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:41.538682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592476143928938:2507], now have 1 active actors on pipe
2025-10-10T13:59:41.538714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592476143928894:2442], now have 1 active actors on pipe
2025-10-10T13:59:41.538017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 14
2025-10-10T13:59:41.540700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592476143928930:2696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:41.540729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592476143928930:2696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:41.540746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592476143928930:2696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:41.540775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 15 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:41.552593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592476143928965:2696], now have 1 active actors on pipe
2025-10-10T13:59:41.552708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 14
2025-10-10T13:59:41.553063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.553095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.553187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dce8703b-701e63b-d799507-fd37c120_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:41.553223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.553249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.553260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:41.553299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.553347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:41.553394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:41.554358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.554384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.554445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:41.554809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 15 partition: 0 MaxSeqNo: 36 sessionId: src_id|dce8703b-701e63b-d799507-fd37c120_0
2025-10-10T13:59:41.555796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f850b0e0-63d347a6-eca33794-42650d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dce8703b-701e63b-d799507-fd37c120_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:41.608216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce8703b-701e63b-d799507-fd37c120_0] Write session: try to update token
2025-10-10T13:59:41.608278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce8703b-701e63b-d799507-fd37c120_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:41.688273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.688303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.688316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.688373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:41.688388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:41.688402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:41.688412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:41.688422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:41.688459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.688484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.688503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.688521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.688675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:41.688706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:41.688708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:41.688728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:41.688733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:41.688744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:41.688754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:41.690191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:41.777456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId: src_id|dce8703b-701e63b-d799507-fd37c120_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:41.800461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:41.884408Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:41.906586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.906641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.906706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:41.906719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:41.906762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592474566013994:2603]
2025-10-10T13:59:41.907589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:41.907997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:41.911722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:41.913734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592476143928938:2507]
2025-10-10T13:59:41.913888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:41.940731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 15 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dce8703b-701e63b-d799507-fd37c120_0
2025-10-10T13:59:41.941679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce8703b-701e63b-d799507-fd37c120_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:41.941718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce8703b-701e63b-d799507-fd37c120_0] Write session will restart in 0.006558s
2025-10-10T13:59:41.941820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce8703b-701e63b-d799507-fd37c120_0] Write session: Do CDS request
2025-10-10T13:59:41.941848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce8703b-701e63b-d799507-fd37c120_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:41.941081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 15 sessionId: src_id|dce8703b-701e63b-d799507-fd37c120_0 is DEAD
2025-10-10T13:59:41.954162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dce8703b-701e63b-d799507-fd37c120_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:41.957722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:41.957752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 16
2025-10-10T13:59:41.959874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:41.960021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 16 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:41.960037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=16 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:41.960048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:41.961698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 16 sessionId:  describe result for acl check
2025-10-10T13:59:41.961813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:41.961822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:41.961831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:41.961848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592476143928997:2702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:41.964280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592476143928997:2702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:41.978539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592476143928997:2702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:41.994353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592476143928997:2702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:41.994395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592476143928997:2702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:41.994414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592476143928997:2702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:41.994445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 16 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:41.998063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:42.006025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:42.006929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:42.006950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:42.006998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:42.007278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:42.007463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592478860981380:2612]
2025-10-10T13:59:42.009871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:42.015936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592480438896338:2507]
2025-10-10T13:59:42.021587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:42.021855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:42.023137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:42.023473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:42.023481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:42.023487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:42.023494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:42.023499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:42.023505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:42.023512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:42.023519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:42.023525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.023532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.023539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.023545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.023595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:42.023698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:42.023747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:42.023796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:42.023844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:42.023888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:42.023930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:42.023969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:42.024018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.024058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.024102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.024147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.024193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:42.024259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:42.024319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:42.024373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:42.024419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:42.024467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:42.024511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:42.024563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:42.024609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:42.024660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:42.024701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:42.024756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:42.024807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:42.024858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:42.024899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:42.024946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:42.024992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.025042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.025084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.026429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.026509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.026585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.026629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.026678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.027124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:42.081361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:42.107419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:42.107464Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:42.107479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:42.107495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:42.107515Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 15 [2:7559592478860981380:2612]
2025-10-10T13:59:42.107566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:42.107619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:42.107633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.107644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.107654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.107700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:42.107720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:42.107739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:42.124158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.124193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.124208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.124221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.124232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:42.124499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:42.124515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.124653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.124826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.125056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.125883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 15
2025-10-10T13:59:42.125969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 15
2025-10-10T13:59:42.126027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 15, pipe: [1:7559592480438896338:2507]
2025-10-10T13:59:42.126717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:42.126841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592476143928981:2442], now have 1 active actors on pipe
2025-10-10T13:59:42.126864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592480438896338:2507], now have 1 active actors on pipe
2025-10-10T13:59:42.126901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592476143929037:2702], now have 1 active actors on pipe
2025-10-10T13:59:42.126948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:42.126981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:42.127043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.127056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.127068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.127079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.127126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:42.127205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:42.127387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:42.127403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:42.127466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82155c07-631870a2-a89cc56e-eed324af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:42.127496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.127514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.127524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:42.127571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.127628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:42.127777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.127797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:42.127839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:42.129218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:42.129233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:42.129244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:42.129255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:42.129280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:42.131809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 16 partition: 0 MaxSeqNo: 36 sessionId: src_id|82155c07-631870a2-a89cc56e-eed324af_0
2025-10-10T13:59:42.131427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:42.131467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:42.131534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:42.133701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dce8703b-701e63b-d799507-fd37c120_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|82155c07-631870a2-a89cc56e-eed324af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:42.190421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82155c07-631870a2-a89cc56e-eed324af_0] Write session: try to update token
2025-10-10T13:59:42.190476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82155c07-631870a2-a89cc56e-eed324af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:42.213368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.213397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.213408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.387397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:42.387437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:42.387451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:42.387464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:42.387475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:42.387513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.387539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.387564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.387585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.387754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.387766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.387777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.387876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:42.387901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.387912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:42.388990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:42.389251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:42.389285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:42.389314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:42.389340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:42.437315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId: src_id|82155c07-631870a2-a89cc56e-eed324af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:42.532448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:42.681097Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:42.693727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:42.693772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:42.693847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:42.693860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:42.693901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592474566014078:2612]
2025-10-10T13:59:42.695762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:42.695786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:42.694573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:42.702324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:42.744968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82155c07-631870a2-a89cc56e-eed324af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:42.745043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82155c07-631870a2-a89cc56e-eed324af_0] Write session will restart in 0.009735s
2025-10-10T13:59:42.745205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82155c07-631870a2-a89cc56e-eed324af_0] Write session: Do CDS request
2025-10-10T13:59:42.745236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82155c07-631870a2-a89cc56e-eed324af_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:42.741801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 16 reason: error at write: Disconnected sessionId: src_id|82155c07-631870a2-a89cc56e-eed324af_0
2025-10-10T13:59:42.742147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 16 sessionId: src_id|82155c07-631870a2-a89cc56e-eed324af_0 is DEAD
2025-10-10T13:59:42.762146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82155c07-631870a2-a89cc56e-eed324af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:42.771190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:42.771325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592480438896338:2507]
2025-10-10T13:59:42.771351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:42.771363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 17
2025-10-10T13:59:42.773531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:42.773672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 17 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:42.773688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=17 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:42.773696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:42.778349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 17 sessionId:  describe result for acl check
2025-10-10T13:59:42.778472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:42.778481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:42.778491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:42.778509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592480438896421:2715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:42.780927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592480438896421:2715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:42.788742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:42.800156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:42.800957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:42.800974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:42.801017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:42.801266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:42.801449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592478860981482:2621]
2025-10-10T13:59:42.803690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:42.805007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:42.805236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:42.805979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592480438896421:2715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:42.806368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:42.806650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:42.806657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:42.806662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:42.806668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:42.806675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:42.806680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:42.806685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:42.806689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:42.806694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.806699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.806705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.806709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.806748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:42.806838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:42.806872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:42.806934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:42.806972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:42.807005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:42.807039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:42.807074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:42.807113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.807160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.807195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.807232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.807268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:42.807324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:42.807378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:42.807427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:42.807466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:42.807512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:42.807547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:42.807624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:42.807673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:42.807720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:42.807757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:42.807804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:42.807846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:42.807891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:42.807929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:42.808004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:42.808053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.808101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.808141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.808190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.808235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.808278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.808316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.808363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.808758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:42.835761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592480438896421:2715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:42.835804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592480438896421:2715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:42.835820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592480438896421:2715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:42.835851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 17 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:42.847761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:42.867838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:42.867887Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:42.867904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:42.867925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:42.867949Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 16 [2:7559592478860981482:2621]
2025-10-10T13:59:42.868006Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:42.868067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:42.868082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.868096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.868107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.868156Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:42.868179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:42.868202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:42.873278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592480438896456:2507]
2025-10-10T13:59:42.941674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.941704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.941717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.941730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.941742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:42.942009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:42.942026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:42.942166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:42.942355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:42.943275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:42.943395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:42.943582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592480438896414:2442], now have 1 active actors on pipe
2025-10-10T13:59:42.943606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592480438896454:2715], now have 1 active actors on pipe
2025-10-10T13:59:42.943626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592480438896456:2507], now have 1 active actors on pipe
2025-10-10T13:59:42.943649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:42.943664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:42.943676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:42.943687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:42.943721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:42.943806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:42.943978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:42.943994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:42.944124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:42.944143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:42.944538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:42.944554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:42.944564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:42.944575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:42.944596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:42.946598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 16
2025-10-10T13:59:42.946695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 16
2025-10-10T13:59:42.946753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 16, pipe: [1:7559592480438896456:2507]
2025-10-10T13:59:42.949057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:42.949104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:42.949207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:42.949242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.949262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.949272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:42.949309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.949352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:42.949411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:42.952029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:42.952062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:42.952161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:42.955015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 17 partition: 0 MaxSeqNo: 36 sessionId: src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0
2025-10-10T13:59:42.961395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82155c07-631870a2-a89cc56e-eed324af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:42.963998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.964020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.964032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.018829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0] Write session: try to update token
2025-10-10T13:59:43.018881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:43.215331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.215362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.215374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.215432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:43.215446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:43.215457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:43.215466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:43.215475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:43.215510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:43.215536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:43.215558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:43.215580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:43.215740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:43.215773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:43.215775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:43.215798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:43.215809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:43.215811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:43.215837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:43.216860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:43.253279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId: src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:43.305627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:43.573310Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:43.621374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:43.621428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:43.621500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:43.621512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:43.621553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592478860981476:2621]
2025-10-10T13:59:43.623688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:43.623846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:43.623860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:43.622182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:43.626040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592480438896456:2507]
2025-10-10T13:59:43.627350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:43.673341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 17 reason: error at write: Disconnected sessionId: src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0
2025-10-10T13:59:43.673732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 17 sessionId: src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0 is DEAD
2025-10-10T13:59:43.681356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:43.681397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0] Write session will restart in 0.005231s
2025-10-10T13:59:43.681498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0] Write session: Do CDS request
2025-10-10T13:59:43.681527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:43.704305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:43.704338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 18
2025-10-10T13:59:43.705360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:43.706244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:43.706418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 18 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:43.706436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=18 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:43.706458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:43.707438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:43.711288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 18 sessionId:  describe result for acl check
2025-10-10T13:59:43.711405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:43.711415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:43.711432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:43.711449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592484733863831:2724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:43.713794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592484733863831:2724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:43.718160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:43.718972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:43.718989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:43.719028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:43.719268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:43.719434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592483155948887:2634]
2025-10-10T13:59:43.721786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:43.728039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:43.728329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:43.728885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592484733863831:2724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:43.729093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592484733863852:2507]
2025-10-10T13:59:43.729857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:43.730157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:43.730164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:43.730170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:43.730175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:43.730180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:43.730185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:43.730190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:43.730196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:43.730200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:43.730205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:43.730210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:43.730217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:43.730258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:43.730363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:43.730406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:43.730448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:43.730836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:43.730884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:43.730924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:43.731039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:43.731080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:43.731135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:43.731174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:43.731213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:43.731251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:43.731307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:43.731359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:43.731405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:43.731445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:43.731490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:43.731531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:43.731576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:43.731615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:43.731659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:43.731696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:43.731741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:43.731782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:43.731842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:43.731886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:43.731933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:43.731971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:43.732016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:43.732069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:43.732113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:43.732153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:43.732198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:43.732236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:43.732279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:43.732649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:43.762435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592484733863831:2724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:43.762477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592484733863831:2724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:43.762494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592484733863831:2724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:43.762525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 18 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:43.774097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:43.796778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:43.797046Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:43.797067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:43.797085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:43.797108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 17 [2:7559592483155948887:2634]
2025-10-10T13:59:43.797173Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:43.797233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:43.797246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.797258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.797268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.797315Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:43.797335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:43.797355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:43.814053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:43.814081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:43.814093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:43.814105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:43.814114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:43.814388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:43.814403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:43.814530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:43.814681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:43.814884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:43.814988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:43.815055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:43.815069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:43.815082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:43.815093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:43.815363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:43.815376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:43.815388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:43.815401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:43.816109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:43.816212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:43.816392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:43.816408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:43.816453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592484733863852:2507], now have 1 active actors on pipe
2025-10-10T13:59:43.816485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592484733863865:2724], now have 1 active actors on pipe
2025-10-10T13:59:43.816506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592484733863799:2442], now have 1 active actors on pipe
2025-10-10T13:59:43.816625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:43.816651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:43.818173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 17, pipe: [1:7559592484733863852:2507]
2025-10-10T13:59:43.818296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 17
2025-10-10T13:59:43.818364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 17
2025-10-10T13:59:43.817066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:43.818962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:43.818993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:43.819091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51661b03-786a96ec-6e542659-a3782d5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:43.819124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.819142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.819150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:43.819188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.819230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:43.819278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:43.820919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:43.820949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:43.821014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:43.823341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 18 partition: 0 MaxSeqNo: 36 sessionId: src_id|51661b03-786a96ec-6e542659-a3782d5c_0
2025-10-10T13:59:43.825097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cd3c91b-edaf1655-e6e709fc-f1bc013a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51661b03-786a96ec-6e542659-a3782d5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:43.889439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51661b03-786a96ec-6e542659-a3782d5c_0] Write session: try to update token
2025-10-10T13:59:43.889488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51661b03-786a96ec-6e542659-a3782d5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:43.901611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.901643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.901656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.014440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:44.014477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:44.014490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:44.014500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:44.014510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:44.014542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:44.014565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:44.014585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:44.014602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:44.014829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.014840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.014849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.014897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:44.014920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:44.014931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:44.015706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:44.015739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:44.015766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:44.015792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:44.034537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:44.154768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId: src_id|51661b03-786a96ec-6e542659-a3782d5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:44.198361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:44.240694Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:44.258145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:44.258187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:44.258243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:44.258256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:44.258309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592483155948881:2634]
2025-10-10T13:59:44.260686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592484733863852:2507]
2025-10-10T13:59:44.260779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:44.260791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:44.258895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:44.265831Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:44.305366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:44.305495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 18 reason: error at write: Disconnected sessionId: src_id|51661b03-786a96ec-6e542659-a3782d5c_0
2025-10-10T13:59:44.305831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 18 sessionId: src_id|51661b03-786a96ec-6e542659-a3782d5c_0 is DEAD
2025-10-10T13:59:44.310189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51661b03-786a96ec-6e542659-a3782d5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:44.310229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51661b03-786a96ec-6e542659-a3782d5c_0] Write session will restart in 0.007457s
2025-10-10T13:59:44.310347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51661b03-786a96ec-6e542659-a3782d5c_0] Write session: Do CDS request
2025-10-10T13:59:44.310381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51661b03-786a96ec-6e542659-a3782d5c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:44.332562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51661b03-786a96ec-6e542659-a3782d5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:44.342035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:44.342064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 19
2025-10-10T13:59:44.342675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:44.342788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 19 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:44.342803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=19 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:44.342815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:44.341007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:44.341766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:44.342446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:44.342462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:44.342504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:44.342750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:44.342910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592487450916259:2638]
2025-10-10T13:59:44.344955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:44.344728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 19 sessionId:  describe result for acl check
2025-10-10T13:59:44.344845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:44.344855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:44.344863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:44.344880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592489028831233:2736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:44.347681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592489028831233:2736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:44.350733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:44.351009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:44.352228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:44.352577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:44.352585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:44.352592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:44.352598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:44.352604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:44.352611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:44.352616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:44.352623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:44.352630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:44.352636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:44.352642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:44.352648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:44.352689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:44.352780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:44.352829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:44.352873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:44.352915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:44.352955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:44.352995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:44.353036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:44.353079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:44.353140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:44.353182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:44.353221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:44.353258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:44.353315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:44.353367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:44.353414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:44.353457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:44.353502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:44.353541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:44.353586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:44.353651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:44.353697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:44.353735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:44.353780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:44.353821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:44.353866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:44.353907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:44.353954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:44.353995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:44.354041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:44.354078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:44.354128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:44.354172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:44.354220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:44.354262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:44.354328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:44.354719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:44.362562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592489028831233:2736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:44.362918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592489028831257:2507]
2025-10-10T13:59:44.390457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592489028831233:2736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:44.390498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592489028831233:2736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:44.390513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592489028831233:2736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:44.390544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 19 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:44.415844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:44.462543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:44.462585Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:44.462600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:44.462616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:44.462639Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 18 [2:7559592487450916259:2638]
2025-10-10T13:59:44.462691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:44.462749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:44.462761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.462774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.462783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.462829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:44.462851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:44.462872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:44.516231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 18
2025-10-10T13:59:44.516318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 18, pipe: [1:7559592489028831257:2507]
2025-10-10T13:59:44.514248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:44.516389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 18
2025-10-10T13:59:44.514274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:44.514298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:44.514309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:44.514320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:44.514572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:44.514585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:44.514711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:44.514854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:44.515022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:44.515113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:44.515190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592489028831219:2442], now have 1 active actors on pipe
2025-10-10T13:59:44.515209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592489028831257:2507], now have 1 active actors on pipe
2025-10-10T13:59:44.515226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592489028831266:2736], now have 1 active actors on pipe
2025-10-10T13:59:44.515250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.515262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.515270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.515280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.515336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:44.515379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:44.515393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:44.515402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:44.515412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:44.515418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:44.515570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:44.515585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:44.515705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.515727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:44.515753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:44.520579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:44.520620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:44.520707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:44.520742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.520762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.520774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:44.520813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.520860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:44.520906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:44.524834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:44.524871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:44.524949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:44.525267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 19 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0
2025-10-10T13:59:44.529744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51661b03-786a96ec-6e542659-a3782d5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:44.582985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0] Write session: try to update token
2025-10-10T13:59:44.583041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:44.603312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.603342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.603353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.603424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:44.603438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:44.603474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.603611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:44.603618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:44.626260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:44.627439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:44.628564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:44.637732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:44.661201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:44.661672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:44.795287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.795316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.795327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.795380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:44.795393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:44.795405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:44.795413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:44.795420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:44.795462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.795485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.795502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.795522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592487450916252:2638]
2025-10-10T13:59:44.795660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:44.795691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:44.795701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:44.795894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:44.795928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:44.795952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:44.795974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:44.802508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId: src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:44.810226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:44.846509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:44.991159Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:45.031602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:45.031645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:45.035520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592489028831257:2507]
2025-10-10T13:59:45.035616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:45.035626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:45.037318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:45.039468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 19 reason: error at write: Disconnected sessionId: src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0
2025-10-10T13:59:45.043390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:45.043429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0] Write session will restart in 0.009229s
2025-10-10T13:59:45.043520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0] Write session: Do CDS request
2025-10-10T13:59:45.043552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:45.046146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:45.049254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 19 sessionId: src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0 is DEAD
2025-10-10T13:59:45.063136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:45.074990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:45.075025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 20
2025-10-10T13:59:45.075533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:45.075647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 20 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:45.075663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=20 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:45.075674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:45.078599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 20 sessionId:  describe result for acl check
2025-10-10T13:59:45.078732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:45.078743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:45.078752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:45.078775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592493323798621:2745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:45.082844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592493323798621:2745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:45.098551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:45.103295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:45.104969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:45.105022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:45.105153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:45.105682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:45.105871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592491745883667:2649]
2025-10-10T13:59:45.107992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:45.111087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592493323798621:2745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:45.113504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:45.113747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:45.114962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:45.115255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:45.115262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:45.115268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:45.115274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:45.115279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:45.115286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:45.115294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:45.115299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:45.115303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.115309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.115315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.115322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.115362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:45.115455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:45.115499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:45.115539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:45.115580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:45.115622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:45.115663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:45.115704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:45.115743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.115786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.115824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.115861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.115900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:45.115957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:45.116008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:45.116054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:45.116095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:45.116143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:45.116184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:45.116230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:45.116269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:45.116312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:45.116354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:45.116403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:45.116446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:45.116491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:45.116530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:45.116574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:45.116621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.116669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.116709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.116757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.116796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.116844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.116882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.116927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.121779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:45.128363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592493323798621:2745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:45.128405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592493323798621:2745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:45.128422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592493323798621:2745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:45.128454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 20 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:45.137780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592493323798675:2507]
2025-10-10T13:59:45.192268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:45.207791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:45.207834Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:45.207848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:45.207866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:45.207890Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 19 [2:7559592491745883667:2649]
2025-10-10T13:59:45.207940Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:45.207997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:45.208012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.208024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.208035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.208088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:45.208112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:45.208133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:45.209413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.209428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.209440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.209453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.209464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:45.209730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:45.209745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.209872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.210038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.210257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.210389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:45.210463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592491745883661:2649]
2025-10-10T13:59:45.210477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592491745883661:2649]
2025-10-10T13:59:45.210491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592491745883661:2649]
2025-10-10T13:59:45.210504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592491745883661:2649]
2025-10-10T13:59:45.210664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:45.210676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:45.210690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:45.210701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:45.211821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:45.211924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:45.212126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:45.212145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:45.212192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592493323798673:2745], now have 1 active actors on pipe
2025-10-10T13:59:45.212215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592493323798675:2507], now have 1 active actors on pipe
2025-10-10T13:59:45.212232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592493323798608:2442], now have 1 active actors on pipe
2025-10-10T13:59:45.212353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592491745883661:2649]
2025-10-10T13:59:45.212375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:45.212034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 19
2025-10-10T13:59:45.212131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 19, pipe: [1:7559592493323798675:2507]
2025-10-10T13:59:45.212226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 19
2025-10-10T13:59:45.212905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:45.213779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:45.213808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:45.213901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:45.213933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.213951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.213964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:45.214005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.214049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:45.214099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:45.216081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:45.216133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:45.216217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:45.216498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 20 partition: 0 MaxSeqNo: 36 sessionId: src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0
2025-10-10T13:59:45.224617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ac3d2de-b48d72df-9a5ce94c-169989a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:45.270889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0] Write session: try to update token
2025-10-10T13:59:45.270952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:45.369381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.369422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.369439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.369514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:45.369540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:45.369559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:45.369584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:45.369601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:45.369640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592491745883661:2649]
2025-10-10T13:59:45.369678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592491745883661:2649]
2025-10-10T13:59:45.369724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592491745883661:2649]
2025-10-10T13:59:45.369754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592491745883661:2649]
2025-10-10T13:59:45.369929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:45.369955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.369965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:45.373270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:45.373317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:45.373341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:45.373366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:45.410637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:45.520954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId: src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:45.579479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:45.649259Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:45.658611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:45.658639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:45.665341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592493323798675:2507]
2025-10-10T13:59:45.665418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:45.652667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:45.652703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:45.668014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:45.690524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 20 reason: error at write: Disconnected sessionId: src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0
2025-10-10T13:59:45.690849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 20 sessionId: src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0 is DEAD
2025-10-10T13:59:45.693757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:45.693791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0] Write session will restart in 0.008679s
2025-10-10T13:59:45.693891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0] Write session: Do CDS request
2025-10-10T13:59:45.693926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:45.714972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:45.715644Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:45.715677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 21
2025-10-10T13:59:45.716100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:45.716215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 21 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:45.716230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=21 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:45.716241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:45.717630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 21 sessionId:  describe result for acl check
2025-10-10T13:59:45.717740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:45.717750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:45.717761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:45.717778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592493323798724:2753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:45.720421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592493323798724:2753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:45.750067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592493323798724:2753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:45.771944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592493323798769:2507]
2025-10-10T13:59:45.780766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:45.785453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592493323798724:2753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:45.785496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592493323798724:2753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:45.785514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592493323798724:2753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:45.785545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 21 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:45.797875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:45.798727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:45.798757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:45.798803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:45.799063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:45.799231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592491745883771:2659]
2025-10-10T13:59:45.802334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:45.806503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:45.806752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:45.807993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:45.808301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:45.808310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:45.808316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:45.808324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:45.808330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:45.808337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:45.808344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:45.808350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:45.808358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.808364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.808371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.808386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.808433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:45.808534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:45.808578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:45.808621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:45.808661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:45.808705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:45.808746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:45.808786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:45.808825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.808868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.808912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.808952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.808990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:45.809051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:45.809108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:45.809182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:45.809227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:45.809274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:45.809315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:45.809367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:45.809431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:45.809484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:45.809529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:45.809584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:45.809629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:45.809679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:45.809723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:45.809787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:45.809832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.809882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.809924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.809977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.810018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.810069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.810112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.810165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.810610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:45.862642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:45.898436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:45.898480Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:45.898495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:45.898510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:45.898532Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 20 [2:7559592491745883771:2659]
2025-10-10T13:59:45.898584Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:45.898643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:45.898657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.898669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.898680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.898729Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:45.898749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:45.898770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:45.928749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.928781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.928793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.928805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.928816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:45.929064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:45.929079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:45.929238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:45.929407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:45.929616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:45.929725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:45.929812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592491745883763:2659]
2025-10-10T13:59:45.929825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592491745883763:2659]
2025-10-10T13:59:45.929838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592491745883763:2659]
2025-10-10T13:59:45.929850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592491745883763:2659]
2025-10-10T13:59:45.929893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:45.929970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:45.930031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:45.930045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:45.930056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:45.930067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:45.930142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:45.930158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:45.930286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592491745883763:2659]
2025-10-10T13:59:45.930306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:45.930354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:45.930407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592493323798776:2753], now have 1 active actors on pipe
2025-10-10T13:59:45.930430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592493323798709:2442], now have 1 active actors on pipe
2025-10-10T13:59:45.930449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592493323798769:2507], now have 1 active actors on pipe
2025-10-10T13:59:45.935522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 20
2025-10-10T13:59:45.935646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 20
2025-10-10T13:59:45.935714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 20, pipe: [1:7559592493323798769:2507]
2025-10-10T13:59:45.941505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:45.941545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:45.941638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:45.941669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.941688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.941697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:45.941732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.941774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:45.941824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:45.949283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:45.949319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:45.949394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:45.951033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 21 partition: 0 MaxSeqNo: 36 sessionId: src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0
2025-10-10T13:59:45.952860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83bd89bf-6c7f2705-aec938c7-a86e600b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:45.999443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.999468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.999479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.030688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0] Write session: try to update token
2025-10-10T13:59:46.030755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:46.063085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:46.063122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:46.063139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:46.063151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:46.063164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:46.063202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592491745883763:2659]
2025-10-10T13:59:46.063232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592491745883763:2659]
2025-10-10T13:59:46.063258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592491745883763:2659]
2025-10-10T13:59:46.063281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592491745883763:2659]
2025-10-10T13:59:46.063442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:46.063448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:46.063482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:46.063482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.063495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:46.063509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:46.063542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:46.066356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:46.226523Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:46.234717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:46.234758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:46.234829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 21 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0
2025-10-10T13:59:46.235248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 21 sessionId: src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0 is DEAD
2025-10-10T13:59:46.235613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:46.235758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592493323798769:2507]
2025-10-10T13:59:46.249646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T13:59:46.249692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0] Write session will restart in 0.008132s
2025-10-10T13:59:46.249811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0] Write session: Do CDS request
2025-10-10T13:59:46.249845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:46.293956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:46.293805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:46.293838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 22
2025-10-10T13:59:46.300221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:46.300442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 22 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:46.300468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=22 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:46.300484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:46.302615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 22 sessionId:  describe result for acl check
2025-10-10T13:59:46.302741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:46.302751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:46.302761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:46.302777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592497618766151:2765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:46.305509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592497618766151:2765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:46.313741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592497618766151:2765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:46.331805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:46.335624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:46.335847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592497618766151:2765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:46.335888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592497618766151:2765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:46.335903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592497618766151:2765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:46.335933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 22 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:46.336327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592497618766186:2507]
2025-10-10T13:59:46.336452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:46.336481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:46.336524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:46.336770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:46.336940Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592496040851163:2667]
2025-10-10T13:59:46.340814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:46.342013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:46.342273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:46.343699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:46.344040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:46.344047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:46.344054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:46.344060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:46.344067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:46.344074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:46.344080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:46.344087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:46.344094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.344102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.344110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.344117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.344166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:46.344281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:46.344334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:46.344382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:46.344431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:46.344481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:46.344527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:46.344575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:46.344626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.344673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.344722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.344776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.344824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:46.344896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:46.344959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:46.345019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:46.345076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:46.345513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:46.345581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:46.345642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:46.345698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:46.345758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:46.345807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:46.345860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:46.345912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:46.345970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:46.346017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:46.346076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:46.346128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.346192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.346241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.346300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.346362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.346432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.346484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.346539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.347028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:46.369934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:46.390169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:46.390224Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:46.390237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:46.390255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:46.390278Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 21 [2:7559592496040851163:2667]
2025-10-10T13:59:46.390342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:46.390402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:46.390416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.390427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.390439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.390487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:46.390509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:46.390532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:46.392633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.392651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.392664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.392675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.392684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:46.392936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:46.392950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.393077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.399161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 21
2025-10-10T13:59:46.399244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 21, pipe: [1:7559592497618766186:2507]
2025-10-10T13:59:46.399313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 21
2025-10-10T13:59:46.402932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.403196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.403313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:46.403439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592497618766185:2765], now have 1 active actors on pipe
2025-10-10T13:59:46.403466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592497618766186:2507], now have 1 active actors on pipe
2025-10-10T13:59:46.403489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592497618766106:2442], now have 1 active actors on pipe
2025-10-10T13:59:46.403541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:46.403566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:46.403661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592496040851157:2667]
2025-10-10T13:59:46.403676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592496040851157:2667]
2025-10-10T13:59:46.403689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592496040851157:2667]
2025-10-10T13:59:46.403701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592496040851157:2667]
2025-10-10T13:59:46.403739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:46.403849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:46.404022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:46.404052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:46.404119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:46.404159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.404176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.404185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:46.404219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.404261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:46.404403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592496040851157:2667]
2025-10-10T13:59:46.404421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:46.404462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:46.404655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:46.404666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:46.404676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:46.404686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:46.404710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:46.411002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:46.411045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:46.411135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:46.412813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 22 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0
2025-10-10T13:59:46.413821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16788fd-e19294db-fc8e0ef1-e9cf07b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:46.474143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0] Write session: try to update token
2025-10-10T13:59:46.474210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:46.582341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.582370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.582417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.582469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:46.582484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:46.582495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:46.582505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:46.582515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:46.582545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592496040851157:2667]
2025-10-10T13:59:46.582571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592496040851157:2667]
2025-10-10T13:59:46.582593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592496040851157:2667]
2025-10-10T13:59:46.582614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592496040851157:2667]
2025-10-10T13:59:46.582751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:46.582776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.582788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:46.583202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:46.583232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:46.583259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:46.583283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:46.590136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:46.682091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId: src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:46.719149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:46.784247Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:46.794136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:46.794182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:46.796530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:46.801502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:46.802638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592497618766186:2507]
2025-10-10T13:59:46.802821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:46.807025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 22 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0
2025-10-10T13:59:46.807706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 22 sessionId: src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0 is DEAD
2025-10-10T13:59:46.818575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:46.818661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0] Write session will restart in 0.005198s
2025-10-10T13:59:46.823669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0] Write session: Do CDS request
2025-10-10T13:59:46.823715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:46.838396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:46.837377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:46.837411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 23
2025-10-10T13:59:46.839045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:46.839168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 23 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:46.839183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=23 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:46.839194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:46.845292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 23 sessionId:  describe result for acl check
2025-10-10T13:59:46.845422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:46.845432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:46.845440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:46.845459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592497618766247:2774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:46.848163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592497618766247:2774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:46.870159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592497618766247:2774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:46.871576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:46.874004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:46.874866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:46.874886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:46.874933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:46.875203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:46.875377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592496040851257:2673]
2025-10-10T13:59:46.877615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:46.878783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:46.878996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:46.880168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:46.880458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:46.880466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:46.880474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:46.880480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:46.880487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:46.880492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:46.880498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:46.880504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:46.880509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.880515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.880522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.880527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.880568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:46.880663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:46.880704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:46.880742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:46.880783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:46.880821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:46.880865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:46.880909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:46.880951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.880994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.881036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.881078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.881112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:46.881195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:46.881252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:46.881302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:46.881346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:46.881392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:46.881430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:46.881477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:46.881521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:46.881567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:46.881610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:46.881655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:46.881694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:46.881739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:46.881778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:46.881825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:46.881869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.881915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.881953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.881998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.882040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.882087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.882126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.882173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.882552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:46.883854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592497618766247:2774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:46.883897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592497618766247:2774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:46.883911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592497618766247:2774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:46.883943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 23 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:46.901323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592497618766295:2507]
2025-10-10T13:59:46.911535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:46.936228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:46.936269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:46.936286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:46.936304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:46.936327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 22 [2:7559592496040851257:2673]
2025-10-10T13:59:46.936377Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:46.936434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:46.936447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.936459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.936471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.936520Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:46.936541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:46.936562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:46.937763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.937785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.937800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.937812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.937823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:46.938085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:46.938101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:46.938235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:46.938424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:46.938628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:46.938732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:46.938803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:46.938816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:46.938830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:46.938840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:46.938882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:46.938957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:46.939113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:46.939129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:46.939255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:46.939272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:46.939511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:46.939524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:46.939535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:46.939546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:46.939568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:46.941190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592497618766226:2442], now have 1 active actors on pipe
2025-10-10T13:59:46.941234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592497618766292:2774], now have 1 active actors on pipe
2025-10-10T13:59:46.941255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592497618766295:2507], now have 1 active actors on pipe
2025-10-10T13:59:46.941302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 22
2025-10-10T13:59:46.941400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 22
2025-10-10T13:59:46.941457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 22, pipe: [1:7559592497618766295:2507]
2025-10-10T13:59:46.945500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:46.945540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:46.945645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:46.945682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.945699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.945709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:46.945748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.945797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:46.945862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:46.949705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:46.949745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:46.949822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:46.950181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 23 partition: 0 MaxSeqNo: 36 sessionId: src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0
2025-10-10T13:59:46.951136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0ef9b1-149c7877-20ea74d1-7b6f19fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:46.991104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0] Write session: try to update token
2025-10-10T13:59:46.991166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:47.046626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.046652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.046663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.046720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:47.046734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:47.046748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:47.046756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:47.046765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:47.046800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:47.046827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:47.046848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:47.046868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:47.048674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:47.048712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:47.048740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:47.048767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:47.060891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:47.060950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.060966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:47.062238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:47.131787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId: src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:47.150606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:47.269605Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:47.272263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:47.272290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:47.272328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592496040851252:2673]
2025-10-10T13:59:47.272472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:47.272493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:47.272516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:47.273279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:47.273435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:47.273446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:47.273984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592497618766295:2507]
2025-10-10T13:59:47.273234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:47.296556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 23 reason: error at write: Disconnected sessionId: src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0
2025-10-10T13:59:47.296924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 23 sessionId: src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0 is DEAD
2025-10-10T13:59:47.301907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:47.301945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0] Write session will restart in 0.008310s
2025-10-10T13:59:47.302050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0] Write session: Do CDS request
2025-10-10T13:59:47.302077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:47.321192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:47.322736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:47.322769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 24
2025-10-10T13:59:47.329457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:47.329596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 24 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:47.329612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=24 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:47.329623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:47.336343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:47.334732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 24 sessionId:  describe result for acl check
2025-10-10T13:59:47.334843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:47.334853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:47.334862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:47.334878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592501913733655:2779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:47.337226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592501913733655:2779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:47.339125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:47.339913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:47.339931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:47.339990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:47.340249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:47.340418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592500335818650:2682]
2025-10-10T13:59:47.345663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:47.349416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:47.349667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:47.350915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:47.351160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:47.351165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:47.351169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:47.351173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:47.351178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:47.351182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:47.351186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:47.351190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:47.351194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.351198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.351202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.351206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.351234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:47.351300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:47.351329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:47.351358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:47.351383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:47.351408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:47.351436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:47.351461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:47.351485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.349800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592501913733655:2779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:47.351511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.351534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.351555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.351578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:47.351615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:47.351646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:47.351674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:47.351699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:47.351725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:47.351746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:47.351771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:47.351797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:47.351828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:47.351853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:47.351883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:47.351907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:47.351937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:47.351963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:47.351994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:47.352020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.352049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.352074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.352104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.352130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.352161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.352185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.352214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.352514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:47.372265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592501913733655:2779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:47.372306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592501913733655:2779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:47.372322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592501913733655:2779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:47.372351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 24 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:47.373507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592501913733690:2507]
2025-10-10T13:59:47.390962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:47.405074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:47.405120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:47.406715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:47.406751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:47.406775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 23 [2:7559592500335818650:2682]
2025-10-10T13:59:47.406830Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:47.406891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:47.406905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.406916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.406926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.406978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:47.407000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:47.407020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:47.409106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.409121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.409150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.409164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.409175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:47.409460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:47.409476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.409592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.409740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.409930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.410035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:47.410111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.410125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.410139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.410155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.410473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:47.410485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:47.410495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:47.410505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:47.411538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:47.411643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:47.411828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:47.411844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:47.411891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592501913733690:2507], now have 1 active actors on pipe
2025-10-10T13:59:47.411913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592501913733604:2442], now have 1 active actors on pipe
2025-10-10T13:59:47.411933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592501913733689:2779], now have 1 active actors on pipe
2025-10-10T13:59:47.412056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.412090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:47.412504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:47.415099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:47.415131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:47.415207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb847748-30154bc7-22a55f00-de47d238_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:47.415241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.415259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.415269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:47.415306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.415351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:47.415396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:47.413524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 23, pipe: [1:7559592501913733690:2507]
2025-10-10T13:59:47.413632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 23
2025-10-10T13:59:47.413705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 23
2025-10-10T13:59:47.418576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:47.418611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:47.418708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:47.422797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 24 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb847748-30154bc7-22a55f00-de47d238_0
2025-10-10T13:59:47.425311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ca0be-667a88fd-ba5d89cf-45871f39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb847748-30154bc7-22a55f00-de47d238_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:47.482849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:47.482885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:47.482921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.483046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:47.484985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:47.485438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:47.489297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb847748-30154bc7-22a55f00-de47d238_0] Write session: try to update token
2025-10-10T13:59:47.489357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb847748-30154bc7-22a55f00-de47d238_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:47.502479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:47.504077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:47.505292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:47.506898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:47.516784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:47.516950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.516962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.516973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.646528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.646560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.646569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.646624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:47.646638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:47.646650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:47.646660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:47.646668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:47.646705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.646730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.646763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.646782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592500335818644:2682]
2025-10-10T13:59:47.646913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:47.646927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:47.646945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:47.646952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.646963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:47.646971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:47.646997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:47.648175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:47.685444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId: src_id|cb847748-30154bc7-22a55f00-de47d238_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:47.723420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:47.872580Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:47.882883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:47.882934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:47.884114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:47.885551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592501913733690:2507]
2025-10-10T13:59:47.885704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:47.885920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:47.885945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:47.918976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 24 reason: error at write: Disconnected sessionId: src_id|cb847748-30154bc7-22a55f00-de47d238_0
2025-10-10T13:59:47.919315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 24 sessionId: src_id|cb847748-30154bc7-22a55f00-de47d238_0 is DEAD
2025-10-10T13:59:47.923707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb847748-30154bc7-22a55f00-de47d238_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:47.923746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb847748-30154bc7-22a55f00-de47d238_0] Write session will restart in 0.006477s
2025-10-10T13:59:47.923879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb847748-30154bc7-22a55f00-de47d238_0] Write session: Do CDS request
2025-10-10T13:59:47.923912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb847748-30154bc7-22a55f00-de47d238_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:47.940290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb847748-30154bc7-22a55f00-de47d238_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:47.940335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:47.940366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 25
2025-10-10T13:59:47.940968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:47.941096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 25 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:47.941117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=25 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:47.941140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:47.942581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 25 sessionId:  describe result for acl check
2025-10-10T13:59:47.942694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:47.942703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:47.942710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:47.942728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592501913733764:2791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:47.945372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592501913733764:2791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:47.954926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592501913733764:2791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:47.961257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:47.965210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592501913733764:2791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:47.965241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592501913733764:2791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:47.965252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592501913733764:2791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:47.965276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 25 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:47.965450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:47.966535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:47.966553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:47.966598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:47.966873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:47.967041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592500335818763:2691]
2025-10-10T13:59:47.969462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:47.973737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:47.973971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:47.975403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:47.975845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:47.975859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:47.975865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:47.975870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:47.975874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:47.975879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:47.975885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:47.975890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:47.975897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.975903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.975909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.975914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.975954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:47.976045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:47.976084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:47.976122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:47.976160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:47.976198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:47.976236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:47.976274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:47.976311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.976350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.976386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.976424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.976459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:47.976516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:47.976568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:47.976616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:47.976652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:47.976696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:47.976735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:47.976781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:47.976822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:47.976866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:47.976909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:47.976956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:47.976997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:47.977041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:47.977077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:47.977144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:47.977188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.977235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:47.977273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.977319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:47.977355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.977404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:47.977444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.977492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:47.977906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:47.989616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592501913733801:2507]
2025-10-10T13:59:48.025812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:48.043900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:48.043949Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:48.043967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:48.043988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:48.044013Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 24 [2:7559592500335818763:2691]
2025-10-10T13:59:48.044076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:48.044142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:48.044158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.044171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.044185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.044236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:48.044260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:48.044283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:48.046966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.046992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:48.047008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:48.047022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:48.047034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:48.047321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:48.047340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.047498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:48.047710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:48.047972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:48.048101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:48.048179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.048196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.048211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.048225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.048277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:48.048364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:48.048549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:48.048568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:48.048713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:48.048721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.048731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:48.048742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:48.048747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:48.048755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:48.048780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:48.050352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 24, pipe: [1:7559592501913733801:2507]
2025-10-10T13:59:48.050599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592501913733801:2507], now have 1 active actors on pipe
2025-10-10T13:59:48.050455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 24
2025-10-10T13:59:48.050625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592501913733795:2791], now have 1 active actors on pipe
2025-10-10T13:59:48.050638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592501913733727:2442], now have 1 active actors on pipe
2025-10-10T13:59:48.050505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 24
2025-10-10T13:59:48.051554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:48.051586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:48.051678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c7b3922-90483927-427ff7eb-d1995758_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:48.051710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.051739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.051748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:48.051786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.051830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:48.051876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:48.056787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:48.056830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:48.056908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:48.057364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 25 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c7b3922-90483927-427ff7eb-d1995758_0
2025-10-10T13:59:48.058292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb847748-30154bc7-22a55f00-de47d238_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c7b3922-90483927-427ff7eb-d1995758_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:48.085539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b3922-90483927-427ff7eb-d1995758_0] Write session: try to update token
2025-10-10T13:59:48.085593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b3922-90483927-427ff7eb-d1995758_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:48.204018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:48.204049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:48.204085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.204218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.204229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.204239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.204303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:48.209305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:48.212516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:48.213741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:48.214999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:48.236462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:48.242801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:48.243269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:48.382993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.383026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.383039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.383094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:48.383108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:48.383121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:48.383132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:48.383143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:48.383184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.383211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.383234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.383257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592500335818757:2691]
2025-10-10T13:59:48.383403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:48.383434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.383446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:48.384454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:48.389244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId: src_id|2c7b3922-90483927-427ff7eb-d1995758_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:48.389258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:48.389306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:48.389338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:48.389370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:48.427021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:48.555347Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:48.557066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:48.557099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:48.558341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:48.558691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:48.558723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:48.567141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592501913733801:2507]
2025-10-10T13:59:48.567314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:48.620420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 25 reason: error at write: Disconnected sessionId: src_id|2c7b3922-90483927-427ff7eb-d1995758_0
2025-10-10T13:59:48.620763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 25 sessionId: src_id|2c7b3922-90483927-427ff7eb-d1995758_0 is DEAD
2025-10-10T13:59:48.621657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b3922-90483927-427ff7eb-d1995758_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:48.621701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b3922-90483927-427ff7eb-d1995758_0] Write session will restart in 0.008784s
2025-10-10T13:59:48.621883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b3922-90483927-427ff7eb-d1995758_0] Write session: Do CDS request
2025-10-10T13:59:48.621951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b3922-90483927-427ff7eb-d1995758_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:48.633810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:48.636083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b3922-90483927-427ff7eb-d1995758_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:48.637489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:48.637521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 26
2025-10-10T13:59:48.637865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:48.637982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 26 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:48.638004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=26 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:48.638015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:48.639829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 26 sessionId:  describe result for acl check
2025-10-10T13:59:48.639951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:48.639965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:48.639974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:48.639990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592506208701183:2800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:48.640659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:48.641635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:48.641656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:48.641694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:48.641903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:48.642024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592504630786147:2697]
2025-10-10T13:59:48.642847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592506208701183:2800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:48.643557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:48.646935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:48.647182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:48.648670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:48.649039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:48.649048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:48.649056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:48.649062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:48.649069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:48.649077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:48.649084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:48.649092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:48.649099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.649106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:48.649114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:48.649121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:48.649186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:48.649303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:48.649366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:48.649420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:48.649468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:48.649519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:48.649568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:48.649621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:48.649668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.649727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:48.649774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:48.649820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:48.649863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:48.649938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:48.650000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:48.650057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:48.650107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:48.650164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:48.650216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:48.650269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:48.650322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:48.650390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:48.650435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:48.650494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:48.650831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592506208701183:2800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:48.650546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:48.650604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:48.650654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:48.650708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:48.650760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.650816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.650865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:48.650925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:48.650977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:48.651036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:48.651086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:48.651144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:48.651628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:48.667397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592506208701213:2507]
2025-10-10T13:59:48.668619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592506208701183:2800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:48.668655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592506208701183:2800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:48.668673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592506208701183:2800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:48.668705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 26 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:48.684700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:48.698642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:48.698691Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:48.698712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:48.698735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:48.698761Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 25 [2:7559592504630786147:2697]
2025-10-10T13:59:48.698826Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:48.698886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:48.698901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.698915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.698928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.698980Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:48.699003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:48.699027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:48.700385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.700412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:48.700425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:48.700440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:48.700452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:48.700730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:48.700749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.700914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:48.701118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:48.701389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:48.701519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:48.701606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592506208701213:2507], now have 1 active actors on pipe
2025-10-10T13:59:48.701634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592506208701142:2442], now have 1 active actors on pipe
2025-10-10T13:59:48.701656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592506208701217:2800], now have 1 active actors on pipe
2025-10-10T13:59:48.701680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592504630786142:2697]
2025-10-10T13:59:48.701695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592504630786142:2697]
2025-10-10T13:59:48.701710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592504630786142:2697]
2025-10-10T13:59:48.701725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592504630786142:2697]
2025-10-10T13:59:48.701766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:48.701848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:48.702041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:48.702058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:48.702183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592504630786142:2697]
2025-10-10T13:59:48.702202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:48.702399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:48.702413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:48.702425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:48.702436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:48.702458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:48.703176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:48.703200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:48.703274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:48.703319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.703337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.703348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:48.703382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.703422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:48.703473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:48.702600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 25
2025-10-10T13:59:48.702712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 25
2025-10-10T13:59:48.702782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 25, pipe: [1:7559592506208701213:2507]
2025-10-10T13:59:48.706670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:48.706712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:48.706791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:48.712511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 26 partition: 0 MaxSeqNo: 36 sessionId: src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0
2025-10-10T13:59:48.713380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c7b3922-90483927-427ff7eb-d1995758_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:48.785525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0] Write session: try to update token
2025-10-10T13:59:48.785585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:48.816967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:48.817000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:48.817015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:48.817027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:48.817037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:48.817076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592504630786142:2697]
2025-10-10T13:59:48.817103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592504630786142:2697]
2025-10-10T13:59:48.817163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592504630786142:2697]
2025-10-10T13:59:48.817184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592504630786142:2697]
2025-10-10T13:59:48.817353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.817365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.817375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.817403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:48.817421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:48.817443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:48.817446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:48.817456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:48.817480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:48.817522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:48.818528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:48.914744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId: src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:48.954555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:48.981100Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:48.984233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:48.984263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:48.988360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:48.988094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592506208701213:2507]
2025-10-10T13:59:48.988189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:48.988312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:48.988325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:48.997683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 26 reason: error at write: Disconnected sessionId: src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0
2025-10-10T13:59:48.998037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 26 sessionId: src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0 is DEAD
2025-10-10T13:59:49.001139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:49.001184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0] Write session will restart in 0.009040s
2025-10-10T13:59:49.001273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0] Write session: Do CDS request
2025-10-10T13:59:49.001306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:49.019211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:49.025222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:49.025257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 27
2025-10-10T13:59:49.025779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:49.026025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 27 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:49.026063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=27 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:49.026081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:49.028141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 27 sessionId:  describe result for acl check
2025-10-10T13:59:49.028256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:49.028266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:49.028274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:49.028290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592510503668539:2805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:49.030802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592510503668539:2805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:49.041387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592510503668539:2805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:49.059558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592510503668539:2805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:49.059598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592510503668539:2805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:49.059615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592510503668539:2805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:49.059645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 27 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:49.056329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:49.058889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:49.059452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:49.059472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:49.059514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:49.059705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:49.059842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592508925753549:2707]
2025-10-10T13:59:49.061374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:49.062183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:49.062398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:49.063419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:49.063695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:49.063712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:49.063718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:49.063724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:49.063731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:49.063737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:49.063744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:49.063750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:49.063757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.063764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.063770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.063778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.063822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:49.063934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:49.063982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:49.064028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:49.064078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:49.064126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:49.064173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:49.064219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:49.064265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.064313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.064357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.064402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.064444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:49.064512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:49.064573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:49.064636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:49.064683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:49.064733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:49.064776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:49.064827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:49.064875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:49.064921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:49.064955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:49.064991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:49.065032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:49.065085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:49.065179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:49.065236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:49.065278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.065341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.065386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.065430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.065463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.065502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.065534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.065571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.065954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:49.089259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592510503668600:2507]
2025-10-10T13:59:49.131140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:49.147185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:49.147222Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:49.147233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:49.147246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:49.147263Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 26 [2:7559592508925753549:2707]
2025-10-10T13:59:49.147302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:49.147356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:49.147370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.147380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.147389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.147422Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:49.147437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:49.150372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 26
2025-10-10T13:59:49.150493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 26
2025-10-10T13:59:49.150561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 26, pipe: [1:7559592510503668600:2507]
2025-10-10T13:59:49.147454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:49.149549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.149563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.149573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.149584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.149594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:49.149842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:49.149858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.149983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.150144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.150340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.150456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:49.150535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592510503668600:2507], now have 1 active actors on pipe
2025-10-10T13:59:49.150555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592506208701230:2442], now have 1 active actors on pipe
2025-10-10T13:59:49.150574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592510503668593:2805], now have 1 active actors on pipe
2025-10-10T13:59:49.150596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.150607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.150619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.150631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.150691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:49.150703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:49.150714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:49.150724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:49.151471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:49.151567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:49.151752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:49.151776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:49.151851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:49.151875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:49.152006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.152039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:49.152116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:49.152152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.152173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.152185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:49.152222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.152266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:49.152385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:49.152513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:49.153727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:49.153755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:49.153820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:49.154229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 27 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0
2025-10-10T13:59:49.158170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3b9686-98905fa5-14d8a64a-90bb9952_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:49.219012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0] Write session: try to update token
2025-10-10T13:59:49.219068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:49.312250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.312279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.312291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.312403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:49.312416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:49.312428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:49.312436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:49.312445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:49.312476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.312501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.312524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.312543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.313579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:49.313637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:49.313664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:49.313688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:49.345373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:49.345417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.345428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:49.347952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:49.357961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId: src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:49.379551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:49.499304Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:49.508482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:49.508511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:49.508552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592508925753543:2707]
2025-10-10T13:59:49.508681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:49.508692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:49.508717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:49.510854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:49.509370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592510503668600:2507]
2025-10-10T13:59:49.509461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:49.509578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:49.509588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:49.520271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 27 reason: error at write: Disconnected sessionId: src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0
2025-10-10T13:59:49.520627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 27 sessionId: src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0 is DEAD
2025-10-10T13:59:49.524541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:49.524581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0] Write session will restart in 0.008441s
2025-10-10T13:59:49.524689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0] Write session: Do CDS request
2025-10-10T13:59:49.524717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:49.557868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:49.560818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:49.560855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 28
2025-10-10T13:59:49.561402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:49.561507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 28 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:49.561524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=28 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:49.561535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:49.562822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 28 sessionId:  describe result for acl check
2025-10-10T13:59:49.562921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:49.562931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:49.562939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:49.562956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592510503668654:2817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:49.569648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592510503668654:2817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:49.597009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592510503668654:2817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:49.607052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:49.611497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592510503668714:2507]
2025-10-10T13:59:49.612851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592510503668654:2817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:49.612891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592510503668654:2817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:49.612913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592510503668654:2817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:49.612949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 28 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:49.617675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:49.618796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:49.618826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:49.618876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:49.619171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:49.619347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592508925753651:2715]
2025-10-10T13:59:49.621375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:49.625450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:49.625689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:49.627003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:49.627345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:49.627353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:49.627359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:49.627365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:49.627371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:49.627376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:49.627384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:49.627391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:49.627397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.627402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.627409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.627415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.627457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:49.627552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:49.627593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:49.627630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:49.627671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:49.627710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:49.627753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:49.627793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:49.627833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.627874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.627916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.627951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.627992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:49.628054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:49.628108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:49.628153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:49.628193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:49.628239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:49.628278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:49.628321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:49.628357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:49.628401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:49.628435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:49.628476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:49.628516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:49.628559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:49.628595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:49.628638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:49.628677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.628722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.628761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.628810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.628850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.628893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.628934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.628979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.632432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:49.673824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:49.753255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:49.753301Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:49.753318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:49.753337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:49.753360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 27 [2:7559592508925753651:2715]
2025-10-10T13:59:49.753414Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:49.753474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:49.753488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.753501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.753512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.753560Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:49.753581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:49.753603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:49.755676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.755692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.755705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.755718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.755727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:49.755991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:49.756005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.756140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:49.756309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:49.756522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:49.756629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:49.756710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592510503668714:2507], now have 1 active actors on pipe
2025-10-10T13:59:49.756732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592510503668638:2442], now have 1 active actors on pipe
2025-10-10T13:59:49.756752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592510503668717:2817], now have 1 active actors on pipe
2025-10-10T13:59:49.756775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592508925753644:2715]
2025-10-10T13:59:49.756788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592508925753644:2715]
2025-10-10T13:59:49.756799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592508925753644:2715]
2025-10-10T13:59:49.756811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592508925753644:2715]
2025-10-10T13:59:49.756877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:49.756889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:49.756899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:49.756910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:49.756962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 27, pipe: [1:7559592510503668714:2507]
2025-10-10T13:59:49.757058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 27
2025-10-10T13:59:49.757142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 27
2025-10-10T13:59:49.764185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:49.764303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:49.764494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:49.764511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:49.764595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:49.764617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:49.764748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592508925753644:2715]
2025-10-10T13:59:49.764781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:49.764846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:49.764879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.764897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.764907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:49.764943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.764984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:49.765098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:49.765445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:49.776895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:49.776942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:49.777024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:49.780272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 28 partition: 0 MaxSeqNo: 36 sessionId: src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0
2025-10-10T13:59:49.785452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d700a7-dbf05b0-48e85b43-bf39f965_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:49.823206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0] Write session: try to update token
2025-10-10T13:59:49.823263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:49.854551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.854598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.854610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.967950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:49.967981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:49.967993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:49.968005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:49.968017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:49.968054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592508925753644:2715]
2025-10-10T13:59:49.968079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592508925753644:2715]
2025-10-10T13:59:49.968103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592508925753644:2715]
2025-10-10T13:59:49.968124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592508925753644:2715]
2025-10-10T13:59:49.968296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.968309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.968321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.968369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:49.968394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:49.968405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:49.969943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:49.970127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:49.970191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:49.970246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:49.970294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:50.046292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId: src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:50.065911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:50.170079Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:50.182272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:50.182314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:50.187599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:50.188067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592510503668714:2507]
2025-10-10T13:59:50.188123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:50.188211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:50.188220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:50.218523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 28 reason: error at write: Disconnected sessionId: src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0
2025-10-10T13:59:50.218815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 28 sessionId: src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0 is DEAD
2025-10-10T13:59:50.221452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:50.221519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0] Write session will restart in 0.009714s
2025-10-10T13:59:50.221679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0] Write session: Do CDS request
2025-10-10T13:59:50.221740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:50.249923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:50.250604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:50.250636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 29
2025-10-10T13:59:50.253855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:50.253999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 29 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:50.254014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=29 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:50.254025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:50.258319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 29 sessionId:  describe result for acl check
2025-10-10T13:59:50.258467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:50.258483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:50.258491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:50.258509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592514798636089:2825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:50.261009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592514798636089:2825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:50.265586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:50.268113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:50.268941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:50.268959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:50.269002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:50.269280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:50.269458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592513220721051:2721]
2025-10-10T13:59:50.271516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:50.272537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:50.272738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:50.273925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:50.274221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:50.274227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:50.274233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:50.274240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:50.274246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:50.274251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:50.274257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:50.274263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:50.274268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.274274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.274280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.274286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.274327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:50.274437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:50.274479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:50.274519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:50.274562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:50.274605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:50.274647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:50.274687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:50.274727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.274768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.274806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.274845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.274883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:50.274942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:50.274997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:50.275049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:50.275093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:50.275140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:50.275180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:50.275227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:50.275275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:50.275325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:50.275365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:50.275415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:50.275461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:50.275512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:50.275553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:50.275602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:50.275649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.275697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.275740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.275793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.275839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.275891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.275932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.275982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.276399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:50.284923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592514798636089:2825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:50.288278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592514798636116:2507]
2025-10-10T13:59:50.308565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592514798636089:2825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:50.308611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592514798636089:2825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:50.308632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592514798636089:2825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:50.308666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 29 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:50.313432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:50.335375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:50.335423Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:50.335440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:50.335459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:50.335483Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 28 [2:7559592513220721051:2721]
2025-10-10T13:59:50.335541Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:50.335608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:50.335624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.335636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.335650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.335700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:50.335725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:50.335748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:50.337486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.337509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.337521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.337533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.337544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:50.337855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:50.337872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.338012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.338196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.338430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.338537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:50.338625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592514798636116:2507], now have 1 active actors on pipe
2025-10-10T13:59:50.338647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592514798636044:2442], now have 1 active actors on pipe
2025-10-10T13:59:50.338666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592514798636123:2825], now have 1 active actors on pipe
2025-10-10T13:59:50.338689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592513220721045:2721]
2025-10-10T13:59:50.338703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592513220721045:2721]
2025-10-10T13:59:50.338717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592513220721045:2721]
2025-10-10T13:59:50.338727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592513220721045:2721]
2025-10-10T13:59:50.338768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:50.338834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:50.338849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:50.338849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:50.338859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:50.338868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:50.339017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:50.339033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:50.339163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592513220721045:2721]
2025-10-10T13:59:50.339190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:50.340843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 28, pipe: [1:7559592514798636116:2507]
2025-10-10T13:59:50.340956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 28
2025-10-10T13:59:50.341033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 28
2025-10-10T13:59:50.343031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:50.344272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:50.344303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:50.344383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:50.344418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.344436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.344447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:50.344486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.344533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:50.344577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:50.346321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:50.346349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:50.346434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:50.357364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 29 partition: 0 MaxSeqNo: 36 sessionId: src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0
2025-10-10T13:59:50.365509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27b81511-f29c8972-77d91cc7-d5c4830e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:50.415040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0] Write session: try to update token
2025-10-10T13:59:50.415100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:50.425242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.425274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.425284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.573913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:50.573944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:50.573956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:50.573966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:50.573976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:50.574010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592513220721045:2721]
2025-10-10T13:59:50.574036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592513220721045:2721]
2025-10-10T13:59:50.574056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592513220721045:2721]
2025-10-10T13:59:50.574075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592513220721045:2721]
2025-10-10T13:59:50.574225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.574241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.574252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.574298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:50.574323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.574334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:50.574920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:50.574953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:50.574976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:50.574995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:50.575294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:50.602972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId: src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:50.622679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:50.739740Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:50.742728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:50.742775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:50.747934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592514798636116:2507]
2025-10-10T13:59:50.748064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:50.748212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:50.748238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:50.754889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:50.758871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 29 reason: error at write: Disconnected sessionId: src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0
2025-10-10T13:59:50.759355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 29 sessionId: src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0 is DEAD
2025-10-10T13:59:50.763909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:50.763955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0] Write session will restart in 0.009952s
2025-10-10T13:59:50.764072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0] Write session: Do CDS request
2025-10-10T13:59:50.764102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:50.782332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:50.789818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:50.789851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 30
2025-10-10T13:59:50.790288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:50.790445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 30 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:50.790461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=30 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:50.790471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:50.791806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 30 sessionId:  describe result for acl check
2025-10-10T13:59:50.791907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:50.791916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:50.791924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:50.791940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592514798636177:2833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:50.794490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592514798636177:2833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:50.819891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592514798636177:2833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:50.830581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:50.839363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:50.840253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:50.840270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:50.840315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:50.840572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:50.840739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592513220721162:2730]
2025-10-10T13:59:50.842900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:50.845327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592514798636177:2833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:50.845367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592514798636177:2833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:50.845385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592514798636177:2833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:50.845417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 30 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:50.846859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592514798636244:2507]
2025-10-10T13:59:50.849432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:50.849702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:50.851068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:50.851393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:50.851402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:50.851409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:50.851416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:50.851423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:50.851430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:50.851437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:50.851444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:50.851451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.851458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.851466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.851473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.851521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:50.851626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:50.851678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:50.851725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:50.851771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:50.851819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:50.851862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:50.851907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:50.851954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.852002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.852050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.852097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.852136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:50.852206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:50.852261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:50.852317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:50.852366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:50.852421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:50.852469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:50.852528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:50.852575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:50.852632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:50.852679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:50.852733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:50.852781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:50.852833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:50.852879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:50.852953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:50.853007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.853064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.853109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.853836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.853877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.853920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.853951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.853989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.854301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:50.894596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:50.907567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:50.907607Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:50.907627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:50.907650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:50.907674Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 29 [2:7559592513220721162:2730]
2025-10-10T13:59:50.907737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:50.907799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:50.907824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.907838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.907850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.907889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:50.907907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:50.907924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:50.923671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.923699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.923712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.923724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.923735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:50.924007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:50.924025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:50.924169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:50.925443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:50.925708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:50.925829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:50.925916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592514798636242:2833], now have 1 active actors on pipe
2025-10-10T13:59:50.925943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592514798636163:2442], now have 1 active actors on pipe
2025-10-10T13:59:50.925967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592514798636244:2507], now have 1 active actors on pipe
2025-10-10T13:59:50.925992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:50.926006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:50.926020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:50.929306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 29
2025-10-10T13:59:50.926033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:50.926070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:50.929307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 29
2025-10-10T13:59:50.926155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:50.929380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 29, pipe: [1:7559592514798636244:2507]
2025-10-10T13:59:50.926342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:50.926359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:50.926494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:50.926513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:50.926692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:50.926704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:50.926715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:50.926727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:50.926748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:50.929771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:50.929802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:50.929880Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:50.929912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.929930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.929940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:50.929975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.930016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:50.930061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:50.930936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:50.930963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:50.931030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:50.931389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 30 partition: 0 MaxSeqNo: 36 sessionId: src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0
2025-10-10T13:59:50.932957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a67e89-85f44a7f-fac1b76a-e7ab786_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:50.976402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0] Write session: try to update token
2025-10-10T13:59:50.976466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:51.004372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.004398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.004406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.116799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId: src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:51.161021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:51.164805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:51.164836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:51.164850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:51.164860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:51.164869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:51.164904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:51.164928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:51.164948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:51.164967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:51.165085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:51.165115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:51.165154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.165157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:51.165167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.165177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.165185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:51.176089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:51.176138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:51.176151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:51.178615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:51.365504Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:51.367936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:51.367971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:51.368017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:51.368031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:51.368071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592513220721157:2730]
2025-10-10T13:59:51.370591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:51.370622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:51.369231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:51.372159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:51.430714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:51.430873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592514798636244:2507]
2025-10-10T13:59:51.434339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 30 reason: error at write: Disconnected sessionId: src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0
2025-10-10T13:59:51.434757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 30 sessionId: src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0 is DEAD
2025-10-10T13:59:51.445264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:51.445308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0] Write session will restart in 0.006899s
2025-10-10T13:59:51.445415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0] Write session: Do CDS request
2025-10-10T13:59:51.445448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:51.475794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:51.481319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:51.481352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 31
2025-10-10T13:59:51.482322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:51.482455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 31 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:51.482470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=31 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:51.482479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:51.484586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 31 sessionId:  describe result for acl check
2025-10-10T13:59:51.484697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:51.484707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:51.484716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:51.484732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592519093603608:2845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:51.487206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592519093603608:2845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:51.513002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592519093603608:2845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:51.532245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592519093603608:2845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:51.532301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592519093603608:2845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:51.532317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592519093603608:2845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:51.532346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 31 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:51.532803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592519093603666:2507]
2025-10-10T13:59:51.536790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:51.538350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:51.539100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:51.539117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:51.539156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:51.539393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:51.539556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592517515688573:2740]
2025-10-10T13:59:51.548828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:51.550171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:51.550404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:51.551721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:51.552025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:51.552033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:51.552040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:51.552048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:51.552056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:51.552063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:51.552069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:51.552076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:51.552083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:51.552089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:51.552095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:51.552102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:51.552148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:51.552248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:51.552288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:51.552329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:51.552381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:51.552422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:51.552459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:51.552500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:51.552536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:51.552575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:51.552613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:51.552650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:51.552689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:51.552748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:51.552801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:51.552846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:51.552886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:51.552930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:51.552968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:51.553009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:51.553049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:51.553092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:51.553930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:51.553994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:51.554034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:51.554077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:51.554116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:51.554165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:51.554215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:51.554265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:51.554306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:51.554355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:51.554398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:51.554463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:51.554508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:51.554562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:51.555286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:51.622948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:51.648486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:51.648537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:51.648554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:51.648573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:51.648597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 30 [2:7559592517515688573:2740]
2025-10-10T13:59:51.648650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:51.648716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:51.648732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.648742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.648754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.648801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:51.648824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:51.648844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:51.671483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:51.671510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:51.671520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:51.671530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:51.671540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:51.671794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:51.671809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:51.671942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:51.672113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:51.672321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:51.672434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:51.672507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592517515688558:2740]
2025-10-10T13:59:51.672520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592517515688558:2740]
2025-10-10T13:59:51.672533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592517515688558:2740]
2025-10-10T13:59:51.672544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592517515688558:2740]
2025-10-10T13:59:51.672589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:51.672667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:51.672829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:51.672844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:51.673504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:51.673521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:51.673533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:51.673544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:51.674875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592517515688558:2740]
2025-10-10T13:59:51.674910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:51.674969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592519093603666:2507], now have 1 active actors on pipe
2025-10-10T13:59:51.674990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592519093603665:2845], now have 1 active actors on pipe
2025-10-10T13:59:51.675010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592519093603594:2442], now have 1 active actors on pipe
2025-10-10T13:59:51.675070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:51.675090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:51.675291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8aa9f354-85440a63-41166445-2ca9b876_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:51.675321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.675338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.675348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:51.675384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.675427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:51.675489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:51.674087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 30, pipe: [1:7559592519093603666:2507]
2025-10-10T13:59:51.674203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 30
2025-10-10T13:59:51.674270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 30
2025-10-10T13:59:51.676286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:51.678029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:51.678058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:51.678126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:51.683085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71d036b-52de0dfb-a4ef022c-4621de38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8aa9f354-85440a63-41166445-2ca9b876_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:51.678522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 31 partition: 0 MaxSeqNo: 36 sessionId: src_id|8aa9f354-85440a63-41166445-2ca9b876_0
2025-10-10T13:59:51.749992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa9f354-85440a63-41166445-2ca9b876_0] Write session: try to update token
2025-10-10T13:59:51.750058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa9f354-85440a63-41166445-2ca9b876_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:51.835242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.835272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.835284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.835341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:51.835357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:51.835369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:51.835380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:51.835390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:51.835428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592517515688558:2740]
2025-10-10T13:59:51.835453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592517515688558:2740]
2025-10-10T13:59:51.835477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592517515688558:2740]
2025-10-10T13:59:51.835497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592517515688558:2740]
2025-10-10T13:59:51.835633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:51.835660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:51.835671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:51.836305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:51.836337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:51.836363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:51.836392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:51.846316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:51.969335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId: src_id|8aa9f354-85440a63-41166445-2ca9b876_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:52.013278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:52.023848Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:52.026683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:52.026726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:52.031280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:52.031552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:52.031578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:52.031593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592519093603666:2507]
2025-10-10T13:59:52.030076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:52.090553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 31 reason: error at write: Disconnected sessionId: src_id|8aa9f354-85440a63-41166445-2ca9b876_0
2025-10-10T13:59:52.090913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 31 sessionId: src_id|8aa9f354-85440a63-41166445-2ca9b876_0 is DEAD
2025-10-10T13:59:52.092212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa9f354-85440a63-41166445-2ca9b876_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:52.092263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa9f354-85440a63-41166445-2ca9b876_0] Write session will restart in 0.007378s
2025-10-10T13:59:52.092460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa9f354-85440a63-41166445-2ca9b876_0] Write session: Do CDS request
2025-10-10T13:59:52.092508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa9f354-85440a63-41166445-2ca9b876_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:52.097973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:52.100308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:52.101299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:52.101329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:52.101375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:52.101658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:52.101845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592521810655980:2751]
2025-10-10T13:59:52.104457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:52.106966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:52.107414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:52.109304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa9f354-85440a63-41166445-2ca9b876_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:52.109373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:52.109406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 32
2025-10-10T13:59:52.109004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:52.109374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:52.109382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:52.109389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:52.109395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:52.109402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:52.109407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:52.109413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:52.109420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:52.109426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.109432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.109439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.109446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.109490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:52.109589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:52.109633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:52.109678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:52.109721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:52.109768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:52.109809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:52.109849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:52.109890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.109930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.109970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.110012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.110051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:52.110114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:52.109935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:52.110167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:52.110232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:52.110046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 32 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:52.110063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=32 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:52.110074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:52.110546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:52.110607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:52.110651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:52.110701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:52.110743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:52.110790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:52.111337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 32 sessionId:  describe result for acl check
2025-10-10T13:59:52.111451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:52.111461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:52.111470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:52.111489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592523388571041:2854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:52.110835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:52.110904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:52.110946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:52.110995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:52.111035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:52.111085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:52.111132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.111179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.111221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.111271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.111311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.111358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.111398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.111448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.111855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:52.114056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592523388571041:2854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:52.125831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592523388571041:2854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:52.129638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592523388571067:2507]
2025-10-10T13:59:52.135899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592523388571041:2854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:52.135944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592523388571041:2854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:52.135962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592523388571041:2854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:52.135997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 32 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:52.150435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:52.164198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:52.164248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:52.164267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:52.164288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:52.164312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 31 [2:7559592521810655980:2751]
2025-10-10T13:59:52.164369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:52.164433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:52.164448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.164461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.164473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.164522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:52.164542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:52.164565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:52.185930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.185959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.185974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.185988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.186000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:52.186287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:52.186306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.186474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.186680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.188166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 31, pipe: [1:7559592523388571067:2507]
2025-10-10T13:59:52.188264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 31
2025-10-10T13:59:52.188343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 31
2025-10-10T13:59:52.186907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.187058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:52.187130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592521810655974:2751]
2025-10-10T13:59:52.187146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592521810655974:2751]
2025-10-10T13:59:52.187161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592521810655974:2751]
2025-10-10T13:59:52.187174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592521810655974:2751]
2025-10-10T13:59:52.187205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:52.187229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:52.187260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:52.187292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:52.187294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:52.187309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:52.187494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:52.187512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:52.187558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592523388571072:2854], now have 1 active actors on pipe
2025-10-10T13:59:52.187584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592523388571067:2507], now have 1 active actors on pipe
2025-10-10T13:59:52.187606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592523388570991:2442], now have 1 active actors on pipe
2025-10-10T13:59:52.187727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592521810655974:2751]
2025-10-10T13:59:52.187759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:52.187924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:52.189262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:52.189296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:52.189865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abecff56-f103a70d-78bed42c-2a52115d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:52.189912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.189933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.189945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:52.189980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.190055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:52.190113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:52.190628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:52.190655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:52.190717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:52.190997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 32 partition: 0 MaxSeqNo: 36 sessionId: src_id|abecff56-f103a70d-78bed42c-2a52115d_0
2025-10-10T13:59:52.193367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa9f354-85440a63-41166445-2ca9b876_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abecff56-f103a70d-78bed42c-2a52115d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:52.243006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abecff56-f103a70d-78bed42c-2a52115d_0] Write session: try to update token
2025-10-10T13:59:52.243061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abecff56-f103a70d-78bed42c-2a52115d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:52.299632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.299660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.299671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.299722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:52.299734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:52.299749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:52.299758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:52.299769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:52.299805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592521810655974:2751]
2025-10-10T13:59:52.299832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592521810655974:2751]
2025-10-10T13:59:52.299853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592521810655974:2751]
2025-10-10T13:59:52.299872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592521810655974:2751]
2025-10-10T13:59:52.300006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:52.300028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.300038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:52.301158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:52.301306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:52.301336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:52.301362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:52.301416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:52.418709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: src_id|abecff56-f103a70d-78bed42c-2a52115d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:52.440619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:52.468969Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:52.470794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:52.470825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:52.473307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:52.473341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:52.475967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592523388571067:2507]
2025-10-10T13:59:52.476175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:52.477645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:52.510799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 32 reason: error at write: Disconnected sessionId: src_id|abecff56-f103a70d-78bed42c-2a52115d_0
2025-10-10T13:59:52.511104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 32 sessionId: src_id|abecff56-f103a70d-78bed42c-2a52115d_0 is DEAD
2025-10-10T13:59:52.513577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abecff56-f103a70d-78bed42c-2a52115d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:52.513626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abecff56-f103a70d-78bed42c-2a52115d_0] Write session will restart in 0.005203s
2025-10-10T13:59:52.513765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abecff56-f103a70d-78bed42c-2a52115d_0] Write session: Do CDS request
2025-10-10T13:59:52.513810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abecff56-f103a70d-78bed42c-2a52115d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:52.524265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abecff56-f103a70d-78bed42c-2a52115d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:52.523921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:52.523950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 33
2025-10-10T13:59:52.525049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:52.525207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 33 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:52.525223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=33 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:52.525233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:52.526832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 33 sessionId:  describe result for acl check
2025-10-10T13:59:52.526970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:52.526988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:52.526997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:52.527012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592523388571143:2859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:52.529447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592523388571143:2859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:52.532165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:52.533774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:52.534604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:52.534622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:52.534669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:52.534915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:52.535080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592521810656087:2760]
2025-10-10T13:59:52.537575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:52.539542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592523388571143:2859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:52.538665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:52.538869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:52.540088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:52.540391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:52.540399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:52.540405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:52.540411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:52.540417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:52.540423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:52.540431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:52.540438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:52.540443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.540449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.540456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.540464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.540508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:52.540600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:52.540643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:52.540685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:52.540725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:52.540768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:52.540808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:52.540849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:52.540902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.540947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.540986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.541028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.541068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:52.541165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:52.541225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:52.541277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:52.541320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:52.541370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:52.541409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:52.541458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:52.541500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:52.541552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:52.541596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:52.541645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:52.541686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:52.541735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:52.541776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:52.541827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:52.541874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.541921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.541982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.542037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.542078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.542128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.542168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.542215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.544119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:52.550633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592523388571143:2859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:52.550669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592523388571143:2859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:52.550685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592523388571143:2859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:52.550714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 33 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:52.575427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592523388571187:2507]
2025-10-10T13:59:52.588737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:52.604067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:52.604108Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:52.604122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:52.604142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:52.604164Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 32 [2:7559592521810656087:2760]
2025-10-10T13:59:52.604215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:52.604267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:52.604282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.604292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.604304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.604349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:52.604370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:52.604389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:52.606074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.606090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.606103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.606115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.606126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:52.606401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:52.606418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.606581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:52.606765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:52.606988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:52.607103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:52.607185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:52.607201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:52.607215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:52.607226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:52.607504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:52.607516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:52.607527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:52.607539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:52.609412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 32
2025-10-10T13:59:52.609503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 32
2025-10-10T13:59:52.609575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 32, pipe: [1:7559592523388571187:2507]
2025-10-10T13:59:52.610572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:52.610686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:52.610872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:52.610890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:52.610936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592523388571187:2507], now have 1 active actors on pipe
2025-10-10T13:59:52.610962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592523388571181:2859], now have 1 active actors on pipe
2025-10-10T13:59:52.610977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592523388571086:2442], now have 1 active actors on pipe
2025-10-10T13:59:52.611010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:52.611023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:52.611132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:52.611160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:52.611216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:52.611230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e3af692-394d9d3-7b8591dd-3e014144_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:52.611258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.611273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.611280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:52.611309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.611340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:52.611443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:52.613206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:52.613238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:52.613313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:52.614173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 33 partition: 0 MaxSeqNo: 36 sessionId: src_id|5e3af692-394d9d3-7b8591dd-3e014144_0
2025-10-10T13:59:52.614921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abecff56-f103a70d-78bed42c-2a52115d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5e3af692-394d9d3-7b8591dd-3e014144_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:52.682685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3af692-394d9d3-7b8591dd-3e014144_0] Write session: try to update token
2025-10-10T13:59:52.682739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3af692-394d9d3-7b8591dd-3e014144_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:52.820355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId: src_id|5e3af692-394d9d3-7b8591dd-3e014144_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:52.839552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.839582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.839591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.839645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:52.839655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:52.839667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:52.839675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:52.839683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:52.839711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:52.839733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:52.839751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:52.839768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:52.839955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:52.839980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:52.839990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:52.841036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:52.846099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:52.846137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:52.846162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:52.846188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:52.856046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:53.008875Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:53.035240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:53.035282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:53.035344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:53.035357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:53.035392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592521810656081:2760]
2025-10-10T13:59:53.035872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:53.038022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:53.036733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:53.038235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592523388571187:2507]
2025-10-10T13:59:53.038348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:53.056381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 33 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e3af692-394d9d3-7b8591dd-3e014144_0
2025-10-10T13:59:53.066249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 33 sessionId: src_id|5e3af692-394d9d3-7b8591dd-3e014144_0 is DEAD
2025-10-10T13:59:53.072697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3af692-394d9d3-7b8591dd-3e014144_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:53.072740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3af692-394d9d3-7b8591dd-3e014144_0] Write session will restart in 0.008177s
2025-10-10T13:59:53.072832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3af692-394d9d3-7b8591dd-3e014144_0] Write session: Do CDS request
2025-10-10T13:59:53.072856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3af692-394d9d3-7b8591dd-3e014144_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:53.094520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:53.094556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 34
2025-10-10T13:59:53.098732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3af692-394d9d3-7b8591dd-3e014144_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:53.101997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:53.102362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 34 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:53.102414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=34 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:53.102448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:53.104826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 34 sessionId:  describe result for acl check
2025-10-10T13:59:53.104962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:53.104974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:53.104984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:53.105002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592527683538570:2874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:53.107954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592527683538570:2874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:53.117061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:53.122496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592527683538570:2874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:53.124951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:53.125865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:53.125890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:53.125944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:53.126205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:53.126392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592526105623492:2763]
2025-10-10T13:59:53.128442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:53.130847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592527683538570:2874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:53.130886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592527683538570:2874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:53.130904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592527683538570:2874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:53.130935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 34 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:53.129761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:53.129986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:53.131224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:53.131508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:53.131515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:53.131521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:53.131528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:53.131534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:53.131540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:53.131547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:53.131553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:53.131559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.131565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.131571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.131576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.131618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:53.131715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:53.131761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:53.131807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:53.131849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:53.131896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:53.131936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:53.131975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:53.132015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.132054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.132093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.132132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.132167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:53.132223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:53.132276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:53.132321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:53.132359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:53.132402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:53.132441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:53.132487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:53.132524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:53.132568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:53.132607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:53.132651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:53.132693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:53.132741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:53.132779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:53.132825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:53.132866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.132911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.132953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.133000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.133042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.133088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.139112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592527683538603:2507]
2025-10-10T13:59:53.140293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.140409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.140884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:53.179489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:53.192835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:53.192885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:53.192906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:53.192941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:53.192968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 33 [2:7559592526105623492:2763]
2025-10-10T13:59:53.193031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:53.193094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:53.193109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.193723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.193756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.193809Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:53.193833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:53.193853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:53.195211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.195227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.195241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.195257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.195269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:53.195545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:53.195563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.195717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.198648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 33
2025-10-10T13:59:53.198761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 33
2025-10-10T13:59:53.198824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 33, pipe: [1:7559592527683538603:2507]
2025-10-10T13:59:53.195936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.196203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.196339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:53.196411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.196426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.196441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.196456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.196493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:53.196577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:53.196782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:53.196799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:53.196925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.196945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:53.197231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:53.197243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:53.197255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:53.197268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:53.197293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:53.208200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592527683538511:2442], now have 1 active actors on pipe
2025-10-10T13:59:53.208255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592527683538601:2874], now have 1 active actors on pipe
2025-10-10T13:59:53.208290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592527683538603:2507], now have 1 active actors on pipe
2025-10-10T13:59:53.208379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:53.208403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:53.208499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99c80285-265c5451-5abc86ec-b49928d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:53.208535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.208554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.208566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:53.208605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.208650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:53.208700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:53.210683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:53.210720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:53.210825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:53.211495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 34 partition: 0 MaxSeqNo: 36 sessionId: src_id|99c80285-265c5451-5abc86ec-b49928d9_0
2025-10-10T13:59:53.213677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e3af692-394d9d3-7b8591dd-3e014144_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|99c80285-265c5451-5abc86ec-b49928d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:53.258931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c80285-265c5451-5abc86ec-b49928d9_0] Write session: try to update token
2025-10-10T13:59:53.258975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c80285-265c5451-5abc86ec-b49928d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:53.350609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.350644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.350657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.350726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:53.350743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:53.350758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:53.350771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:53.350782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:53.350821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.350849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.350877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.350901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.351211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:53.351206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:53.351253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.351261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:53.351275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:53.351301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:53.351340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:53.356784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:53.422586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId: src_id|99c80285-265c5451-5abc86ec-b49928d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:53.445511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:53.506772Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:53.517732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:53.517775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:53.517834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:53.517849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:53.517885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592526105623487:2763]
2025-10-10T13:59:53.519713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:53.519833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:53.519843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:53.518450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:53.519194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:53.525371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592527683538603:2507]
2025-10-10T13:59:53.586744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:53.591463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c80285-265c5451-5abc86ec-b49928d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:53.591524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c80285-265c5451-5abc86ec-b49928d9_0] Write session will restart in 0.007899s
2025-10-10T13:59:53.591677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c80285-265c5451-5abc86ec-b49928d9_0] Write session: Do CDS request
2025-10-10T13:59:53.591718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c80285-265c5451-5abc86ec-b49928d9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:53.589486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 34 reason: error at write: Disconnected sessionId: src_id|99c80285-265c5451-5abc86ec-b49928d9_0
2025-10-10T13:59:53.589826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 34 sessionId: src_id|99c80285-265c5451-5abc86ec-b49928d9_0 is DEAD
2025-10-10T13:59:53.595965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:53.598653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:53.598685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:53.598728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:53.599036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:53.599224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592526105623594:2775]
2025-10-10T13:59:53.602670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:53.603905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:53.604385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:53.605877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:53.606246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:53.606256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:53.606263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:53.606270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:53.606278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:53.606285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:53.606292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:53.606301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:53.606309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.606316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.606324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.606332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.606380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:53.606509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:53.606563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:53.606616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:53.606665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:53.606716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:53.606768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:53.606815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:53.606863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.606913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.606962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.607029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.607114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:53.607275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:53.607435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:53.607593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:53.607717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:53.607821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:53.607922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:53.608028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:53.608140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:53.608261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:53.608387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:53.608514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:53.608627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:53.608733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:53.608852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:53.608951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:53.609002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.609058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.609105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.609630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.609701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.609760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.609812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.609869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.610736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c80285-265c5451-5abc86ec-b49928d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:53.610446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:53.613377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:53.613405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 35
2025-10-10T13:59:53.613837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:53.613959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 35 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:53.613976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=35 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:53.613987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:53.615421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 35 sessionId:  describe result for acl check
2025-10-10T13:59:53.615541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:53.615551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:53.615562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:53.615578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592527683538691:2880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:53.618346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592527683538691:2880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:53.623220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T13:59:53.623298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T13:59:53.625866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592527683538711:2507]
2025-10-10T13:59:53.628482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592527683538691:2880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:53.635563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592527683538691:2880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:53.635603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592527683538691:2880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:53.635622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592527683538691:2880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:53.635652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 35 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:53.639980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:53.655775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:53.655820Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:53.655835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:53.655855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:53.655877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 34 [2:7559592526105623594:2775]
2025-10-10T13:59:53.655931Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:53.655983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:53.655996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.656007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.656018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.656198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:53.656219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:53.656239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:53.674265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.674292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.674303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.674313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.674323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:53.675039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:53.675074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.675207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:53.675379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:53.675608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:53.675724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:53.675791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592526105623589:2775]
2025-10-10T13:59:53.675807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592526105623589:2775]
2025-10-10T13:59:53.675820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592526105623589:2775]
2025-10-10T13:59:53.675834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592526105623589:2775]
2025-10-10T13:59:53.675874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:53.675951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:53.676132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:53.676149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:53.676263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592526105623589:2775]
2025-10-10T13:59:53.676282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:53.677264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:53.677282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:53.677290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:53.677298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:53.677316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:53.678789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 34
2025-10-10T13:59:53.678871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 34
2025-10-10T13:59:53.678911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 34, pipe: [1:7559592527683538711:2507]
2025-10-10T13:59:53.678098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592527683538617:2442], now have 1 active actors on pipe
2025-10-10T13:59:53.678141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592527683538721:2880], now have 1 active actors on pipe
2025-10-10T13:59:53.678164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592527683538711:2507], now have 1 active actors on pipe
2025-10-10T13:59:53.679948Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T13:59:53.680328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:53.680357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:53.680423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:53.680443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.680456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.680464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:53.680490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.680521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:53.680558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:53.681205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T13:59:53.681687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T13:59:53.684544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-10T13:59:53.684731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:53.684766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:53.688023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 35 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0
2025-10-10T13:59:53.687581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:53.688866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c80285-265c5451-5abc86ec-b49928d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:53.717946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0] Write session: try to update token
2025-10-10T13:59:53.718004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:53.765692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:53.765722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:53.765736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:53.765748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:53.765761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:53.765798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592526105623589:2775]
2025-10-10T13:59:53.765828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592526105623589:2775]
2025-10-10T13:59:53.765855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592526105623589:2775]
2025-10-10T13:59:53.765877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592526105623589:2775]
2025-10-10T13:59:53.766046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.766062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.766074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.766119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:53.766145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:53.766158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:53.766175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:53.766219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:53.766261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:53.766291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:53.767429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:53.867474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId: src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:53.891381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:53.918054Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:53.919842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:53.919890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:53.922675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:53.922782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:53.922789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:53.925322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592527683538711:2507]
2025-10-10T13:59:53.926471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:53.951476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 35 reason: error at write: Disconnected sessionId: src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0
2025-10-10T13:59:53.951777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 35 sessionId: src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0 is DEAD
2025-10-10T13:59:53.955161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:53.955219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0] Write session will restart in 0.008140s
2025-10-10T13:59:53.955397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0] Write session: Do CDS request
2025-10-10T13:59:53.955450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:53.975896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:53.975923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 36
2025-10-10T13:59:53.976781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:53.977395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:53.977524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 36 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:53.977541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=36 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:53.977551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:53.982376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 36 sessionId:  describe result for acl check
2025-10-10T13:59:53.982518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:53.982529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:53.982538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:53.982559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592527683538785:2885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:53.985663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592527683538785:2885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:53.994029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592527683538785:2885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:54.003550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592527683538785:2885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:54.003594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592527683538785:2885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:54.003612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592527683538785:2885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:54.003642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 36 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:54.008050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:54.009649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:54.010365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:54.010390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:54.010430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:54.010657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:54.010835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592530400591011:2779]
2025-10-10T13:59:54.013347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:54.014395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:54.014595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:54.015896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:54.016261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:54.016269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:54.016276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:54.016282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:54.016288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:54.016294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:54.016300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:54.016307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:54.016314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.016321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.016327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.016333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.016387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:54.016509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:54.016561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:54.016612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:54.016661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:54.016709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:54.016758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:54.016819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:54.016859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.016899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.016936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.016973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.017002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:54.017067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:54.017148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:54.017209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:54.017262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:54.017318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:54.017371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:54.017428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:54.017481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:54.017542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:54.017588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:54.017658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:54.017710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:54.017766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:54.017816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:54.017871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:54.017922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.017987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.018038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.018098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.018148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.018205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.018255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.018313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.018834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:54.031002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592531978506121:2507]
2025-10-10T13:59:54.051530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:54.063663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:54.063707Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:54.063725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:54.063745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:54.063769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 35 [2:7559592530400591011:2779]
2025-10-10T13:59:54.063828Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:54.063885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:54.063899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.063913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.063929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.063977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:54.064008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:54.064029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:54.065681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.065702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.065720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.065736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.065748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:54.066018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:54.066036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.066201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.066403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.066664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.066789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:54.066861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.066877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.066892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.066906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.066947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:54.067029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:54.067227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:54.067243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:54.067370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.067391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:54.068913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:54.068935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:54.068946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:54.068958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:54.068985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:54.069163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592531978506113:2885], now have 1 active actors on pipe
2025-10-10T13:59:54.069200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592527683538740:2442], now have 1 active actors on pipe
2025-10-10T13:59:54.069226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592531978506121:2507], now have 1 active actors on pipe
2025-10-10T13:59:54.069997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 35, pipe: [1:7559592531978506121:2507]
2025-10-10T13:59:54.070108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 35
2025-10-10T13:59:54.070179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 35
2025-10-10T13:59:54.073221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:54.073258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:54.073356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:54.073389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.073408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.073420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:54.073457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.073502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:54.073555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:54.074313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:54.074338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:54.074401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:54.074695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 36 partition: 0 MaxSeqNo: 36 sessionId: src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0
2025-10-10T13:59:54.084058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6138f9-8a2bcfca-1ce35fdd-6f87013d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:54.173273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.173307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.173318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.176742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0] Write session: try to update token
2025-10-10T13:59:54.176800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:54.240462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:54.240490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:54.240504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:54.240515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:54.240526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:54.240561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.240589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.240615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.240635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.241219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:54.241255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:54.241285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:54.241312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:54.293093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:54.293253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.293266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:54.294206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:54.341218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId: src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:54.362111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:54.459952Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:54.462782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:54.462809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:54.462852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592530400591005:2779]
2025-10-10T13:59:54.463001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:54.463026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:54.463162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:54.463977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:54.464490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592531978506121:2507]
2025-10-10T13:59:54.464579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:54.464590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:54.491933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:54.491990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0] Write session will restart in 0.007932s
2025-10-10T13:59:54.492134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0] Write session: Do CDS request
2025-10-10T13:59:54.492177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:54.489571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:54.489698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 36 reason: error at write: Disconnected sessionId: src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0
2025-10-10T13:59:54.490000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 36 sessionId: src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0 is DEAD
2025-10-10T13:59:54.510233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:54.510262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 37
2025-10-10T13:59:54.513406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:54.517841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:54.518003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 37 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:54.518022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=37 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:54.518033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:54.520380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 37 sessionId:  describe result for acl check
2025-10-10T13:59:54.520492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:54.520502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:54.520510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:54.520527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592531978506166:2895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:54.524888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592531978506166:2895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:54.539327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592531978506166:2895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:54.542651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:54.552749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:54.553661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:54.553687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:54.553730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:54.553980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:54.554153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592530400591105:2788]
2025-10-10T13:59:54.556447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:54.556920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592531978506166:2895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:54.556959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592531978506166:2895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:54.556974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592531978506166:2895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:54.557000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 37 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:54.557764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:54.557969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:54.559273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:54.559598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:54.559614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:54.559623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:54.559630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:54.559637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:54.559645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:54.559652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:54.559658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:54.559664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.559672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.559680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.559688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.559736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:54.559843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:54.559896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:54.559950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:54.560001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:54.560050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:54.560098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:54.560145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:54.560195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.560250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.560300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.560350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.560392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:54.560464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:54.560530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:54.560599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:54.560653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:54.560715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:54.560768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:54.560828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:54.560885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:54.560946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:54.560995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:54.561051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:54.561105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:54.561479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:54.561539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:54.561598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:54.561653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.561717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.561767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.561832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.561884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.561947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.561997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.562057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.562546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:54.565831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592531978506243:2507]
2025-10-10T13:59:54.595142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:54.609393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:54.609437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:54.609453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:54.609473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:54.609495Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 36 [2:7559592530400591105:2788]
2025-10-10T13:59:54.609552Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:54.609609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:54.609623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.609635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.609646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.609690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:54.609710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:54.609730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:54.611021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.611049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.611063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.611076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.611087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:54.612938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 36, pipe: [1:7559592531978506243:2507]
2025-10-10T13:59:54.613060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 36
2025-10-10T13:59:54.613143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 36
2025-10-10T13:59:54.611601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:54.611625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.611772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:54.611968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:54.612215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:54.612343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:54.612425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592531978506243:2507], now have 1 active actors on pipe
2025-10-10T13:59:54.612451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592531978506239:2895], now have 1 active actors on pipe
2025-10-10T13:59:54.612474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592531978506146:2442], now have 1 active actors on pipe
2025-10-10T13:59:54.612498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592530400591100:2788]
2025-10-10T13:59:54.612512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592530400591100:2788]
2025-10-10T13:59:54.612537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592530400591100:2788]
2025-10-10T13:59:54.612550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592530400591100:2788]
2025-10-10T13:59:54.612592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:54.612674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:54.612864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:54.612880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:54.613002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592530400591100:2788]
2025-10-10T13:59:54.613020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:54.613455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:54.613469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:54.613482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:54.613495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:54.613517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:54.614577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:54.614607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:54.614719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:54.614754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.614782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.614793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:54.614834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.614878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:54.614946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:54.617148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:54.617183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:54.617270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:54.618445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 37 partition: 0 MaxSeqNo: 36 sessionId: src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0
2025-10-10T13:59:54.619541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2afb1999-c9862041-9a2f4355-6bcfd850_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:54.696100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0] Write session: try to update token
2025-10-10T13:59:54.696158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:54.758585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.758615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.758628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.758685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:54.758700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:54.758713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:54.758722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:54.758733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:54.758770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592530400591100:2788]
2025-10-10T13:59:54.758796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592530400591100:2788]
2025-10-10T13:59:54.758819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592530400591100:2788]
2025-10-10T13:59:54.758841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592530400591100:2788]
2025-10-10T13:59:54.758987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:54.759013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:54.759026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:54.759286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:54.759321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:54.759356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:54.759386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:54.762009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:54.827352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId: src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:54.849702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:54.926970Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:54.944323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:54.944362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:54.948777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:54.948821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592531978506243:2507]
2025-10-10T13:59:54.948920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:54.948932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:54.953285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:54.994164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 37 reason: error at write: Disconnected sessionId: src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0
2025-10-10T13:59:54.994612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 37 sessionId: src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0 is DEAD
2025-10-10T13:59:55.001218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:55.001248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0] Write session will restart in 0.008379s
2025-10-10T13:59:55.001334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0] Write session: Do CDS request
2025-10-10T13:59:55.001364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:55.014469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:55.016846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:55.016879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 38
2025-10-10T13:59:55.017301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:55.017408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 38 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:55.017423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=38 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:55.017433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:55.018811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 38 sessionId:  describe result for acl check
2025-10-10T13:59:55.018925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:55.018936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:55.018944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:55.018964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592536273473622:2905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:55.021433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592536273473622:2905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:55.026552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:55.031420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592536273473622:2905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:55.031157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:55.031922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:55.031938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:55.031977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:55.032213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:55.032378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592534695558520:2793]
2025-10-10T13:59:55.034487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:55.039230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:55.039440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:55.040716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:55.041046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:55.041068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:55.041074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:55.041082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:55.041089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:55.041095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:55.041102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:55.041107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:55.041114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.041121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.041142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.041147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.041193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:55.041295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:55.041340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:55.041384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:55.041437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:55.041486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:55.041537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:55.041577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:55.041622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.041667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.041709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.041750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.041791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:55.041856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:55.041912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:55.041965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:55.043455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:55.043552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:55.043626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:55.043696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:55.043751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:55.043803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:55.043861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:55.043910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:55.043955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:55.044007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:55.044060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:55.044109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:55.044151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.044197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.044239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.044286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.044329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.044388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.044429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.044473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.044865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:55.045433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592536273473648:2507]
2025-10-10T13:59:55.048659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592536273473622:2905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:55.048699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592536273473622:2905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:55.048716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592536273473622:2905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:55.048744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 38 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:55.086710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:55.101102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:55.101508Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:55.101527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:55.101547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:55.101570Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 37 [2:7559592534695558520:2793]
2025-10-10T13:59:55.101619Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:55.101676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:55.101690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.101701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.101711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.101759Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:55.101782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:55.101806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:55.103969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.103988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.103997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.104004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.104012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:55.104236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:55.104246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.104355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.104511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.104744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.104814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:55.104875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.104888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.104900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.104911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.104953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:55.105030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:55.105253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:55.105265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:55.105276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:55.105286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:55.105522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:55.105552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:55.105736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592536273473648:2507], now have 1 active actors on pipe
2025-10-10T13:59:55.105762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592536273473656:2905], now have 1 active actors on pipe
2025-10-10T13:59:55.105780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592531978506273:2442], now have 1 active actors on pipe
2025-10-10T13:59:55.105798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.105736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 37, pipe: [1:7559592536273473648:2507]
2025-10-10T13:59:55.105848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 37
2025-10-10T13:59:55.105912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 37
2025-10-10T13:59:55.110421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 38 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0
2025-10-10T13:59:55.105828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:55.105880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:55.106579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:55.106603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:55.106688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:55.106716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.106733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.106743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:55.106778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.106816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:55.106857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:55.109865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:55.109897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:55.109978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:55.113602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fcafe26-60284c9a-4c458acd-68ff04bb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:55.149342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0] Write session: try to update token
2025-10-10T13:59:55.149398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:55.160207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:55.160237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:55.160273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.160393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:55.162095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:55.174228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:55.175535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:55.176692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:55.182028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:55.191438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:55.191929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:55.198920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.198946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.198959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.357972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.358004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.358018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.358078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:55.358093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:55.358105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:55.358115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:55.358127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:55.358167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.358190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.358209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.358227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592534695558510:2793]
2025-10-10T13:59:55.358366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:55.358391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.358401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:55.358564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:55.358607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:55.358642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:55.358677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:55.374984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:55.413222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId: src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:55.441780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:55.552687Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:55.555779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:55.555813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:55.558381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:55.559329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592536273473648:2507]
2025-10-10T13:59:55.559528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:55.559554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:55.560066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:55.583160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 38 reason: error at write: Disconnected sessionId: src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0
2025-10-10T13:59:55.583549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 38 sessionId: src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0 is DEAD
2025-10-10T13:59:55.585461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:55.585502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0] Write session will restart in 0.007280s
2025-10-10T13:59:55.585601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0] Write session: Do CDS request
2025-10-10T13:59:55.585644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:55.623191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:55.622905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:55.622950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 39
2025-10-10T13:59:55.629393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:55.629537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 39 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:55.629552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=39 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:55.629561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:55.632009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 39 sessionId:  describe result for acl check
2025-10-10T13:59:55.632126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:55.632135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:55.632144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:55.632162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592536273473699:2911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:55.636750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592536273473699:2911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:55.660638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592536273473723:2507]
2025-10-10T13:59:55.675937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592536273473699:2911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:55.707691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:55.718820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:55.718038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592536273473699:2911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:55.718079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592536273473699:2911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:55.718097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592536273473699:2911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:55.718128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 39 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:55.719669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:55.719699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:55.719748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:55.720029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:55.720205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592534695558623:2803]
2025-10-10T13:59:55.722484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:55.726096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:55.726359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:55.727663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:55.727998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:55.728005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:55.728012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:55.728019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:55.728025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:55.728031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:55.728037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:55.728042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:55.728049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.728055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.728062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.728068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.728113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:55.728214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:55.728259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:55.728302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:55.728343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:55.728385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:55.728428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:55.728468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:55.728512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.728554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.728595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.728635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.728676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:55.728737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:55.728796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:55.728848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:55.728894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:55.728944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:55.728986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:55.729036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:55.729082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:55.729988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:55.730058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:55.730115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:55.730162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:55.730228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:55.730272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:55.730327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:55.730377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.730431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.730473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.730549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.730594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.730643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.730687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.730740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.731158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:55.782445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:55.797149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:55.797188Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:55.797205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:55.797226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:55.797249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 38 [2:7559592534695558623:2803]
2025-10-10T13:59:55.797306Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:55.797360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:55.797373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.797386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.797397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.797441Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:55.797461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:55.797481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:55.826900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.826925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.826938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.826951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.826962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:55.827238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:55.827256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:55.827392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:55.827569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:55.827799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:55.828246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:55.828331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:55.828348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:55.828361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:55.828374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:55.828411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:55.828495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:55.828679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:55.828694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:55.828818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:55.828837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:55.829330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:55.829356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:55.829369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:55.829382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:55.829409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:55.830111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592536273473671:2442], now have 1 active actors on pipe
2025-10-10T13:59:55.830148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592536273473787:2911], now have 1 active actors on pipe
2025-10-10T13:59:55.830173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592536273473723:2507], now have 1 active actors on pipe
2025-10-10T13:59:55.830451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 38
2025-10-10T13:59:55.830576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 38
2025-10-10T13:59:55.830649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 38, pipe: [1:7559592536273473723:2507]
2025-10-10T13:59:55.831585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:55.831619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:55.831706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:55.831737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.831755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.831765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:55.831799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.831840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:55.831890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:55.836141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:55.836184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:55.836262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:55.836705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 39 partition: 0 MaxSeqNo: 36 sessionId: src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0
2025-10-10T13:59:55.839926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ad994cf-f5660fc8-7da64da1-3b008f6c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:55.889197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0] Write session: try to update token
2025-10-10T13:59:55.889250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:55.915990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.916026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.916039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.916120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:55.916136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:55.916175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:55.916281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:55.916311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:55.926834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:55.928126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:55.936987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:55.938270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:55.944947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:55.947941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:56.010486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:56.010533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:56.010549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:56.010561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:56.010572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:56.010610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:56.010635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:56.010660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:56.027749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592534695558616:2803]
2025-10-10T13:59:56.027977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.027992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.028004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.028052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:56.028080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.028091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:56.029277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:56.031084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:56.031127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:56.031148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:56.031166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:56.126443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId: src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:56.165716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:56.191566Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:56.193983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:56.194023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:56.194742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:56.195246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:56.195376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:56.204938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 39 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0
2025-10-10T13:59:56.205266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 39 sessionId: src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0 is DEAD
2025-10-10T13:59:56.205717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:56.205785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0] Write session will restart in 0.007024s
2025-10-10T13:59:56.205938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0] Write session: Do CDS request
2025-10-10T13:59:56.205983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:56.215032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592536273473723:2507]
2025-10-10T13:59:56.220387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:56.220424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 40
2025-10-10T13:59:56.221189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:56.222024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:56.222145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 40 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:56.222168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=40 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:56.222177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:56.223419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 40 sessionId:  describe result for acl check
2025-10-10T13:59:56.223518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:56.223529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:56.223538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:56.223555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592540568441117:2924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:56.229485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592540568441117:2924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:56.236250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592540568441117:2924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:56.251959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592540568441117:2924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:56.252000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592540568441117:2924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:56.252017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592540568441117:2924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:56.252048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 40 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:56.257598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:56.263796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:56.265017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:56.265064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:56.265151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:56.265635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:56.265893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592538990526044:2812]
2025-10-10T13:59:56.269953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:56.271486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:56.271696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:56.272947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:56.273290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:56.273299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:56.273316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:56.273323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:56.273331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:56.273339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:56.273345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:56.273351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:56.273357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.273363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.273370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.273376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.273419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:56.273524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:56.273583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:56.273628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:56.273670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:56.273713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:56.273756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:56.273798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:56.273841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.273902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.273947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.273991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.274041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:56.274111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:56.274171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:56.274235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:56.274283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:56.274333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:56.274380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:56.274437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:56.274481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:56.274541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:56.274587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:56.274640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:56.274683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:56.274735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:56.274780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:56.274830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:56.274873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.274924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.274967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.275019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.275065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.275115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.275159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.275208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.275639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:56.303542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:56.315114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592540568441203:2507]
2025-10-10T13:59:56.322326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:56.322371Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:56.322387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:56.322407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:56.322432Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 39 [2:7559592538990526044:2812]
2025-10-10T13:59:56.322487Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:56.322559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:56.322574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.322585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.322594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.322639Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:56.322659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:56.322680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:56.332977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.333019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.333035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.333051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.333064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:56.333789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 39
2025-10-10T13:59:56.333869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 39, pipe: [1:7559592540568441203:2507]
2025-10-10T13:59:56.333941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 39
2025-10-10T13:59:56.333458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:56.333490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.333655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.333870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.334125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.334280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:56.334402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592540568441184:2924], now have 1 active actors on pipe
2025-10-10T13:59:56.334428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592540568441203:2507], now have 1 active actors on pipe
2025-10-10T13:59:56.334452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592540568441103:2442], now have 1 active actors on pipe
2025-10-10T13:59:56.334476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.334492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.334506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.334520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.334570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:56.334656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:56.334704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:56.334720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:56.334732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:56.334743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:56.334857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:56.334875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:56.335034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:56.335058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:56.335106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.335139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:56.335169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:56.335253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:56.335282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.335300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.335311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:56.335346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.335389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:56.335479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:56.340555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:56.340598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:56.340681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:56.341353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 40 partition: 0 MaxSeqNo: 36 sessionId: src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0
2025-10-10T13:59:56.342174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f385b9e1-decd5a78-fbef458b-d9d7e5dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:56.383422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0] Write session: try to update token
2025-10-10T13:59:56.383483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:56.470834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.470897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.470912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.471045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:56.471060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:56.471087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:56.471102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:56.471114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:56.471151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.471179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.471202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.471225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.471362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:56.471400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:56.471442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:56.471496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:56.538077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:56.538150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.538176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:56.539699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:56.565004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId: src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:56.591490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:56.683705Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:56.685759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:56.685782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:56.685829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592538990526039:2812]
2025-10-10T13:59:56.685978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:56.686003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:56.686178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:56.687016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:56.687044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:56.691400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592540568441203:2507]
2025-10-10T13:59:56.691486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:56.686852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:56.705845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 40 reason: error at write: Disconnected sessionId: src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0
2025-10-10T13:59:56.706150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 40 sessionId: src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0 is DEAD
2025-10-10T13:59:56.709512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:56.709575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0] Write session will restart in 0.007088s
2025-10-10T13:59:56.709708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0] Write session: Do CDS request
2025-10-10T13:59:56.709764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:56.728950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:56.729025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:56.729064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 41
2025-10-10T13:59:56.729868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:56.730122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 41 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:56.730149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=41 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:56.730171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:56.732541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 41 sessionId:  describe result for acl check
2025-10-10T13:59:56.732635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:56.732641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:56.732647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:56.732659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592540568441271:2933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:56.736150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592540568441271:2933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:56.751263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592540568441271:2933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:56.757584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:56.760444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:56.761353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:56.761374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:56.761416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:56.761689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:56.761883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592538990526151:2817]
2025-10-10T13:59:56.765491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592540568441271:2933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:56.765543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592540568441271:2933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:56.765562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592540568441271:2933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:56.765594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 41 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:56.765734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:56.769816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:56.770075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:56.771483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:56.771840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:56.771850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:56.771860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:56.771867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:56.771874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:56.771882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:56.771891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:56.771898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:56.771906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.771912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.771921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.771928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.771980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:56.772066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:56.772106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:56.772144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:56.772181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:56.772218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:56.772252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:56.772300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:56.772346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.772397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.772449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.772497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.772540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:56.772613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:56.772683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:56.772746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:56.772801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:56.772860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:56.772911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:56.772959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:56.772994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:56.773032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:56.773063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:56.773105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:56.774129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:56.774212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:56.774268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:56.774327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:56.774383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.774438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.774487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.774562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.774616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.774675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.774725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.774784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.775270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:56.792238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592540568441328:2507]
2025-10-10T13:59:56.821279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:56.835292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:56.835337Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:56.835355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:56.835374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:56.835398Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 40 [2:7559592538990526151:2817]
2025-10-10T13:59:56.835456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:56.835509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:56.835524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.835537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.835549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.835593Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:56.835615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:56.835637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:56.837743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.837770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.837785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.837800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.837813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:56.838629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 40
2025-10-10T13:59:56.838652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 40, pipe: [1:7559592540568441328:2507]
2025-10-10T13:59:56.838737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 40
2025-10-10T13:59:56.838108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:56.838135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.838297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:56.838497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:56.838753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:56.838879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:56.838958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592540568441322:2933], now have 1 active actors on pipe
2025-10-10T13:59:56.838982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592540568441328:2507], now have 1 active actors on pipe
2025-10-10T13:59:56.839002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592540568441238:2442], now have 1 active actors on pipe
2025-10-10T13:59:56.839026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:56.839042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:56.839057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:56.839070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:56.839103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:56.839158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:56.839173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:56.839179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:56.839184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:56.839195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:56.839364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:56.839381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:56.839435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:56.839456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:56.839589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:56.839619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:56.839687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:56.839696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:56.839721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.839739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.839750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:56.839782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.839817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:56.839943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:56.841482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:56.841510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:56.841599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:56.842421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 41 partition: 0 MaxSeqNo: 36 sessionId: src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0
2025-10-10T13:59:56.843459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f8197-bac86193-dfaa0c0c-ac11af5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:56.886502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0] Write session: try to update token
2025-10-10T13:59:56.886575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:56.999050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.999075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.999082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.999128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:56.999142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:56.999155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:56.999166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:56.999177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:56.999212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:56.999237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:56.999259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:56.999278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:56.999485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:56.999512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:56.999522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:56.999528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:56.999561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:56.999591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:56.999619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:57.006045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:57.045270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId: src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:57.066334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:57.185927Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:57.206905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:57.206948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:57.207012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:57.207026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:57.207067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592538990526146:2817]
2025-10-10T13:59:57.207541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:57.207930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:57.209331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592540568441328:2507]
2025-10-10T13:59:57.209459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:57.209648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:57.225863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 41 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0
2025-10-10T13:59:57.226234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 41 sessionId: src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0 is DEAD
2025-10-10T13:59:57.230016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:57.230075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0] Write session will restart in 0.005281s
2025-10-10T13:59:57.230208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0] Write session: Do CDS request
2025-10-10T13:59:57.230247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:57.255364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:57.256523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:57.256587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 42
2025-10-10T13:59:57.262206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:57.262353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 42 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:57.262368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=42 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:57.262378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:57.263814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 42 sessionId:  describe result for acl check
2025-10-10T13:59:57.263943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:57.263955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:57.263963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:57.263981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592544863408664:2938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:57.266199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592544863408664:2938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:57.272669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592544863408664:2938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:57.282635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:57.283486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592544863408664:2938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:57.283528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592544863408664:2938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:57.283554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592544863408664:2938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:57.283582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 42 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:57.285147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:57.285925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:57.285957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:57.286002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:57.286268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:57.286453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592543285493585:2827]
2025-10-10T13:59:57.288677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:57.289809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:57.290078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:57.291353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:57.291695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:57.291703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:57.291709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:57.291717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:57.291723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:57.291730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:57.291736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:57.291742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:57.291749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.291755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.291762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.291769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.291812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:57.291911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:57.291957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:57.292002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:57.292050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:57.292093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:57.292137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:57.292180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:57.292223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.292271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.292318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.292363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.292403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:57.292466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:57.292522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:57.292575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:57.292623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:57.292673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:57.292713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:57.292762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:57.292807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:57.293183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:57.293233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:57.293287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:57.293333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:57.293397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:57.293439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:57.293490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:57.293535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.293583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.293626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.293695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.293741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.293789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.293831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.293870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.294277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:57.309511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592544863408733:2507]
2025-10-10T13:59:57.325938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:57.368570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:57.368608Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:57.368622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:57.368639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:57.368661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 41 [2:7559592543285493585:2827]
2025-10-10T13:59:57.368710Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:57.368767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:57.368781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.368793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.368802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.368848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:57.368869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:57.368890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:57.372877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.375760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 41, pipe: [1:7559592544863408733:2507]
2025-10-10T13:59:57.375854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 41
2025-10-10T13:59:57.375929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 41
2025-10-10T13:59:57.373018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.373034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.373047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.373057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:57.373346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:57.373362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.373487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.373656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.373860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.373966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:57.374044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.374059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.374071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.374082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.374131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:57.374210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:57.374370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:57.374386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:57.374517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.374536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:57.374802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:57.374814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:57.374824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:57.374835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:57.374858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:57.376694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592544863408733:2507], now have 1 active actors on pipe
2025-10-10T13:59:57.376729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592544863408638:2442], now have 1 active actors on pipe
2025-10-10T13:59:57.376750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592544863408723:2938], now have 1 active actors on pipe
2025-10-10T13:59:57.376812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:57.376833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:57.376903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:57.376935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.376952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.376963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:57.376998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.377046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:57.377088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:57.383242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:57.383283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:57.383361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:57.383829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 42 partition: 0 MaxSeqNo: 36 sessionId: src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0
2025-10-10T13:59:57.385362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fcd224-92407c1d-9631fe63-bafd2c05_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:57.428878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0] Write session: try to update token
2025-10-10T13:59:57.428930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:57.506998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:57.507027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:57.507038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:57.507047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:57.507056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:57.507088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.507107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.507126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.507142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.507292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:57.507330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:57.507346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.507355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:57.507357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.507367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.507382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:57.507409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:57.507432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.507441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:57.508474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:57.605226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId: src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:57.649368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:57.679198Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:57.702994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:57.703042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:57.703103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:57.703116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:57.703156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592543285493579:2827]
2025-10-10T13:59:57.704392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:57.705844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592544863408733:2507]
2025-10-10T13:59:57.705923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:57.706044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:57.706055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:57.709672Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:57.739945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 42 reason: error at write: Disconnected sessionId: src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0
2025-10-10T13:59:57.740327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 42 sessionId: src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0 is DEAD
2025-10-10T13:59:57.741611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:57.741645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0] Write session will restart in 0.005293s
2025-10-10T13:59:57.741739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0] Write session: Do CDS request
2025-10-10T13:59:57.741767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:57.758315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:57.795389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:57.795419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 43
2025-10-10T13:59:57.795931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:57.796026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 43 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:57.796040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=43 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:57.796049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:57.800798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 43 sessionId:  describe result for acl check
2025-10-10T13:59:57.800918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:57.800928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:57.800940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:57.800958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592544863408833:2950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:57.804214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592544863408833:2950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:57.806140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:57.808290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592544863408842:2507]
2025-10-10T13:59:57.816552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:57.815605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592544863408833:2950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:57.817412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:57.817439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:57.817481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:57.817771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:57.817972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592543285493689:2835]
2025-10-10T13:59:57.820009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:57.825456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592544863408833:2950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:57.825494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592544863408833:2950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:57.825510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592544863408833:2950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:57.825537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 43 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:57.822440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:57.822683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:57.823934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:57.824231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:57.824238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:57.824245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:57.824252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:57.824259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:57.824265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:57.824272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:57.824278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:57.824285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.824292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.824299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.824306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.824350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:57.824452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:57.824497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:57.824540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:57.824584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:57.824626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:57.824670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:57.824712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:57.824754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.824797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.824838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.824881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.824916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:57.824976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:57.825029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:57.825082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:57.825151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:57.825202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:57.825243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:57.825290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:57.825332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:57.825379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:57.825419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:57.825466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:57.825505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:57.825551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:57.825591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:57.825638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:57.825677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.825725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.825766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.825812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.825853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.825902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.825940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.825987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.826369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:57.887349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:57.905487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:57.905532Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:57.905550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:57.905568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:57.905594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 42 [2:7559592543285493689:2835]
2025-10-10T13:59:57.905649Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:57.905713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:57.905729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.905742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.905754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.905801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:57.905824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:57.905845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:57.907200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.907216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.907230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.907243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.907253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:57.907522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:57.907540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:57.907680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:57.907859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:57.908073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:57.908187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:57.908263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:57.908277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:57.908288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:57.908300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:57.908345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:57.908425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:57.908475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:57.908488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:57.908497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:57.908507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:57.908593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:57.908609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:57.912452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:57.912515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:57.912656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592544863408773:2442], now have 1 active actors on pipe
2025-10-10T13:59:57.912680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592544863408872:2950], now have 1 active actors on pipe
2025-10-10T13:59:57.912702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592544863408842:2507], now have 1 active actors on pipe
2025-10-10T13:59:57.913339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 42
2025-10-10T13:59:57.913450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 42
2025-10-10T13:59:57.913513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 42, pipe: [1:7559592544863408842:2507]
2025-10-10T13:59:57.913038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:57.919032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:57.919075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:57.919168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:57.919205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.919223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.919234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:57.919276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.919325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:57.919377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:57.926142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:57.926185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:57.926273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:57.927744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 43 partition: 0 MaxSeqNo: 36 sessionId: src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0
2025-10-10T13:59:57.929356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aa3215b-9e127bf4-f016f2ad-2e9ef5cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:58.020021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0] Write session: try to update token
2025-10-10T13:59:58.020080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:58.069033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:58.069066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:58.069103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:58.069251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.069268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.069281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.069348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:58.070961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:58.072020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:58.073062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:58.077277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:58.087101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:58.107505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:58.107925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:58.180174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:58.180206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:58.180220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:58.180232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:58.180241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:58.180283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:58.180306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:58.180328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:58.180350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592543285493675:2835]
2025-10-10T13:59:58.180507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.180517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.180528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.180574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:58.180598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.180609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:58.181623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:58.181660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:58.181685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:58.181713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:58.182455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:58.241578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId: src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:58.266106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:58.390358Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:58.392870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:58.392903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:58.393641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:58.397250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:58.397414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:58.399317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592544863408842:2507]
2025-10-10T13:59:58.406927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 43 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0
2025-10-10T13:59:58.407316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 43 sessionId: src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0 is DEAD
2025-10-10T13:59:58.410423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:58.410460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0] Write session will restart in 0.008423s
2025-10-10T13:59:58.410558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0] Write session: Do CDS request
2025-10-10T13:59:58.410607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:58.426917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:58.427513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:58.427546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 44
2025-10-10T13:59:58.429413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:58.429698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 44 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:58.429727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=44 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:58.429744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:58.431335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 44 sessionId:  describe result for acl check
2025-10-10T13:59:58.431461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:58.431471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:58.431480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:58.431495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592549158376197:2957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:58.434523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592549158376197:2957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:58.444634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592549158376197:2957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:58.455205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592549158376197:2957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:58.455237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592549158376197:2957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:58.455248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592549158376197:2957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:58.455270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 44 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:58.488234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:58.490319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:58.491068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:58.491097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:58.491143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:58.491390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:58.491562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592547580461110:2847]
2025-10-10T13:59:58.493709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:58.494837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:58.495041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:58.496203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:58.496504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:58.496512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:58.496519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:58.496526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:58.496531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:58.496536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:58.496542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:58.496547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:58.496555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.496560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.496567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.496574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.496617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:58.496716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:58.496760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:58.496799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:58.496838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:58.496880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:58.496922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:58.496963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:58.497005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.497045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.497087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.497150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.497192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:58.497249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:58.497299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:58.497350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:58.497397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:58.497444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:58.497481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:58.497530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:58.497575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:58.497621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:58.497662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:58.497709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:58.497753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:58.497802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:58.497846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:58.497891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:58.497937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.497983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.498027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.498075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.498117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.498168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.498211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.499715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592549158376277:2507]
2025-10-10T13:59:58.498262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.498690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:58.528328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:58.543966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:58.544008Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:58.544024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:58.544041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:58.544061Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 43 [2:7559592547580461110:2847]
2025-10-10T13:59:58.544111Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:58.544167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:58.544182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.544194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.544206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.544252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:58.544273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:58.544295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:58.560974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.560997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.561007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.561018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.561028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:58.561286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:58.561306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.561423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.561584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.561793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.561899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:58.561978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592549158376187:2442], now have 1 active actors on pipe
2025-10-10T13:59:58.562003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592549158376277:2507], now have 1 active actors on pipe
2025-10-10T13:59:58.562022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592549158376245:2957], now have 1 active actors on pipe
2025-10-10T13:59:58.562047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.562061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.562073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.562085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.562123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:58.562158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:58.562177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:58.562187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:58.562193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:58.562196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:58.562348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:58.562369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:58.562484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.562510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:58.562544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:58.563521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 43, pipe: [1:7559592549158376277:2507]
2025-10-10T13:59:58.563522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 43
2025-10-10T13:59:58.563611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 43
2025-10-10T13:59:58.563840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:58.563870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:58.563951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ba7198e-20407758-dd869ec4-a703994d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:58.563986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.564006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.564017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:58.564052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.564097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:58.564141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:58.564522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:58.564544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:58.564598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:58.564909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 44 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ba7198e-20407758-dd869ec4-a703994d_0
2025-10-10T13:59:58.566345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8a88b0-5988be7-bfa3d5cc-4aa57ee7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ba7198e-20407758-dd869ec4-a703994d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:58.608068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:58.608101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:58.608136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.608224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:58.615982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba7198e-20407758-dd869ec4-a703994d_0] Write session: try to update token
2025-10-10T13:59:58.616041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba7198e-20407758-dd869ec4-a703994d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:58.625400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:58.635790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T13:59:58.637037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:58.638873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:58.640084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T13:59:58.643853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T13:59:58.644357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T13:59:58.644673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.644704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.644715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.728458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:58.728493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:58.728506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:58.728515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:58.728526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:58.728567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.728591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.728614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.728635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592547580461104:2847]
2025-10-10T13:59:58.728783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:58.728816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.728827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:58.728933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:58.728965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:58.728989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:58.729018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:58.746220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:58.770294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId: src_id|1ba7198e-20407758-dd869ec4-a703994d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:58.792756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:58.919433Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:58.927499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:58.927543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:58.928424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:58.928594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592549158376277:2507]
2025-10-10T13:59:58.928683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:58.928204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:58.940171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 44 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ba7198e-20407758-dd869ec4-a703994d_0
2025-10-10T13:59:58.940518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 44 sessionId: src_id|1ba7198e-20407758-dd869ec4-a703994d_0 is DEAD
2025-10-10T13:59:58.941312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba7198e-20407758-dd869ec4-a703994d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T13:59:58.941347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba7198e-20407758-dd869ec4-a703994d_0] Write session will restart in 0.009714s
2025-10-10T13:59:58.941447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba7198e-20407758-dd869ec4-a703994d_0] Write session: Do CDS request
2025-10-10T13:59:58.941478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba7198e-20407758-dd869ec4-a703994d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:58.957724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba7198e-20407758-dd869ec4-a703994d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:58.964968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:58.965014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 45
2025-10-10T13:59:58.965705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:58.965843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 45 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:58.965860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=45 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:58.965870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:58.971344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 45 sessionId:  describe result for acl check
2025-10-10T13:59:58.971460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:58.971470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:58.971480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:58.971497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592549158376367:2970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:58.975853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592549158376367:2970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:58.981782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592549158376367:2970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:58.986950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:58.989121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:58.989857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:58.989881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:58.989921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:58.990145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:58.990313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592547580461228:2855]
2025-10-10T13:59:58.992367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:58.993276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:58.993455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:58.992475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592549158376367:2970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:58.992516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592549158376367:2970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:58.992534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592549158376367:2970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:58.992563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 45 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:58.994604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:58.994883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:58.994890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:58.994894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:58.994898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:58.994903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:58.994910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:58.994917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:58.994922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:58.994930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.994937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.994944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.994951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.994994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:58.995096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:58.995140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:58.995183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:58.995226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:58.995270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:58.995312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:58.995354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:58.995398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.995440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.995483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.995523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.995562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:58.995621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:58.995679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:58.995731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:58.995775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:58.995823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:58.995864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:58.995915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:58.995961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:58.996011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:58.996064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:58.996115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:58.996166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:58.996217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:58.996265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:58.996322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:58.996372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.996424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:58.996467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.996504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:58.996537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.996573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:58.996606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.996642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:58.996949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:59.029157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592553453343715:2507]
2025-10-10T13:59:59.041918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:59.056879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:59.056927Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:59.056944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:59.056964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:59.056987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 44 [2:7559592547580461228:2855]
2025-10-10T13:59:59.057043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:59.057102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:59.057116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.057146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.057157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.057204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:59.057226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:59.057248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:59.059597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.059625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.059639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.059652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.059662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:59.059927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:59.059949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.060084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.060255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.060474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.060582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:59.060673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592549158376325:2442], now have 1 active actors on pipe
2025-10-10T13:59:59.060738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592549158376415:2970], now have 1 active actors on pipe
2025-10-10T13:59:59.060758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592553453343715:2507], now have 1 active actors on pipe
2025-10-10T13:59:59.060781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.060794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.060806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.060816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.060853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:59.060854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 44
2025-10-10T13:59:59.060927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:59.061053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:59.061068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:59.061078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:59.061088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:59.060953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 44
2025-10-10T13:59:59.061009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 44, pipe: [1:7559592553453343715:2507]
2025-10-10T13:59:59.061297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:59.061320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:59.061488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:59.061510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:59.061543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.061574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:59.061604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:59.061683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1debe64-d3c82159-c209e605-1c0d6019_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:59.061713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.061728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.061739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:59.061775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.061815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:59.061890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:59.062963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:59.062990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:59.063052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:59.063362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 45 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1debe64-d3c82159-c209e605-1c0d6019_0
2025-10-10T13:59:59.065745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba7198e-20407758-dd869ec4-a703994d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1debe64-d3c82159-c209e605-1c0d6019_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:59.100687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1debe64-d3c82159-c209e605-1c0d6019_0] Write session: try to update token
2025-10-10T13:59:59.100745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1debe64-d3c82159-c209e605-1c0d6019_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:59.224915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:59.224943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:59.224953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:59.224960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:59.224966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:59.224991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.225009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.225024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.225036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.225169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.225177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.225185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.225264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:59.225282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.225290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:59.226101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:59.228864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:59.228905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:59.228937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:59.228962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:59.261173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId: src_id|a1debe64-d3c82159-c209e605-1c0d6019_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:59.283814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:59.379192Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:59.388863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:59.388918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:59.388995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:59.389011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:59.389058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592547580461222:2855]
2025-10-10T13:59:59.389249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:59.389738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:59.390191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:59.389900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:59.389913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:59.390932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592553453343715:2507]
2025-10-10T13:59:59.430464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1debe64-d3c82159-c209e605-1c0d6019_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:59.430516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1debe64-d3c82159-c209e605-1c0d6019_0] Write session will restart in 0.008394s
2025-10-10T13:59:59.430630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1debe64-d3c82159-c209e605-1c0d6019_0] Write session: Do CDS request
2025-10-10T13:59:59.430661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1debe64-d3c82159-c209e605-1c0d6019_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:59.427509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 45 reason: error at write: Disconnected sessionId: src_id|a1debe64-d3c82159-c209e605-1c0d6019_0
2025-10-10T13:59:59.427836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 45 sessionId: src_id|a1debe64-d3c82159-c209e605-1c0d6019_0 is DEAD
2025-10-10T13:59:59.446130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1debe64-d3c82159-c209e605-1c0d6019_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:59.447265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:59.447295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 46
2025-10-10T13:59:59.447630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:59.447734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 46 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:59.447749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=46 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:59.447758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:59.449759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 46 sessionId:  describe result for acl check
2025-10-10T13:59:59.449865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:59.449875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:59.449884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:59.449901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592553453343773:2977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:59.452430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592553453343773:2977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:59.469513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:59.467166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592553453343773:2977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:59.473595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:59.474434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:59.474460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:59.474503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:59.474781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:59.474962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592551875428644:2861]
2025-10-10T13:59:59.476977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:59.478019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:59.478222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:59.480822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592553453343773:2977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:59.480866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592553453343773:2977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:59.480883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592553453343773:2977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:59.480911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 46 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:59.479996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:59.480235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:59.480240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:59.480244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:59.480249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:59.480252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:59.480257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:59.480261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:59.480265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:59.480269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.480272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.480276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.480280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.480309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:59.480392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:59.480442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:59.480473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:59.480502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:59.480533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:59.480563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:59.480594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:59.480625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.480654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.480683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.480710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.480734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:59.480775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:59.480813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:59.480846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:59.480876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:59.480910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:59.480937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:59.480972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:59.481001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:59.481033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:59.481061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:59.481095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:59.481139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:59.481185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:59.481222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:59.481255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:59.481284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.481317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.481343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.481375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.481413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.481461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.481500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.481534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.481843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:59.492012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592553453343834:2507]
2025-10-10T13:59:59.502332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:59.538756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:59.538803Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:59.538904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:59.538931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:59.538962Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 45 [2:7559592551875428644:2861]
2025-10-10T13:59:59.539016Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:59.539093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:59.539122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.539134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.539144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.539194Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:59.539215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:59.539235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:59.540380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.540397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.540404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.540412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.540420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:59.540651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:59.540673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.540792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.540942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.541165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.541268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:59.541346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592553453343830:2977], now have 1 active actors on pipe
2025-10-10T13:59:59.541368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592553453343738:2442], now have 1 active actors on pipe
2025-10-10T13:59:59.541387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592553453343834:2507], now have 1 active actors on pipe
2025-10-10T13:59:59.541409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.541423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.541435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.541446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.541489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:59.541561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:59.541574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:59.541580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:59.541594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:59.541607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:59.541731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:59.541746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:59.541893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:59.541913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:59.541945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.541979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:59.542048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:59.542111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:59.542142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.542160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.542170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:59.542203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.542246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:59.542332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:59.543867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:59.543902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:59.543969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:59.541219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 45
2025-10-10T13:59:59.541307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 45
2025-10-10T13:59:59.541368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 45, pipe: [1:7559592553453343834:2507]
2025-10-10T13:59:59.544554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 46 partition: 0 MaxSeqNo: 36 sessionId: src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0
2025-10-10T13:59:59.545404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1debe64-d3c82159-c209e605-1c0d6019_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:59.565890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0] Write session: try to update token
2025-10-10T13:59:59.565954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T13:59:59.677365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T13:59:59.677401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:59.677417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T13:59:59.677429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T13:59:59.677443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T13:59:59.677479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.677507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.677531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.677553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.677715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.677728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.677738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.677833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T13:59:59.677857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.677869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T13:59:59.678314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T13:59:59.678349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T13:59:59.678380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T13:59:59.678408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T13:59:59.684241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T13:59:59.713729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId: src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:59.735491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:59.844383Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T13:59:59.855522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:59.855575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:59.855647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T13:59:59.855659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T13:59:59.855697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592551875428638:2861]
2025-10-10T13:59:59.857465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T13:59:59.858752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T13:59:59.858896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592553453343834:2507]
2025-10-10T13:59:59.858980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T13:59:59.859000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T13:59:59.859493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T13:59:59.893151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 46 reason: error at write: Disconnected sessionId: src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0
2025-10-10T13:59:59.893570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 46 sessionId: src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0 is DEAD
2025-10-10T13:59:59.901618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T13:59:59.901705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0] Write session will restart in 0.007094s
2025-10-10T13:59:59.901908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0] Write session: Do CDS request
2025-10-10T13:59:59.901958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T13:59:59.919838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:59.919872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 47
2025-10-10T13:59:59.920597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:59.921221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:59.921344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 47 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T13:59:59.921359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=47 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:59.921369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:59.922697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 47 sessionId:  describe result for acl check
2025-10-10T13:59:59.922805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:59.922821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:59.922829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:59.922845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592553453343925:2984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:59.926678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592553453343925:2984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:59.932339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:59.936710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:59.937397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592553453343925:2984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:59.937550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:59.937577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T13:59:59.937623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:59.937886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:59.938063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592551875428760:2870]
2025-10-10T13:59:59.940257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T13:59:59.942150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T13:59:59.942380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T13:59:59.943292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T13:59:59.943576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:59.943584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:59.943591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:59.943596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:59.943603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:59.943610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:59.943617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:59.943623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:59.943629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.943635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.943640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.943647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.943692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:59.943784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:59.943826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:59.943868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:59.943910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:59.943954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:59.943992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:59.944034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:59.944078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.944120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.944159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.944199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.944237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:59.944293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T13:59:59.944349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:59.944400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T13:59:59.944444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:59.944490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T13:59:59.944529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:59.944578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T13:59:59.944623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:59.944673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T13:59:59.944712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:59.944758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T13:59:59.944797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:59.944845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T13:59:59.944888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:59.944939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T13:59:59.945518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592553453343925:2984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:59.944989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.945556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592553453343925:2984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T13:59:59.945036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.945572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592553453343925:2984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:59.945077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.945601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 47 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:59.946056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.946132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.946187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.946237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.946288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.946721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T13:59:59.959053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592553453343962:2507]
2025-10-10T13:59:59.970270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T13:59:59.988766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T13:59:59.988803Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T13:59:59.988814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:59.989039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:59.989060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 46 [2:7559592551875428760:2870]
2025-10-10T13:59:59.989097Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T13:59:59.989163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T13:59:59.989176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.989187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.989199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.989245Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T13:59:59.989266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:59.989287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:59.991272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.991303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.991315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.991328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.991338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T13:59:59.992519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 46, pipe: [1:7559592553453343962:2507]
2025-10-10T13:59:59.992636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 46
2025-10-10T13:59:59.992698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 46
2025-10-10T13:59:59.991607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T13:59:59.991629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T13:59:59.991758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T13:59:59.991907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T13:59:59.992103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T13:59:59.992172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T13:59:59.992231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592553453343962:2507], now have 1 active actors on pipe
2025-10-10T13:59:59.992244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592553453343959:2984], now have 1 active actors on pipe
2025-10-10T13:59:59.992257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592553453343865:2442], now have 1 active actors on pipe
2025-10-10T13:59:59.992274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592551875428754:2870]
2025-10-10T13:59:59.992284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592551875428754:2870]
2025-10-10T13:59:59.992293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592551875428754:2870]
2025-10-10T13:59:59.992301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592551875428754:2870]
2025-10-10T13:59:59.992333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T13:59:59.992370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T13:59:59.992382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T13:59:59.992394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T13:59:59.992404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T13:59:59.992405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T13:59:59.993121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T13:59:59.993160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:59.993328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:59.993354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:59.993384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592551875428754:2870]
2025-10-10T13:59:59.993408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T13:59:59.993525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:59.993562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.993581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.993594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:59.993628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.993673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:59.993755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:59.993876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T13:59:59.994273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:59.994294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:59.994348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:59.994759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 47 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0
2025-10-10T13:59:59.997657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1eb1a50-c1e94e0a-5aa174bd-6fb0dec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:00.024373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0] Write session: try to update token
2025-10-10T14:00:00.024434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:00.108478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:00.108506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:00.108518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:00.108527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:00.108537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:00.108568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592551875428754:2870]
2025-10-10T14:00:00.108590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592551875428754:2870]
2025-10-10T14:00:00.108611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592551875428754:2870]
2025-10-10T14:00:00.108630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592551875428754:2870]
2025-10-10T14:00:00.108758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:00.108796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:00.108828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:00.108832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.108843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.108852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.108859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:00.108893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:00.108916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.108925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:00.109976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:00.134900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId: src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:00.155898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:00.270758Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:00.286111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:00.286163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:00.286220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:00.286228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:00.286259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592551875428754:2870]
2025-10-10T14:00:00.286869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:00.287314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:00.287610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:00.287746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:00.287757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:00.289058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592553453343962:2507]
2025-10-10T14:00:00.297270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 47 reason: error at write: Disconnected sessionId: src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0
2025-10-10T14:00:00.297635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 47 sessionId: src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0 is DEAD
2025-10-10T14:00:00.305561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:00.305604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0] Write session will restart in 0.007228s
2025-10-10T14:00:00.305702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0] Write session: Do CDS request
2025-10-10T14:00:00.305732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:00.329254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:00.332138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:00.332176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 48
2025-10-10T14:00:00.335387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:00.335543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 48 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:00.335560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=48 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:00.335572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:00.341902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 48 sessionId:  describe result for acl check
2025-10-10T14:00:00.342103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:00.342140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:00.342160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:00.342196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592557748311289:2989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:00.345537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592557748311289:2989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:00.359581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592557748311289:2989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:00.383351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592557748311289:2989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:00.383395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592557748311289:2989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:00.383424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592557748311289:2989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:00.383455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 48 sessionId:  partition: 0 expectedGeneration: (NULL)
E1010 14:00:00.384432203  106882 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:00:00.385351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:00.386951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:00.387702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:00.387717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:00.387762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:00.388045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:00.388224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592556170396190:2879]
2025-10-10T14:00:00.388530Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:00:00.388954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592557748311375:2507]
2025-10-10T14:00:00.390324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:00.391782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:00.392119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:00.393287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:00.393594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:00.393603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:00.393609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:00.393615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:00.393622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:00.393629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:00.393636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:00.393642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:00.393648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.393654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.393661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.393667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.393711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:00.393812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:00.393859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:00.393901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:00.393943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:00.393983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:00.394023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:00.394062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:00.394103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.394143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.394201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.394340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.394383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:00.394441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:00.394494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:00.394543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:00.394589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:00.394656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:00.394696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:00.394744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:00.394788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:00.394838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:00.394881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:00.394934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:00.394980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:00.395030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:00.395071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:00.395121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:00.395164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.395214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.395254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.395305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.395349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.395398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.395462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.395513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.395929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:00.422403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:00.435067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:00.435109Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:00.435123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:00.435142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:00.435165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 47 [2:7559592556170396190:2879]
2025-10-10T14:00:00.435219Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:00.435279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:00.435293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.435304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.435315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.435365Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:00.435386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:00.435407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:00.440086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 47
2025-10-10T14:00:00.440200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 47
2025-10-10T14:00:00.440266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 47, pipe: [1:7559592557748311375:2507]
2025-10-10T14:00:00.438405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.438422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.438431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.438444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.438453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:00.438751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:00.438767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.438919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.439113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.439323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.439429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:00.439515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592557748311372:2989], now have 1 active actors on pipe
2025-10-10T14:00:00.439537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592557748311270:2442], now have 1 active actors on pipe
2025-10-10T14:00:00.439557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592557748311375:2507], now have 1 active actors on pipe
2025-10-10T14:00:00.439582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592556170396183:2879]
2025-10-10T14:00:00.439595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592556170396183:2879]
2025-10-10T14:00:00.439608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592556170396183:2879]
2025-10-10T14:00:00.439620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592556170396183:2879]
2025-10-10T14:00:00.439658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:00.439730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:00.439847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:00.439858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:00.439947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592556170396183:2879]
2025-10-10T14:00:00.439958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:00.440085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:00.440097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:00.440107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:00.440115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:00.440130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:00.440676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:00.440699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:00.440782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|719e2372-611e7b69-f667429d-c171c0df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:00.440813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.440829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.440838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:00.440873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.440915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:00.440959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:00.445801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:00.445842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:00.445928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:00.446978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 48 partition: 0 MaxSeqNo: 36 sessionId: src_id|719e2372-611e7b69-f667429d-c171c0df_0
2025-10-10T14:00:00.448409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a8cd7c2-5b69787e-1386c2aa-b1920f8c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|719e2372-611e7b69-f667429d-c171c0df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:00.490198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719e2372-611e7b69-f667429d-c171c0df_0] Write session: try to update token
2025-10-10T14:00:00.490238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719e2372-611e7b69-f667429d-c171c0df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:00.552524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.552555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.552565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.552886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:00.552904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:00.552917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:00.552925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:00.552935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:00.552969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592556170396183:2879]
2025-10-10T14:00:00.552994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592556170396183:2879]
2025-10-10T14:00:00.553018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592556170396183:2879]
2025-10-10T14:00:00.553036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592556170396183:2879]
2025-10-10T14:00:00.553195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:00.553219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.553230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:00.553604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:00.553637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:00.553672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:00.553700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:00.567128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:00.634545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId: src_id|719e2372-611e7b69-f667429d-c171c0df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:00.662447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:00.721790Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:00.724415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:00.724452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:00.726086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:00.726135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:00.743251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:00.743414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592557748311375:2507]
2025-10-10T14:00:00.743483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 48 reason: error at write: Disconnected sessionId: src_id|719e2372-611e7b69-f667429d-c171c0df_0
2025-10-10T14:00:00.744548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719e2372-611e7b69-f667429d-c171c0df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:00.744585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719e2372-611e7b69-f667429d-c171c0df_0] Write session will restart in 0.009433s
2025-10-10T14:00:00.744702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719e2372-611e7b69-f667429d-c171c0df_0] Write session: Do CDS request
2025-10-10T14:00:00.744735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719e2372-611e7b69-f667429d-c171c0df_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:00.749349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 48 sessionId: src_id|719e2372-611e7b69-f667429d-c171c0df_0 is DEAD
2025-10-10T14:00:00.757685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:00.766787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|719e2372-611e7b69-f667429d-c171c0df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:00.774283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:00.774317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 49
2025-10-10T14:00:00.775174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:00.775307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 49 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:00.775323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=49 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:00.775333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:00.777483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 49 sessionId:  describe result for acl check
2025-10-10T14:00:00.777600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:00.777615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:00.777624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:00.777640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592557748311438:3002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:00.779376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592557748311438:3002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:00.788998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592557748311438:3002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:00.791500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:00.794057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:00.794844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:00.794869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:00.794911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:00.795147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:00.795322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592556170396294:2882]
2025-10-10T14:00:00.797622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:00.796880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592557748311438:3002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:00.796924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592557748311438:3002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:00.796941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592557748311438:3002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:00.796973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 49 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:00.798906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:00.799141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:00.800361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:00.800648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:00.800655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:00.800661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:00.800667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:00.800674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:00.800679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:00.800687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:00.800693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:00.800700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.800706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.800712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.800718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.800764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:00.800872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:00.800922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:00.800966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:00.801009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:00.801054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:00.801101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:00.801166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:00.801211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.801255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.801301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.801347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.801388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:00.801457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:00.801518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:00.801571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:00.801620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:00.801669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:00.801713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:00.801786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:00.801850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:00.801920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:00.801969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:00.802021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:00.802068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:00.802125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:00.802172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:00.802225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:00.802275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.802327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.802371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.802425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.802471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.802524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.802565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.802626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.803068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:00.843332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592557748311516:2507]
2025-10-10T14:00:00.842034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:00.857301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:00.857343Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:00.857360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:00.857379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:00.857401Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 48 [2:7559592556170396294:2882]
2025-10-10T14:00:00.857453Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:00.857510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:00.857524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.857536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.857548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.857594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:00.857615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:00.857638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:00.859911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.859936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.859947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.859960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.859972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:00.860244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:00.860270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:00.860408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:00.860586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:00.860807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:00.860666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 48
2025-10-10T14:00:00.860774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 48
2025-10-10T14:00:00.860841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 48, pipe: [1:7559592557748311516:2507]
2025-10-10T14:00:00.860931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:00.861024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592557748311507:3002], now have 1 active actors on pipe
2025-10-10T14:00:00.861053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592557748311419:2442], now have 1 active actors on pipe
2025-10-10T14:00:00.861073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592557748311516:2507], now have 1 active actors on pipe
2025-10-10T14:00:00.861101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:00.861120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:00.861146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:00.861157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:00.861197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:00.861228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:00.861244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:00.861256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:00.861269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:00.861278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:00.861448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:00.861466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:00.861544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:00.861565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:00.861691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:00.861720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:00.861805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:00.861838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.861857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.861868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:00.861905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.861949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:00.862053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:00.862083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:00.863163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:00.863194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:00.863269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:00.863734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 49 partition: 0 MaxSeqNo: 36 sessionId: src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0
2025-10-10T14:00:00.864712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|719e2372-611e7b69-f667429d-c171c0df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:00.908055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0] Write session: try to update token
2025-10-10T14:00:00.908116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:01.013021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:01.013070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:01.013096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:01.013120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:01.013156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:01.013231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:01.013294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:01.013350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:01.013395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:01.013702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.013741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.013743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:01.013765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.013796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:01.013876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:01.013932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:01.013951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:01.013996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.014018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:01.017591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:01.066522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId: src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:01.091552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:01.164328Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:01.181644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:01.181690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:01.181767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:01.181781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:01.181825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592556170396289:2882]
2025-10-10T14:00:01.183937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:01.183966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:01.185071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:01.185405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592557748311516:2507]
2025-10-10T14:00:01.182498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:01.187372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:01.190882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 49 reason: error at write: Disconnected sessionId: src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0
2025-10-10T14:00:01.191327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 49 sessionId: src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0 is DEAD
2025-10-10T14:00:01.193383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:01.193454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0] Write session will restart in 0.007029s
2025-10-10T14:00:01.193626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0] Write session: Do CDS request
2025-10-10T14:00:01.193674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:01.205275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:01.205192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:01.205225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 50
2025-10-10T14:00:01.209286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:01.209466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 50 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:01.209484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=50 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:01.209496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:01.210845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 50 sessionId:  describe result for acl check
2025-10-10T14:00:01.210960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:01.210972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:01.210980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:01.210999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592562043278847:3010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:01.213799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592562043278847:3010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:01.222434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592562043278847:3010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:01.243942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592562043278847:3010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:01.243988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592562043278847:3010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:01.244008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592562043278847:3010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:01.244041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 50 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:01.251610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:01.254533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:01.255457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:01.255491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:01.255539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:01.255821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:01.256027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592560465363704:2886]
2025-10-10T14:00:01.258581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:01.259632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:01.259873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:01.261290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:01.261666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:01.261677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:01.261685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:01.261693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:01.261702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:01.261710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:01.261719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:01.261727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:01.261735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.261743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.261750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.261758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.261814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:01.261945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:01.262005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:01.262066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:01.262124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:01.262175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:01.262223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:01.262276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:01.262328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.262385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.262442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.262494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.262543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:01.262618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:01.262704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:01.262764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:01.262820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:01.262877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:01.262932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:01.262997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:01.263056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:01.263119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:01.263175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:01.263234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:01.263284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:01.263345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:01.263395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:01.263456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:01.263533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.263591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.263643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.263704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.263756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.263814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.263864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.263923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.264419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:01.285604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592562043278934:2507]
2025-10-10T14:00:01.287890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:01.300902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:01.300946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:01.300967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:01.300987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:01.301009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 49 [2:7559592560465363704:2886]
2025-10-10T14:00:01.301063Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:01.301120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:01.301505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.301522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.301533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.301589Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:01.301613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:01.301633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:01.315587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.315627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.315640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.315663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.315673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:01.315986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:01.316026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.316156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.316340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.316562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.316482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 49, pipe: [1:7559592562043278934:2507]
2025-10-10T14:00:01.316506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 49
2025-10-10T14:00:01.316675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:01.316593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 49
2025-10-10T14:00:01.316769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592562043278934:2507], now have 1 active actors on pipe
2025-10-10T14:00:01.316797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592562043278834:2442], now have 1 active actors on pipe
2025-10-10T14:00:01.316819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592562043278926:3010], now have 1 active actors on pipe
2025-10-10T14:00:01.316844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.316863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.316875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.316887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.316928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:01.316969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:01.317003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:01.317012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:01.317015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:01.317027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:01.317209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:01.317237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:01.317418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:01.317447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:01.317480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.317547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:01.317711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:01.317840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|706dcaa-1d3f0668-fff38824-638c9653_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:01.317877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.317900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.317912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:01.317947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.317995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:01.318087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:01.320002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:01.320042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:01.320120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:01.321758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d517ce-fa85bb4-427f5be5-a003e04f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|706dcaa-1d3f0668-fff38824-638c9653_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:01.320846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 50 partition: 0 MaxSeqNo: 36 sessionId: src_id|706dcaa-1d3f0668-fff38824-638c9653_0
2025-10-10T14:00:01.360554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|706dcaa-1d3f0668-fff38824-638c9653_0] Write session: try to update token
2025-10-10T14:00:01.360609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|706dcaa-1d3f0668-fff38824-638c9653_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:01.425618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.425660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.425673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.425740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:01.425762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:01.425777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:01.425794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:01.425814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:01.425854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.425891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.425924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.425954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.426107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:01.426156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:01.426205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:01.426211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:01.426241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:01.426245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.426262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:01.427995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:01.484325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId: src_id|706dcaa-1d3f0668-fff38824-638c9653_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:01.515969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:01.579829Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:01.595843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:01.595897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:01.595971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:01.595985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:01.596027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592560465363699:2886]
2025-10-10T14:00:01.596297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:01.596713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:01.596978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592562043278934:2507]
2025-10-10T14:00:01.597051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:01.597172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:01.597185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:01.613683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 50 reason: error at write: Disconnected sessionId: src_id|706dcaa-1d3f0668-fff38824-638c9653_0
2025-10-10T14:00:01.614090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 50 sessionId: src_id|706dcaa-1d3f0668-fff38824-638c9653_0 is DEAD
2025-10-10T14:00:01.614493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706dcaa-1d3f0668-fff38824-638c9653_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:01.614540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706dcaa-1d3f0668-fff38824-638c9653_0] Write session will restart in 0.006625s
2025-10-10T14:00:01.614679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706dcaa-1d3f0668-fff38824-638c9653_0] Write session: Do CDS request
2025-10-10T14:00:01.614726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706dcaa-1d3f0668-fff38824-638c9653_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:01.634955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:01.634987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 51
2025-10-10T14:00:01.635312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|706dcaa-1d3f0668-fff38824-638c9653_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:01.636205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:01.636366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 51 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:01.636383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=51 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:01.636394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:01.639059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 51 sessionId:  describe result for acl check
2025-10-10T14:00:01.639300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:01.639321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:01.639339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:01.639368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592562043278964:3015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:01.643866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592562043278964:3015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:01.651234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592562043278964:3015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:01.660626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592562043278964:3015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:01.660662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592562043278964:3015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:01.660673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592562043278964:3015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:01.660696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 51 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:01.668754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:01.670570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:01.671258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:01.671279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:01.671327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:01.671531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:01.671698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592560465363835:2897]
2025-10-10T14:00:01.673496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:01.674281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:01.674483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:01.675692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:01.675967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:01.675974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:01.675980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:01.675987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:01.675994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:01.676001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:01.676008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:01.676015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:01.676021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.676027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.676034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.676040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.676086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:01.676192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:01.676239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:01.676285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:01.676330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:01.676379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:01.676428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:01.676474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:01.676532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.676584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.676630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.676675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.676717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:01.676782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:01.676840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:01.676894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:01.676940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:01.676993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:01.677033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:01.677083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:01.677169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:01.677224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:01.677270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:01.677318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:01.677364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:01.677417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:01.677462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:01.677515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:01.677560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.677629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.677675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.677723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.677765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.677815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.677858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.677909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.678345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:01.697206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592562043279053:2507]
2025-10-10T14:00:01.701444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:01.714223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:01.714258Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:01.714277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:01.714298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:01.714315Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 50 [2:7559592560465363835:2897]
2025-10-10T14:00:01.714357Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:01.714406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:01.714419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.714429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.714439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.714472Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:01.714490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:01.714507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:01.715750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.715772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.715797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.715812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.715823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:01.716043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:01.716067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.716205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:01.716381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:01.716413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 50
2025-10-10T14:00:01.716521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 50, pipe: [1:7559592562043279053:2507]
2025-10-10T14:00:01.716616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:01.716592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 50
2025-10-10T14:00:01.716750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:01.716830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592562043278945:2442], now have 1 active actors on pipe
2025-10-10T14:00:01.716858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592562043279053:2507], now have 1 active actors on pipe
2025-10-10T14:00:01.716883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592562043279018:3015], now have 1 active actors on pipe
2025-10-10T14:00:01.716944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592560465363830:2897]
2025-10-10T14:00:01.716962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592560465363830:2897]
2025-10-10T14:00:01.716975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592560465363830:2897]
2025-10-10T14:00:01.716987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592560465363830:2897]
2025-10-10T14:00:01.717029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:01.717062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:01.717089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:01.717101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:01.717113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:01.717116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:01.717315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:01.717338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:01.717397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:01.717421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:01.717541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592560465363830:2897]
2025-10-10T14:00:01.717575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:01.717645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3605463a-caa41152-74741af8-b1b945d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:01.717676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.717695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:01.717697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.717709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:01.717741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.717776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:01.717895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:01.718747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:01.718768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:01.718815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:01.719152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 51 partition: 0 MaxSeqNo: 36 sessionId: src_id|3605463a-caa41152-74741af8-b1b945d5_0
2025-10-10T14:00:01.720014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|706dcaa-1d3f0668-fff38824-638c9653_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3605463a-caa41152-74741af8-b1b945d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:01.756747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3605463a-caa41152-74741af8-b1b945d5_0] Write session: try to update token
2025-10-10T14:00:01.756809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3605463a-caa41152-74741af8-b1b945d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:01.812682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:01.812716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:01.812730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:01.812740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:01.812749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:01.812788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592560465363830:2897]
2025-10-10T14:00:01.812813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592560465363830:2897]
2025-10-10T14:00:01.812836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592560465363830:2897]
2025-10-10T14:00:01.812856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592560465363830:2897]
2025-10-10T14:00:01.812995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:01.813021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:01.813034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:01.813993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:01.817249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:01.817297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:01.817326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:01.817355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:01.871797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId: src_id|3605463a-caa41152-74741af8-b1b945d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:01.891527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:01.965799Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:01.967479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:01.967517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:01.969008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:01.969235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592562043279053:2507]
2025-10-10T14:00:01.969405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:01.969438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:01.971777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:01.982406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 51 reason: error at write: Disconnected sessionId: src_id|3605463a-caa41152-74741af8-b1b945d5_0
2025-10-10T14:00:01.982792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 51 sessionId: src_id|3605463a-caa41152-74741af8-b1b945d5_0 is DEAD
2025-10-10T14:00:01.983420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3605463a-caa41152-74741af8-b1b945d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:01.983474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3605463a-caa41152-74741af8-b1b945d5_0] Write session will restart in 0.008706s
2025-10-10T14:00:01.983621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3605463a-caa41152-74741af8-b1b945d5_0] Write session: Do CDS request
2025-10-10T14:00:01.983674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3605463a-caa41152-74741af8-b1b945d5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:01.997019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3605463a-caa41152-74741af8-b1b945d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:02.015479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:02.017862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:02.020286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:02.020318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 52
2025-10-10T14:00:02.020741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:02.020857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 52 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:02.020886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=52 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:02.020896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:02.019200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:02.019242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:02.019317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:02.019774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:02.019979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592564760331253:2904]
2025-10-10T14:00:02.022175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 52 sessionId:  describe result for acl check
2025-10-10T14:00:02.022292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:02.022309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:02.022319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:02.022337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592566338246455:3027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:02.022434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:02.023326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:02.023520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:02.024758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:02.025005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592566338246455:3027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:02.025056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:02.025070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:02.025076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:02.025083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:02.025088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:02.025095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:02.025100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:02.025106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:02.025112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.025119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.025151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.025157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.025199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:02.025292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:02.025334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:02.025375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:02.025427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:02.025472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:02.025517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:02.025562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:02.025612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.025657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.025700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.025744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.025781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:02.025841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:02.025892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:02.025939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:02.025982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:02.026028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:02.026069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:02.026118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:02.026160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:02.026207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:02.026249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:02.026298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:02.026341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:02.026388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:02.026430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:02.026479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:02.026521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.026572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.026613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.026677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.026724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.026775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.026816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.026863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.027265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:02.030777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592566338246455:3027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:02.042196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592566338246455:3027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:02.042242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592566338246455:3027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:02.042260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592566338246455:3027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:02.042291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 52 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:02.068919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592566338246487:2507]
2025-10-10T14:00:02.073411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:02.091168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:02.091211Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:02.091227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:02.091246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:02.091269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 51 [2:7559592564760331253:2904]
2025-10-10T14:00:02.091325Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:02.091386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:02.091401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.091413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.091424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.091473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:02.091496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:02.091517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:02.094178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.094201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.094214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.094231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.094244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:02.095790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 51, pipe: [1:7559592566338246487:2507]
2025-10-10T14:00:02.095908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 51
2025-10-10T14:00:02.095994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 51
2025-10-10T14:00:02.094510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:02.094531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.094686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.094863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.095083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.095193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:02.095270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.095284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.095298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.095310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.095352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:02.095431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:02.095601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:02.095609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:02.095618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:02.095623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:02.095634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:02.095644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:02.095757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592566338246487:2507], now have 1 active actors on pipe
2025-10-10T14:00:02.095780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592562043279092:2442], now have 1 active actors on pipe
2025-10-10T14:00:02.095797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.095816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:02.095823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:02.095896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592566338246485:3027], now have 1 active actors on pipe
2025-10-10T14:00:02.096302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:02.096323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:02.096394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:02.096424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.096439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.096450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:02.096484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.096523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:02.096560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:02.096982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:02.097008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:02.097064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:02.097336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 52 partition: 0 MaxSeqNo: 36 sessionId: src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0
2025-10-10T14:00:02.098007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3605463a-caa41152-74741af8-b1b945d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:02.118325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0] Write session: try to update token
2025-10-10T14:00:02.118379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:02.153279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:02.153313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:02.153355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.153478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:02.153514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:02.156355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:02.157981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:02.159455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:02.161447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:02.163203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:02.163704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:02.240615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.240648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.240661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.240725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:02.240742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:02.240756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:02.240768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:02.240780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:02.240824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.240851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.240874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.240897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592564760331248:2904]
2025-10-10T14:00:02.241057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:02.241083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.241095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:02.242518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:02.244567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:02.244602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:02.244632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:02.244660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:02.258609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId: src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:02.284699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:02.413300Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:02.418253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:02.418287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:02.419851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:02.419872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:02.420857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:02.420972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592566338246487:2507]
2025-10-10T14:00:02.421105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:02.427236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 52 reason: error at write: Disconnected sessionId: src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0
2025-10-10T14:00:02.427630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 52 sessionId: src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0 is DEAD
2025-10-10T14:00:02.429384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:02.429409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0] Write session will restart in 0.008304s
2025-10-10T14:00:02.429474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0] Write session: Do CDS request
2025-10-10T14:00:02.429496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:02.453169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:02.457226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:02.457259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 53
2025-10-10T14:00:02.457665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:02.457800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 53 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:02.457822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=53 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:02.457832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:02.459339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 53 sessionId:  describe result for acl check
2025-10-10T14:00:02.459481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:02.459491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:02.459502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:02.459519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592566338246528:3034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:02.464150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592566338246528:3034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:02.473184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592566338246528:3034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:02.482444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592566338246528:3034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:02.482492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592566338246528:3034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:02.482523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592566338246528:3034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:02.482554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 53 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:02.504129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:02.507123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:02.507972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:02.507986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:02.508019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:02.508232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:02.508404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592564760331385:2910]
2025-10-10T14:00:02.510144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:02.511236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:02.511428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:02.512492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:02.512781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:02.512795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:02.512803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:02.512810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:02.512818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:02.512826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:02.512834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:02.512841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:02.512849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.512855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.512863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.512871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.512923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:02.513042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:02.513099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:02.513178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:02.513237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:02.513293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:02.513337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:02.513373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:02.513412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.513451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.513489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.513524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.513550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:02.513602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:02.513644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:02.513687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:02.513724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:02.513778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:02.513820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:02.513863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:02.513899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:02.513938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:02.513973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:02.514374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:02.514436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:02.514502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:02.514561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:02.514627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:02.514694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.514762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.514817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.514875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.514914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.514956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.514990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.515030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.515538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:02.522917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592566338246618:2507]
2025-10-10T14:00:02.542065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:02.569163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:02.569205Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:02.569225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:02.569244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:02.569268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 52 [2:7559592564760331385:2910]
2025-10-10T14:00:02.569327Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:02.569387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:02.569403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.569416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.569427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.569474Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:02.569497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:02.569517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:02.570984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.571010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.571026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.571041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.571053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:02.571336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:02.571354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.571504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:02.571728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:02.571994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:02.572141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:02.572229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592566338246513:2442], now have 1 active actors on pipe
2025-10-10T14:00:02.572255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592566338246585:3034], now have 1 active actors on pipe
2025-10-10T14:00:02.572279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592566338246618:2507], now have 1 active actors on pipe
2025-10-10T14:00:02.572304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.572320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.572333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.572346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.572391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:02.572474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:02.572746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 52
2025-10-10T14:00:02.572858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 52
2025-10-10T14:00:02.572925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 52, pipe: [1:7559592566338246618:2507]
2025-10-10T14:00:02.572657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:02.572682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:02.572805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.572826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:02.572999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:02.573015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:02.573027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:02.573040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:02.573061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:02.573712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:02.573743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:02.573823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f53c966-19d77757-563d205f-48ba7361_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:02.573854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.573873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.573885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:02.573920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.573959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:02.574005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:02.574895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:02.574923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:02.574988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:02.575306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 53 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f53c966-19d77757-563d205f-48ba7361_0
2025-10-10T14:00:02.576451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89be5f05-b5b8d9d9-89d9fad5-7cfdf476_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f53c966-19d77757-563d205f-48ba7361_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:02.612172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f53c966-19d77757-563d205f-48ba7361_0] Write session: try to update token
2025-10-10T14:00:02.612229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f53c966-19d77757-563d205f-48ba7361_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:02.628516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:02.628553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:02.628591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.628692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:02.630324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:02.637941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:02.674674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:02.679403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:02.690591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:02.722885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId: src_id|6f53c966-19d77757-563d205f-48ba7361_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:02.722549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:02.723655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.723678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.723691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.723743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:02.792728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:02.828013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:02.828060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:02.828115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:02.828130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:02.828143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:02.828154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:02.828164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:02.828208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.828235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.828261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.828283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592564760331377:2910]
2025-10-10T14:00:02.828456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.828469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.828480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.828558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:02.828583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:02.828595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:02.830206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:02.831633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:02.831670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:02.831706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:02.831737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:02.969522Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:02.972547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:00:02.973376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:02.978131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:02.978272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592566338246618:2507]
2025-10-10T14:00:03.080367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592570633213990:2507]
2025-10-10T14:00:03.109011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:03.109033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:03.109102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 53 reason: error at write: Disconnected sessionId: src_id|6f53c966-19d77757-563d205f-48ba7361_0
2025-10-10T14:00:03.109432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 53 sessionId: src_id|6f53c966-19d77757-563d205f-48ba7361_0 is DEAD
2025-10-10T14:00:03.115266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f53c966-19d77757-563d205f-48ba7361_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:03.115333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f53c966-19d77757-563d205f-48ba7361_0] Write session will restart in 0.006614s
2025-10-10T14:00:03.115464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f53c966-19d77757-563d205f-48ba7361_0] Write session: Do CDS request
2025-10-10T14:00:03.115520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f53c966-19d77757-563d205f-48ba7361_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:03.134382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f53c966-19d77757-563d205f-48ba7361_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:03.137647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:03.137675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 54
2025-10-10T14:00:03.140865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:03.141006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 54 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:03.141023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=54 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:03.141032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:03.142006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:03.146263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 54 sessionId:  describe result for acl check
2025-10-10T14:00:03.146383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:03.146394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:03.146403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:03.146420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592570633214022:3041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:03.152794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592570633214022:3041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:03.160295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592570633214022:3041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:03.161633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:03.162522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:03.162540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:03.162583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:03.162863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:03.163041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592569055298803:2919]
2025-10-10T14:00:03.165513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:03.168142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:03.168331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:03.169599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:03.169867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.169872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.169878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:03.169882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:03.169887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:03.169891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:03.169897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:03.169902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:03.169907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.169912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.169917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.169922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.169957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.170040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.170074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:03.170109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:03.170142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:03.170180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:03.170217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:03.170251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:03.170284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.170319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.170351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.170394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.170434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.170504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.170565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.170623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.170687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:03.170741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:03.170809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:03.170878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:03.170930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:03.170984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:03.171031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:03.171085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:03.171130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:03.171208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:03.171263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:03.171319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:03.171202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592570633214022:3041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:03.171250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592570633214022:3041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:03.171268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592570633214022:3041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:03.171299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 54 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:03.171368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.171422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.171470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.171528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.171578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.171634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.171681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.171738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.172143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:03.228709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:03.241171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:03.241221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:03.241239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:03.241260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:03.241285Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 53 [2:7559592569055298803:2919]
2025-10-10T14:00:03.241344Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:03.241409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:03.241425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.241437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.241449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.241499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:03.241521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:03.241544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:03.243469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.243496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.243509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.243523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.243535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:03.243799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:03.243815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.243958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.244136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.244346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.244466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:03.244544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592569055298797:2919]
2025-10-10T14:00:03.244559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592569055298797:2919]
2025-10-10T14:00:03.244569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592569055298797:2919]
2025-10-10T14:00:03.244581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592569055298797:2919]
2025-10-10T14:00:03.244626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:03.244710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:03.244891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:03.244907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:03.245034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592569055298797:2919]
2025-10-10T14:00:03.245053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:03.245754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:03.245772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:03.246648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 53
2025-10-10T14:00:03.245784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:03.246738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 53, pipe: [1:7559592570633213990:2507]
2025-10-10T14:00:03.245795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:03.246806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 53
2025-10-10T14:00:03.245821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:03.246736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592570633214054:3041], now have 1 active actors on pipe
2025-10-10T14:00:03.246767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592570633213990:2507], now have 1 active actors on pipe
2025-10-10T14:00:03.246787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592566338246656:2442], now have 1 active actors on pipe
2025-10-10T14:00:03.247281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:03.247308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:03.247393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bf52a52-20bc195c-875a146d-390195a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:03.247428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.247445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.247455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:03.247494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.247540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:03.247587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:03.251400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:03.251434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:03.251511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:03.256007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 54 partition: 0 MaxSeqNo: 36 sessionId: src_id|9bf52a52-20bc195c-875a146d-390195a7_0
2025-10-10T14:00:03.257294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f53c966-19d77757-563d205f-48ba7361_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9bf52a52-20bc195c-875a146d-390195a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:03.276767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bf52a52-20bc195c-875a146d-390195a7_0] Write session: try to update token
2025-10-10T14:00:03.276812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bf52a52-20bc195c-875a146d-390195a7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:03.404742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.404770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.404780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.404827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:03.404839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:03.404849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:03.404858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:03.404867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:03.404896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592569055298797:2919]
2025-10-10T14:00:03.404917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592569055298797:2919]
2025-10-10T14:00:03.404936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592569055298797:2919]
2025-10-10T14:00:03.404953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592569055298797:2919]
2025-10-10T14:00:03.405092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:03.405115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.405170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:03.405275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:03.405306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:03.405333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:03.405357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:03.429801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:03.460454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId: src_id|9bf52a52-20bc195c-875a146d-390195a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:03.482859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:03.581524Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:03.584435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:03.584474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:03.585465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:03.585502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:03.594353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 54 reason: error at write: Disconnected sessionId: src_id|9bf52a52-20bc195c-875a146d-390195a7_0
2025-10-10T14:00:03.594700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 54 sessionId: src_id|9bf52a52-20bc195c-875a146d-390195a7_0 is DEAD
2025-10-10T14:00:03.595029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bf52a52-20bc195c-875a146d-390195a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:03.595124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bf52a52-20bc195c-875a146d-390195a7_0] Write session will restart in 0.006026s
2025-10-10T14:00:03.595347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bf52a52-20bc195c-875a146d-390195a7_0] Write session: Do CDS request
2025-10-10T14:00:03.595398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bf52a52-20bc195c-875a146d-390195a7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:03.606346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bf52a52-20bc195c-875a146d-390195a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:03.615647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:03.621062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:03.621223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 55
2025-10-10T14:00:03.621740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592570633213990:2507]
2025-10-10T14:00:03.622079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:03.622441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:03.622658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 55 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:03.622699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=55 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:03.622718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:03.625267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 55 sessionId:  describe result for acl check
2025-10-10T14:00:03.625398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:03.625410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:03.625420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:03.625445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592570633214101:3052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:03.628876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592570633214101:3052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:03.634471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592570633214101:3052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:03.643374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592570633214101:3052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:03.643415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592570633214101:3052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:03.643432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592570633214101:3052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:03.643461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 55 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:03.648593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:03.654178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:03.655148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:03.655182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:03.655228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:03.655500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:03.655699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592569055298947:2928]
2025-10-10T14:00:03.658211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:03.662036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:03.662295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:03.663714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:03.664074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.664093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.664101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:03.664109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:03.664117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:03.664124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:03.664132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:03.664139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:03.664145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.664152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.664159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.664166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.664218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.664337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.664401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:03.664453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:03.664508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:03.664563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:03.664613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:03.664747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:03.664802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.664865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.664922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.664975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.665023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.665097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.665186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.665253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.665307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:03.665363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:03.665413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:03.665470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:03.665521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:03.665580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:03.665634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:03.665693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:03.665751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:03.665814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:03.665870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:03.665928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:03.665982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.666042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.666095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.666157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.666208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.666270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.666327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.666393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.666904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:03.694339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:03.708416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:03.708463Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:03.708483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:03.708503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:03.708527Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 54 [2:7559592569055298947:2928]
2025-10-10T14:00:03.708585Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:03.708641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:03.708656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.708667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.708680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.708728Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:03.708751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:03.708773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:03.711799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 54
2025-10-10T14:00:03.711890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 54
2025-10-10T14:00:03.711160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.711194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.711210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.711225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.711236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:03.711505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:03.711523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.711675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.711874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.712112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:03.712235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:03.712310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592570633214183:3052], now have 1 active actors on pipe
2025-10-10T14:00:03.712335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592570633214098:2442], now have 1 active actors on pipe
2025-10-10T14:00:03.712359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.712374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.712387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.712398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.712439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:03.712479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:03.712494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:03.712507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:03.712517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:03.712518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:03.712696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:03.712713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:03.712765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:03.712784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:03.712914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.712943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:03.712961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:03.713008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:03.713034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.713052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.713063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:03.713093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.713810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:03.713998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:03.714447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:03.714473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:03.714532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:03.715165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 55 partition: 0 MaxSeqNo: 36 sessionId: src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0
2025-10-10T14:00:03.715916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bf52a52-20bc195c-875a146d-390195a7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:03.722162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592570633214196:2507]
2025-10-10T14:00:03.722792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592570633214196:2507], now have 1 active actors on pipe
2025-10-10T14:00:03.723534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 54, pipe: [1:7559592570633214196:2507]
2025-10-10T14:00:03.736155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0] Write session: try to update token
2025-10-10T14:00:03.736202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:03.791337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:03.791369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:03.791384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:03.791395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:03.791406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:03.791448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.791475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.791499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.791519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.791660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:03.791712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:03.791746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:03.791773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:03.791787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.791803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:03.791819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:03.792801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:03.817514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId: src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:03.839672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:03.935479Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:03.946014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:03.946067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:03.946132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:03.946147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:03.946190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592569055298942:2928]
2025-10-10T14:00:03.946362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:03.946756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592570633214196:2507]
2025-10-10T14:00:03.946787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:03.946822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:03.946799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:03.946839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:03.986465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:03.989692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 55 reason: error at write: Disconnected sessionId: src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0
2025-10-10T14:00:03.990006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 55 sessionId: src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0 is DEAD
2025-10-10T14:00:03.990010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:03.990299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:03.990349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0] Write session will restart in 0.009324s
2025-10-10T14:00:03.990478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0] Write session: Do CDS request
2025-10-10T14:00:03.990512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:03.991447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:03.991497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:03.991587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:03.992119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:03.992442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592569055299062:2933]
2025-10-10T14:00:03.997043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:03.998072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:03.998301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:03.999372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:03.999709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.999720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.999724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.004902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:03.999728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:03.999734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.004933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 56
2025-10-10T14:00:03.999743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:03.999749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:03.999757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:03.999764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:03.999770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:03.999776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:03.999782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.005150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:03.999820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:03.999930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:03.999971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.000014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.000065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.000104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.000141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.000178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.000219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.000267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.000307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.000354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.000400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.000455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.000505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.000562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.000607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.000658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.000697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.000735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.000781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.000830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.000872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.000925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.000960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.001005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.001044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.001104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.001167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.001222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.001272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.001338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.001390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.001443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.001497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.001553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.002042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:04.006140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:04.006299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 56 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:04.006322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=56 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:04.006333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:04.007807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 56 sessionId:  describe result for acl check
2025-10-10T14:00:04.007927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:04.007944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:04.007954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:04.007971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592574928181600:3061] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:04.010811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592574928181600:3061] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:04.017443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592574928181600:3061] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:04.024906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592574928181600:3061] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:04.024946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592574928181600:3061] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:04.024965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592574928181600:3061] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:04.024995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 56 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:04.026799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:04.039663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:04.039697Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:04.039711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:04.039725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:04.039748Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 55 [2:7559592569055299062:2933]
2025-10-10T14:00:04.039793Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:04.039849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:04.039864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.039876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.039886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.039923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:04.039946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:04.039964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:04.041074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.041096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.041112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.041144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.041158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:04.041480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:04.041510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.041686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.041741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 55
2025-10-10T14:00:04.041745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 55
2025-10-10T14:00:04.041890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.042135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.042273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:04.042368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592574928181629:3061], now have 1 active actors on pipe
2025-10-10T14:00:04.042398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592570633214228:2442], now have 1 active actors on pipe
2025-10-10T14:00:04.042443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:04.042464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:04.042501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.042515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.042524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.042533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.042560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:04.042608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:04.042620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:04.042623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:04.042635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:04.042647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:04.042841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:04.042859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:04.042904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:04.042924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.042937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.042944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:04.042971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.043013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:04.043139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.043165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:04.043197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:04.043201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:04.043648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:04.043677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:04.043741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:04.043998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 56 partition: 0 MaxSeqNo: 36 sessionId: src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0
2025-10-10T14:00:04.044747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c76bf25a-2d254f8e-490cdb0-f6ecd1b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:04.046762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592574928181634:2507]
2025-10-10T14:00:04.047258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592574928181634:2507], now have 1 active actors on pipe
2025-10-10T14:00:04.047358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 55, pipe: [1:7559592574928181634:2507]
2025-10-10T14:00:04.065932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0] Write session: try to update token
2025-10-10T14:00:04.065988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:04.090823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:04.090852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:04.090882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.091001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:04.091022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:04.092917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:04.094159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:04.095199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:04.096224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:04.097881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:04.098355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:04.136044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:04.136096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:04.136125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:04.136144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:04.136162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:04.136232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.136272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.136317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.136362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592569055299057:2933]
2025-10-10T14:00:04.136493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:04.136507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:04.136533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.136544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:04.136547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:04.136580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:04.136620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:04.137543Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:04.154305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId: src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:04.173055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:04.287950Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:04.290342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:04.290373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:04.291313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:04.291342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:04.291574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592574928181634:2507]
2025-10-10T14:00:04.291679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:04.291646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:04.328611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 56 reason: error at write: Disconnected sessionId: src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0
2025-10-10T14:00:04.328980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 56 sessionId: src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0 is DEAD
2025-10-10T14:00:04.329494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:04.329561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0] Write session will restart in 0.007901s
2025-10-10T14:00:04.329722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0] Write session: Do CDS request
2025-10-10T14:00:04.329766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:04.334954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:04.338667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:04.339491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:04.339509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:04.339550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:04.339798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:04.339958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592573350266495:2942]
2025-10-10T14:00:04.341994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:04.342829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:04.342864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 57
2025-10-10T14:00:04.343051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:04.343067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:04.343326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:04.343615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:04.343731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 57 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:04.343752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=57 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:04.343760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:04.344677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:04.344923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 57 sessionId:  describe result for acl check
2025-10-10T14:00:04.344968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.344983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.344989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.345020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:04.344995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.345035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:04.345000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.345043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:04.345006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.345058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592574928181713:3065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:04.345011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.345017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.345023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.345028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.345033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.345038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.345077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.345184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.345225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.345274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.345314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.345354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.345399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.345440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.345478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.345544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.345625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.345701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.345760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.345866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.345934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.345996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.346056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.346107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.346150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.346200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.346245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.346287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.346325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.346376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.346420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.346468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.346506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.346561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.346626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.346677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.346733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.346780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.346820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.346865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.346912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.346973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.347359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:04.347569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592574928181713:3065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:04.354296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592574928181713:3065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:04.362172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592574928181713:3065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:04.362213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592574928181713:3065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:04.362229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592574928181713:3065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:04.362255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 57 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:04.371660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:04.385324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:04.385370Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:04.385386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:04.385405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:04.385429Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 56 [2:7559592573350266495:2942]
2025-10-10T14:00:04.385478Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:04.385529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:04.385543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.385556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.385566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.385614Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:04.385636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:04.385670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:04.388604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.388628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.388640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.388651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.388660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:04.388924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:04.388948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.389064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.389247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.389268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 56
2025-10-10T14:00:04.389358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 56
2025-10-10T14:00:04.389452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.389558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:04.389640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592574928181745:3065], now have 1 active actors on pipe
2025-10-10T14:00:04.389668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592574928181638:2442], now have 1 active actors on pipe
2025-10-10T14:00:04.389690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.389704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.389715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.389727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.389756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:04.389787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:04.389799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:04.389810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:04.389821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:04.389829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:04.389984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:04.390007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:04.390058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:04.390083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:04.390214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.390251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:04.390290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:04.390317Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:04.390344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.390366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.390376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:04.390409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.390449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:04.390574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:04.391397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:04.391424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:04.391494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:04.391770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 57 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0
2025-10-10T14:00:04.391810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592574928181750:2507]
2025-10-10T14:00:04.392159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592574928181750:2507], now have 1 active actors on pipe
2025-10-10T14:00:04.392236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 56, pipe: [1:7559592574928181750:2507]
2025-10-10T14:00:04.397518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c772f82f-db5225b0-4b3f3565-a0f1fab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:04.416418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0] Write session: try to update token
2025-10-10T14:00:04.416471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:04.430748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:04.430782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:04.430821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.430946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:04.430972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:04.432763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:04.434043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:04.435374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:04.436590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:04.438138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:04.438550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:04.486057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.486107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.486149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.513184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId: src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:04.538370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:04.538399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:04.538410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:04.538419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:04.538429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:04.538465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.538486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.538506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.538526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592573350266489:2942]
2025-10-10T14:00:04.538617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:04.538652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:04.538668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:04.538678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.538701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:04.538714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:04.538747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:04.539869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:04.551872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:04.686533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:04.688366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:04.688415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:04.689173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:04.691841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:04.692134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592574928181750:2507]
2025-10-10T14:00:04.692336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:04.712336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 57 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0
2025-10-10T14:00:04.712677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 57 sessionId: src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0 is DEAD
2025-10-10T14:00:04.713018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:04.713063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0] Write session will restart in 0.005314s
2025-10-10T14:00:04.713173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0] Write session: Do CDS request
2025-10-10T14:00:04.713201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:04.738284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:04.744141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:04.744183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 58
2025-10-10T14:00:04.745422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:04.745552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 58 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:04.745567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=58 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:04.745576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:04.754345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 58 sessionId:  describe result for acl check
2025-10-10T14:00:04.754461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:04.754471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:04.754480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:04.754496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592574928181793:3071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:04.756925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592574928181793:3071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:04.767883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592574928181793:3071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:04.777276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592574928181793:3071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:04.777322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592574928181793:3071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:04.777337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592574928181793:3071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:04.777372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 58 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:04.778213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:04.779675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:04.780238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:04.780248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:04.780276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:04.780429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:04.780561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592573350266628:2951]
2025-10-10T14:00:04.781933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:04.782769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:04.782900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:04.783758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:04.783952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.783957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.783961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.783965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.783969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.783972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.783976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.783980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.783983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.783987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.783991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.783995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.784026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.784116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.784149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.784185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.784226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.784255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.784284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.784314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.784344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.784375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.784406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.784435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.784459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.784501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:04.784538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.784584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:04.784628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.784661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:04.784689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.784739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:04.784770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.784804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:04.784829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.784863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:04.784892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.784926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:04.784957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.784989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:04.785018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.785049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.785084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.785144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.785184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.785232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.785268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.785300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.785592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:04.788637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592574928181885:2507]
2025-10-10T14:00:04.808468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:04.824601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:04.824653Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:04.824672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:04.824694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:04.824719Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 57 [2:7559592573350266628:2951]
2025-10-10T14:00:04.824783Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:04.824847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:04.824862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.824876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.824888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.824937Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:04.824959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:04.824983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:04.827981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 57
2025-10-10T14:00:04.828076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 57, pipe: [1:7559592574928181885:2507]
2025-10-10T14:00:04.828151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 57
2025-10-10T14:00:04.827059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.827086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.827102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.827117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.827128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:04.827406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:04.827424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.827579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:04.827786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:04.828030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:04.828156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:04.828259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592574928181765:2442], now have 1 active actors on pipe
2025-10-10T14:00:04.828285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592574928181885:2507], now have 1 active actors on pipe
2025-10-10T14:00:04.828309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592574928181879:3071], now have 1 active actors on pipe
2025-10-10T14:00:04.828336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592573350266621:2951]
2025-10-10T14:00:04.828351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592573350266621:2951]
2025-10-10T14:00:04.828365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592573350266621:2951]
2025-10-10T14:00:04.828378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592573350266621:2951]
2025-10-10T14:00:04.828411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:04.828473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:04.828488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:04.828498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:04.828499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:04.828511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:04.828684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:04.828700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:04.828871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:04.828893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:04.828922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592573350266621:2951]
2025-10-10T14:00:04.828958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:04.828974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:04.829074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:04.829108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.829858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.829878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:04.829918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.829959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:04.830067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:04.830701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:04.830740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:04.830808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:04.831113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 58 partition: 0 MaxSeqNo: 36 sessionId: src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0
2025-10-10T14:00:04.833362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8f9d7bc-a8102846-3a4d000b-bedfa185_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:04.858684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0] Write session: try to update token
2025-10-10T14:00:04.858763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:04.897071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:04.897115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:04.897345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:04.897367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:04.897389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:04.897448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592573350266621:2951]
2025-10-10T14:00:04.897494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592573350266621:2951]
2025-10-10T14:00:04.897534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592573350266621:2951]
2025-10-10T14:00:04.897569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592573350266621:2951]
2025-10-10T14:00:04.897849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:04.897905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:04.897923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:04.901901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:04.901961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:04.901999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:04.902026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:04.903924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:04.962499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId: src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:04.987472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:05.058237Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:05.060735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:05.060768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:05.063505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:05.063774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592574928181885:2507]
2025-10-10T14:00:05.063940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:05.063962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:05.064886Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:05.074112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 58 reason: error at write: Disconnected sessionId: src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0
2025-10-10T14:00:05.074443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 58 sessionId: src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0 is DEAD
2025-10-10T14:00:05.077025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:05.077071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0] Write session will restart in 0.008276s
2025-10-10T14:00:05.077199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0] Write session: Do CDS request
2025-10-10T14:00:05.077250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:05.091899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:05.111727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:05.116199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:05.116227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 59
2025-10-10T14:00:05.115741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:05.116644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:05.116662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:05.116713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:05.116971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:05.117160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592577645234033:2953]
2025-10-10T14:00:05.119235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:05.120109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:05.120337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:05.120403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:05.120615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 59 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:05.120649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=59 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:05.120661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:05.121558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:05.121911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.121930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.121937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.121942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.121948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.121954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.121961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.121967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.121973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.121979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.121985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.121991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.122035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.122134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.122177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.122223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.122264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.122307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.122350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.122391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.122432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.122485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.122528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.122568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.122606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.122666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.122738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.122793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.122836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.122885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.122926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.122976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.123018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.123064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.123103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.123153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.123194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.123239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.123279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.123330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.123372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.123417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.123459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.123509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.123550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.123598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.123638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.122042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 59 sessionId:  describe result for acl check
2025-10-10T14:00:05.123686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.124097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:05.122162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:05.122173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:05.122182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:05.122200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592579223149283:3082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:05.124739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592579223149283:3082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:05.130053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592579223149283:3082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:05.138385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592579223149283:3082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:05.138424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592579223149283:3082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:05.138440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592579223149283:3082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:05.138469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 59 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:05.156644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:05.163446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592579223149315:2507]
2025-10-10T14:00:05.173273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:05.173318Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:05.173333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:05.173351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:05.173374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 58 [2:7559592577645234033:2953]
2025-10-10T14:00:05.173422Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:05.173481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:05.173494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.173506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.173516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.173564Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:05.173584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:05.173606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:05.175924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.175951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.175965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.175978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.175990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:05.176256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:05.176281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.176406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.176574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.176662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 58
2025-10-10T14:00:05.176739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 58, pipe: [1:7559592579223149315:2507]
2025-10-10T14:00:05.176795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.176817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 58
2025-10-10T14:00:05.176907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:05.176992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592579223149313:3082], now have 1 active actors on pipe
2025-10-10T14:00:05.177014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592579223149315:2507], now have 1 active actors on pipe
2025-10-10T14:00:05.177033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592579223149207:2442], now have 1 active actors on pipe
2025-10-10T14:00:05.177056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.177070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.177084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.177094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.177145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:05.177220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:05.177309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:05.177335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:05.177345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:05.177354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:05.177387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:05.177402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:05.177455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:05.177474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:05.177611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.177638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:05.177709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:05.177745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.177762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.177766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:05.177771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:05.177822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.177863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:05.177999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:05.178453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:05.178470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:05.178525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:05.178826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 59 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0
2025-10-10T14:00:05.179863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|538d5f0c-1fcd006e-e01e3b7c-31c16cab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:05.220249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0] Write session: try to update token
2025-10-10T14:00:05.220298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:05.247695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:05.247729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:05.247764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.247887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:05.248308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:05.251203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:05.266102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:05.268137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:05.273391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:05.276351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:05.276857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.276870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.276882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.276933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:05.313863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:05.313901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:05.313917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:05.313927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:05.313937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:05.313973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.313996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.314014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.314033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592577645234028:2953]
2025-10-10T14:00:05.314185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:05.314209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.314218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:05.314605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:05.314631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:05.314657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:05.314679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:05.330296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:05.362302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId: src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:05.383426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:05.475848Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:05.485407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:05.485465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:05.486170Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:05.486482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:05.486542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:05.492781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592579223149315:2507]
2025-10-10T14:00:05.492885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:05.523209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 59 reason: error at write: Disconnected sessionId: src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0
2025-10-10T14:00:05.523567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 59 sessionId: src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0 is DEAD
2025-10-10T14:00:05.523932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:05.523988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0] Write session will restart in 0.008102s
2025-10-10T14:00:05.524149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0] Write session: Do CDS request
2025-10-10T14:00:05.524200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:05.536719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:05.541245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:05.541278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 60
2025-10-10T14:00:05.541666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:05.541776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 60 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:05.541797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=60 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:05.541805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:05.543318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:05.543921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 60 sessionId:  describe result for acl check
2025-10-10T14:00:05.544041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:05.544056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:05.544065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:05.544081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592579223149415:3089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:05.546640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592579223149415:3089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:05.549596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:05.550399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:05.550415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:05.550458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:05.550690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:05.551074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592577645234169:2959]
2025-10-10T14:00:05.553840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:05.556618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:05.556846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:05.559989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:05.560374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.560383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.560390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.560396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.560403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.560411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.560417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.560424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.560430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.560437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.560443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.560450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.560496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.560599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.560643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.561149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.561201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.561244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.561286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.561328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.561373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.561417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.561467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.561509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.561549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.561610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.561664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.561713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.561760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.561868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.561908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.561955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.561997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.562046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.562091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.562153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.562198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.562246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.562289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.562339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.562387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.562447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.562501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.562562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.562609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.562663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.562723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.562778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.563202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:05.564537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592579223149415:3089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:05.585171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592579223149415:3089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:05.585205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592579223149415:3089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:05.585216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592579223149415:3089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:05.585240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 60 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:05.588847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592579223149450:2507]
2025-10-10T14:00:05.593045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:05.604812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:05.604856Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:05.604873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:05.604891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:05.604916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 59 [2:7559592577645234169:2959]
2025-10-10T14:00:05.604971Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:05.605031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:05.605046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.605066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.605080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.605149Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:05.605170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:05.605191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:05.606391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.606415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.606428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.606441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.606453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:05.606726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:05.606752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.606893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.607071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.607288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.607399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:05.607487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592579223149449:3089], now have 1 active actors on pipe
2025-10-10T14:00:05.607519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592579223149450:2507], now have 1 active actors on pipe
2025-10-10T14:00:05.607539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592579223149341:2442], now have 1 active actors on pipe
2025-10-10T14:00:05.607564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592577645234164:2959]
2025-10-10T14:00:05.607580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592577645234164:2959]
2025-10-10T14:00:05.607593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592577645234164:2959]
2025-10-10T14:00:05.607605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592577645234164:2959]
2025-10-10T14:00:05.607644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:05.607693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:05.607708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:05.607719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:05.607721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:05.607729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:05.607889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:05.607905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:05.608032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592577645234164:2959]
2025-10-10T14:00:05.608056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:05.608075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:05.609306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 59
2025-10-10T14:00:05.609448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 59
2025-10-10T14:00:05.609482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 59, pipe: [1:7559592579223149450:2507]
2025-10-10T14:00:05.609769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:05.609801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:05.609873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:05.609907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.609926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.609938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:05.609977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.610021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:05.610067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:05.614247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 60 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0
2025-10-10T14:00:05.613860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:05.613895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:05.613979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:05.617831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a34b0c8-a450c198-676fffe3-db022ce7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:05.650998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0] Write session: try to update token
2025-10-10T14:00:05.651044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:05.701182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:05.701224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:05.701240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:05.701252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:05.701266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:05.701302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592577645234164:2959]
2025-10-10T14:00:05.701331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592577645234164:2959]
2025-10-10T14:00:05.701358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592577645234164:2959]
2025-10-10T14:00:05.701380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592577645234164:2959]
2025-10-10T14:00:05.701539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:05.701578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.701590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:05.702626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:05.702650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:05.702668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:05.702698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:05.702743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:05.780424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId: src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:05.819397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:05.855652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:05.858623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:05.858651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:05.863065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:05.863444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:05.863465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:05.864064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592579223149450:2507]
2025-10-10T14:00:05.864190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:05.901776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 60 reason: error at write: Disconnected sessionId: src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0
2025-10-10T14:00:05.901993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 60 sessionId: src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0 is DEAD
2025-10-10T14:00:05.909325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:05.909367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0] Write session will restart in 0.006021s
2025-10-10T14:00:05.909460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0] Write session: Do CDS request
2025-10-10T14:00:05.909488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:05.919081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:05.920633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:05.921459Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:05.921486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:05.921530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:05.921763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:05.921951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592577645234298:2968]
2025-10-10T14:00:05.924251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:05.922113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:05.922149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 61
2025-10-10T14:00:05.925350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:05.925875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:05.926540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:05.926679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 61 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:05.926695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=61 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:05.926706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:05.925597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:05.926933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:05.927304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.927312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.927319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.927326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.927332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.927340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.927348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.927355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.927361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.927368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.927376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.927382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.927430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.927543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.927593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.927644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.927695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.927741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.927787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.927834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.927883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.927932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.927978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.928025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.928064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.928148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:05.928209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.928266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:05.928316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.928373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:05.928422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.928476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:05.928528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.928587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:05.928634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.928690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:05.928740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.928798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:05.928845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.928901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:05.928949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.929005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.929052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.929106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.928187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 61 sessionId:  describe result for acl check
2025-10-10T14:00:05.928299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:05.928309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:05.928319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:05.928336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592579223149563:3098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:05.930971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592579223149563:3098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:05.931592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.931681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.931735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.931796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.932288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:05.948908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592579223149563:3098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:05.961024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:05.961660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592579223149563:3098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:05.961706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592579223149563:3098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:05.961724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592579223149563:3098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:05.961755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 61 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:05.963651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592579223149595:2507]
2025-10-10T14:00:05.977645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:05.977685Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:05.977701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:05.977720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:05.977742Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 60 [2:7559592577645234298:2968]
2025-10-10T14:00:05.977798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:05.977854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:05.977868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.977880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.977892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.977939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:05.977961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:05.977983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:05.980215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.980231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.980246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.980258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.980270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:05.980541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:05.980557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:05.980694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:05.980882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:05.981105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:05.982615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 60, pipe: [1:7559592579223149595:2507]
2025-10-10T14:00:05.982693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 60
2025-10-10T14:00:05.982757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 60
2025-10-10T14:00:05.982119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:05.982210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592579223149595:2507], now have 1 active actors on pipe
2025-10-10T14:00:05.982231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592579223149483:2442], now have 1 active actors on pipe
2025-10-10T14:00:05.982251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592579223149593:3098], now have 1 active actors on pipe
2025-10-10T14:00:05.982274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:05.982289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:05.982302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:05.982316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:05.982349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:05.982428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:05.982601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:05.982617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:05.982747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:05.982766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:05.983349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:05.983368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:05.983380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:05.983392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:05.983414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:05.983930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:05.983958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:05.984026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:05.984066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.984084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.984095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:05.984126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.984166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:05.984210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:05.984862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:05.984886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:05.984942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:05.986169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1474232-b0afb412-22cb2a26-b7a94a99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:05.985353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 61 partition: 0 MaxSeqNo: 36 sessionId: src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0
2025-10-10T14:00:06.021413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:06.021446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:06.021479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:06.021603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:06.021642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:06.023509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:06.036194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0] Write session: try to update token
2025-10-10T14:00:06.036243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:06.041233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:06.042479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:06.045194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:06.047115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:06.047582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:06.110768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.110792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.110800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.110840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:06.110849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:06.110857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:06.110865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:06.110874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:06.110899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:06.110915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:06.110930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:06.110944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592577645234293:2968]
2025-10-10T14:00:06.111039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:06.111055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.111063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:06.111061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:06.111097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:06.111137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:06.111176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:06.112145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:06.171165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId: src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:06.193293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:06.257907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:06.259783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:06.259822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:06.260718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:06.260474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592579223149595:2507]
2025-10-10T14:00:06.260568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:06.260689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:06.260701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:06.299201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 61 reason: error at write: Disconnected sessionId: src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0
2025-10-10T14:00:06.305102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 61 sessionId: src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0 is DEAD
2025-10-10T14:00:06.305692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:06.305752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0] Write session will restart in 0.007420s
2025-10-10T14:00:06.305906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0] Write session: Do CDS request
2025-10-10T14:00:06.305972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:06.320021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:06.319837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:06.319886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 62
2025-10-10T14:00:06.320799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:06.320957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 62 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:06.320974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=62 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:06.320984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:06.324425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:06.323699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 62 sessionId:  describe result for acl check
2025-10-10T14:00:06.323806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:06.323816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:06.323826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:06.323843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592583518116979:3102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:06.326475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592583518116979:3102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:06.326604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:06.327282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:06.327306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:06.327349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:06.327555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:06.327711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592581940201729:2975]
2025-10-10T14:00:06.329478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:06.330099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:06.330278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:06.331228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:06.331476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:06.331490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:06.331497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:06.331505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:06.331513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:06.331521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:06.331528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:06.331535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:06.331543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.331549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.331557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.331564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.331612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:06.331719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:06.331771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:06.331834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:06.331891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:06.331944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:06.331995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:06.332048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:06.332100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.332163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.332224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.332278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.332324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:06.332392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:06.332457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:06.332521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:06.332575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:06.332639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:06.332686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:06.332743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:06.332791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:06.332846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:06.332890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:06.332943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:06.332988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:06.333038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:06.333081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:06.334413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:06.334504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.333697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592583518116979:3102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:06.334589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.334654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.334715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.334797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.334872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.334926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.334987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.335479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:06.350512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592583518116979:3102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:06.350553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592583518116979:3102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:06.350570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592583518116979:3102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:06.350601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 62 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:06.363904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592583518117014:2507]
2025-10-10T14:00:06.375804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:06.388905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:06.388949Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:06.388965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:06.388984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:06.389006Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 61 [2:7559592581940201729:2975]
2025-10-10T14:00:06.389061Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:06.389117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:06.389148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.389160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.389171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.389218Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:06.389240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:06.389261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:06.392448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 61, pipe: [1:7559592583518117014:2507]
2025-10-10T14:00:06.392585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 61
2025-10-10T14:00:06.392663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 61
2025-10-10T14:00:06.391661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.391691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.391707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.391723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.391735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:06.392012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:06.392030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.392178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.392376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.392623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.392747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:06.392823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592583518117014:2507], now have 1 active actors on pipe
2025-10-10T14:00:06.392847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592583518116902:2442], now have 1 active actors on pipe
2025-10-10T14:00:06.392868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592583518117013:3102], now have 1 active actors on pipe
2025-10-10T14:00:06.392894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.392907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.392920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.392933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.392965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:06.392987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:06.393001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:06.393012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:06.393023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:06.393045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:06.393713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:06.393740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:06.393819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:06.393839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:06.393971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.394007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:06.394036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:06.394081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:06.394110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.394126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.394139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:06.394172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.394210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:06.394335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:06.395020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:06.395050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:06.395111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:06.395444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 62 partition: 0 MaxSeqNo: 36 sessionId: src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0
2025-10-10T14:00:06.396314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90999fce-9907945a-a7a01af0-6c8c98ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:06.422060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0] Write session: try to update token
2025-10-10T14:00:06.422117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:06.494417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:06.494455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:06.494468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:06.494479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:06.494489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:06.494523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.494546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.494568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.494586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.494825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.494847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.494844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:06.494857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.494882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:06.494904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:06.494916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:06.494928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.494938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:06.494947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:06.501394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:06.522048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:06.545060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:06.647865Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:06.658632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:06.658688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:06.658772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:06.658785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:06.658825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592581940201724:2975]
2025-10-10T14:00:06.659016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:06.659274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:06.659247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592583518117014:2507]
2025-10-10T14:00:06.659340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:06.659470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:06.659487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:06.669445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 62 reason: error at write: Disconnected sessionId: src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0
2025-10-10T14:00:06.669813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 62 sessionId: src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0 is DEAD
2025-10-10T14:00:06.672715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:06.672787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0] Write session will restart in 0.005732s
2025-10-10T14:00:06.672945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0] Write session: Do CDS request
2025-10-10T14:00:06.672989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:06.684489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:06.690068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:06.690100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 63
2025-10-10T14:00:06.691037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:06.691151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 63 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:06.691166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=63 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:06.691176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:06.693155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 63 sessionId:  describe result for acl check
2025-10-10T14:00:06.693286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:06.693296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:06.693305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:06.693321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592583518117060:3113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:06.695854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592583518117060:3113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:06.711644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592583518117060:3113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:06.720291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592583518117060:3113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:06.720338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592583518117060:3113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:06.720355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592583518117060:3113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:06.720387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 63 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:06.722532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:06.724207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:06.724924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:06.724951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:06.724990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:06.725227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:06.725397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592581940201862:2980]
2025-10-10T14:00:06.727371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:06.728690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:06.728936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:06.730200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:06.730511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:06.730564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:06.730577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:06.730583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:06.730589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:06.730597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:06.730603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:06.730609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:06.730615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.730620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.730627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.730633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.730675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:06.730784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:06.730832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:06.730876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:06.730926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:06.730977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:06.731023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:06.731073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:06.731122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.731171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.731218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.731265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.731309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:06.731376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:06.731437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:06.731494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:06.731542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:06.731594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:06.731645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:06.731692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:06.731732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:06.731785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:06.731828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:06.731877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:06.731928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:06.731970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:06.732002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:06.732051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:06.732093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.732147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.732195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.732252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.732299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.732342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.732384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.732441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.732866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:06.760110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592583518117157:2507]
2025-10-10T14:00:06.757354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:06.770914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:06.770960Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:06.770973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:06.770991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:06.771015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 62 [2:7559592581940201862:2980]
2025-10-10T14:00:06.771065Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:06.771126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:06.771140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.771151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.771161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.771207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:06.771227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:06.771247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:06.774353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.774390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.774408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.774421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.774431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:06.774697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:06.774713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.774865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:06.775042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:06.775256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:06.775362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:06.775435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592581940201857:2980]
2025-10-10T14:00:06.775450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592581940201857:2980]
2025-10-10T14:00:06.775463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592581940201857:2980]
2025-10-10T14:00:06.775474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592581940201857:2980]
2025-10-10T14:00:06.775516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:06.775602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:06.775674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:06.775690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:06.775701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:06.775710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:06.775777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:06.776674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 62
2025-10-10T14:00:06.775794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:06.775933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592581940201857:2980]
2025-10-10T14:00:06.775953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:06.775987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:06.776771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 62, pipe: [1:7559592583518117157:2507]
2025-10-10T14:00:06.776041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592583518117044:2442], now have 1 active actors on pipe
2025-10-10T14:00:06.776063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592583518117157:2507], now have 1 active actors on pipe
2025-10-10T14:00:06.776085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592583518117150:3113], now have 1 active actors on pipe
2025-10-10T14:00:06.776851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 62
2025-10-10T14:00:06.777227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:06.777259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:06.777362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:06.777410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.777438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.777449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:06.777494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.777547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:06.777602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:06.778046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:06.778072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:06.778134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:06.778867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 63 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0
2025-10-10T14:00:06.781364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|998ab16d-b4a6ce07-28b4a5bb-6d12b30f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:06.804623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0] Write session: try to update token
2025-10-10T14:00:06.804685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:06.878726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:06.878777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:06.878791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:06.878803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:06.878815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:06.878850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592581940201857:2980]
2025-10-10T14:00:06.878876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592581940201857:2980]
2025-10-10T14:00:06.878900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592581940201857:2980]
2025-10-10T14:00:06.878921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592581940201857:2980]
2025-10-10T14:00:06.879109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.879123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.879134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.879142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:06.879176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:06.879186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:06.879203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:06.879214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:06.879216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:06.879241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:06.880274Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:06.947584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId: src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:06.969056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:07.026812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:07.028462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:07.028500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:07.029864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:07.029915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:07.031178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:07.031432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592583518117157:2507]
2025-10-10T14:00:07.032737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:07.065305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 63 reason: error at write: Disconnected sessionId: src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0
2025-10-10T14:00:07.066041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:07.066100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0] Write session will restart in 0.005916s
2025-10-10T14:00:07.066272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0] Write session: Do CDS request
2025-10-10T14:00:07.066324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:07.065602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 63 sessionId: src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0 is DEAD
2025-10-10T14:00:07.078630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:07.078607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:07.078652Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 64
2025-10-10T14:00:07.079096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:07.079207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 64 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:07.079233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=64 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:07.079243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:07.080421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 64 sessionId:  describe result for acl check
2025-10-10T14:00:07.080500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:07.080506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:07.080512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:07.080524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592587813084567:3122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:07.083079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592587813084567:3122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:07.084044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:07.088762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592587813084567:3122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:07.090032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:07.090862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:07.090892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:07.090930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:07.091171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:07.091347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592586235169282:2984]
2025-10-10T14:00:07.092858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:07.094001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:07.094203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:07.095306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:07.095599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.095615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.095622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.095628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.095634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.095639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.095644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.095650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.095655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.095660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.095667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.095675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.095717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.095808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.095851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.095893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.095932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.095970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.096010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.096048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.096086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.096125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.096164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.096201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.096238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.096309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.096359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.096406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.096445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.096491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.096527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.096574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.096623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.096672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.096708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.096759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.096805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.096852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.096896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.096939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.096986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.097037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.097078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.097160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.095640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592587813084567:3122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:07.097203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.095682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592587813084567:3122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:07.095697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592587813084567:3122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:07.095726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 64 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:07.097260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.097306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.097364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.097794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:07.124761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:07.131614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592587813084602:2507]
2025-10-10T14:00:07.138071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:07.138120Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:07.138137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:07.138156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:07.138180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 63 [2:7559592586235169282:2984]
2025-10-10T14:00:07.138235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:07.138298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:07.138313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.138326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.138337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.138386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:07.138408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:07.138429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:07.139668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.139701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.139713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.139726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.139736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:07.140000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:07.140015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.140148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.140411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 63, pipe: [1:7559592587813084602:2507]
2025-10-10T14:00:07.140322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.140530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.140414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 63
2025-10-10T14:00:07.140528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 63
2025-10-10T14:00:07.140637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:07.140728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592587813084489:2442], now have 1 active actors on pipe
2025-10-10T14:00:07.140749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592587813084602:2507], now have 1 active actors on pipe
2025-10-10T14:00:07.140768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592587813084599:3122], now have 1 active actors on pipe
2025-10-10T14:00:07.140828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:07.140847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:07.140883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.140896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.140909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.140920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.140959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:07.141008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:07.141023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:07.141031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:07.141033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:07.141043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:07.141248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:07.141267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:07.141335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:07.141364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.141393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.141407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:07.141446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.141487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:07.141620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.141651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:07.141695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:07.141693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:07.142464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:07.142505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:07.142587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:07.144831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 64 partition: 0 MaxSeqNo: 36 sessionId: src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0
2025-10-10T14:00:07.145622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b60aa3-4ec49564-3644e806-da6e73eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:07.166929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0] Write session: try to update token
2025-10-10T14:00:07.167013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:07.169321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:07.169351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:07.169387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.169512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:07.169528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:07.171797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:07.201032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:07.202457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:07.203913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:07.205681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:07.206211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:07.277628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId: src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:07.318694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.318724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.318736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.318812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:07.318827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:07.318837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:07.318847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:07.318856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:07.318894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.318919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.318939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.318960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592586235169277:2984]
2025-10-10T14:00:07.319104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:07.319141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.319151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:07.320191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:07.325267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:07.325315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:07.325339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:07.325365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:07.326710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:07.472986Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:07.478307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:07.478358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:07.479204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:07.479464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:07.479624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592587813084602:2507]
2025-10-10T14:00:07.479716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:07.506905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 64 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0
2025-10-10T14:00:07.507398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 64 sessionId: src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0 is DEAD
2025-10-10T14:00:07.507782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:07.507834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0] Write session will restart in 0.005569s
2025-10-10T14:00:07.507960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0] Write session: Do CDS request
2025-10-10T14:00:07.508006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:07.520730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:07.522198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:07.522232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 65
2025-10-10T14:00:07.524267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:07.524544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 65 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:07.524582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=65 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:07.524620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:07.527104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 65 sessionId:  describe result for acl check
2025-10-10T14:00:07.527268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:07.527289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:07.527298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:07.527316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592587813084625:3126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:07.531859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592587813084625:3126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:07.545017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592587813084625:3126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:07.557011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592587813084625:3126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:07.557059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592587813084625:3126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:07.557075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592587813084625:3126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:07.557104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 65 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:07.570742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:07.572737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:07.573750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:07.573805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:07.573874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:07.574189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:07.574331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592586235169430:2994]
2025-10-10T14:00:07.576167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:07.577045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:07.577241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:07.578104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:07.578351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.578363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.578367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.578370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.578374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.578379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.578382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.578386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.578390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.578394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.578398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.578401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.578431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.578526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.578569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.578616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.578657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.578690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.578721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.578764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.578795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.578827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.578858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.578888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.578916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.578968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.579008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.579046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.579089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.579126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.579155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.579189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.579221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.579257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.579303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.579343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.579386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.579425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.579453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.579503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.579547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.579595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.579636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.579678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.579706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.579742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.579771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.579806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.580094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:07.580136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592587813084725:2507]
2025-10-10T14:00:07.612905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:07.624729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:07.624764Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:07.624774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:07.624787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:07.624806Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 64 [2:7559592586235169430:2994]
2025-10-10T14:00:07.624844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:07.624891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:07.624902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.624910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.624920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.624956Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:07.624972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:07.624988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:07.627997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 64, pipe: [1:7559592587813084725:2507]
2025-10-10T14:00:07.628076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 64
2025-10-10T14:00:07.628096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 64
2025-10-10T14:00:07.627196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.627226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.627239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.627250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.627260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:07.627523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:07.627539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.627668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.627848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.628052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.628150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:07.628233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592587813084725:2507], now have 1 active actors on pipe
2025-10-10T14:00:07.628254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592587813084611:2442], now have 1 active actors on pipe
2025-10-10T14:00:07.628272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592587813084682:3126], now have 1 active actors on pipe
2025-10-10T14:00:07.628294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592586235169425:2994]
2025-10-10T14:00:07.628306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592586235169425:2994]
2025-10-10T14:00:07.628317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592586235169425:2994]
2025-10-10T14:00:07.628327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592586235169425:2994]
2025-10-10T14:00:07.628365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:07.628441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:07.628599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:07.628616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:07.628671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:07.628685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:07.628696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:07.628707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:07.628771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592586235169425:2994]
2025-10-10T14:00:07.628799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:07.628824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:07.628914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:07.628933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:07.629039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddabb558-412ede67-42832761-5c9e69ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:07.629070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.629087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.629096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:07.629325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.629367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:07.629440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:07.631165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:07.631198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:07.631264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:07.632410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 65 partition: 0 MaxSeqNo: 36 sessionId: src_id|ddabb558-412ede67-42832761-5c9e69ea_0
2025-10-10T14:00:07.633479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a521d87a-149cf4d0-f9908fe0-cbe1cb4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ddabb558-412ede67-42832761-5c9e69ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:07.670605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddabb558-412ede67-42832761-5c9e69ea_0] Write session: try to update token
2025-10-10T14:00:07.670669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddabb558-412ede67-42832761-5c9e69ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:07.699010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:07.699070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:07.699082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:07.699091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:07.699100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:07.699137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592586235169425:2994]
2025-10-10T14:00:07.699162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592586235169425:2994]
2025-10-10T14:00:07.699186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592586235169425:2994]
2025-10-10T14:00:07.699207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592586235169425:2994]
2025-10-10T14:00:07.699341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:07.699362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:07.699385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:07.699389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.699410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:07.699414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:07.699454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:07.700570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:07.758093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId: src_id|ddabb558-412ede67-42832761-5c9e69ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:07.782553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:07.867378Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:07.877114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:07.877194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:07.879602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592587813084725:2507]
2025-10-10T14:00:07.879749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:07.879865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:07.879875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:07.880436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:07.913357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 65 reason: error at write: Disconnected sessionId: src_id|ddabb558-412ede67-42832761-5c9e69ea_0
2025-10-10T14:00:07.913718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 65 sessionId: src_id|ddabb558-412ede67-42832761-5c9e69ea_0 is DEAD
2025-10-10T14:00:07.917784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddabb558-412ede67-42832761-5c9e69ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:07.917815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddabb558-412ede67-42832761-5c9e69ea_0] Write session will restart in 0.005398s
2025-10-10T14:00:07.917906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddabb558-412ede67-42832761-5c9e69ea_0] Write session: Do CDS request
2025-10-10T14:00:07.917936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddabb558-412ede67-42832761-5c9e69ea_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:07.935711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddabb558-412ede67-42832761-5c9e69ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:07.941539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:07.941574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 66
2025-10-10T14:00:07.942737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:07.942869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 66 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:07.942884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=66 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:07.942893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:07.944369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 66 sessionId:  describe result for acl check
2025-10-10T14:00:07.944481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:07.944490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:07.944498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:07.944514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592587813084792:3139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:07.948047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592587813084792:3139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:07.972939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592587813084792:3139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:07.984827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:07.981294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592587813084876:2507]
2025-10-10T14:00:07.985506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592587813084792:3139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:07.985547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592587813084792:3139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:07.985565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592587813084792:3139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:07.985596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 66 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:07.987337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:07.988124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:07.988143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:07.988188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:07.988470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:07.988642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592586235169569:3002]
2025-10-10T14:00:07.990702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:07.992078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:07.992295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:07.993457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:07.993761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.993769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.993775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.993781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.993787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.993793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.993800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.993833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.993842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.993847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.993854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.993861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.993904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.993999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.994042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.994090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.994127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.994169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.994208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.994247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.994290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.994331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.994367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.994409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.994447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.994504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:07.994552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.994600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:07.994641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.994686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:07.994723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.994786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:07.994825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.994867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:07.994903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.994949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:07.994990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.995035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:07.995075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.995120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:07.995162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.995210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:07.995251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.995296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:07.995336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.995385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:07.995425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.995476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:07.995928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:08.029074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:08.055307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:08.055348Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:08.055362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:08.055378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:08.055401Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 65 [2:7559592586235169569:3002]
2025-10-10T14:00:08.055454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:08.055509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:08.055522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.055533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.055543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.055588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:08.055609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:08.055630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:08.058105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.058126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.058137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.058149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.058158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:08.058428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:08.058444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.058571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.058743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.058958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.059065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:08.059153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592587813084760:2442], now have 1 active actors on pipe
2025-10-10T14:00:08.059175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592587813084876:2507], now have 1 active actors on pipe
2025-10-10T14:00:08.059195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592587813084882:3139], now have 1 active actors on pipe
2025-10-10T14:00:08.059219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592586235169563:3002]
2025-10-10T14:00:08.059235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592586235169563:3002]
2025-10-10T14:00:08.059246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592586235169563:3002]
2025-10-10T14:00:08.059259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592586235169563:3002]
2025-10-10T14:00:08.059306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:08.059384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:08.059543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:08.059559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:08.059684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592586235169563:3002]
2025-10-10T14:00:08.059704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:08.060719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:08.060738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:08.060747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:08.060757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:08.060780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:08.063358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 65
2025-10-10T14:00:08.063452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 65, pipe: [1:7559592587813084876:2507]
2025-10-10T14:00:08.063522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 65
2025-10-10T14:00:08.064080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:08.064116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:08.064209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:08.064252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.064270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.064280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:08.064315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.064371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:08.064417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:08.065862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:08.065892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:08.065955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:08.066309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 66 partition: 0 MaxSeqNo: 36 sessionId: src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0
2025-10-10T14:00:08.068782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddabb558-412ede67-42832761-5c9e69ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:08.107669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0] Write session: try to update token
2025-10-10T14:00:08.107725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:08.174174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:08.174209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:08.174224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:08.174235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:08.174244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:08.174280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592586235169563:3002]
2025-10-10T14:00:08.174305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592586235169563:3002]
2025-10-10T14:00:08.174325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592586235169563:3002]
2025-10-10T14:00:08.174342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592586235169563:3002]
2025-10-10T14:00:08.174511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.174531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.174542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.174571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:08.174586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:08.174603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:08.174610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.174620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:08.174629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:08.174655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:08.175987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:08.247104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId: src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:08.273867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:08.347322Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:08.350715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:08.350759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:08.351662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:08.351917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592587813084876:2507]
2025-10-10T14:00:08.352041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:08.352060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:08.362600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 66 reason: error at write: Disconnected sessionId: src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0
2025-10-10T14:00:08.363421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:08.363487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0] Write session will restart in 0.005065s
2025-10-10T14:00:08.363702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0] Write session: Do CDS request
2025-10-10T14:00:08.363739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:08.362970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 66 sessionId: src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0 is DEAD
2025-10-10T14:00:08.374038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:08.381777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:08.381814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 67
2025-10-10T14:00:08.381926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:08.382606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:08.382844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 67 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:08.382895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=67 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:08.382914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:08.385243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 67 sessionId:  describe result for acl check
2025-10-10T14:00:08.385422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:08.385451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:08.385466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:08.385493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592592108052225:3146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:08.388098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592592108052225:3146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:08.397159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592592108052225:3146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:08.409878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592592108052225:3146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:08.409923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592592108052225:3146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:08.409939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592592108052225:3146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:08.409970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 67 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:08.410222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:08.412616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:08.413311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:08.413339Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:08.413382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:08.413626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:08.413807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592590530136992:3006]
2025-10-10T14:00:08.415496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:08.416322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:08.416529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:08.417739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:08.418037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:08.418051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:08.418058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:08.418065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:08.418071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:08.418077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:08.418083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:08.418089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:08.418095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.418101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.418107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.418113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.418152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:08.418233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:08.418267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:08.418311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:08.418355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:08.418404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:08.418450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:08.418499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:08.418541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.418579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.418611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.418642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.418667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:08.418715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:08.418758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:08.418807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:08.418843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:08.418888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:08.418928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:08.418981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:08.419015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:08.419052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:08.419084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:08.419119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:08.419150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:08.419182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:08.419219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:08.419257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:08.419290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.419327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.419359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.419398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.419450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.419492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.419541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.419590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.419967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:08.443013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:08.452103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592592108052324:2507]
2025-10-10T14:00:08.455623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:08.455663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:08.455679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:08.455699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:08.455722Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 66 [2:7559592590530136992:3006]
2025-10-10T14:00:08.455773Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:08.455824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:08.455835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.455846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.455857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.455895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:08.455911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:08.455927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:08.457373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.457399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.457412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.457427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.457439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:08.457728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:08.457757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.458791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 66
2025-10-10T14:00:08.458897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 66
2025-10-10T14:00:08.458963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 66, pipe: [1:7559592592108052324:2507]
2025-10-10T14:00:08.457894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.458076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.458299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.458408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:08.458490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592592108052205:2442], now have 1 active actors on pipe
2025-10-10T14:00:08.458514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592592108052318:3146], now have 1 active actors on pipe
2025-10-10T14:00:08.458532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592592108052324:2507], now have 1 active actors on pipe
2025-10-10T14:00:08.458556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.458571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.458584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.458596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.458639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:08.458688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:08.458702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:08.458711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:08.458719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:08.458721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:08.458907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:08.458923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:08.459049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.459079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:08.459095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:08.459569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:08.459596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:08.459678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:08.459723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.459741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.459750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:08.459789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.459854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:08.459912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:08.461278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:08.461311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:08.461381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:08.461728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 67 partition: 0 MaxSeqNo: 36 sessionId: src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0
2025-10-10T14:00:08.462533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a84922-b3cbec5f-76b14885-bb3219bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:08.484345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0] Write session: try to update token
2025-10-10T14:00:08.484405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:08.519613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:08.519651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:08.519692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.519828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:08.519875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:08.527336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:08.533603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:08.541452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:08.544118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:08.548225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:08.548937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:08.555915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.555948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.555962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.566725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId: src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:08.594701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:08.594734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:08.594747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:08.594761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:08.594790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:08.594832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.594858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.594881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.594902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592590530136986:3006]
2025-10-10T14:00:08.595052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:08.595082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.595093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:08.596063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:08.596105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:08.596137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:08.596169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:08.596176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:08.599708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:08.748479Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:08.762787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:08.762834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:08.763319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:08.763493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:08.763519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:08.763520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592592108052324:2507]
2025-10-10T14:00:08.763555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:08.775082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 67 reason: error at write: Disconnected sessionId: src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0
2025-10-10T14:00:08.775489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 67 sessionId: src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0 is DEAD
2025-10-10T14:00:08.781066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:08.781119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0] Write session will restart in 0.005704s
2025-10-10T14:00:08.781314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0] Write session: Do CDS request
2025-10-10T14:00:08.781360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:08.793799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:08.793831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 68
2025-10-10T14:00:08.796181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:08.797681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:08.797849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 68 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:08.797872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=68 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:08.797885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:08.799497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 68 sessionId:  describe result for acl check
2025-10-10T14:00:08.799624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:08.799639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:08.799648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:08.799666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592592108052358:3151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:08.804858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592592108052358:3151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:08.812081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592592108052358:3151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:08.820163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592592108052358:3151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:08.820204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592592108052358:3151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:08.820219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592592108052358:3151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:08.820250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 68 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:08.843013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:08.844828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:08.845524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:08.845546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:08.845581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:08.845763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:08.845897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592590530137143:3017]
2025-10-10T14:00:08.847763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:08.848794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:08.849048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:08.850627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:08.850881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:08.850887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:08.850891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:08.850895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:08.850900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:08.850904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:08.850909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:08.850913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:08.850917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.850920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.850924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.850928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.850960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:08.851039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:08.851073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:08.851105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:08.851136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:08.851167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:08.851196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:08.851230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:08.851266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.851301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.851340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.851373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.851397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:08.851451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:08.851500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:08.851552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:08.851591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:08.852265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:08.852315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:08.852368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:08.852415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:08.852465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:08.852504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:08.852552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:08.852594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:08.852642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:08.852684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:08.852734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:08.852796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.852843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.852881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.852928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.852968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.853016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.853056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.853106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.853544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:08.863676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592592108052465:2507]
2025-10-10T14:00:08.885318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:08.905805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:08.905850Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:08.905866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:08.905886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:08.905921Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 67 [2:7559592590530137143:3017]
2025-10-10T14:00:08.905976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:08.906037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:08.906052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.906064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.906075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.906123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:08.906145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:08.906166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:08.908777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.908795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.908809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.908822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.908833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:08.909105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:08.909121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:08.910435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 67, pipe: [1:7559592592108052465:2507]
2025-10-10T14:00:08.910528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 67
2025-10-10T14:00:08.910580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 67
2025-10-10T14:00:08.909840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:08.910028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:08.910247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:08.910361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:08.910443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592592108052465:2507], now have 1 active actors on pipe
2025-10-10T14:00:08.910466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592592108052345:2442], now have 1 active actors on pipe
2025-10-10T14:00:08.910486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592592108052397:3151], now have 1 active actors on pipe
2025-10-10T14:00:08.910508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:08.910522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:08.910534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:08.910547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:08.910585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:08.910662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:08.910837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:08.910839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:08.910848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:08.910854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:08.910859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:08.910868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:08.910972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:08.910991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:08.910997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:08.911111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:08.911130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:08.911233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:08.911262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.911281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.911292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:08.911338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.911379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:08.911445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:08.913295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:08.913324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:08.913387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:08.913648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 68 partition: 0 MaxSeqNo: 36 sessionId: src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0
2025-10-10T14:00:08.915632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7aa69d3-637bee4b-bd8cc58a-25d3dbfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:08.950234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0] Write session: try to update token
2025-10-10T14:00:08.950314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:09.003702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:09.003732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:09.003744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:09.003752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:09.003760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:09.003798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:09.003822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:09.003842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:09.003858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:09.003956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:09.004003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:09.004030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:09.004053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:09.004055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:09.004076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.004086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:09.006499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:09.057399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId: src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:09.079683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:09.156010Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:09.171217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:09.171268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:09.171336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:09.171349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:09.171391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592590530137137:3017]
2025-10-10T14:00:09.171627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:09.171913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:09.172148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592592108052465:2507]
2025-10-10T14:00:09.172231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:09.172373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:09.172384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:09.203357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 68 reason: error at write: Disconnected sessionId: src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0
2025-10-10T14:00:09.203708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 68 sessionId: src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0 is DEAD
2025-10-10T14:00:09.209182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:09.209227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0] Write session will restart in 0.009074s
2025-10-10T14:00:09.209329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0] Write session: Do CDS request
2025-10-10T14:00:09.209363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:09.223271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:09.223311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 69
2025-10-10T14:00:09.226756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:09.227855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:09.228088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 69 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:09.228131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=69 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:09.228149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:09.231509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 69 sessionId:  describe result for acl check
2025-10-10T14:00:09.231644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:09.231665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:09.231674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:09.231691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592596403019838:3157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:09.234433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592596403019838:3157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:09.240213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:09.239948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592596403019838:3157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:09.241849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:09.242577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:09.242595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:09.242655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:09.242905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:09.243073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592594825104578:3024]
2025-10-10T14:00:09.246141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592596403019838:3157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:09.246183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592596403019838:3157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:09.246200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592596403019838:3157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:09.246230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 69 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:09.249228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:09.250308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:09.250553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:09.251737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:09.252038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:09.252046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:09.252053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:09.252059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:09.252065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:09.252072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:09.252078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:09.252085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:09.252092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.252098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.252105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.252112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.252159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:09.252259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:09.252304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:09.252351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:09.252394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:09.252435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:09.252476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:09.252518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:09.252562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.252604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.252644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.252688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.252726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:09.252788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:09.252844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:09.252895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:09.252940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:09.252990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:09.253034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:09.253083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:09.253939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:09.254009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:09.254060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:09.254108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:09.254153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:09.254202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:09.254243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:09.254292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:09.254350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.254402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.254445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.254493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.254535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.254585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.254627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.254674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.255093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:09.274186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592596403019906:2507]
2025-10-10T14:00:09.287443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:09.300677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:09.300725Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:09.300743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:09.300763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:09.300785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 68 [2:7559592594825104578:3024]
2025-10-10T14:00:09.300845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:09.300902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:09.300917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.300929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.300940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.300988Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:09.301011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:09.301033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:09.302413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.302439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.302453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.302469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.302482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:09.304468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 68, pipe: [1:7559592596403019906:2507]
2025-10-10T14:00:09.304487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 68
2025-10-10T14:00:09.304577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 68
2025-10-10T14:00:09.302749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:09.302775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.302943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.303144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.303420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.303546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:09.303614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.303629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.303642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.303654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.303696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:09.303779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:09.303866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:09.303882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:09.303894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:09.303906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:09.303970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:09.303987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:09.304109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.304130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:09.304190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:09.304229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592596403019787:2442], now have 1 active actors on pipe
2025-10-10T14:00:09.304303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592596403019906:2507], now have 1 active actors on pipe
2025-10-10T14:00:09.304329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592596403019900:3157], now have 1 active actors on pipe
2025-10-10T14:00:09.304820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:09.304846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:09.304927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:09.304958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.304970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.304978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:09.305004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.305033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:09.305076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:09.306139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:09.306183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:09.306261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:09.306613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 69 partition: 0 MaxSeqNo: 36 sessionId: src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0
2025-10-10T14:00:09.309760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7bc3e6-74716a35-38cd8b49-abe2e99e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:09.335609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0] Write session: try to update token
2025-10-10T14:00:09.335666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:09.385965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:09.386000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:09.386014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:09.386026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:09.386038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:09.386073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.386098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.386121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.386143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.387969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:09.388011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:09.388040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:09.388067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:09.415806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:09.415864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.415875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:09.417169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:09.455541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId: src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:09.508077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:09.574866Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:09.587347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:09.587374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:09.587406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592594825104573:3024]
2025-10-10T14:00:09.587515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:09.587537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:09.587685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:09.588424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:09.589268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:09.598198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 69 reason: status is not ok: tablet will be restarted right now sessionId: src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0
2025-10-10T14:00:09.598557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 69 sessionId: src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0 is DEAD
2025-10-10T14:00:09.601611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:09.601652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0] Write session will restart in 0.005458s
2025-10-10T14:00:09.601746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0] Write session: Do CDS request
2025-10-10T14:00:09.601783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:09.616342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:09.617385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:09.617418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 70
2025-10-10T14:00:09.617560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:09.617679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592596403019906:2507]
2025-10-10T14:00:09.624302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:09.624448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 70 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:09.624465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=70 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:09.624477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:09.625710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 70 sessionId:  describe result for acl check
2025-10-10T14:00:09.625808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:09.625817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:09.625826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:09.625844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592596403019947:3167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:09.629556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592596403019947:3167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:09.643321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592596403019947:3167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:09.655415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592596403019947:3167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:09.655456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592596403019947:3167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:09.655473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592596403019947:3167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:09.655504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 70 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:09.663746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:09.666236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:09.667081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:09.667099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:09.667142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:09.667394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:09.667576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592594825104718:3028]
2025-10-10T14:00:09.669697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:09.670672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:09.670955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:09.672237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:09.672548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:09.672569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:09.672575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:09.672582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:09.672589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:09.672595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:09.672601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:09.672606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:09.672613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.672619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.672626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.672633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.672679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:09.672787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:09.672836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:09.672883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:09.672934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:09.672982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:09.673029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:09.673076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:09.673119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.673185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.673228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.673274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.673314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:09.673379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:09.673438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:09.673492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:09.673541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:09.673595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:09.673640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:09.673693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:09.673739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:09.673790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:09.673834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:09.673890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:09.673938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:09.673991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:09.674034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:09.674089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:09.674139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.674193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.674238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.674292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.674337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.674390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.674434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.674487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.674956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:09.714010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:09.720637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592596403020057:2507]
2025-10-10T14:00:09.730287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:09.730332Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:09.730348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:09.730367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:09.730390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 69 [2:7559592594825104718:3028]
2025-10-10T14:00:09.730443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:09.730500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:09.730516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.730528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.730538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.730584Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:09.730611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:09.730632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:09.747705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.747735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.747747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.747758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.747769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:09.748067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:09.748082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.748227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:09.748404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:09.748622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:09.748736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:09.748821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592594825104712:3028]
2025-10-10T14:00:09.748836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592594825104712:3028]
2025-10-10T14:00:09.748848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592594825104712:3028]
2025-10-10T14:00:09.748862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592594825104712:3028]
2025-10-10T14:00:09.748910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:09.749001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:09.749304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:09.749319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:09.749331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:09.749342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:09.751196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:09.751229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:09.751405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592596403020043:3167], now have 1 active actors on pipe
2025-10-10T14:00:09.751429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592596403019942:2442], now have 1 active actors on pipe
2025-10-10T14:00:09.751452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592596403020057:2507], now have 1 active actors on pipe
2025-10-10T14:00:09.750515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 69
2025-10-10T14:00:09.750612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 69
2025-10-10T14:00:09.750676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 69, pipe: [1:7559592596403020057:2507]
2025-10-10T14:00:09.751493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:09.751516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:09.751570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592594825104712:3028]
2025-10-10T14:00:09.751606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:09.751738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56695f05-ebedf81a-e4481fd-f86b110e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:09.751774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.751793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.751804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:09.751847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.751896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:09.751987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:09.752269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:09.754551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:09.754589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:09.754658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:09.755097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 70 partition: 0 MaxSeqNo: 36 sessionId: src_id|56695f05-ebedf81a-e4481fd-f86b110e_0
2025-10-10T14:00:09.756080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|877bd3a6-78bb71a-208fabc8-c57af45b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56695f05-ebedf81a-e4481fd-f86b110e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:09.797071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56695f05-ebedf81a-e4481fd-f86b110e_0] Write session: try to update token
2025-10-10T14:00:09.797147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56695f05-ebedf81a-e4481fd-f86b110e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:09.832221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:09.832253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:09.832265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:09.832276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:09.832287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:09.832324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592594825104712:3028]
2025-10-10T14:00:09.832351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592594825104712:3028]
2025-10-10T14:00:09.832374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592594825104712:3028]
2025-10-10T14:00:09.832395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592594825104712:3028]
2025-10-10T14:00:09.832572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.832592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.832603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.832649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:09.832653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:09.832673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:09.832685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:09.832685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:09.832711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:09.832759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:09.834652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:09.896303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId: src_id|56695f05-ebedf81a-e4481fd-f86b110e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:09.939924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:09.992637Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:09.994564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:09.994606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:09.997260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:09.996788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:09.996811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:09.997240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:09.997417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592596403020057:2507]
2025-10-10T14:00:10.004873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 70 reason: error at write: Disconnected sessionId: src_id|56695f05-ebedf81a-e4481fd-f86b110e_0
2025-10-10T14:00:10.005108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 70 sessionId: src_id|56695f05-ebedf81a-e4481fd-f86b110e_0 is DEAD
2025-10-10T14:00:10.006122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56695f05-ebedf81a-e4481fd-f86b110e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:10.006180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56695f05-ebedf81a-e4481fd-f86b110e_0] Write session will restart in 0.006738s
2025-10-10T14:00:10.006382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56695f05-ebedf81a-e4481fd-f86b110e_0] Write session: Do CDS request
2025-10-10T14:00:10.006444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56695f05-ebedf81a-e4481fd-f86b110e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:10.030629Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:10.030670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 71
2025-10-10T14:00:10.033907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56695f05-ebedf81a-e4481fd-f86b110e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:10.035249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:10.035419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 71 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:10.035442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=71 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:10.035454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:10.042604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 71 sessionId:  describe result for acl check
2025-10-10T14:00:10.042733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:10.042746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:10.042754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:10.042770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592600697987402:3177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:10.054020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592600697987402:3177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:10.060818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592600697987402:3177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:10.076170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592600697987402:3177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:10.076214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592600697987402:3177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:10.076230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592600697987402:3177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:10.076258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 71 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:10.093993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:10.097996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592600697987505:2507]
2025-10-10T14:00:10.096664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:10.097558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:10.097577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:10.097620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:10.097878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:10.098056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592599120072144:3033]
2025-10-10T14:00:10.100248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:10.101250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:10.101459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:10.102795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:10.103124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:10.103131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:10.103138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:10.103145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:10.103150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:10.103157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:10.103165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:10.103172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:10.103177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.103183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.103188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.103194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.103235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:10.103343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:10.103389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:10.103430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:10.103472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:10.103519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:10.103563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:10.103605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:10.103651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.103699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.103740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.103784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.103821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:10.103881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:10.103936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:10.103991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:10.104037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:10.104087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:10.104131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:10.104180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:10.104226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:10.104278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:10.104322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:10.104376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:10.104419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:10.104473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:10.104515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:10.104562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:10.104610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.104674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.104721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.104773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.104816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.104866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.104908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.104962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.109535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:10.142963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:10.159591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:10.159642Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:10.159656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:10.159673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:10.159696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 70 [2:7559592599120072144:3033]
2025-10-10T14:00:10.159748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:10.159806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:10.159819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.159831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.159842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.159886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:10.159909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:10.159931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:10.176127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.176158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.176169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.176182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.176192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:10.176447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:10.176473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.176594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.176588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 70
2025-10-10T14:00:10.176637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 70
2025-10-10T14:00:10.176672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 70, pipe: [1:7559592600697987505:2507]
2025-10-10T14:00:10.176755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.176958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.177066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:10.177172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592596403020080:2442], now have 1 active actors on pipe
2025-10-10T14:00:10.177198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592600697987471:3177], now have 1 active actors on pipe
2025-10-10T14:00:10.177221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592600697987505:2507], now have 1 active actors on pipe
2025-10-10T14:00:10.177290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:10.177315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:10.177350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.177368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.177380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.177391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.177426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:10.177466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:10.177485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:10.177495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:10.177501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:10.177506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:10.177656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:10.177679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:10.177745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f2aed63-d405da32-b454521a-2d495f2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:10.177782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.177803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.177814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:10.177852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.177900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:10.178026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.178057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:10.178081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:10.178123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:10.178610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:10.178633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:10.178689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:10.178982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 71 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f2aed63-d405da32-b454521a-2d495f2a_0
2025-10-10T14:00:10.182379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56695f05-ebedf81a-e4481fd-f86b110e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f2aed63-d405da32-b454521a-2d495f2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:10.229879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2aed63-d405da32-b454521a-2d495f2a_0] Write session: try to update token
2025-10-10T14:00:10.229937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2aed63-d405da32-b454521a-2d495f2a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:10.251330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:10.251366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:10.251402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.251516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:10.251531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:10.253752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:10.255243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:10.257080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:10.260832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:10.264869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:10.265506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.265533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.265544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.265595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:10.411114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.411164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.411178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.411237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:10.411253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:10.411265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:10.411278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:10.411289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:10.411331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.411357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.411391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.411416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592599120072138:3033]
2025-10-10T14:00:10.411569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:10.411604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.411617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:10.412100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:10.412145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:10.412177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:10.412213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:10.414958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:10.429972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId: src_id|4f2aed63-d405da32-b454521a-2d495f2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:10.459896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:10.564436Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:10.571350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:10.575103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:10.575923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:10.576033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:10.575951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:10.575964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:10.576056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592600697987505:2507]
2025-10-10T14:00:10.632892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 71 reason: error at write: Disconnected sessionId: src_id|4f2aed63-d405da32-b454521a-2d495f2a_0
2025-10-10T14:00:10.633655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2aed63-d405da32-b454521a-2d495f2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:10.633686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2aed63-d405da32-b454521a-2d495f2a_0] Write session will restart in 0.009534s
2025-10-10T14:00:10.633778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2aed63-d405da32-b454521a-2d495f2a_0] Write session: Do CDS request
2025-10-10T14:00:10.633808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2aed63-d405da32-b454521a-2d495f2a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:10.634458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 71 sessionId: src_id|4f2aed63-d405da32-b454521a-2d495f2a_0 is DEAD
2025-10-10T14:00:10.651077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:10.651120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 72
2025-10-10T14:00:10.652027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2aed63-d405da32-b454521a-2d495f2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:10.652652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:10.652766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 72 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:10.652780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=72 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:10.652792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:10.656378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 72 sessionId:  describe result for acl check
2025-10-10T14:00:10.656511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:10.656520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:10.656529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:10.656545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592600697987605:3182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:10.659036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592600697987605:3182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:10.665235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:10.667121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592600697987605:3182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:10.668293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:10.669468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:10.669494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:10.669544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:10.669818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:10.670001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592599120072316:3043]
2025-10-10T14:00:10.672241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:10.673284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:10.673542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:10.675489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592600697987646:2507]
2025-10-10T14:00:10.674763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:10.675125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:10.675134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:10.675141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:10.675147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:10.675154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:10.675160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:10.675166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:10.675173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:10.675187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.675198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.675204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.675211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.675257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:10.675359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:10.675406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:10.675452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:10.675495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:10.675540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:10.675582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:10.675626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:10.675670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.675713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.675755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.675795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.675838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:10.675897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:10.675951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:10.676004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:10.676056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:10.676108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:10.676151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:10.676202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:10.676250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:10.676327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:10.676370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:10.676423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:10.676484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:10.676535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:10.676578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:10.676626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:10.676673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.676755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.676805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.676857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.676900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.676216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592600697987605:3182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:10.676943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.676991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.676252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592600697987605:3182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:10.677054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.676267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592600697987605:3182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:10.676298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 72 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:10.677607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:10.703694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:10.716671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:10.716714Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:10.716731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:10.716751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:10.716773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 71 [2:7559592599120072316:3043]
2025-10-10T14:00:10.716826Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:10.716880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:10.716893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.716904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.716914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.716960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:10.716984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:10.717004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:10.732355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.732384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.732396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.732408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.732418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:10.732688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:10.732712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.732841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:10.733019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:10.733282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:10.733409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:10.733505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592600697987519:2442], now have 1 active actors on pipe
2025-10-10T14:00:10.733526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592600697987646:2507], now have 1 active actors on pipe
2025-10-10T14:00:10.733546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592600697987650:3182], now have 1 active actors on pipe
2025-10-10T14:00:10.733569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592599120072298:3043]
2025-10-10T14:00:10.733582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592599120072298:3043]
2025-10-10T14:00:10.733593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592599120072298:3043]
2025-10-10T14:00:10.733501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 71
2025-10-10T14:00:10.733607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592599120072298:3043]
2025-10-10T14:00:10.733648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:10.733557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 71, pipe: [1:7559592600697987646:2507]
2025-10-10T14:00:10.733597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 71
2025-10-10T14:00:10.733730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:10.733810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:10.733825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:10.733835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:10.733845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:10.733901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:10.733917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:10.734038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592599120072298:3043]
2025-10-10T14:00:10.734062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:10.734135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:10.734155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:10.734288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a07e5014-d2650102-d3c069a8-b36f567c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:10.734319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.734337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.734347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:10.734383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.734425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:10.734477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:10.734560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:10.736017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:10.736050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:10.736117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:10.736561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 72 partition: 0 MaxSeqNo: 36 sessionId: src_id|a07e5014-d2650102-d3c069a8-b36f567c_0
2025-10-10T14:00:10.737330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f2aed63-d405da32-b454521a-2d495f2a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a07e5014-d2650102-d3c069a8-b36f567c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:10.774266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a07e5014-d2650102-d3c069a8-b36f567c_0] Write session: try to update token
2025-10-10T14:00:10.774324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a07e5014-d2650102-d3c069a8-b36f567c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:10.823916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:10.823951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:10.823965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:10.823976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:10.823987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:10.824023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592599120072298:3043]
2025-10-10T14:00:10.824050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592599120072298:3043]
2025-10-10T14:00:10.824074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592599120072298:3043]
2025-10-10T14:00:10.824093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592599120072298:3043]
2025-10-10T14:00:10.824280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.824292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.824303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.824351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:10.824375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:10.824385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:10.824457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:10.824494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:10.824538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:10.824566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:10.825508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:10.877226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId: src_id|a07e5014-d2650102-d3c069a8-b36f567c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:10.908833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:10.983388Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:10.985690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:10.985736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:10.989303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592600697987646:2507]
2025-10-10T14:00:10.989410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:10.989423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:10.989318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:11.004953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:11.005102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 72 reason: error at write: Disconnected sessionId: src_id|a07e5014-d2650102-d3c069a8-b36f567c_0
2025-10-10T14:00:11.005842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07e5014-d2650102-d3c069a8-b36f567c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:11.005892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07e5014-d2650102-d3c069a8-b36f567c_0] Write session will restart in 0.006711s
2025-10-10T14:00:11.006035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07e5014-d2650102-d3c069a8-b36f567c_0] Write session: Do CDS request
2025-10-10T14:00:11.006082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07e5014-d2650102-d3c069a8-b36f567c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:11.005437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 72 sessionId: src_id|a07e5014-d2650102-d3c069a8-b36f567c_0 is DEAD
2025-10-10T14:00:11.021955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a07e5014-d2650102-d3c069a8-b36f567c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:11.047449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:11.047483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 73
2025-10-10T14:00:11.047512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:11.051554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:11.052369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:11.052396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:11.052438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:11.052684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:11.052874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592603415039739:3051]
2025-10-10T14:00:11.052678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:11.052814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 73 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:11.052829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=73 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:11.052837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:11.054865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:11.056191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 73 sessionId:  describe result for acl check
2025-10-10T14:00:11.056325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:11.056345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:11.056354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:11.056370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592604992955079:3195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:11.059152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592604992955079:3195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:11.056102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:11.056322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:11.057420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:11.057694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.057701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.057707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.057714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.057721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.057727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.057732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.057738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.057743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.057749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.057755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.057759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.057799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.057893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.057934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.057976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.058014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.058053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.058092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.058131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.058173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.058216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.058258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.058299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.058333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.058388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.058438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.058484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.058547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.058593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.058631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.058675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.058716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.058761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.058800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.058862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.058907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.058953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.058990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.059038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.059079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.059127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.059163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.059206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.059249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.059294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.059332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.059376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.059756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:11.069936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592604992955079:3195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:11.076923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592604992955079:3195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:11.076964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592604992955079:3195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:11.076981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592604992955079:3195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:11.077013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 73 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:11.087994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:11.093262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592604992955110:2507]
2025-10-10T14:00:11.102622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:11.102665Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:11.102682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:11.102700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:11.102721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 72 [2:7559592603415039739:3051]
2025-10-10T14:00:11.102770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:11.102837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:11.102852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.102864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.102874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.102920Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:11.102941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:11.102962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:11.105521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.105547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.105560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.105573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.105583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:11.105840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:11.105857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.105987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.106150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.106357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.106675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 72
2025-10-10T14:00:11.106756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 72, pipe: [1:7559592604992955110:2507]
2025-10-10T14:00:11.106837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 72
2025-10-10T14:00:11.106461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:11.106553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592604992955110:2507], now have 1 active actors on pipe
2025-10-10T14:00:11.106576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592604992954980:2442], now have 1 active actors on pipe
2025-10-10T14:00:11.106596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592604992955108:3195], now have 1 active actors on pipe
2025-10-10T14:00:11.106618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.106632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.106645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.106655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.106692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:11.106771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:11.106944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:11.106961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:11.107080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.107089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:11.107097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:11.107098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:11.107105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:11.107115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:11.107153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:11.107341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:11.107365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:11.107484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:11.107517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.107535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.107544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:11.107581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.107637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:11.107680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:11.108245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:11.108284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:11.108347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:11.110441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 73 partition: 0 MaxSeqNo: 36 sessionId: src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0
2025-10-10T14:00:11.111279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a07e5014-d2650102-d3c069a8-b36f567c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:11.139326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0] Write session: try to update token
2025-10-10T14:00:11.139383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:11.147012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:11.147042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:11.147082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.147215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:11.147262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:11.166655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:11.180297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:11.181863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:11.183513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:11.187341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:11.187888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:11.269574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.269604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.269615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.269663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:11.269678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:11.269692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:11.269704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:11.269717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:11.269760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.269787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.269811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.269844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592603415039733:3051]
2025-10-10T14:00:11.269988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:11.270015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.270035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:11.271181Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:11.273289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:11.273343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:11.273376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:11.273409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:11.298228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId: src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:11.319007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:11.422644Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:11.424564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:11.424606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:11.425355Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:11.425329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592604992955110:2507]
2025-10-10T14:00:11.425369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:11.425459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:11.425471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:11.434536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:11.434621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0] Write session will restart in 0.008050s
2025-10-10T14:00:11.434855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0] Write session: Do CDS request
2025-10-10T14:00:11.434917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:11.433920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 73 reason: error at write: Disconnected sessionId: src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0
2025-10-10T14:00:11.434231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 73 sessionId: src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0 is DEAD
2025-10-10T14:00:11.450370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:11.450640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:11.450668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 74
2025-10-10T14:00:11.456638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:11.456800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 74 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:11.456817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=74 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:11.456828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:11.458487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 74 sessionId:  describe result for acl check
2025-10-10T14:00:11.458612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:11.458621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:11.458631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:11.458647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592604992955147:3203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:11.462746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592604992955147:3203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:11.473151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592604992955147:3203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:11.483816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592604992955147:3203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:11.483855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592604992955147:3203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:11.483870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592604992955147:3203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:11.483903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 74 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:11.507559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:11.510802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:11.511587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:11.511600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:11.511632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:11.511814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:11.511996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592603415039874:3055]
2025-10-10T14:00:11.513524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:11.514428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:11.514566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:11.515503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:11.515713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.515718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.515722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.515726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.515730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.515735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.515738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.515742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.515748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.515752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.515757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.515761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.515792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.515866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.515910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.515942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.515973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.516003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.516035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.516064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.516095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.516129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.516160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.516190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.516216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.516258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.516294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.516329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.516359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.516393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.516421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.516453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.516483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.516514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.516541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.516574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.516616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.516650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.516678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.516709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.516748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.516803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.516840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.516886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.516916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.516948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.516989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.517023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.517427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:11.527235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592604992955255:2507]
2025-10-10T14:00:11.541475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:11.553695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:11.553738Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:11.553755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:11.553773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:11.553795Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 73 [2:7559592603415039874:3055]
2025-10-10T14:00:11.553849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:11.553906Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:11.553928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.553939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.553950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.553999Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:11.554020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:11.554038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:11.577897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 73, pipe: [1:7559592604992955255:2507]
2025-10-10T14:00:11.578009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 73
2025-10-10T14:00:11.578079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 73
2025-10-10T14:00:11.577205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.577232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.577239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.577248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.577257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:11.577528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:11.577543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.577661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.577802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.577982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.578080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:11.578155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592604992955255:2507], now have 1 active actors on pipe
2025-10-10T14:00:11.578174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592604992955209:3203], now have 1 active actors on pipe
2025-10-10T14:00:11.578193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592604992955133:2442], now have 1 active actors on pipe
2025-10-10T14:00:11.578216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592603415039869:3055]
2025-10-10T14:00:11.578229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592603415039869:3055]
2025-10-10T14:00:11.578240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592603415039869:3055]
2025-10-10T14:00:11.578250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592603415039869:3055]
2025-10-10T14:00:11.578292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:11.578337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:11.578350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:11.578360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:11.578364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:11.578371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:11.578515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:11.578532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:11.578675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:11.578694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:11.578735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592603415039869:3055]
2025-10-10T14:00:11.578766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:11.578784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:11.578887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38876868-2ded81dc-98a11676-c5b34184_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:11.578917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.578934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.578944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:11.578978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.579017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:11.579096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:11.579660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:11.579684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:11.579747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:11.579955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 74 partition: 0 MaxSeqNo: 36 sessionId: src_id|38876868-2ded81dc-98a11676-c5b34184_0
2025-10-10T14:00:11.581654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd6155f-c10290b2-50c94ffe-9557bb8b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38876868-2ded81dc-98a11676-c5b34184_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:11.608785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38876868-2ded81dc-98a11676-c5b34184_0] Write session: try to update token
2025-10-10T14:00:11.608839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38876868-2ded81dc-98a11676-c5b34184_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:11.685459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.685494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.685505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.685559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:11.685582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:11.685596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:11.685606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:11.685616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:11.685652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592603415039869:3055]
2025-10-10T14:00:11.685677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592603415039869:3055]
2025-10-10T14:00:11.685701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592603415039869:3055]
2025-10-10T14:00:11.685721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592603415039869:3055]
2025-10-10T14:00:11.685884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:11.685912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.685924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:11.686119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:11.686157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:11.686196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:11.686226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:11.689178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:11.753231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId: src_id|38876868-2ded81dc-98a11676-c5b34184_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:11.773099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:11.831300Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:11.833745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:11.833781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:11.834691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592604992955255:2507]
2025-10-10T14:00:11.834727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:11.834749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:11.834908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:11.844395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 74 reason: error at write: Disconnected sessionId: src_id|38876868-2ded81dc-98a11676-c5b34184_0
2025-10-10T14:00:11.844739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 74 sessionId: src_id|38876868-2ded81dc-98a11676-c5b34184_0 is DEAD
2025-10-10T14:00:11.845101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38876868-2ded81dc-98a11676-c5b34184_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:11.845159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38876868-2ded81dc-98a11676-c5b34184_0] Write session will restart in 0.005052s
2025-10-10T14:00:11.845333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38876868-2ded81dc-98a11676-c5b34184_0] Write session: Do CDS request
2025-10-10T14:00:11.845374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38876868-2ded81dc-98a11676-c5b34184_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:11.851068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:11.857975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38876868-2ded81dc-98a11676-c5b34184_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:11.860842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:11.860874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 75
2025-10-10T14:00:11.861277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:11.861423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 75 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:11.861461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=75 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:11.861474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:11.862875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 75 sessionId:  describe result for acl check
2025-10-10T14:00:11.863004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:11.863020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:11.863031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:11.863048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592604992955289:3209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:11.867725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592604992955289:3209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:11.890605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592604992955289:3209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:11.893058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:11.901274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:11.902100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:11.902132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:11.902177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:11.902425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:11.902625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592603415040030:3066]
2025-10-10T14:00:11.903081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592604992955289:3209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:11.903119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592604992955289:3209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:11.903136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592604992955289:3209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:11.903165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 75 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:11.905010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:11.906256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:11.906455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:11.907481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:11.907683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.907687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.907691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.907695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.907699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.907703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.907707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.907711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.907716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.907720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.907724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.907728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.907757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.907845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.907876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.907909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.907939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.907967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.907995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.908034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.908067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.908096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.908123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.908150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.908176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.908234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:11.908276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.908310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:11.908342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.908374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:11.908401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.908433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:11.908460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.908493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:11.908519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.908550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:11.908577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.908610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:11.908640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.908669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:11.908698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.908729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.908757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.908787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.908815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.908846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.908879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.908924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.910249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:11.935262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592604992955399:2507]
2025-10-10T14:00:11.936023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:11.952598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:11.952641Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:11.952657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:11.952675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:11.952698Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 74 [2:7559592603415040030:3066]
2025-10-10T14:00:11.952749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:11.952808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:11.952823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.952834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.952844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.952890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:11.952911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:11.952936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:11.963664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.964972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.964988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.964997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.965005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:11.965310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:11.965328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:11.965474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:11.965661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:11.965871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:11.965980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:11.966065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592604992955399:2507], now have 1 active actors on pipe
2025-10-10T14:00:11.966087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592604992955272:2442], now have 1 active actors on pipe
2025-10-10T14:00:11.966109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592604992955394:3209], now have 1 active actors on pipe
2025-10-10T14:00:11.966134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592603415040025:3066]
2025-10-10T14:00:11.966148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592603415040025:3066]
2025-10-10T14:00:11.966160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592603415040025:3066]
2025-10-10T14:00:11.966172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592603415040025:3066]
2025-10-10T14:00:11.966211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:11.966244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:11.966258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:11.966268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:11.966280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:11.966292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:11.966467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:11.966484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:11.966557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:11.966577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:11.966701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592603415040025:3066]
2025-10-10T14:00:11.966728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:11.966759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:11.966779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:11.966800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.966812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.966820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:11.966857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.966890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:11.966968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:11.967897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:11.967922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:11.967966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:11.965897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 74, pipe: [1:7559592604992955399:2507]
2025-10-10T14:00:11.966009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 74
2025-10-10T14:00:11.966084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 74
2025-10-10T14:00:11.968309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 75 partition: 0 MaxSeqNo: 36 sessionId: src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0
2025-10-10T14:00:11.969039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38876868-2ded81dc-98a11676-c5b34184_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:11.991636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0] Write session: try to update token
2025-10-10T14:00:11.991702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:12.035289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:12.035329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:12.035343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:12.035354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:12.035363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:12.035402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592603415040025:3066]
2025-10-10T14:00:12.035428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592603415040025:3066]
2025-10-10T14:00:12.035450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592603415040025:3066]
2025-10-10T14:00:12.035470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592603415040025:3066]
2025-10-10T14:00:12.035625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:12.035660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.035677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:12.037178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:12.037225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:12.037257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:12.037282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:12.044287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:12.125237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId: src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:12.159363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:12.191912Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:12.195629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:12.195667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:12.196908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592604992955399:2507]
2025-10-10T14:00:12.197080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:12.197103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:12.199695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:12.200529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:12.259700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:12.259767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0] Write session will restart in 0.006044s
2025-10-10T14:00:12.259911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0] Write session: Do CDS request
2025-10-10T14:00:12.259947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:12.258985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 75 reason: error at write: Disconnected sessionId: src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0
2025-10-10T14:00:12.259318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 75 sessionId: src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0 is DEAD
2025-10-10T14:00:12.273528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:12.273473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:12.273503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 76
2025-10-10T14:00:12.274320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:12.274459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 76 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:12.274475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=76 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:12.274483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:12.275949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 76 sessionId:  describe result for acl check
2025-10-10T14:00:12.276063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:12.276085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:12.276095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:12.276113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592609287922809:3214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:12.277497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:12.280991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:12.278727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592609287922809:3214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:12.281809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:12.281835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:12.281875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:12.282111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:12.282286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592607710007475:3068]
2025-10-10T14:00:12.284423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:12.285323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592609287922809:3214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:12.291850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:12.292100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:12.293426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:12.293768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:12.293776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:12.293783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:12.293790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:12.293796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:12.293802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:12.293808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:12.293813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:12.293818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.293824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.293830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.293837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.293880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:12.293977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:12.294023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:12.294064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:12.294104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:12.294149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:12.294194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:12.294233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:12.294273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.294315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.294354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.294392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.294431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:12.294494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:12.294546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:12.294595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:12.294638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:12.294687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:12.294726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:12.294771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:12.294815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:12.294880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:12.294920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:12.294964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:12.295010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:12.295057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:12.295096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:12.295142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:12.295209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.295270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.295313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.295362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.295402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.295447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.295488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.295536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.297072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:12.296729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592609287922809:3214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:12.296818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592609287922809:3214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:12.296831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592609287922809:3214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:12.296856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 76 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:12.297341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592609287922838:2507]
2025-10-10T14:00:12.326878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:12.344982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:12.345050Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:12.345082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:12.345148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:12.345191Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 75 [2:7559592607710007475:3068]
2025-10-10T14:00:12.345285Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:12.345353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:12.345375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.345387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.345398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.345461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:12.345486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:12.345514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:12.348708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 75
2025-10-10T14:00:12.348787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 75, pipe: [1:7559592609287922838:2507]
2025-10-10T14:00:12.348860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 75
2025-10-10T14:00:12.347980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.348007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.348020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.348032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.348044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:12.348425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:12.348453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.348603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.348776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.348995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.349106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:12.349217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592609287922837:3214], now have 1 active actors on pipe
2025-10-10T14:00:12.349240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592609287922838:2507], now have 1 active actors on pipe
2025-10-10T14:00:12.349261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592609287922717:2442], now have 1 active actors on pipe
2025-10-10T14:00:12.349285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.349299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.349311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.349323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.349363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:12.349425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:12.349442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:12.349449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:12.349453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:12.349463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:12.349611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:12.349628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:12.349699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:12.349717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:12.349850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.349880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:12.349950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|688314de-3de7f089-989becea-2dba7104_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:12.349982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.350001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.350011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:12.350035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:12.350045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.350086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:12.350204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:12.351018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:12.351061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:12.351119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:12.354032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f168a481-2f10d76a-da8d6fe3-75104f15_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|688314de-3de7f089-989becea-2dba7104_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:12.353202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 76 partition: 0 MaxSeqNo: 36 sessionId: src_id|688314de-3de7f089-989becea-2dba7104_0
2025-10-10T14:00:12.402090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688314de-3de7f089-989becea-2dba7104_0] Write session: try to update token
2025-10-10T14:00:12.402148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688314de-3de7f089-989becea-2dba7104_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:12.407010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:12.407041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:12.407081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.407207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:12.408772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:12.430701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:12.442508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:12.444178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:12.450862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:12.465722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:12.466158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.466177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.466188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.466243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:12.543557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:12.543592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:12.543606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:12.543618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:12.543629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:12.543670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.543698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.543720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.543743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592607710007470:3068]
2025-10-10T14:00:12.543897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:12.543931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.543945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:12.544395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:12.544437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:12.544466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:12.544496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:12.564735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:12.596892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId: src_id|688314de-3de7f089-989becea-2dba7104_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:12.628234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:12.754076Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:12.757759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:12.757799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:12.759137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:12.759659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:12.759685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:12.806692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592609287922838:2507]
2025-10-10T14:00:12.806773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:12.806915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 76 reason: error at write: Disconnected sessionId: src_id|688314de-3de7f089-989becea-2dba7104_0
2025-10-10T14:00:12.807248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 76 sessionId: src_id|688314de-3de7f089-989becea-2dba7104_0 is DEAD
2025-10-10T14:00:12.809668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688314de-3de7f089-989becea-2dba7104_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:12.809749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688314de-3de7f089-989becea-2dba7104_0] Write session will restart in 0.009525s
2025-10-10T14:00:12.809915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688314de-3de7f089-989becea-2dba7104_0] Write session: Do CDS request
2025-10-10T14:00:12.809977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688314de-3de7f089-989becea-2dba7104_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:12.832583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688314de-3de7f089-989becea-2dba7104_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:12.832283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:12.832312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 77
2025-10-10T14:00:12.832997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:12.833115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 77 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:12.833152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=77 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:12.833163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:12.834999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 77 sessionId:  describe result for acl check
2025-10-10T14:00:12.835122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:12.835133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:12.835142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:12.835158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592609287922963:3225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:12.837837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592609287922963:3225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:12.838067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:12.840935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:12.842174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:12.842204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:12.842255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:12.842583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:12.842804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592607710007622:3078]
2025-10-10T14:00:12.844927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:12.847141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:12.847396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:12.848579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:12.848867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:12.848874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:12.844704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592609287922963:3225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:12.848881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:12.848887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:12.848893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:12.848901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:12.848907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:12.848914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:12.848920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.848927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.848934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.848940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.848983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:12.849079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:12.849142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:12.849188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:12.849231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:12.849275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:12.849315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:12.849358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:12.849399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.849443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.849484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.849522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.849561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:12.849619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:12.849677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:12.849726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:12.849769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:12.849817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:12.849859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:12.849909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:12.849964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:12.850014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:12.850056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:12.850106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:12.850150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:12.850200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:12.850250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:12.850298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:12.850343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.850403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.850450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.850502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.850545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.850593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.850635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.850683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.851099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:12.868698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592609287922963:3225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:12.868729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592609287922963:3225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:12.868741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592609287922963:3225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:12.868765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 77 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:12.894238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:12.908138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592609287923000:2507]
2025-10-10T14:00:12.909792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:12.909834Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:12.909850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:12.909867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:12.909888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 76 [2:7559592607710007622:3078]
2025-10-10T14:00:12.909941Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:12.909994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:12.910009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.910022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.910033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.910077Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:12.910099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:12.910120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:12.930027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.930055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.930065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.930075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.930085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:12.930359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:12.930373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:12.930499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:12.930649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:12.930856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:12.930976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:12.931058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592609287922893:2442], now have 1 active actors on pipe
2025-10-10T14:00:12.931079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592609287922998:3225], now have 1 active actors on pipe
2025-10-10T14:00:12.931097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592609287923000:2507], now have 1 active actors on pipe
2025-10-10T14:00:12.932676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 76
2025-10-10T14:00:12.931122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592607710007617:3078]
2025-10-10T14:00:12.931135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592607710007617:3078]
2025-10-10T14:00:12.932783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 76
2025-10-10T14:00:12.931147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592607710007617:3078]
2025-10-10T14:00:12.932836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 76, pipe: [1:7559592609287923000:2507]
2025-10-10T14:00:12.931157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592607710007617:3078]
2025-10-10T14:00:12.931200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:12.931279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:12.931344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:12.931359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:12.931369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:12.931379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:12.931442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:12.931461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:12.931589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592607710007617:3078]
2025-10-10T14:00:12.931624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:12.931649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:12.933327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:12.933361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:12.933472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:12.933510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.933530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.933541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:12.933579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.933624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:12.933669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:12.938143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:12.938181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:12.938267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:12.938916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 77 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0
2025-10-10T14:00:12.941699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688314de-3de7f089-989becea-2dba7104_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:12.972629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0] Write session: try to update token
2025-10-10T14:00:12.972691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:13.022724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.022759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.022771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.022830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:13.022847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:13.022875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:13.022885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:13.022896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:13.022933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592607710007617:3078]
2025-10-10T14:00:13.022962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592607710007617:3078]
2025-10-10T14:00:13.022987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592607710007617:3078]
2025-10-10T14:00:13.023006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592607710007617:3078]
2025-10-10T14:00:13.023155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:13.023182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.023194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:13.024435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:13.025285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:13.025326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:13.025360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:13.025393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:13.098517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId: src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:13.120204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:13.183680Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:13.188224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:13.188341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:13.188349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:13.185584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:13.185627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:13.189313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592609287923000:2507]
2025-10-10T14:00:13.191647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:13.200225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 77 reason: error at write: Disconnected sessionId: src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0
2025-10-10T14:00:13.200564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 77 sessionId: src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0 is DEAD
2025-10-10T14:00:13.201735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:13.201804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0] Write session will restart in 0.006211s
2025-10-10T14:00:13.201921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0] Write session: Do CDS request
2025-10-10T14:00:13.201960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:13.218227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:13.231411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:13.231439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 78
2025-10-10T14:00:13.233395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:13.233560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 78 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:13.233578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=78 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:13.233590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:13.239627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 78 sessionId:  describe result for acl check
2025-10-10T14:00:13.239850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:13.239873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:13.239896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:13.239928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592613582890350:3234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:13.243668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592613582890350:3234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:13.256043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592613582890350:3234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:13.275413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592613582890350:3234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:13.275460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592613582890350:3234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:13.275478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592613582890350:3234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:13.275508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 78 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:13.290698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592613582890451:2507]
2025-10-10T14:00:13.295628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:13.298593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:13.299253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:13.299282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:13.299324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:13.299537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:13.299686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592612004975068:3082]
2025-10-10T14:00:13.301090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:13.303493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:13.303767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:13.305011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:13.305357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:13.305375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:13.305382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:13.305389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:13.305396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:13.305402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:13.305409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:13.305415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:13.305422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.305427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.305434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.305441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.305485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:13.305653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:13.305711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:13.305754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:13.305804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:13.305856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:13.305905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:13.305954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:13.306006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.306053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.306100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.306149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.306198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:13.306299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:13.306362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:13.306423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:13.306477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:13.306535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:13.307345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:13.307426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:13.307484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:13.307544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:13.307593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:13.307651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:13.307704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:13.307762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:13.307806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:13.307862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:13.307914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.307974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.308025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.308083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.308132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.308186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.308235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.308317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.308847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:13.359358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:13.382198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:13.382247Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:13.382265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:13.382283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:13.382307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 77 [2:7559592612004975068:3082]
2025-10-10T14:00:13.382360Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:13.382417Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:13.382433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.382444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.382454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.382503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:13.382524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:13.382544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:13.388288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 77
2025-10-10T14:00:13.388378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 77, pipe: [1:7559592613582890451:2507]
2025-10-10T14:00:13.384771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.384806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.384821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.384834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.384845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:13.387529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:13.387551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.387679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.387842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.388059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.388158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:13.388247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592613582890316:2442], now have 1 active actors on pipe
2025-10-10T14:00:13.388270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592613582890451:2507], now have 1 active actors on pipe
2025-10-10T14:00:13.388289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592613582890433:3234], now have 1 active actors on pipe
2025-10-10T14:00:13.388313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.388326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.388337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.388350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.388390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:13.388470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:13.388642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:13.388656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:13.388789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.388807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:13.388445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 77
2025-10-10T14:00:13.388961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:13.388985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:13.389001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:13.389011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:13.389037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:13.389487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:13.389512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:13.389584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:13.389616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.389634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.389643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:13.389677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.389719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:13.389759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:13.395155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 78 partition: 0 MaxSeqNo: 36 sessionId: src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0
2025-10-10T14:00:13.393592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:13.393630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:13.393708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:13.400392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c3fb759-4462958d-1eb9b3a7-79d851ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:13.447534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0] Write session: try to update token
2025-10-10T14:00:13.447590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:13.458546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:13.458579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:13.458618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.458750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:13.458844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:13.460782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:13.465043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:13.466355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:13.467567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:13.469114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:13.521105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.521163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.521174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.521293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
E1010 14:00:13.599008816  106882 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:00:13.606744Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:00:13.608508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId: src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:13.614330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:13.614373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:13.614385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:13.614397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:13.614409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:13.614447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.614475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.614501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.614528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592612004975060:3082]
2025-10-10T14:00:13.614678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:13.614702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:13.614708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.614720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:13.614735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:13.614770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:13.614799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:13.615711Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:13.635222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:13.757921Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:13.759483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:13.759505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:13.760052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:13.760238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:13.760074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:13.761259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:13.761476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592613582890451:2507]
2025-10-10T14:00:13.791521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 78 reason: error at write: Disconnected sessionId: src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0
2025-10-10T14:00:13.791811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 78 sessionId: src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0 is DEAD
2025-10-10T14:00:13.793625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:13.793659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0] Write session will restart in 0.009968s
2025-10-10T14:00:13.793759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0] Write session: Do CDS request
2025-10-10T14:00:13.793793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:13.815668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:13.816218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:13.816244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 79
2025-10-10T14:00:13.816556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:13.816668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 79 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:13.816682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=79 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:13.816690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:13.818088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 79 sessionId:  describe result for acl check
2025-10-10T14:00:13.818198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:13.818209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:13.818218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:13.818235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592613582890518:3239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:13.820836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592613582890518:3239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:13.829586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592613582890518:3239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:13.848679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592613582890518:3239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:13.848724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592613582890518:3239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:13.848740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592613582890518:3239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:13.848774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 79 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:13.855632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:13.862150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:13.861243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592613582890603:2507]
2025-10-10T14:00:13.863087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:13.863121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:13.863165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:13.863451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:13.863642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592612004975237:3097]
2025-10-10T14:00:13.866028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:13.872278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:13.872549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:13.873889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:13.874238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:13.874257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:13.874263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:13.874269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:13.874275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:13.874282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:13.874288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:13.874294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:13.874300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.874307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.874313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.874320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.874363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:13.874464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:13.874509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:13.874552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:13.874590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:13.874631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:13.874673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:13.874712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:13.874768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.874809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.874847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.874906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.874952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:13.875020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:13.875083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:13.875138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:13.875188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:13.875244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:13.875286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:13.875335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:13.875382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:13.875434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:13.875484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:13.875536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:13.875585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:13.875638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:13.875684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:13.875732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:13.875780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.875833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.875881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.875927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.875969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.876014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.876056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.876104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.876494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:13.905526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:13.922897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:13.922946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:13.922964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:13.922983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:13.923009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 78 [2:7559592612004975237:3097]
2025-10-10T14:00:13.923063Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:13.923125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:13.923140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.923151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.923162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.923207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:13.923230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:13.923261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:13.950418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.950446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.950456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.950466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.950476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:13.950753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:13.950769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:13.950923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:13.951086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:13.951286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:13.951391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:13.951466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:13.951480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:13.951494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:13.951506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:13.951555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:13.951636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:13.951815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:13.951833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:13.951975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:13.951995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:13.952595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:13.952615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:13.952627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:13.952637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:13.952661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:13.954662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 78
2025-10-10T14:00:13.954763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 78
2025-10-10T14:00:13.955462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 78, pipe: [1:7559592613582890603:2507]
2025-10-10T14:00:13.957480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592613582890603:2507], now have 1 active actors on pipe
2025-10-10T14:00:13.957518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592613582890478:2442], now have 1 active actors on pipe
2025-10-10T14:00:13.957540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592613582890597:3239], now have 1 active actors on pipe
2025-10-10T14:00:13.961309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:13.961357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:13.961443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:13.961478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.961496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.961507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:13.961544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.961589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:13.961634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:13.969608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:13.969651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:13.969732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:13.973635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 79 partition: 0 MaxSeqNo: 36 sessionId: src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0
2025-10-10T14:00:13.974525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc16186-b88aad5f-fb890eb9-69deeaa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:14.000882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0] Write session: try to update token
2025-10-10T14:00:14.000943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:14.036017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.036050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.036065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.036136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:14.036153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:14.036172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:14.036187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:14.036203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:14.036246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:14.036282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:14.036326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:14.036351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:14.036576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:14.036616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.036633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:14.036672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:14.036718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:14.036762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:14.036796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:14.039000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:14.085749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId: src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:14.116876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:14.198437Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:14.218028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:14.218071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:14.218130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:14.218142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:14.218172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592612004975231:3097]
2025-10-10T14:00:14.218307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:14.219202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:14.221449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592613582890603:2507]
2025-10-10T14:00:14.221583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:14.221782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:14.239743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 79 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0
2025-10-10T14:00:14.241228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:14.241301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0] Write session will restart in 0.008850s
2025-10-10T14:00:14.241462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0] Write session: Do CDS request
2025-10-10T14:00:14.241504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:14.240018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 79 sessionId: src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0 is DEAD
2025-10-10T14:00:14.254118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:14.267194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:14.267223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 80
2025-10-10T14:00:14.274125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:14.274255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 80 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:14.274270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=80 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:14.274279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:14.276339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 80 sessionId:  describe result for acl check
2025-10-10T14:00:14.276441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:14.276450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:14.276459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:14.276475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592617877857977:3251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:14.280774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592617877857977:3251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:14.295407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592617877857977:3251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:14.308002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:14.308319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592617877857977:3251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:14.308358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592617877857977:3251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:14.308375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592617877857977:3251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:14.308405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 80 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:14.312589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:14.313496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:14.313526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:14.313568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:14.313833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:14.314033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592616299942665:3099]
2025-10-10T14:00:14.316415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:14.317536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:14.317771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:14.318498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592617877858068:2507]
2025-10-10T14:00:14.319094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:14.319421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:14.319440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:14.319449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:14.319456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:14.319464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:14.319472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:14.319479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:14.319487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:14.319495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.319502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.319509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.319516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.319564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:14.319677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:14.319730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:14.319788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:14.319843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:14.319899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:14.319962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:14.320014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:14.320068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.320122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.320172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.320223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.320267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:14.320342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:14.320422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:14.320492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:14.320549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:14.320608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:14.320660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:14.320720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:14.320773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:14.320835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:14.320889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:14.320950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:14.321005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:14.321060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:14.321111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:14.321195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:14.321249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.321309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.321361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.321422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.321475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.321531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.321582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.321641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.322104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:14.366716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:14.382267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:14.382307Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:14.382323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:14.382340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:14.382363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 79 [2:7559592616299942665:3099]
2025-10-10T14:00:14.382415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:14.382466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:14.382481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.382494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.382504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.382550Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:14.382573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:14.382595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:14.384877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.384896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.384906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.384915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.384921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:14.385148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:14.385171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.385299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.385473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.385692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.385808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:14.385900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592617877858068:2507], now have 1 active actors on pipe
2025-10-10T14:00:14.385929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592617877857928:2442], now have 1 active actors on pipe
2025-10-10T14:00:14.385950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592617877858063:3251], now have 1 active actors on pipe
2025-10-10T14:00:14.385975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.385994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.386007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.386020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.386058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:14.386115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:14.386136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:14.386142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:14.386153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:14.386164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:14.386294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:14.386317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:14.386412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.386436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:14.386457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:14.388019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 79, pipe: [1:7559592617877858068:2507]
2025-10-10T14:00:14.388142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 79
2025-10-10T14:00:14.388238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 79
2025-10-10T14:00:14.388737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:14.388787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:14.388871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:14.388908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.388932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.388942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:14.388995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.389045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:14.389094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:14.389961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:14.389994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:14.390061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:14.390315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 80 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0
2025-10-10T14:00:14.391171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c31d7ad7-87cac1eb-bd0a1155-7b9896dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:14.414982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0] Write session: try to update token
2025-10-10T14:00:14.415029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:14.459905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:14.459975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:14.460062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.460235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:14.460277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:14.462423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:14.463477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:14.464656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:14.465903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:14.467663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:14.480899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:14.498507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId: src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:14.517150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.517182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.517195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.517253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:14.517268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:14.517280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:14.517290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:14.517301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:14.517342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.517370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.517392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.517413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592616299942659:3099]
2025-10-10T14:00:14.517534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:14.517563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:14.517567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:14.517588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.517595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:14.517599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:14.517622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:14.519578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:14.529280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:14.664179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:14.665756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:14.665800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:14.666411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592617877858068:2507]
2025-10-10T14:00:14.666499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:14.666625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:14.666640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:14.666702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:14.705321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 80 reason: error at write: Disconnected sessionId: src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0
2025-10-10T14:00:14.705622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 80 sessionId: src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0 is DEAD
2025-10-10T14:00:14.706479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:14.706544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0] Write session will restart in 0.009150s
2025-10-10T14:00:14.706720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0] Write session: Do CDS request
2025-10-10T14:00:14.706782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:14.722633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:14.722663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 81
2025-10-10T14:00:14.722825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:14.723403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:14.723673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 81 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:14.723706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=81 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:14.723726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:14.724861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 81 sessionId:  describe result for acl check
2025-10-10T14:00:14.724930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:14.724942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:14.724948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:14.724960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592617877858198:3259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:14.727111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592617877858198:3259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:14.736607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:14.738963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:14.739768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:14.739811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:14.739853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:14.740097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:14.740286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592616299942806:3103]
2025-10-10T14:00:14.742668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592617877858198:3259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:14.742653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:14.743903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:14.744118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:14.745576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:14.745899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:14.745908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:14.745916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:14.745924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:14.745932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:14.745940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:14.745948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:14.745954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:14.745961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.745969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.745977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.745984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.746029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:14.746137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:14.746190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:14.746239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:14.746288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:14.746338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:14.746386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:14.746432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:14.746479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.746529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.746577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.746624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.746664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:14.746739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:14.746796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:14.746858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:14.746933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:14.746990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:14.747039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:14.747095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:14.747146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:14.747203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:14.747262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:14.747318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:14.747367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:14.747427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:14.751320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592617877858198:3259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:14.751361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592617877858198:3259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:14.751378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592617877858198:3259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:14.751410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 81 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:14.747477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:14.752609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:14.752676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.752735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.752784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.752842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.752895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.752954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.753001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.753062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.753572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:14.767946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592617877858235:2507]
2025-10-10T14:00:14.773726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:14.787098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:14.787143Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:14.787158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:14.787176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:14.787199Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 80 [2:7559592616299942806:3103]
2025-10-10T14:00:14.787250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:14.787306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:14.787322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.787333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.787343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.787389Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:14.787410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:14.787430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:14.823972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.824005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.824017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.824027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.824037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:14.824289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:14.824311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.824429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:14.824580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:14.824766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:14.824868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:14.824946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.824960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.824970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.824981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.825016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:14.825087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:14.825275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:14.825287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:14.825298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:14.825308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:14.825799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 80
2025-10-10T14:00:14.825917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 80, pipe: [1:7559592617877858235:2507]
2025-10-10T14:00:14.826025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 80
2025-10-10T14:00:14.826041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:14.826066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:14.826216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592617877858103:2442], now have 1 active actors on pipe
2025-10-10T14:00:14.826238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592617877858235:2507], now have 1 active actors on pipe
2025-10-10T14:00:14.826255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592617877858231:3259], now have 1 active actors on pipe
2025-10-10T14:00:14.826290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.826321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:14.826401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:14.827076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:14.827108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:14.827174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:14.827211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.827232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.827246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:14.827280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.827324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:14.827368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:14.827842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:14.827870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:14.827945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:14.828279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 81 partition: 0 MaxSeqNo: 36 sessionId: src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0
2025-10-10T14:00:14.830559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce21d38-2b5210f8-c5dda785-225d3759_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:14.853282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0] Write session: try to update token
2025-10-10T14:00:14.853346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:14.872251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:14.872282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:14.872315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.872441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:14.872450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:14.874521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:14.876001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:14.880447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:14.881850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:14.884186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:14.884946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:14.889235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.889268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.889278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.985160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:14.985194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:14.985209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:14.985221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:14.985232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:14.985276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.985304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.985331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.985357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592616299942798:3103]
2025-10-10T14:00:14.985515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:14.985544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:14.985558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:14.985571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:14.985589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:14.985626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:14.985674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:14.986831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:15.064643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId: src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:15.093891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:15.155685Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:15.158721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:15.158766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:15.159543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:15.160107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592617877858235:2507]
2025-10-10T14:00:15.160203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:15.160216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:15.161291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:15.172368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 81 reason: error at write: Disconnected sessionId: src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0
2025-10-10T14:00:15.177549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 81 sessionId: src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0 is DEAD
2025-10-10T14:00:15.178242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:15.178272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0] Write session will restart in 0.009958s
2025-10-10T14:00:15.178374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0] Write session: Do CDS request
2025-10-10T14:00:15.178404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:15.208611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:15.208637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 82
2025-10-10T14:00:15.210056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:15.210768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:15.211012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 82 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:15.211057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=82 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:15.211081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:15.213933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 82 sessionId:  describe result for acl check
2025-10-10T14:00:15.214125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:15.214144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:15.214166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:15.214196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592622172825557:3264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:15.218193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592622172825557:3264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:15.228082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592622172825557:3264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:15.236248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592622172825557:3264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:15.236289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592622172825557:3264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:15.236307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592622172825557:3264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:15.236339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 82 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:15.259027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592622172825604:2507]
2025-10-10T14:00:15.296147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:15.299234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:15.300128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:15.300146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:15.300192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:15.300453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:15.300628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592620594910283:3113]
2025-10-10T14:00:15.304198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:15.305414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:15.305695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:15.307136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:15.307481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:15.307489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:15.307496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:15.307503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:15.307510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:15.307517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:15.307524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:15.307531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:15.307539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.307547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.307554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.307561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.307611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:15.307727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:15.307779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:15.307828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:15.307874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:15.307921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:15.307968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:15.308014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:15.308062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.308108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.308155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.308201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.308243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:15.308312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:15.308371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:15.308446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:15.308514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:15.308572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:15.308620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:15.308677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:15.308727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:15.308785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:15.308831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:15.308888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:15.308938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:15.308997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:15.309044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:15.309098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:15.310477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.310569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.310635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.310696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.310768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.310839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.310887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.310956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.311602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:15.339887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:15.372860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:15.372905Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:15.372924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:15.372945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:15.372969Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 81 [2:7559592620594910283:3113]
2025-10-10T14:00:15.373030Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:15.373087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:15.373102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.373115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.373145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.373198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:15.373229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:15.373254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:15.375423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.375452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.375469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.375485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.375497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:15.376249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 81
2025-10-10T14:00:15.376320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 81
2025-10-10T14:00:15.376369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 81, pipe: [1:7559592622172825604:2507]
2025-10-10T14:00:15.389501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:15.389540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.389685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.389860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.390064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.390181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:15.390225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592622172825588:3264], now have 1 active actors on pipe
2025-10-10T14:00:15.390250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592622172825544:2442], now have 1 active actors on pipe
2025-10-10T14:00:15.390271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592622172825604:2507], now have 1 active actors on pipe
2025-10-10T14:00:15.390340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.390356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.390377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.390392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.390433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:15.390517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:15.390585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:15.390602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:15.390614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:15.390626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:15.390689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:15.390705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:15.390826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.390857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:15.390877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:15.392051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:15.392077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:15.392169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:15.392198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.392215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.392225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:15.392259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.392300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:15.392347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:15.393448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:15.393479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:15.393539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:15.393812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 82 partition: 0 MaxSeqNo: 36 sessionId: src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0
2025-10-10T14:00:15.394632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b01b1b-9c4e31fe-e80998ed-e2f3dded_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:15.448024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0] Write session: try to update token
2025-10-10T14:00:15.448140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:15.519300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:15.519334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:15.519373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.519528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.519541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.519554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.519615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:15.520493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:15.527685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:15.529551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:15.535983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:15.540100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:15.543100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:15.543659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:15.604411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:15.604445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:15.604457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:15.604469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:15.604480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:15.604522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.604547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.604570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.604591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592620594910278:3113]
2025-10-10T14:00:15.604736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:15.604769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.604779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:15.605399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:15.605440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:15.605471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:15.605499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:15.618672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:15.657109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId: src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:15.698432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:15.765152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:15.768001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:15.768040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:15.769139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:15.769834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592622172825604:2507]
2025-10-10T14:00:15.769942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:15.769954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:15.808222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 82 reason: error at write: Disconnected sessionId: src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0
2025-10-10T14:00:15.808560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 82 sessionId: src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0 is DEAD
2025-10-10T14:00:15.809547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:15.809632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0] Write session will restart in 0.005064s
2025-10-10T14:00:15.809841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0] Write session: Do CDS request
2025-10-10T14:00:15.809901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:15.819419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:15.830624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:15.830708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:15.830721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 83
2025-10-10T14:00:15.837664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:15.837815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 83 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:15.837831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=83 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:15.837842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:15.839320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 83 sessionId:  describe result for acl check
2025-10-10T14:00:15.839434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:15.839444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:15.839453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:15.839471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592622172825747:3278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:15.842135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592622172825747:3278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:15.848642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592622172825747:3278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:15.861450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592622172825747:3278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:15.861491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592622172825747:3278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:15.861511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592622172825747:3278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:15.861541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 83 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:15.870411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592622172825850:2507]
2025-10-10T14:00:15.878430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:15.880392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:15.881484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:15.881516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:15.881561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:15.881821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:15.882036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592620594910433:3122]
2025-10-10T14:00:15.884171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:15.893469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:15.893769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:15.895216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:15.895557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:15.895564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:15.895570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:15.895576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:15.895582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:15.895588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:15.895594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:15.895602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:15.895608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.895613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.895631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.895637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.895686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:15.895793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:15.895840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:15.895888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:15.895933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:15.895981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:15.896031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:15.896079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:15.896125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.896172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.896214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.896260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.896301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:15.896363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:15.896418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:15.896478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:15.896525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:15.896579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:15.896623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:15.896674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:15.896719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:15.896767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:15.896810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:15.896862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:15.896907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:15.896957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:15.897000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:15.897053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:15.897099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.898239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.898315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.898377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.898437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.898490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.898535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.898590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.899093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:15.932939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:15.984591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:15.985136Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:15.985160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:15.985180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:15.985202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 82 [2:7559592620594910433:3122]
2025-10-10T14:00:15.985255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:15.985313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:15.985325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.985336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.985346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.985393Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:15.985414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:15.985437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:15.986731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.986746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.986758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.986772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.986783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:15.987083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:15.987101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:15.987236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:15.987409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:15.987624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:15.987735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:15.987816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592622172825850:2507], now have 1 active actors on pipe
2025-10-10T14:00:15.987841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592622172825733:2442], now have 1 active actors on pipe
2025-10-10T14:00:15.987862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592622172825828:3278], now have 1 active actors on pipe
2025-10-10T14:00:15.987888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592620594910428:3122]
2025-10-10T14:00:15.987901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592620594910428:3122]
2025-10-10T14:00:15.988555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592620594910428:3122]
2025-10-10T14:00:15.988579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592620594910428:3122]
2025-10-10T14:00:15.989010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 82, pipe: [1:7559592622172825850:2507]
2025-10-10T14:00:15.988620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:15.989122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 82
2025-10-10T14:00:15.988710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:15.988855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:15.988869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:15.989235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 82
2025-10-10T14:00:15.988879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:15.988886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:15.988889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:15.988905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:15.989031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592620594910428:3122]
2025-10-10T14:00:15.989055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:15.989081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:15.989839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:15.989872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:15.989946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:15.989983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.990005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.990016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:15.990056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.990108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:15.990156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:15.991346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:15.991373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:15.991436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:15.992376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 83 partition: 0 MaxSeqNo: 36 sessionId: src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0
2025-10-10T14:00:15.993144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47d0364-13f8fdea-f95d5655-f0d9a3e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:16.025730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0] Write session: try to update token
2025-10-10T14:00:16.025791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:16.074349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:16.074383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:16.074397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:16.074407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:16.074417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:16.074454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592620594910428:3122]
2025-10-10T14:00:16.074480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592620594910428:3122]
2025-10-10T14:00:16.074504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592620594910428:3122]
2025-10-10T14:00:16.074523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592620594910428:3122]
2025-10-10T14:00:16.074622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:16.074649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:16.074681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:16.074708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:16.074943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:16.074977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.074987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:16.077013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:16.140619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId: src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:16.167684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:16.234916Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:16.236962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:16.236997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:16.238832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592622172825850:2507]
2025-10-10T14:00:16.238972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:16.239187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:16.239206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:16.241842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:16.255737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 83 reason: error at write: Disconnected sessionId: src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0
2025-10-10T14:00:16.256119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 83 sessionId: src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0 is DEAD
2025-10-10T14:00:16.256534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:16.256607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0] Write session will restart in 0.006830s
2025-10-10T14:00:16.256778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0] Write session: Do CDS request
2025-10-10T14:00:16.256827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:16.274642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:16.274250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:16.274276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 84
2025-10-10T14:00:16.280643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:16.280876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 84 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:16.280919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=84 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:16.280936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:16.282417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 84 sessionId:  describe result for acl check
2025-10-10T14:00:16.282533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:16.282548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:16.282557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:16.282573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592626467793185:3286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:16.286824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592626467793185:3286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:16.294898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592626467793185:3286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:16.305648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592626467793185:3286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:16.305689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592626467793185:3286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:16.305707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592626467793185:3286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:16.305735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 84 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:16.332844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:16.335603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:16.336412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:16.336432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:16.336477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:16.336743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:16.336940Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592624889877886:3126]
2025-10-10T14:00:16.340038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592626467793316:2507]
2025-10-10T14:00:16.339369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:16.343054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:16.343342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:16.344784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:16.345164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:16.345173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:16.345181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:16.345188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:16.345197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:16.345205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:16.345212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:16.345220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:16.345228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.345235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.345242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.345251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.345305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:16.345428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:16.345482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:16.345535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:16.345608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:16.345661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:16.345722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:16.345780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:16.345835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.345892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.345941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.345982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.346017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:16.346069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:16.346136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:16.346194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:16.346255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:16.346313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:16.346363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:16.346420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:16.346477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:16.346534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:16.346583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:16.346645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:16.346700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:16.346760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:16.346808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:16.346872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:16.346925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.347003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.347057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.347124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.347175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.347232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.347280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.347335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.347818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:16.392067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:16.405713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:16.405748Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:16.405760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:16.405776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:16.405796Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 83 [2:7559592624889877886:3126]
2025-10-10T14:00:16.405850Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:16.405897Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:16.405909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.405920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.405930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.405964Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:16.405981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:16.405998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:16.407986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.408007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.408017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.408027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.408035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:16.408486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:16.408505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.408606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.408743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.408949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.409043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:16.409079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592626467793173:2442], now have 1 active actors on pipe
2025-10-10T14:00:16.409100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592626467793238:3286], now have 1 active actors on pipe
2025-10-10T14:00:16.409116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592626467793316:2507], now have 1 active actors on pipe
2025-10-10T14:00:16.409216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.409233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.408948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 83
2025-10-10T14:00:16.409062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 83
2025-10-10T14:00:16.409149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 83, pipe: [1:7559592626467793316:2507]
2025-10-10T14:00:16.409248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.409262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.409297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:16.409311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:16.409322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:16.409333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:16.409345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:16.409379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:16.409534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:16.409545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:16.409593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:16.409607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:16.409697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.409724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:16.409761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:16.409792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:16.409822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.409840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.409850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:16.409886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.409927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:16.410062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:16.412178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:16.412212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:16.412283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:16.412633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 84 partition: 0 MaxSeqNo: 36 sessionId: src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0
2025-10-10T14:00:16.413638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1602ca6f-3c74255e-64dc152f-8710af8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:16.442224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0] Write session: try to update token
2025-10-10T14:00:16.442269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:16.549422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:16.549466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:16.549501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.549617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.549623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:16.549636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.549647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.549706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:16.551498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:16.552897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:16.554168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:16.555382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:16.558340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:16.558764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:16.648598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:16.648632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:16.648645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:16.648657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:16.648669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:16.648710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.648735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.648757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.648781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592624889877881:3126]
2025-10-10T14:00:16.648924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:16.648955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.648967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:16.650031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:16.651829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:16.651869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:16.651901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:16.651932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:16.660927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId: src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:16.687325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:16.793282Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:16.797936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:16.797987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:16.799268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:16.798872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:16.799069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:16.799090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:16.799456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592626467793316:2507]
2025-10-10T14:00:16.822709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 84 reason: error at write: Disconnected sessionId: src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0
2025-10-10T14:00:16.823055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 84 sessionId: src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0 is DEAD
2025-10-10T14:00:16.825671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:16.825707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0] Write session will restart in 0.009008s
2025-10-10T14:00:16.825806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0] Write session: Do CDS request
2025-10-10T14:00:16.825839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:16.842382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:16.842698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:16.842728Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 85
2025-10-10T14:00:16.843032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:16.843157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 85 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:16.843179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=85 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:16.843190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:16.844652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 85 sessionId:  describe result for acl check
2025-10-10T14:00:16.844765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:16.844782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:16.844791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:16.844809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592626467793357:3292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:16.847490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592626467793357:3292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:16.855498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592626467793357:3292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:16.864199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592626467793357:3292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:16.864242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592626467793357:3292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:16.864259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592626467793357:3292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:16.864292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 85 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:16.891725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:16.893194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:16.894030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:16.894048Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:16.894093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:16.894349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:16.894533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592624889878056:3141]
2025-10-10T14:00:16.896732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:16.899564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592626467793474:2507]
2025-10-10T14:00:16.897881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:16.898094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:16.899405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:16.899753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:16.899762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:16.899770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:16.899777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:16.899784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:16.899789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:16.899807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:16.899814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:16.899820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.899828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.899835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.899842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.899889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:16.899997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:16.900064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:16.900119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:16.900167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:16.900218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:16.900260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:16.900306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:16.900349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.900395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.900438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.900483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.900524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:16.900589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:16.900658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:16.900711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:16.900758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:16.901190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:16.901251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:16.901306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:16.901355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:16.901410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:16.901454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:16.901506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:16.901550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:16.901601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:16.901645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:16.901695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:16.901740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.901793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.901838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.901893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.901937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.901986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.902028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.902076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.902507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:16.955736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:16.973385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:16.973431Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:16.973447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:16.973467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:16.973492Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 84 [2:7559592624889878056:3141]
2025-10-10T14:00:16.973551Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:16.973624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:16.973640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.973652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.973665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.973712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:16.973735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:16.973757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:16.976192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.976219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.976233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.976248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.976259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:16.976554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:16.976582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:16.976724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:16.976902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:16.977144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:16.977258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:16.977333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:16.977356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:16.977370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:16.977383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:16.977415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:16.977499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:16.977495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:16.977524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:16.977539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:16.977551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:16.977678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:16.977695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:16.977739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592626467793341:2442], now have 1 active actors on pipe
2025-10-10T14:00:16.977763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592626467793414:3292], now have 1 active actors on pipe
2025-10-10T14:00:16.977782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592626467793474:2507], now have 1 active actors on pipe
2025-10-10T14:00:16.977898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:16.977926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:16.977962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:16.981992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:16.982030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:16.982122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:16.982166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.982189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.982210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:16.982253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.982319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:16.982373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:16.982818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:16.982840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:16.982900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:16.981293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 84
2025-10-10T14:00:16.981409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 84
2025-10-10T14:00:16.981469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 84, pipe: [1:7559592626467793474:2507]
2025-10-10T14:00:16.983187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 85 partition: 0 MaxSeqNo: 36 sessionId: src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0
2025-10-10T14:00:16.983963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b560c922-5b87e4de-cd53e6f-fe00e07f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:17.020265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0] Write session: try to update token
2025-10-10T14:00:17.020320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:17.089755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:17.089809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:17.089834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:17.089853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:17.089872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:17.089939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:17.089984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:17.090030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:17.090076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:17.090261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:17.090367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:17.090423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:17.090427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.090449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.090468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.090484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:17.090544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:17.090580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.090593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:17.104485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:17.151396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId: src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:17.175963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:17.276430Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:17.300225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:17.300281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:17.300353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:17.300367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:17.300408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592624889878051:3141]
2025-10-10T14:00:17.300666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:17.300958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:17.303269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:17.303483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:17.365426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:17.368119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:17.368854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:17.368874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:17.368935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:17.369241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:17.369449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592629184845492:3143]
2025-10-10T14:00:17.371454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:17.372419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:17.372663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:17.375040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:17.375605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:17.375625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:17.375631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:17.375638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:17.375644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:17.375650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:17.375657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:17.375664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:17.375672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.375678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.375684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.375690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.375738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:17.375855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:17.375904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:17.375953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:17.375999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:17.376050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:17.376098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:17.376146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:17.376191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.376242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.376285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.376367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.376444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:17.376585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:17.376710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:17.376834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:17.376937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:17.377062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:17.375705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592626467793474:2507]
2025-10-10T14:00:17.377161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:17.375801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 85 reason: status is not ok: tablet will be restarted right now sessionId: src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0
2025-10-10T14:00:17.377223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:17.376131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 85 sessionId: src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0 is DEAD
2025-10-10T14:00:17.377274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:17.377330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:17.377383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:17.377438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:17.377487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:17.377543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:17.377589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:17.377618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:17.377666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0] Write session will restart in 0.008064s
2025-10-10T14:00:17.377689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:17.377786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.377824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0] Write session: Do CDS request
2025-10-10T14:00:17.377878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:17.377892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.377978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.378085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.378175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.378280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.378376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.378489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.379397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:17.413906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:17.417959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:17.417993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 86
2025-10-10T14:00:17.418377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:17.418504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 86 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:17.418526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=86 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:17.418536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:17.420056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 86 sessionId:  describe result for acl check
2025-10-10T14:00:17.420172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:17.420189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:17.420200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:17.420217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592630762760919:3304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:17.423023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592630762760919:3304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:17.429801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:17.448754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592630762760919:3304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:17.450485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:17.450528Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:17.450546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:17.450565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:17.450587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 85 [2:7559592629184845492:3143]
2025-10-10T14:00:17.450644Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:17.450699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:17.450712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.450724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.450736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.450781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:17.450803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:17.450825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:17.454475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 85
2025-10-10T14:00:17.453400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.453424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.453438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.453454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.453467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:17.453741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:17.453759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.453909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.454106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.454345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.454469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:17.454551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592630762760801:2442], now have 1 active actors on pipe
2025-10-10T14:00:17.454578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592629184845487:3143]
2025-10-10T14:00:17.454593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592629184845487:3143]
2025-10-10T14:00:17.454607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592629184845487:3143]
2025-10-10T14:00:17.454621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592629184845487:3143]
2025-10-10T14:00:17.454654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:17.454734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:17.454774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:17.454790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:17.454804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:17.454818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:17.454923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:17.454940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:17.455090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592629184845487:3143]
2025-10-10T14:00:17.455122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:17.455394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:17.461386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592630762760962:3304], now have 1 active actors on pipe
2025-10-10T14:00:17.461757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:17.461791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:17.461874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:17.461908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.461928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.461939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:17.461974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.462018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:17.462066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:17.459641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592630762760919:3304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:17.459685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592630762760919:3304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:17.459702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592630762760919:3304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:17.459740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 86 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:17.461541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 85
2025-10-10T14:00:17.462807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:17.462837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:17.462906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:17.463336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 86 partition: 0 MaxSeqNo: 36 sessionId: src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0
2025-10-10T14:00:17.464401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911b227e-58fcd3b5-605ce6b3-b2adb4f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:17.477413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592630762760964:2507]
2025-10-10T14:00:17.478069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592630762760964:2507], now have 1 active actors on pipe
2025-10-10T14:00:17.478145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 85, pipe: [1:7559592630762760964:2507]
2025-10-10T14:00:17.489057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0] Write session: try to update token
2025-10-10T14:00:17.489119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:17.542916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:17.542969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:17.542985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:17.542996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:17.543007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:17.543045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592629184845487:3143]
2025-10-10T14:00:17.543083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592629184845487:3143]
2025-10-10T14:00:17.543111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592629184845487:3143]
2025-10-10T14:00:17.543133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592629184845487:3143]
2025-10-10T14:00:17.543256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:17.543289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:17.543300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:17.543320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.543331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:17.543332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:17.543363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:17.544659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:17.617086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId: src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:17.651627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:17.698466Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:17.700356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:17.700387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:17.704220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:17.701525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:17.701562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:17.703110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:17.703392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592630762760964:2507]
2025-10-10T14:00:17.753370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 86 reason: error at write: Disconnected sessionId: src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0
2025-10-10T14:00:17.753683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 86 sessionId: src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0 is DEAD
2025-10-10T14:00:17.755253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:17.755327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0] Write session will restart in 0.007281s
2025-10-10T14:00:17.755512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0] Write session: Do CDS request
2025-10-10T14:00:17.755562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:17.773971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:17.777806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:17.777842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 87
2025-10-10T14:00:17.778318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:17.778441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 87 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:17.778465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=87 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:17.778476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:17.780220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:17.779995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 87 sessionId:  describe result for acl check
2025-10-10T14:00:17.780127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:17.780138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:17.780148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:17.780163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592630762761079:3312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:17.783084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592630762761079:3312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:17.784544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:17.785737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:17.785763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:17.785807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:17.786058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:17.786230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592629184845647:3147]
2025-10-10T14:00:17.788329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:17.790799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:17.791096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:17.792473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:17.789238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592630762761079:3312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:17.792852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:17.792884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:17.792893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:17.792901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:17.792910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:17.792917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:17.792925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:17.792931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:17.792939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.792947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.792955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.792963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.793015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:17.793154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:17.793207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:17.793260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:17.793311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:17.793359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:17.793412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:17.793461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:17.793510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.793560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.793609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.793657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.793703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:17.793773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:17.793834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:17.793894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:17.793946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:17.794004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:17.794056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:17.794112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:17.794160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:17.794220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:17.794270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:17.794324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:17.794371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:17.794429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:17.794474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:17.794528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:17.794582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.794641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.794688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.794747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.794796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.794854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.794902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.794979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.796589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:17.798712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592630762761079:3312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:17.798752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592630762761079:3312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:17.798769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592630762761079:3312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:17.798797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 87 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:17.807266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592630762761114:2507]
2025-10-10T14:00:17.858749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:17.873450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:17.873495Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:17.873515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:17.873535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:17.873561Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 86 [2:7559592629184845647:3147]
2025-10-10T14:00:17.873621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:17.873678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:17.873693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.873705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.873715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.873763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:17.873785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:17.873810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:17.876288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.876320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.876336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.876352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.876364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:17.876655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:17.876681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.876829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:17.877033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:17.877306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:17.877443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:17.877528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592630762760976:2442], now have 1 active actors on pipe
2025-10-10T14:00:17.877553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592630762761114:2507], now have 1 active actors on pipe
2025-10-10T14:00:17.877576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592630762761113:3312], now have 1 active actors on pipe
2025-10-10T14:00:17.877601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592629184845639:3147]
2025-10-10T14:00:17.877617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592629184845639:3147]
2025-10-10T14:00:17.877631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592629184845639:3147]
2025-10-10T14:00:17.877641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592629184845639:3147]
2025-10-10T14:00:17.877683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:17.877768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:17.877955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:17.877974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:17.878095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592629184845639:3147]
2025-10-10T14:00:17.878115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:17.878355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:17.878370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:17.878383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:17.878396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:17.878419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:17.881503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 86
2025-10-10T14:00:17.881596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 86, pipe: [1:7559592630762761114:2507]
2025-10-10T14:00:17.881666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 86
2025-10-10T14:00:17.882440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:17.882482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:17.882556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:17.882603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.882629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.882641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:17.882686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.882727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:17.882777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:17.883536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:17.883568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:17.883645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:17.883987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 87 partition: 0 MaxSeqNo: 36 sessionId: src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0
2025-10-10T14:00:17.885653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bd8fe2f-df5ead9d-7c1c6d86-2d07c1c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:17.919176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0] Write session: try to update token
2025-10-10T14:00:17.919238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:17.963261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:17.963300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:17.963314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:17.963325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:17.963335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:17.963371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592629184845639:3147]
2025-10-10T14:00:17.963398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592629184845639:3147]
2025-10-10T14:00:17.963423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592629184845639:3147]
2025-10-10T14:00:17.963445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592629184845639:3147]
2025-10-10T14:00:17.963602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:17.963627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:17.963640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:17.964766Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:17.967398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:17.967450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:17.967482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:17.967513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:18.015959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId: src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:18.059900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:18.142482Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:18.150701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:18.150747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:18.157449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:18.157496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:18.159024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:18.159288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592630762761114:2507]
2025-10-10T14:00:18.158237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:18.193861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 87 reason: error at write: Disconnected sessionId: src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0
2025-10-10T14:00:18.194205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 87 sessionId: src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0 is DEAD
2025-10-10T14:00:18.199574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:18.199621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0] Write session will restart in 0.006283s
2025-10-10T14:00:18.199729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0] Write session: Do CDS request
2025-10-10T14:00:18.199770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:18.219867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:18.223352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:18.223375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 88
2025-10-10T14:00:18.228359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:18.228500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 88 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:18.228516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=88 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:18.228529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:18.229898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 88 sessionId:  describe result for acl check
2025-10-10T14:00:18.230014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:18.230024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:18.230034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:18.230050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592635057728438:3317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:18.233065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592635057728438:3317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:18.245029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592635057728438:3317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:18.258447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592635057728489:2507]
2025-10-10T14:00:18.266516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592635057728438:3317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:18.266556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592635057728438:3317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:18.266577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592635057728438:3317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:18.266606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 88 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:18.287807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:18.298750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:18.299665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:18.299685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:18.299731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:18.299994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:18.300183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592633479813125:3157]
2025-10-10T14:00:18.302572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:18.306724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:18.307024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:18.308432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:18.308782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:18.308803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:18.308811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:18.308819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:18.308828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:18.308836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:18.308844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:18.308851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:18.308857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.308865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.308873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.308882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.308935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:18.309056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:18.309110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:18.309182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:18.309242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:18.309302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:18.309353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:18.309405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:18.309453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.309506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.309558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.309608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.309659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:18.309735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:18.309800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:18.309863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:18.309917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:18.309984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:18.310034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:18.310093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:18.310152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:18.310216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:18.310272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:18.310333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:18.310389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:18.310452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:18.310506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:18.310566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:18.310620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.310681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.310735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.310798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.310856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.310918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.310984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.311047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.311553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:18.356824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:18.389424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:18.389476Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:18.389497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:18.389520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:18.389549Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 87 [2:7559592633479813125:3157]
2025-10-10T14:00:18.389616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:18.389680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:18.389695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.389709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.389724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.389775Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:18.389800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:18.389824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:18.391287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.391304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.391320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.391336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.391348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:18.392938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:18.392970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.393176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.393392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.393283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 87
2025-10-10T14:00:18.393366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 87, pipe: [1:7559592635057728489:2507]
2025-10-10T14:00:18.393654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.393440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 87
2025-10-10T14:00:18.393800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:18.393846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592635057728512:3317], now have 1 active actors on pipe
2025-10-10T14:00:18.393875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592635057728489:2507], now have 1 active actors on pipe
2025-10-10T14:00:18.393899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592635057728425:2442], now have 1 active actors on pipe
2025-10-10T14:00:18.393973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.393990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.394005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.394017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.394059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:18.394158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:18.394182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:18.394272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:18.394465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:18.394483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:18.394641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:18.394670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.394687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.394698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:18.394726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:18.394732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.394741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:18.394753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:18.394765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:18.394771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:18.394809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.394843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:18.394929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:18.395061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:18.397888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:18.397926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:18.398003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:18.399435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 88 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0
2025-10-10T14:00:18.401381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe83c3f-5385a4bb-9d289b30-1eb4b26e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:18.442113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0] Write session: try to update token
2025-10-10T14:00:18.442173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:18.586047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.586084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.586097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.586213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:18.586227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:18.586243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:18.586254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:18.586266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:18.586301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.586328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.586355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.586376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.587053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:18.587122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:18.587176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:18.587222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:18.649978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:18.650031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.650045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:18.651194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:18.681246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId: src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:18.727016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:18.866007Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:18.883693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:18.883728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:18.883771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592633479813119:3157]
2025-10-10T14:00:18.883924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:18.883959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:18.884134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:18.885047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:18.886630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:18.900563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592635057728489:2507]
2025-10-10T14:00:18.900638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:18.900739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 88 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0
2025-10-10T14:00:18.901073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 88 sessionId: src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0 is DEAD
2025-10-10T14:00:18.903529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:18.903564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0] Write session will restart in 0.008409s
2025-10-10T14:00:18.903654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0] Write session: Do CDS request
2025-10-10T14:00:18.903682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:18.929087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:18.929121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 89
2025-10-10T14:00:18.929863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:18.930483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:18.930595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 89 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:18.930621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=89 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:18.930637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:18.933402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 89 sessionId:  describe result for acl check
2025-10-10T14:00:18.933516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:18.933525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:18.933533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:18.933552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592635057728637:3330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:18.935915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592635057728637:3330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:18.949610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592635057728637:3330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:18.965469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592635057728637:3330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:18.965504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592635057728637:3330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:18.965515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592635057728637:3330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:18.965546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 89 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:18.969749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:18.972602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:18.973217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:18.973240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:18.973270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:18.973433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:18.973550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592633479813281:3166]
2025-10-10T14:00:18.974898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:18.975926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:18.976117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:18.977356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:18.977667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:18.977695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:18.977702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:18.977708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:18.977714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:18.977720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:18.977726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:18.977731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:18.977738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.977744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.977751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.977757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.977804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:18.977906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:18.977952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:18.977995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:18.978035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:18.978079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:18.978121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:18.978161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:18.978201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.978246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.978287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.978332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.978374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:18.978442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:18.978500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:18.978551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:18.978595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:18.978646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:18.978693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:18.978742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:18.978787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:18.978834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:18.978876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:18.978924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:18.978970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:18.979035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:18.979078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:18.979147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:18.979200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.979252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:18.979296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.979347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:18.979391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.979439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:18.979482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.979530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:18.979946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:19.000752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592639352696052:2507]
2025-10-10T14:00:19.040952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:19.055945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:19.055985Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:19.055996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:19.056011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:19.056029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 88 [2:7559592633479813281:3166]
2025-10-10T14:00:19.056070Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:19.056133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:19.056144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.056153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.056163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.056198Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:19.056214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:19.056232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:19.057930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.057957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.057971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.057983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.057995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:19.058280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:19.058299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.058444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.058620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.058854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.058972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:19.059094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592635057728736:3330], now have 1 active actors on pipe
2025-10-10T14:00:19.059120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592639352696052:2507], now have 1 active actors on pipe
2025-10-10T14:00:19.059142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592635057728612:2442], now have 1 active actors on pipe
2025-10-10T14:00:19.059168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592633479813275:3166]
2025-10-10T14:00:19.059183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592633479813275:3166]
2025-10-10T14:00:19.059195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592633479813275:3166]
2025-10-10T14:00:19.059208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592633479813275:3166]
2025-10-10T14:00:19.059251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:19.059341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:19.059520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:19.059547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:19.059683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592633479813275:3166]
2025-10-10T14:00:19.059702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:19.059885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:19.059897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:19.059907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:19.059917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:19.059941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:19.060842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 88
2025-10-10T14:00:19.060924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 88, pipe: [1:7559592639352696052:2507]
2025-10-10T14:00:19.060992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 88
2025-10-10T14:00:19.061202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:19.061241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:19.061328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:19.061366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.061383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.061394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:19.061432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.061480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:19.061538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:19.062186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:19.062213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:19.062275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:19.062544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 89 partition: 0 MaxSeqNo: 36 sessionId: src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0
2025-10-10T14:00:19.063766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8aa1af-4854017b-a7439a77-df50fa8e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:19.114651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0] Write session: try to update token
2025-10-10T14:00:19.114712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:19.141583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:19.141614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:19.141629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:19.141641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:19.141651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:19.141691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592633479813275:3166]
2025-10-10T14:00:19.141719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592633479813275:3166]
2025-10-10T14:00:19.141745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592633479813275:3166]
2025-10-10T14:00:19.141770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592633479813275:3166]
2025-10-10T14:00:19.141891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:19.141920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:19.141923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:19.141949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.141952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:19.141960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:19.141981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:19.154509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:19.247111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId: src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:19.268235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:19.324998Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:19.339868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:19.339904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:19.343692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:19.342578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:19.342619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:19.348735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592639352696052:2507]
2025-10-10T14:00:19.348876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:19.388070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 89 reason: error at write: Disconnected sessionId: src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0
2025-10-10T14:00:19.388400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 89 sessionId: src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0 is DEAD
2025-10-10T14:00:19.389665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:19.389701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0] Write session will restart in 0.008484s
2025-10-10T14:00:19.389795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0] Write session: Do CDS request
2025-10-10T14:00:19.389822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:19.406832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:19.406873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 90
2025-10-10T14:00:19.409431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:19.410063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:19.410198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 90 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:19.410216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=90 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:19.410227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:19.414225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 90 sessionId:  describe result for acl check
2025-10-10T14:00:19.414346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:19.414355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:19.414365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:19.414382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592639352696119:3337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:19.416952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592639352696119:3337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:19.426003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592639352696119:3337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:19.442178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:19.445662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:19.446506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:19.446535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:19.446578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:19.446819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:19.447017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592637774780740:3176]
2025-10-10T14:00:19.446227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592639352696119:3337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:19.446266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592639352696119:3337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:19.446288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592639352696119:3337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:19.446322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 90 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:19.449038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:19.450216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:19.450434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:19.451382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:19.451605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:19.451615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:19.451619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:19.451623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:19.451627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:19.451631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:19.451634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:19.451638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:19.451642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.451647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.451651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.451654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.451684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:19.451764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:19.451808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:19.451852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:19.451889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:19.451927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:19.451974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:19.452019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:19.452065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.452112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.452156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.452194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.452222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:19.452264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:19.452303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:19.452344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:19.452378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:19.452412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:19.452441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:19.452479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:19.452511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:19.452545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:19.452571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:19.452608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:19.452640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:19.452675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:19.452706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:19.452743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:19.452774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.452809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.452838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.452872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.452904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.452938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.452968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.453003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.453229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592639352696212:2507]
2025-10-10T14:00:19.453338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:19.489656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:19.519420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:19.519460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:19.519475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:19.519493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:19.519516Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 89 [2:7559592637774780740:3176]
2025-10-10T14:00:19.519566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:19.519621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:19.519636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.519647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.519657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.519701Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:19.519723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:19.519742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:19.521948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.521966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.521975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.521983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.521991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:19.522249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:19.522265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.522393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.522565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.522777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.522883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:19.522965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592639352696208:3337], now have 1 active actors on pipe
2025-10-10T14:00:19.522989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592639352696061:2442], now have 1 active actors on pipe
2025-10-10T14:00:19.523020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592639352696212:2507], now have 1 active actors on pipe
2025-10-10T14:00:19.523044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592637774780735:3176]
2025-10-10T14:00:19.523059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592637774780735:3176]
2025-10-10T14:00:19.523071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592637774780735:3176]
2025-10-10T14:00:19.523082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592637774780735:3176]
2025-10-10T14:00:19.523125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:19.523206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:19.523373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:19.523390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:19.523515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592637774780735:3176]
2025-10-10T14:00:19.523536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:19.524517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:19.524539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:19.524549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:19.524560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:19.524585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:19.525288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 89
2025-10-10T14:00:19.525388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 89
2025-10-10T14:00:19.525454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 89, pipe: [1:7559592639352696212:2507]
2025-10-10T14:00:19.525573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:19.525608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:19.525721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:19.525771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.525795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.525806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:19.525843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.525889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:19.525940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:19.526461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:19.526487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:19.526546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:19.526845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 90 partition: 0 MaxSeqNo: 36 sessionId: src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0
2025-10-10T14:00:19.531607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccf7b49e-f90d022c-9e6520f2-8a78cd29_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:19.581257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0] Write session: try to update token
2025-10-10T14:00:19.581313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:19.661713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.661742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.661754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.661808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:19.661822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:19.661834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:19.661843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:19.661852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:19.661884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592637774780735:3176]
2025-10-10T14:00:19.661906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592637774780735:3176]
2025-10-10T14:00:19.661926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592637774780735:3176]
2025-10-10T14:00:19.661944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592637774780735:3176]
2025-10-10T14:00:19.662090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:19.662114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.662124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:19.662126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:19.662172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:19.662233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:19.662266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:19.663182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:19.743380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId: src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:19.764251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:19.832865Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:19.837265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:19.837310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:19.840634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:19.840652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:19.841291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:19.841591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592639352696212:2507]
2025-10-10T14:00:19.841054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:19.862801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:19.862843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0] Write session will restart in 0.009277s
2025-10-10T14:00:19.862939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0] Write session: Do CDS request
2025-10-10T14:00:19.862969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:19.862098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 90 reason: error at write: Disconnected sessionId: src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0
2025-10-10T14:00:19.863605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 90 sessionId: src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0 is DEAD
2025-10-10T14:00:19.875932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:19.881943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:19.882014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 91
2025-10-10T14:00:19.883077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:19.883376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 91 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:19.883427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=91 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:19.883452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:19.885515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 91 sessionId:  describe result for acl check
2025-10-10T14:00:19.885650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:19.885662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:19.885673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:19.885691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592639352696263:3344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:19.888453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592639352696263:3344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:19.896579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592639352696263:3344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:19.910973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592639352696263:3344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:19.911033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592639352696263:3344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:19.911052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592639352696263:3344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:19.911085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 91 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:19.917718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:19.922428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:19.923262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:19.923293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:19.923336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:19.923581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:19.923740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592637774780917:3185]
2025-10-10T14:00:19.927806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:19.929248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:19.929494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:19.930988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:19.931316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:19.931324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:19.931331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:19.931337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:19.931344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:19.931351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:19.931358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:19.931364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:19.931371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.931378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.931385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.931392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.931748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:19.931859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:19.931906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:19.931967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:19.932012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:19.932059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:19.932104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:19.932148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:19.932193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.932238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.932281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.932324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.932363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:19.932431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:19.932489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:19.932541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:19.932586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:19.932636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:19.932678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:19.932728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:19.932774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:19.932825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:19.932868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:19.932917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:19.932963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:19.933015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:19.933059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:19.933110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:19.933178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.933230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.933276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.933329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.933379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.933434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.933482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.933536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.933965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:19.942285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592639352696375:2507]
2025-10-10T14:00:19.956663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:19.980424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:19.980460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:19.980472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:19.980487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:19.980504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 90 [2:7559592637774780917:3185]
2025-10-10T14:00:19.980542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:19.980600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:19.980617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.980630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.980641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.980695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:19.980719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:19.980744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:19.983277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 90
2025-10-10T14:00:19.983374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 90
2025-10-10T14:00:19.983442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 90, pipe: [1:7559592639352696375:2507]
2025-10-10T14:00:19.982418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.982436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.982444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.982452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.982460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:19.982654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:19.982665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:19.982757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:19.982876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:19.983034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:19.983106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:19.983161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592639352696368:3344], now have 1 active actors on pipe
2025-10-10T14:00:19.983181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592639352696234:2442], now have 1 active actors on pipe
2025-10-10T14:00:19.983201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592639352696375:2507], now have 1 active actors on pipe
2025-10-10T14:00:19.983220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:19.983229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:19.983237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:19.983244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:19.983272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:19.983327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:19.983453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:19.983463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:19.983589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:19.983608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:19.983777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:19.983796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:19.983810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:19.983820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:19.983845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:19.984656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:19.984685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:19.984774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:19.984805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.984824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.984833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:19.984871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.984911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:19.984958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:19.985883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:19.985913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:19.985981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:19.986337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 91 partition: 0 MaxSeqNo: 36 sessionId: src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0
2025-10-10T14:00:19.987406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb45a5a-8d0a7bc8-3807fb0f-8eab72cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:20.028918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0] Write session: try to update token
2025-10-10T14:00:20.028976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:20.107618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:20.107652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:20.107662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:20.107670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:20.107692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:20.107726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:20.107750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:20.107769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:20.107787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:20.107954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.107961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:20.107988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.107999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.108012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:20.108045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:20.108093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:20.108097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:20.108119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.108129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:20.109639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:20.139667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId: src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:20.177104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:20.268239Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:20.289899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:20.289951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:20.290019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:20.290033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:20.290072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592637774780912:3185]
2025-10-10T14:00:20.290256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:20.290600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:20.293378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:20.316846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:20.316980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592639352696375:2507]
2025-10-10T14:00:20.317049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 91 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0
2025-10-10T14:00:20.321596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:20.321636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0] Write session will restart in 0.008487s
2025-10-10T14:00:20.321729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0] Write session: Do CDS request
2025-10-10T14:00:20.321756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:20.317375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 91 sessionId: src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0 is DEAD
2025-10-10T14:00:20.338368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:20.341391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:20.341413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 92
2025-10-10T14:00:20.345346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:20.345485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 92 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:20.345500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=92 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:20.345510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:20.348813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 92 sessionId:  describe result for acl check
2025-10-10T14:00:20.348923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:20.348933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:20.348941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:20.348955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592643647663741:3354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:20.351300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592643647663741:3354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:20.374748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592643647663741:3354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:20.383494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:20.395763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592643647663741:3354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:20.395803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592643647663741:3354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:20.395821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592643647663741:3354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:20.395850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 92 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:20.398266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:20.399059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:20.399076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:20.399118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:20.399384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:20.399548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592642069748360:3187]
2025-10-10T14:00:20.401956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:20.402967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:20.403179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:20.404348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:20.404620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:20.404639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:20.404646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:20.404652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:20.404657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:20.404665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:20.404671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:20.404677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:20.404682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.404689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.404694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.404701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.404744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:20.404834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:20.404875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:20.404916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:20.404958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:20.405000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:20.405039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:20.405079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:20.405118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.405226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.405268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.405308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.405343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:20.405399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:20.405453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:20.405498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:20.405538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:20.405594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:20.405632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:20.405682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:20.405727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:20.405778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:20.405818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:20.405866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:20.405909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:20.405954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:20.405996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:20.406042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:20.406081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.406128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.406169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.406215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.406253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.406303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.406345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.406391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.406776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:20.417463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592643647663838:2507]
2025-10-10T14:00:20.440049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:20.478238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:20.478289Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:20.478307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:20.478326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:20.478349Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 91 [2:7559592642069748360:3187]
2025-10-10T14:00:20.478404Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:20.478461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:20.478475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.478487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.478499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.478547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:20.478568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:20.478589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:20.480167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.480194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.480212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.480225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.480238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:20.480545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:20.480563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.480705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.480899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.481150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.481271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:20.481351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.481366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.481379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.481392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.481439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:20.481519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:20.481687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:20.481705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:20.481832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.481850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:20.482252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:20.482251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592643647663838:2507], now have 1 active actors on pipe
2025-10-10T14:00:20.482274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:20.482280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592643647663828:3354], now have 1 active actors on pipe
2025-10-10T14:00:20.482284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:20.482295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:20.482301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592643647663702:2442], now have 1 active actors on pipe
2025-10-10T14:00:20.482319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:20.482777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 91, pipe: [1:7559592643647663838:2507]
2025-10-10T14:00:20.482874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 91
2025-10-10T14:00:20.482947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 91
2025-10-10T14:00:20.485422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:20.485468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:20.485579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab12e489-12ead21e-809b73c7-17823396_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:20.485627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.485645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.485655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:20.485702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.485760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:20.485812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:20.490103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:20.490143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:20.490221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:20.491435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d565aee4-6f7cf50b-c9de8a32-e6e2664f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ab12e489-12ead21e-809b73c7-17823396_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:20.490560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 92 partition: 0 MaxSeqNo: 36 sessionId: src_id|ab12e489-12ead21e-809b73c7-17823396_0
2025-10-10T14:00:20.533707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab12e489-12ead21e-809b73c7-17823396_0] Write session: try to update token
2025-10-10T14:00:20.533773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab12e489-12ead21e-809b73c7-17823396_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:20.594748Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:20.594778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:20.594790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:20.594799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:20.594806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:20.594837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.594859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.594878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.594897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.595072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.595085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.595096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.597308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:20.597347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:20.597381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:20.597413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:20.606241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:20.606315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.606334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:20.607939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:20.655321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId: src_id|ab12e489-12ead21e-809b73c7-17823396_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:20.676895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:20.764395Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:20.784241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:20.784280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:20.784321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592642069748354:3187]
2025-10-10T14:00:20.784466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:20.784497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:20.784573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:20.785187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:20.786050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:20.786065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:20.786079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:20.786282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592643647663838:2507]
2025-10-10T14:00:20.808329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 92 reason: error at write: Disconnected sessionId: src_id|ab12e489-12ead21e-809b73c7-17823396_0
2025-10-10T14:00:20.808599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 92 sessionId: src_id|ab12e489-12ead21e-809b73c7-17823396_0 is DEAD
2025-10-10T14:00:20.809694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab12e489-12ead21e-809b73c7-17823396_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:20.809741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab12e489-12ead21e-809b73c7-17823396_0] Write session will restart in 0.007031s
2025-10-10T14:00:20.809897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab12e489-12ead21e-809b73c7-17823396_0] Write session: Do CDS request
2025-10-10T14:00:20.809940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab12e489-12ead21e-809b73c7-17823396_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:20.826045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:20.826093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 93
2025-10-10T14:00:20.827873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab12e489-12ead21e-809b73c7-17823396_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:20.830099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:20.830235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 93 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:20.830254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=93 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:20.830264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:20.831954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 93 sessionId:  describe result for acl check
2025-10-10T14:00:20.832068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:20.832084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:20.832095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:20.832113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592643647663901:3365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:20.834711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592643647663901:3365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:20.845688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592643647663901:3365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:20.855007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592643647663901:3365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:20.855054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592643647663901:3365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:20.855071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592643647663901:3365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:20.855099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 93 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:20.864580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:20.867016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:20.867719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:20.867744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:20.867786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:20.867976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:20.868109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592642069748540:3197]
2025-10-10T14:00:20.869796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:20.870876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:20.871108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:20.872382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:20.872667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:20.872684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:20.872690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:20.872696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:20.872703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:20.872709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:20.872715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:20.872720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:20.872726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.872732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.872738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.872744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.872788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:20.872887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:20.872934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:20.872979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:20.873022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:20.873065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:20.873110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:20.873170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:20.873215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.873257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.873298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.873340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.873379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:20.873439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:20.873494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:20.873543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:20.873590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:20.874612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:20.874670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:20.874724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:20.874768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:20.874815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:20.874858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:20.874910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:20.874952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:20.874994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:20.875065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:20.875113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:20.875156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.875204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.875247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.875294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.875337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.875383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.875424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.875475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.876351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:20.885883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592643647664030:2507]
2025-10-10T14:00:20.918412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:20.932362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:20.932401Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:20.932415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:20.932432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:20.932455Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 92 [2:7559592642069748540:3197]
2025-10-10T14:00:20.932505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:20.932562Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:20.932581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.932595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.932606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.932654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:20.932674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:20.932696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:20.935147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.935179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.935192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.935203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.935215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:20.935484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:20.935500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:20.935625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:20.936337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 92, pipe: [1:7559592643647664030:2507]
2025-10-10T14:00:20.936413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 92
2025-10-10T14:00:20.936438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 92
2025-10-10T14:00:20.936303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:20.936532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:20.936628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:20.936710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592643647664030:2507], now have 1 active actors on pipe
2025-10-10T14:00:20.936726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592643647663885:2442], now have 1 active actors on pipe
2025-10-10T14:00:20.936747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592643647664020:3365], now have 1 active actors on pipe
2025-10-10T14:00:20.936791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:20.936805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:20.936816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:20.936829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:20.936870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:20.936953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:20.936972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:20.937004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:20.937014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:20.937018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:20.937027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:20.937037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:20.937149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:20.937166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:20.937321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:20.937350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.937366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.937375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:20.937410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.937452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:20.937486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:20.937513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:20.937598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:20.937765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:20.941899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:20.941939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:20.942012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:20.942578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 93 partition: 0 MaxSeqNo: 36 sessionId: src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0
2025-10-10T14:00:20.943508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab12e489-12ead21e-809b73c7-17823396_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:20.988367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0] Write session: try to update token
2025-10-10T14:00:20.988431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:21.073570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:21.073605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:21.073619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:21.073628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:21.073638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:21.073678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:21.073703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:21.073724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:21.073745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:21.073910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.073931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.073941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.073952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:21.073985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:21.074013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:21.074039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:21.074046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:21.074070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.074082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:21.085842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:21.120955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId: src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:21.144388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:21.252399Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:21.267748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:21.267803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:21.267880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:21.267894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:21.267939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592642069748534:3197]
2025-10-10T14:00:21.268223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:21.268681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:21.270696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:21.270863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:21.271394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592643647664030:2507]
2025-10-10T14:00:21.277588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 93 reason: status is not ok: tablet will be restarted right now sessionId: src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0
2025-10-10T14:00:21.278002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 93 sessionId: src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0 is DEAD
2025-10-10T14:00:21.281794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:21.281835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0] Write session will restart in 0.008283s
2025-10-10T14:00:21.281938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0] Write session: Do CDS request
2025-10-10T14:00:21.281972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:21.315104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:21.315138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 94
2025-10-10T14:00:21.315753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:21.316398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:21.316521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 94 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:21.316543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=94 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:21.316554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:21.318036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 94 sessionId:  describe result for acl check
2025-10-10T14:00:21.318158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:21.318170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:21.318179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:21.318195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592647942631350:3370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:21.320932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592647942631350:3370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:21.364185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592647942631350:3370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:21.373498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592647942631383:2507]
2025-10-10T14:00:21.392142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592647942631350:3370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:21.392181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592647942631350:3370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:21.392198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592647942631350:3370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:21.392228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 94 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:21.423957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:21.426800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:21.427661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:21.427681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:21.427727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:21.427995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:21.428195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592646364716001:3206]
2025-10-10T14:00:21.430363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:21.431613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:21.431842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:21.433091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:21.433427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:21.433434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:21.433440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:21.433445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:21.433453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:21.433458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:21.433464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:21.433469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:21.433481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.433486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.433491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.433496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.433541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:21.433646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:21.433694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:21.433737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:21.433781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:21.433827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:21.433873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:21.433915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:21.433959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.434002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.434046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.434087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.434131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:21.434200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:21.434259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:21.434325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:21.437035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:21.437140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:21.437198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:21.437254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:21.437302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:21.437355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:21.437401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:21.437452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:21.437495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:21.437556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:21.437604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:21.437658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:21.437704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.437754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.437802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.437854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.437901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.437951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.437990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.438037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.438463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:21.531261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:21.546395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:21.546439Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:21.546456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:21.546476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:21.546499Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 93 [2:7559592646364716001:3206]
2025-10-10T14:00:21.546552Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:21.546607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:21.546620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.546631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.546641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.546687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:21.546708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:21.546729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:21.550254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 93
2025-10-10T14:00:21.550338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 93, pipe: [1:7559592647942631383:2507]
2025-10-10T14:00:21.550409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 93
2025-10-10T14:00:21.548877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.548908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.548921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.548934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.548947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:21.550940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:21.550967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.551119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.551279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.551486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.551591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:21.551678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592647942631338:2442], now have 1 active actors on pipe
2025-10-10T14:00:21.551701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592647942631383:2507], now have 1 active actors on pipe
2025-10-10T14:00:21.551720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592647942631431:3370], now have 1 active actors on pipe
2025-10-10T14:00:21.551784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:21.551803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:21.551839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592646364715995:3206]
2025-10-10T14:00:21.551852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592646364715995:3206]
2025-10-10T14:00:21.551865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592646364715995:3206]
2025-10-10T14:00:21.551876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592646364715995:3206]
2025-10-10T14:00:21.551918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:21.551998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:21.552163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:21.552182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:21.552248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:21.552279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.552294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.552304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:21.552339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.552383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:21.552515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592646364715995:3206]
2025-10-10T14:00:21.552535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:21.552577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:21.552871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:21.552885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:21.552895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:21.552906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:21.552930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:21.555653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:21.555683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:21.555754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:21.556133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 94 partition: 0 MaxSeqNo: 36 sessionId: src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0
2025-10-10T14:00:21.557039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53a1206f-11bd9709-4380dcc6-f7b4473f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:21.611210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0] Write session: try to update token
2025-10-10T14:00:21.611270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:21.666787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.666823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.666835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.666889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:21.666904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:21.666918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:21.666929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:21.666938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:21.666973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592646364715995:3206]
2025-10-10T14:00:21.666999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592646364715995:3206]
2025-10-10T14:00:21.667024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592646364715995:3206]
2025-10-10T14:00:21.667058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592646364715995:3206]
2025-10-10T14:00:21.667186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:21.667211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:21.667223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:21.667236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.667247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:21.667249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:21.667271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:21.668816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:21.798352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId: src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:21.821785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:21.831826Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:21.834769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:21.834817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:21.837637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:21.838500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:21.837901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592647942631383:2507]
2025-10-10T14:00:21.837980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:21.837992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:21.877504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 94 reason: error at write: Disconnected sessionId: src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0
2025-10-10T14:00:21.877845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 94 sessionId: src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0 is DEAD
2025-10-10T14:00:21.878269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:21.878319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0] Write session will restart in 0.009620s
2025-10-10T14:00:21.878477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0] Write session: Do CDS request
2025-10-10T14:00:21.878522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:21.892291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:21.892855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:21.892887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 95
2025-10-10T14:00:21.893164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:21.893269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 95 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:21.893284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=95 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:21.893293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:21.894551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 95 sessionId:  describe result for acl check
2025-10-10T14:00:21.894663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:21.894673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:21.894682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:21.894699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592647942631612:3383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:21.902105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592647942631612:3383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:21.911244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:21.913523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:21.914248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:21.914264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:21.914303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:21.914544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:21.914710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592646364716163:3210]
2025-10-10T14:00:21.916579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592647942631612:3383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:21.916898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:21.918389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:21.918603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:21.919851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:21.920126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:21.920130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:21.920135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:21.920140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:21.920144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:21.920149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:21.920153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:21.920158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:21.920162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.920166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.920170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.920175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.920206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:21.920281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:21.920312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:21.920345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:21.920375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:21.920405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:21.920437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:21.920469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:21.920498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.920530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.920561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.920593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.920616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:21.920656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:21.920694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:21.920727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:21.920757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:21.920794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:21.920835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:21.920874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:21.920906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:21.920941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:21.920970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:21.921007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:21.921036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:21.921070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:21.921098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:21.922458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:21.922512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.922556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.922587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.922629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.922660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.922694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.922720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.922754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.923147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:21.937038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592647942631612:3383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:21.937103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592647942631612:3383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:21.937121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592647942631612:3383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:21.937170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 95 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:21.937958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592647942631675:2507]
2025-10-10T14:00:21.955310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:21.970136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:21.970195Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:21.970210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:21.970228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:21.970251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 94 [2:7559592646364716163:3210]
2025-10-10T14:00:21.970305Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:21.970364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:21.970378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.970390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.970401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.970450Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:21.970479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:21.970501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:21.972616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.972643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.972657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.972670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.972681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:21.972949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:21.972964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:21.973091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:21.973402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:21.973613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:21.973712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:21.973793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592647942631675:2507], now have 1 active actors on pipe
2025-10-10T14:00:21.973815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592647942631531:2442], now have 1 active actors on pipe
2025-10-10T14:00:21.973835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592647942631674:3383], now have 1 active actors on pipe
2025-10-10T14:00:21.973875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:21.973891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:21.973903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:21.973914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:21.973965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:21.974026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:21.974042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:21.974048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:21.974053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:21.974064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:21.974208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:21.974226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:21.974348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:21.974375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:21.974415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:21.975945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:21.975281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 94
2025-10-10T14:00:21.975989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:21.975375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 94, pipe: [1:7559592647942631675:2507]
2025-10-10T14:00:21.975453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 94
2025-10-10T14:00:21.976091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:21.976132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.976175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.976197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:21.976252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.976297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:21.976361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:21.976887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:21.976915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:21.976969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:21.977286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 95 partition: 0 MaxSeqNo: 36 sessionId: src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0
2025-10-10T14:00:21.979546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d671d244-12b7d1ff-da80cf-ec2a77bd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:22.005258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0] Write session: try to update token
2025-10-10T14:00:22.005306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:22.023985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:22.024029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:22.024069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:22.024191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:22.024223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:22.049475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:22.051004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:22.057661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:22.064810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:22.068807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:22.069344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:22.117824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId: src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:22.129004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.129038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.129050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.129107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:22.129121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:22.129148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:22.129159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:22.129170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:22.129212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:22.129239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:22.129261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:22.129283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592646364716157:3210]
2025-10-10T14:00:22.129410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:22.129422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:22.129449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.129458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:22.129460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:22.129487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:22.129522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:22.130456Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:22.145952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:22.280030Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:22.282980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:22.283024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:22.284749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592647942631675:2507]
2025-10-10T14:00:22.284865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:22.285023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:22.283644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:22.325088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:22.325182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0] Write session will restart in 0.007285s
2025-10-10T14:00:22.324389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 95 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0
2025-10-10T14:00:22.324716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 95 sessionId: src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0 is DEAD
2025-10-10T14:00:22.325334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0] Write session: Do CDS request
2025-10-10T14:00:22.325413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:22.338092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:22.338135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 96
2025-10-10T14:00:22.338641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:22.339210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:22.339361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 96 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:22.339381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=96 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:22.339391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:22.340570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 96 sessionId:  describe result for acl check
2025-10-10T14:00:22.340686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:22.340697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:22.340705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:22.340727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592652237599101:3390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:22.343138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592652237599101:3390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:22.352463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:22.353726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592652237599101:3390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:22.356140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:22.356931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:22.356961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:22.357004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:22.357287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:22.357485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592650659683635:3220]
2025-10-10T14:00:22.359844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:22.361300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:22.361514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:22.362861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:22.363314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:22.363322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:22.363329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:22.363335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:22.363341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:22.363349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:22.363355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:22.363362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:22.363368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.363375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.363381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.363389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.363436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:22.363536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:22.363584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:22.363628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:22.363674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:22.363722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:22.363767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:22.363811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:22.363855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.363898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.363939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.364024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.364102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:22.364196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:22.364266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:22.364324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:22.364374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:22.364426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:22.364470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:22.364521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:22.364568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:22.364620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:22.364663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:22.364712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:22.364768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:22.366213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:22.366278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:22.367363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592652237599101:3390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:22.366337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:22.366386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.367400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592652237599101:3390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:22.366438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.367415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592652237599101:3390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:22.366482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.367444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 96 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:22.366536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.366582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.366636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.366680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.366729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.367174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:22.385316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592652237599140:2507]
2025-10-10T14:00:22.414559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:22.427188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:22.427231Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:22.427247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:22.427266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:22.427289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 95 [2:7559592650659683635:3220]
2025-10-10T14:00:22.427345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:22.427406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:22.427420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.427432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.427442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.427489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:22.427533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:22.427559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:22.429561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.429586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.429598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.429610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.429620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:22.429840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:22.429860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.429969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.430105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.430302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.430411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:22.430499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592652237598994:2442], now have 1 active actors on pipe
2025-10-10T14:00:22.430527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592652237599137:3390], now have 1 active actors on pipe
2025-10-10T14:00:22.430549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592652237599140:2507], now have 1 active actors on pipe
2025-10-10T14:00:22.430573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.430593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.430607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.430617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.430657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:22.430737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:22.430905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:22.430926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:22.431047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.431081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:22.430908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 95
2025-10-10T14:00:22.430982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 95, pipe: [1:7559592652237599140:2507]
2025-10-10T14:00:22.431078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 95
2025-10-10T14:00:22.431208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:22.431229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:22.431241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:22.431252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:22.431277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:22.431583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:22.431613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:22.431692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|323f8452-212a29f1-8ce886fd-131d2af1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:22.431724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.431741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.431750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:22.431785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.431824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:22.431878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:22.432760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:22.432790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:22.432854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:22.436453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 96 partition: 0 MaxSeqNo: 36 sessionId: src_id|323f8452-212a29f1-8ce886fd-131d2af1_0
2025-10-10T14:00:22.437329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c066192b-7c8bea31-ff575438-6ebcc4ae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|323f8452-212a29f1-8ce886fd-131d2af1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:22.486755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|323f8452-212a29f1-8ce886fd-131d2af1_0] Write session: try to update token
2025-10-10T14:00:22.486813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|323f8452-212a29f1-8ce886fd-131d2af1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:22.533489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:22.533540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:22.533596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.533777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.533790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.533800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.533869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:22.534066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:22.557821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:22.566839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:22.569849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:22.579337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:22.592824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:22.593356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:22.641227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:22.641259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:22.641271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:22.641283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:22.641294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:22.641337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.641362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.641383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.641405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592650659683630:3220]
2025-10-10T14:00:22.641538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:22.641570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.641572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:22.641582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.641595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.641600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:22.641628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:22.641645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:22.641673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.641684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:22.642851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:22.641681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId: src_id|323f8452-212a29f1-8ce886fd-131d2af1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:22.671404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:22.792522Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:22.800652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:22.800689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:22.801236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:22.801266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:22.801428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592652237599140:2507]
2025-10-10T14:00:22.801510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:22.801523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:22.828824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 96 reason: error at write: Disconnected sessionId: src_id|323f8452-212a29f1-8ce886fd-131d2af1_0
2025-10-10T14:00:22.829548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323f8452-212a29f1-8ce886fd-131d2af1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:22.829588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323f8452-212a29f1-8ce886fd-131d2af1_0] Write session will restart in 0.005028s
2025-10-10T14:00:22.829693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323f8452-212a29f1-8ce886fd-131d2af1_0] Write session: Do CDS request
2025-10-10T14:00:22.829724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323f8452-212a29f1-8ce886fd-131d2af1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:22.830392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 96 sessionId: src_id|323f8452-212a29f1-8ce886fd-131d2af1_0 is DEAD
2025-10-10T14:00:22.845032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|323f8452-212a29f1-8ce886fd-131d2af1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:22.849369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:22.849402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 97
2025-10-10T14:00:22.849735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:22.849869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 97 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:22.849886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=97 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:22.849898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:22.852906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 97 sessionId:  describe result for acl check
2025-10-10T14:00:22.853146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:22.853159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:22.853169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:22.853200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592652237599196:3396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:22.857028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592652237599196:3396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:22.864898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592652237599196:3396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:22.873765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592652237599196:3396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:22.873801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592652237599196:3396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:22.873818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592652237599196:3396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:22.873849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 97 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:22.886206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:22.893207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:22.894149Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:22.894167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:22.894213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:22.894531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:22.894745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592650659683817:3228]
2025-10-10T14:00:22.897119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:22.898405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:22.898688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:22.900113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:22.900424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:22.900445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:22.900453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:22.900461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:22.900469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:22.900476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:22.900484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:22.900493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:22.900500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.900510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.900519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.900526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.900578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:22.900682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:22.900721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:22.900768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:22.900815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:22.900861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:22.900915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:22.900976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:22.901024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.901082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.901158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.901215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.901248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:22.901311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:22.901364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:22.901432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:22.901492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:22.901555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:22.901607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:22.901666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:22.901708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:22.901749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:22.901786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:22.901830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:22.901867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:22.901926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:22.901969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:22.902024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:22.902068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.902126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.902174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.902232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.902279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.902320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.902354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.902401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.902659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592652237599318:2507]
2025-10-10T14:00:22.902852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:22.924656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:22.959370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:22.959415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:22.959434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:22.959455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:22.959480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 96 [2:7559592650659683817:3228]
2025-10-10T14:00:22.959543Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:22.959605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:22.959619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.959633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.959646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.959695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:22.959719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:22.959752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:22.961076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.961100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.961114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.961144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.961157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:22.961422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:22.961447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:22.961598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:22.961801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:22.962048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:22.962178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:22.962246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:22.962262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:22.962276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:22.962290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:22.962326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:22.962399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:22.962490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:22.962517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:22.962528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:22.962544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:22.962587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:22.962604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:22.962722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:22.962755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:22.962812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:22.962854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592652237599318:2507], now have 1 active actors on pipe
2025-10-10T14:00:22.962917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592652237599310:3396], now have 1 active actors on pipe
2025-10-10T14:00:22.962955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592652237599172:2442], now have 1 active actors on pipe
2025-10-10T14:00:22.963192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 96, pipe: [1:7559592652237599318:2507]
2025-10-10T14:00:22.963335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 96
2025-10-10T14:00:22.963429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 96
2025-10-10T14:00:22.963566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:22.963594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:22.963673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35162f77-3b0f2344-4b486a63-bed869d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:22.963708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.963728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.963739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:22.963770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.963813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:22.963863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:22.964387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:22.964412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:22.964474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:22.964798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 97 partition: 0 MaxSeqNo: 36 sessionId: src_id|35162f77-3b0f2344-4b486a63-bed869d1_0
2025-10-10T14:00:22.965390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|323f8452-212a29f1-8ce886fd-131d2af1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|35162f77-3b0f2344-4b486a63-bed869d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:22.981478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35162f77-3b0f2344-4b486a63-bed869d1_0] Write session: try to update token
2025-10-10T14:00:22.981539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35162f77-3b0f2344-4b486a63-bed869d1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:23.037993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:23.038034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:23.038048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:23.038064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:23.038076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:23.038118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:23.038143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:23.038164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:23.038184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:23.038376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:23.038402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:23.038413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:23.038685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:23.038714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:23.038746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:23.038775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:23.046091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:23.101294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId: src_id|35162f77-3b0f2344-4b486a63-bed869d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:23.123225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:23.226985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:23.255663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:23.255715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:23.255783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:23.255797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:23.255840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592650659683812:3228]
2025-10-10T14:00:23.256420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:23.260298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:23.256882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592652237599318:2507]
2025-10-10T14:00:23.256984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:23.256995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:23.277751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 97 reason: error at write: Disconnected sessionId: src_id|35162f77-3b0f2344-4b486a63-bed869d1_0
2025-10-10T14:00:23.278097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 97 sessionId: src_id|35162f77-3b0f2344-4b486a63-bed869d1_0 is DEAD
2025-10-10T14:00:23.285506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35162f77-3b0f2344-4b486a63-bed869d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:23.285556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35162f77-3b0f2344-4b486a63-bed869d1_0] Write session will restart in 0.008761s
2025-10-10T14:00:23.285660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35162f77-3b0f2344-4b486a63-bed869d1_0] Write session: Do CDS request
2025-10-10T14:00:23.285690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35162f77-3b0f2344-4b486a63-bed869d1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:23.310476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35162f77-3b0f2344-4b486a63-bed869d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:23.311650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:23.314793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:23.314819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 98
2025-10-10T14:00:23.315510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:23.315626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 98 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:23.315640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=98 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:23.315651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:23.319232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 98 sessionId:  describe result for acl check
2025-10-10T14:00:23.319353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:23.319363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:23.319371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:23.319388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592656532566669:3407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:23.321803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592656532566669:3407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:23.345264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592656532566669:3407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:23.365070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592656532566771:2507]
2025-10-10T14:00:23.373222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592656532566669:3407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:23.373260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592656532566669:3407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:23.373278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592656532566669:3407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:23.373309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 98 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:23.375794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:23.386215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:23.387011Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:23.387030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:23.387069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:23.387317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:23.387491Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592654954651264:3231]
2025-10-10T14:00:23.390071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:23.392135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:23.392326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:23.393305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:23.393582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:23.393590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:23.393597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:23.393602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:23.393609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:23.393615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:23.393621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:23.393627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:23.393633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:23.393640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:23.393647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:23.393652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:23.393694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:23.393790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:23.393834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:23.393878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:23.393921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:23.393964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:23.394006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:23.394047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:23.394087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:23.394129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:23.394169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:23.394209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:23.394246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:23.394306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:23.394358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:23.394407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:23.394453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:23.394501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:23.394541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:23.394590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:23.394635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:23.394687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:23.394726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:23.394772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:23.394804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:23.394836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:23.394863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:23.394912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:23.394956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:23.395005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:23.395047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:23.395111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:23.395155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:23.395204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:23.395246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:23.395295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:23.395703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:23.430525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:23.445840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:23.445885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:23.445900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:23.445917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:23.445939Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 97 [2:7559592654954651264:3231]
2025-10-10T14:00:23.445993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:23.446050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:23.446066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.446076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.446087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.446134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:23.446155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:23.446175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:23.470959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:23.470984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:23.470995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:23.471005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:23.471014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:23.471244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:23.471266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:23.471369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:23.471524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:23.471699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:23.471816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:23.471889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.471906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.471919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.471930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.471959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:23.472036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:23.472197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:23.472218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:23.472339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.472366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:23.474170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:23.474198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:23.474209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:23.474220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:23.474243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:23.474642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 97, pipe: [1:7559592656532566771:2507]
2025-10-10T14:00:23.474737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 97
2025-10-10T14:00:23.474806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 97
2025-10-10T14:00:23.475431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592656532566771:2507], now have 1 active actors on pipe
2025-10-10T14:00:23.475472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592656532566777:3407], now have 1 active actors on pipe
2025-10-10T14:00:23.475506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592656532566656:2442], now have 1 active actors on pipe
2025-10-10T14:00:23.475590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:23.475635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:23.475712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98e90616-910affa0-bab956e1-db4e568d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:23.475752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.475768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.475781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:23.475830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.475885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:23.475931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:23.478410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:23.478443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:23.478518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:23.479260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 98 partition: 0 MaxSeqNo: 36 sessionId: src_id|98e90616-910affa0-bab956e1-db4e568d_0
2025-10-10T14:00:23.481638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35162f77-3b0f2344-4b486a63-bed869d1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98e90616-910affa0-bab956e1-db4e568d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:23.509256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e90616-910affa0-bab956e1-db4e568d_0] Write session: try to update token
2025-10-10T14:00:23.509322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e90616-910affa0-bab956e1-db4e568d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:23.625286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:00:23.625340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-10T14:00:23.689594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.689625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.689638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.689809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:23.689824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:23.689837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:23.689846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:23.689856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:23.689890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.689914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.689934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.689954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.690215Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:00:23.692067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:23.692109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:23.692136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:23.692163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:23.718753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:23.718798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:23.718810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:23.719920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:23.728847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:00:23.729005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:00:23.740308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId: src_id|98e90616-910affa0-bab956e1-db4e568d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:23.777933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:23.902110Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:23.925661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:23.925694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:23.925734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592654954651257:3231]
2025-10-10T14:00:23.925878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:23.925900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:23.926611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:23.927202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:23.928009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592656532566771:2507]
2025-10-10T14:00:23.928196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:23.928474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:23.942387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 98 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98e90616-910affa0-bab956e1-db4e568d_0
2025-10-10T14:00:23.942759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 98 sessionId: src_id|98e90616-910affa0-bab956e1-db4e568d_0 is DEAD
2025-10-10T14:00:23.945909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e90616-910affa0-bab956e1-db4e568d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:23.945935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e90616-910affa0-bab956e1-db4e568d_0] Write session will restart in 0.005789s
2025-10-10T14:00:23.946001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e90616-910affa0-bab956e1-db4e568d_0] Write session: Do CDS request
2025-10-10T14:00:23.946021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e90616-910affa0-bab956e1-db4e568d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:23.966923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:23.966952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 99
2025-10-10T14:00:23.969002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e90616-910affa0-bab956e1-db4e568d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:23.969573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:23.969733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 99 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:23.969752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=99 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:23.969762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:23.971198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 99 sessionId:  describe result for acl check
2025-10-10T14:00:23.971311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:23.971328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:23.971336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:23.971353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592656532566853:3417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:23.973700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592656532566853:3417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:23.985357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592656532566853:3417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:23.995700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592656532566853:3417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:23.995747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592656532566853:3417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:23.995765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592656532566853:3417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:23.995797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 99 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:24.028128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592660827534237:2507]
2025-10-10T14:00:24.059170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:24.066111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:24.066946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:24.066965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:24.067008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:24.067290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:24.067490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592659249618748:3244]
2025-10-10T14:00:24.073762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:24.075263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:24.075528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:24.076805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:24.077177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:24.077194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:24.077204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:24.077211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:24.077218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:24.077224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:24.077230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:24.077237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:24.077243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.077251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.077257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.077264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.077310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:24.077412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:24.077460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:24.077503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:24.077546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:24.077596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:24.077639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:24.077681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:24.077723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.077778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.077828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.077878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.077927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:24.077994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:24.078055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:24.078111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:24.078162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:24.078217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:24.078266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:24.078324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:24.078378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:24.078433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:24.078479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:24.078534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:24.078587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:24.078640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:24.078689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:24.078743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:24.078792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.078848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.078893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.078950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.079001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.079053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.079113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.079166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.079589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:24.151662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:24.175176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:24.175225Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:24.175242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:24.175262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:24.175288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 98 [2:7559592659249618748:3244]
2025-10-10T14:00:24.175358Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:24.175422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:24.175437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.175450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.175461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.175520Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:24.175544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:24.175566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:24.177967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.178001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.178016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.178030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.178041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:24.178331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:24.178349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.178498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.178686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.178926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.179068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:24.179181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.179196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.179212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.179225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.179269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:24.179355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:24.179540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:24.179557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:24.179690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.179709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:24.179911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:24.179923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:24.179934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:24.179946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:24.179969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:24.180767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592660827534237:2507], now have 1 active actors on pipe
2025-10-10T14:00:24.180807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592656532566838:2442], now have 1 active actors on pipe
2025-10-10T14:00:24.180830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592656532566880:3417], now have 1 active actors on pipe
2025-10-10T14:00:24.182408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 98, pipe: [1:7559592660827534237:2507]
2025-10-10T14:00:24.182505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 98
2025-10-10T14:00:24.182575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 98
2025-10-10T14:00:24.183570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:24.183618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:24.183713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:24.183748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.183769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.183780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:24.183822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.183873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:24.183922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:24.190622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:24.190672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:24.190762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:24.191643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 99 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0
2025-10-10T14:00:24.196962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e90616-910affa0-bab956e1-db4e568d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:24.231190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0] Write session: try to update token
2025-10-10T14:00:24.231378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:24.288161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:24.288194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:24.288230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.288354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.288365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.288376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.288433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:24.288676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:24.307086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:24.308821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:24.310226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:24.338376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:24.339904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:24.340368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:24.395763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.395794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.395806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.395868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:24.395882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:24.395897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:24.395907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:24.395918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:24.395964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.395991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.396013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.396035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592659249618742:3244]
2025-10-10T14:00:24.396151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:24.396169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.396177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:24.397062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:24.404552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:24.404617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:24.404642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:24.404668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:24.420093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId: src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:24.442601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:24.586666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:24.589462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:24.589509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:24.591214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592660827534237:2507]
2025-10-10T14:00:24.591317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:24.591437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:24.591450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:24.590748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:24.602246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 99 reason: error at write: Disconnected sessionId: src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0
2025-10-10T14:00:24.602593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 99 sessionId: src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0 is DEAD
2025-10-10T14:00:24.607846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:24.607913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0] Write session will restart in 0.007676s
2025-10-10T14:00:24.608057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0] Write session: Do CDS request
2025-10-10T14:00:24.608111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:24.621978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:24.628921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:24.628946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 100
2025-10-10T14:00:24.633294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:24.633438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:24.633455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:24.633463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:24.634810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 100 sessionId:  describe result for acl check
2025-10-10T14:00:24.634920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:24.634931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:24.634941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:24.634957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592660827534336:3427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:24.642046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592660827534336:3427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:24.651982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592660827534336:3427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:24.663337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592660827534336:3427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:24.663379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592660827534336:3427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:24.663394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592660827534336:3427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:24.663424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:24.671254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:24.674038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:24.674878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:24.674896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:24.674936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:24.675196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:24.675379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592659249618919:3251]
2025-10-10T14:00:24.677872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:24.679118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:24.679331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:24.680602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:24.680919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:24.680928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:24.680935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:24.680942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:24.680951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:24.680957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:24.680965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:24.680972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:24.680979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.680986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.680994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.681002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.681051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:24.681189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:24.681241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:24.681290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:24.681339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:24.681389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:24.681436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:24.681490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:24.681538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.681610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.681677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.681744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.681829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:24.681925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:24.682289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:24.682403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:24.682488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:24.682578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:24.682676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:24.682764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:24.682845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:24.682929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:24.682993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:24.683069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:24.683138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:24.683195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:24.683257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:24.683316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:24.683368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.683425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.683472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.683529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.683578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.683633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.683680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.683737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.684225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:24.690643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592660827534478:2507]
2025-10-10T14:00:24.713653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:24.730178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:24.730223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:24.730250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:24.730268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:24.730291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 99 [2:7559592659249618919:3251]
2025-10-10T14:00:24.730348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:24.730403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:24.730417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.730429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.730442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.730489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:24.730511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:24.730532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:24.759807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 99, pipe: [1:7559592660827534478:2507]
2025-10-10T14:00:24.759917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 99
2025-10-10T14:00:24.759994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 99
2025-10-10T14:00:24.757884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.757911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.757921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.757931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.757941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:24.758240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:24.758256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.758379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:24.758548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:24.758766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:24.758884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:24.758959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592660827534478:2507], now have 1 active actors on pipe
2025-10-10T14:00:24.758982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592660827534451:3427], now have 1 active actors on pipe
2025-10-10T14:00:24.759003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592660827534310:2442], now have 1 active actors on pipe
2025-10-10T14:00:24.759025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.759039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.759051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.759061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.759121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:24.759203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:24.759262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:24.759280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:24.759291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:24.759303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:24.759380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:24.759396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:24.759507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.759537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:24.759552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:24.760308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:24.760330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:24.760394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:24.760423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.760441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.760451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:24.760490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.760535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:24.760580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:24.762755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 100 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0
2025-10-10T14:00:24.762411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:24.762442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:24.762510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:24.763847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b88f0ba-181429d2-46c44408-5d2e3531_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:24.811898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:24.811937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:24.811974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.812099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:24.812324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:24.814549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0] Write session: try to update token
2025-10-10T14:00:24.814593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:24.819934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:24.821111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:24.822264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:24.823428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:24.824888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:24.832013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.832044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.832057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.832114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:24.920138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:24.920169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:24.920184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:24.920196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:24.920208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:24.920251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.920280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.920304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.920326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592659249618913:3251]
2025-10-10T14:00:24.920492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:24.920531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:24.920543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:24.921675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:24.922754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:24.922797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:24.922829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:24.922859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
E1010 14:00:24.953733631  106846 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:00:24.958458Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:00:24.963775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId: src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:24.985583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:25.066359Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:25.068226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:25.068263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:25.071985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592660827534478:2507]
2025-10-10T14:00:25.072114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:25.072341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:25.072379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:25.069678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:25.108630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 100 reason: error at write: Disconnected sessionId: src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0
2025-10-10T14:00:25.108979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 100 sessionId: src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0 is DEAD
2025-10-10T14:00:25.109447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:25.109501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0] Write session will restart in 0.006861s
2025-10-10T14:00:25.109658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0] Write session: Do CDS request
2025-10-10T14:00:25.109707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:25.125242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:25.125273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 101
2025-10-10T14:00:25.126102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:25.131073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:25.131310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:25.131340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:25.131358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:25.133475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 101 sessionId:  describe result for acl check
2025-10-10T14:00:25.133557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:25.133565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:25.133571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:25.133582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592665122501894:3437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:25.135456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592665122501894:3437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:25.144244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:25.148236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592665122501894:3437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:25.150268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:25.151247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:25.151265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:25.151308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:25.151574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:25.151756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592663544586391:3257]
2025-10-10T14:00:25.154302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:25.155224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:25.155431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:25.156754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:25.157086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:25.157094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:25.157101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:25.157107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:25.157113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:25.157120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:25.157148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:25.157155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:25.157161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.157168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.157174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.157181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.157242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:25.157361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:25.157412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:25.157460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:25.157512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:25.157561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:25.157607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:25.157669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:25.157717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.157767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.157815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.157865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.157910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:25.157982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:25.158048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:25.158104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:25.158154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:25.158217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:25.158268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:25.158326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:25.158376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:25.158432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:25.158481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:25.158536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:25.158585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:25.158641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:25.158689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:25.158744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:25.158793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.158848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.158895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.158950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.159000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.159055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.159127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.159184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.159667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:25.163290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592665122501894:3437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:25.163322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592665122501894:3437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:25.163335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592665122501894:3437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:25.163359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:25.171953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 14 EndOffset 32 InitDone 1 WaitForData 0, pipe: [1:7559592665122501950:2507]
2025-10-10T14:00:25.199704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:25.222852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:25.222900Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:25.222918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:25.222940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:25.222963Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 100 [2:7559592663544586391:3257]
2025-10-10T14:00:25.223023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:25.223080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:25.223094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.223107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.223129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.223177Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:25.223199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:25.223221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:25.229612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.229646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.229663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.229679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.229692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:25.229977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:25.229996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.230153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.230362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.230624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.230753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:25.230833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592665122501802:2442], now have 1 active actors on pipe
2025-10-10T14:00:25.230859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592665122501948:3437], now have 1 active actors on pipe
2025-10-10T14:00:25.230881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592665122501950:2507], now have 1 active actors on pipe
2025-10-10T14:00:25.230907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592663544586385:3257]
2025-10-10T14:00:25.230923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592663544586385:3257]
2025-10-10T14:00:25.230938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592663544586385:3257]
2025-10-10T14:00:25.230951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592663544586385:3257]
2025-10-10T14:00:25.230991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:25.231069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:25.231254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:25.231267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:25.231361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592663544586385:3257]
2025-10-10T14:00:25.231372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:25.231499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:25.231509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:25.231517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:25.231525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:25.231540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:25.233993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 100
2025-10-10T14:00:25.234110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 100
2025-10-10T14:00:25.234188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 100, pipe: [1:7559592665122501950:2507]
2025-10-10T14:00:25.234561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:25.234589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:25.234645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:25.234673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.234685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.234693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:25.234716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.234748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:25.234779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:25.241871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:25.241914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:25.241995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:25.243020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 101 partition: 0 MaxSeqNo: 36 sessionId: src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0
2025-10-10T14:00:25.244540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f76f9ae-be7b3244-3ce173bf-2c2dd7c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:25.284073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0] Write session: try to update token
2025-10-10T14:00:25.284134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:25.344504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.344544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.344553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.344613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:25.344623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:25.344631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:25.344637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:25.344644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:25.344673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592663544586385:3257]
2025-10-10T14:00:25.344695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592663544586385:3257]
2025-10-10T14:00:25.344715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592663544586385:3257]
2025-10-10T14:00:25.344734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592663544586385:3257]
2025-10-10T14:00:25.344855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:25.344873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.344879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:25.345257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:25.345306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:25.345333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:25.345364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:25.357050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:25.411161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId: src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:25.442592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:25.519892Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:25.523360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:25.523406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:25.529584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:25.529639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:25.530884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592665122501950:2507]
2025-10-10T14:00:25.534844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:25.534954Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:00:25.535360Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_16497766247954288857_v1 is DEAD
2025-10-10T14:00:25.535600Z :ERROR: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:00:25.536820Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In Reconnect, ReadSizeBudget = 9011864, ReadSizeServerDelta = -8487576
2025-10-10T14:00:25.536858Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:00:25.536944Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Reconnecting session to cluster  in 0.008894s
2025-10-10T14:00:25.558167Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592407424450534:2494] disconnected; active server actors: 1
2025-10-10T14:00:25.569146Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Successfully connected. Initializing session
2025-10-10T14:00:25.569978Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592407424450534:2494] client user disconnected session shared/user_1_1_16497766247954288857_v1
2025-10-10T14:00:25.573596Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:00:25.573618Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-10T14:00:25.574172Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:00:25.574340Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 read init: from# ipv6:[::1]:40068, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:00:25.581179Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 auth for : user
2025-10-10T14:00:25.587244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 342 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 15769614 MessagesInflight: 10 }
2025-10-10T14:00:25.586022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 101 reason: error at write: Disconnected sessionId: src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0
2025-10-10T14:00:25.586291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 101 sessionId: src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0 is DEAD
2025-10-10T14:00:25.587347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:25.587374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0] Write session will restart in 0.008900s
2025-10-10T14:00:25.587450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0] Write session: Do CDS request
2025-10-10T14:00:25.587472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:25.597740Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 Handle describe topics response
2025-10-10T14:00:25.597866Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 auth is DEAD
2025-10-10T14:00:25.597935Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:00:25.598682Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:00:25.599059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:25.599319Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592665122501974:3444] connected; active server actors: 1
2025-10-10T14:00:25.599362Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559592665122501974:3444] session shared/user_1_2_667288218893573319_v1
2025-10-10T14:00:25.599409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:00:25.599465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:00:25.599503Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_667288218893573319_v1" (Sender=[1:7559592665122501970:3444], Pipe=[1:7559592665122501974:3444], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:00:25.599527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:00:25.599574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:00:25.599619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_667288218893573319_v1" (Sender=[1:7559592665122501970:3444], Pipe=[1:7559592665122501974:3444], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:00:25.599670Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_667288218893573319_v1" sender [1:7559592665122501970:3444] lock partition 0 for ReadingSession "shared/user_1_2_667288218893573319_v1" (Sender=[1:7559592665122501970:3444], Pipe=[1:7559592665122501974:3444], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-10T14:00:25.599712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:00:25.599741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000149s
2025-10-10T14:00:25.600488Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_667288218893573319_v1" ClientId: "user" PipeClient { RawX1: 7559592665122501974 RawX2: 4503603922341236 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:00:25.600568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:00:25.601324Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got InitResponse. ReadSessionId: shared/user_1_2_667288218893573319_v1
2025-10-10T14:00:25.609237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:25.609278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 102
2025-10-10T14:00:25.610814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:25.611612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:25.611744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:25.611760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:25.611771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:25.614375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 102 sessionId:  describe result for acl check
2025-10-10T14:00:25.614501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:25.614511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:25.614520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:25.614538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592665122501984:3448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:25.619420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592665122501984:3448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:25.635354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592665122501984:3448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:25.650970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592665122501984:3448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:25.651011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592665122501984:3448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:25.651027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592665122501984:3448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:25.651059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:25.697238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:25.702157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:25.702892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:25.702913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:25.702963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:25.703383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:25.703516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592663544586562:3265]
2025-10-10T14:00:25.704869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:25.705830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:25.705977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:25.706831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:25.707041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:25.707046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:25.707050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:25.707054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:25.707059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:25.707063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:25.707067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:25.707072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:25.707076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.707080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.707085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.707090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.707133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:25.707208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:25.707240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:25.707275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:25.707304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:25.707334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:25.707365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:25.707392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:25.707424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.707464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.707495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.707525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.707552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:25.707591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:25.707629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:25.707663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:25.707695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:25.707731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:25.707757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:25.707790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:25.707818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:25.707853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:25.707881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:25.707915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:25.707942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:25.707975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:25.708003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:25.708034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:25.708063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.708096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.708121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.708155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.708187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.708222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.708248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.708279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.708571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:25.740688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:25.756678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:25.756727Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:25.756743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:25.756763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:25.756786Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 101 [2:7559592663544586562:3265]
2025-10-10T14:00:25.756837Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:25.756893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:25.756906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.756916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.756927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.756973Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:25.756995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:25.757015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:25.759003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.759033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.759047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.759059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.759069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:25.759374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:25.759391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.759521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:25.759699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:25.759914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:25.760028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:25.760103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:25.760116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:25.760127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:25.760137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:25.760176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:25.760255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:25.760432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:25.760448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:25.760584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:25.760604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:25.760915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:25.760927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:25.760939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:25.760950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:25.760970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:25.762357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 101
2025-10-10T14:00:25.762467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 101
2025-10-10T14:00:25.762558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 101, pipe: [1:7559592665122501977:3447]
2025-10-10T14:00:25.762645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592665122501965:2442], now have 1 active actors on pipe
2025-10-10T14:00:25.762679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592665122502031:3448], now have 1 active actors on pipe
2025-10-10T14:00:25.762699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592665122501977:3447], now have 1 active actors on pipe
2025-10-10T14:00:25.767324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:25.767380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:25.767441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:25.767456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:25.767488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_667288218893573319_v1 on pipe: [1:7559592665122501977:3447]
2025-10-10T14:00:25.767596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:25.767634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.767653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.767663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:25.767705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.767762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:25.767817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.767840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.767850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:25.767920Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_667288218893573319_v1
2025-10-10T14:00:25.767933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.768056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:25.768109Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:00:25.768611Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_667288218893573319_v1:1 with generation 101
2025-10-10T14:00:25.768965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:25.768985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:25.769049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:25.769617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 102 partition: 0 MaxSeqNo: 36 sessionId: src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0
2025-10-10T14:00:25.770631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aed314d-ab858f29-60ec115a-a0fddb97_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:25.776147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:00:25.776234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:00:25.776259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.776270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.776281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.776312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:00:25.776349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:00:25.776841Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1760104766000 SizeLag: 18742722 WriteTimestampEstimateMS: 1760104825765 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:00:25.776882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-10T14:00:25.776976Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 sending to client partition status
2025-10-10T14:00:25.806037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0] Write session: try to update token
2025-10-10T14:00:25.806099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:25.852796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:25.852828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:25.852838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:25.852846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:25.852853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:25.852885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:25.852906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:25.852924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:25.852940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:25.853081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:25.853119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:25.853157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:25.853163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:25.853187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:25.853198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:25.853272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:25.854645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:25.915035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId: src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:25.950978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:26.020437Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:26.035966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:26.036009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:26.036073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:26.036085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:26.036123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592663544586557:3265]
2025-10-10T14:00:26.036373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:26.036624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_667288218893573319_v1
2025-10-10T14:00:26.036669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:26.036812Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_667288218893573319_v1
2025-10-10T14:00:26.040970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:26.041149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:26.056865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592665122501977:3447]
2025-10-10T14:00:26.056991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 102 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0
2025-10-10T14:00:26.057317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 102 sessionId: src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0 is DEAD
2025-10-10T14:00:26.058910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:26.058950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0] Write session will restart in 0.008874s
2025-10-10T14:00:26.059064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0] Write session: Do CDS request
2025-10-10T14:00:26.059104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:26.079000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:26.086320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:26.086350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 103
2025-10-10T14:00:26.086834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:26.086937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:26.086952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:26.086963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:26.088382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 103 sessionId:  describe result for acl check
2025-10-10T14:00:26.088502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:26.088511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:26.088519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:26.088534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592669417469517:3465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:26.090925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592669417469517:3465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:26.101265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592669417469517:3465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:26.111793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592669417469517:3465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:26.111837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592669417469517:3465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:26.111854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592669417469517:3465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:26.111888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:26.117593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:26.121950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:26.122950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:26.122984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:26.123043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:26.123380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:26.123598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592667839554048:3274]
2025-10-10T14:00:26.126124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:26.127274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:26.127558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:26.129160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:26.129545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:26.129566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:26.129574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:26.129581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:26.129589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:26.129597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:26.129605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:26.129613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:26.129621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.129628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.129636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.129644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.129697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:26.129811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:26.129868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:26.129937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:26.129986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:26.130039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:26.130089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:26.130138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:26.130187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.130240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.130288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.130338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.130385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:26.130458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:26.130526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:26.130589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:26.130644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:26.130704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:26.130754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:26.130811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:26.130866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:26.130927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:26.130996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:26.131055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:26.131119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:26.131189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:26.131245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:26.131308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:26.131365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.131427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.131487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.131547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.131599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.131655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.131705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.131761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.132248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:26.157297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592669417469631:3447]
2025-10-10T14:00:26.162080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:26.186379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:26.186427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:26.186443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:26.186462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:26.186490Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 102 [2:7559592667839554048:3274]
2025-10-10T14:00:26.186547Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:26.186611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:26.186627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.186640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.186651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.186699Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:26.186721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:26.186745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:26.188513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.188536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.188549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.188562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.188572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:26.188783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:26.188835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.188941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.189087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.189296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.189408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:26.189481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.189499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.189511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.189524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.189563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:26.189641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:26.189809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:26.189829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:26.189950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.189974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:26.191447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:26.191470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:26.191482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:26.191492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:26.191515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:26.192308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592669417469622:3465], now have 1 active actors on pipe
2025-10-10T14:00:26.192344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592669417469478:2442], now have 1 active actors on pipe
2025-10-10T14:00:26.192364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592669417469631:3447], now have 1 active actors on pipe
2025-10-10T14:00:26.197328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 102
2025-10-10T14:00:26.197408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 102
2025-10-10T14:00:26.197466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 102, pipe: [1:7559592669417469631:3447]
2025-10-10T14:00:26.201615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:26.201676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:26.201802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:26.201847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.201868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.201889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:26.201930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.201985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:26.202049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:26.205894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:26.205943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:26.206039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:26.206397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 103 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0
2025-10-10T14:00:26.209760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e97a7f-3d32b5ee-9a92d223-f2445442_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:26.258676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0] Write session: try to update token
2025-10-10T14:00:26.258734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:26.336188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.336226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.336237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.336293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:26.336306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:26.336320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:26.336330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:26.336341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:26.336375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.336401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.336425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.336447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.336656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:26.336684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.336696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:26.337262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:26.337296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:26.337327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:26.337356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:26.338095Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:26.459493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId: src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:26.488619Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:26.502943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:26.502974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:26.503021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592667839554043:3274]
2025-10-10T14:00:26.503543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:26.504101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:26.504178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:26.504190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:26.505372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:26.505674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592669417469631:3447]
2025-10-10T14:00:26.567629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 103 reason: error at write: Disconnected sessionId: src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0
2025-10-10T14:00:26.567966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 103 sessionId: src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0 is DEAD
2025-10-10T14:00:26.573418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:26.573486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0] Write session will restart in 0.005628s
2025-10-10T14:00:26.573651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0] Write session: Do CDS request
2025-10-10T14:00:26.573702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:26.591784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:26.590142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:26.590179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 104
2025-10-10T14:00:26.595120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:26.595284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:26.595301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:26.595313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:26.601462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 104 sessionId:  describe result for acl check
2025-10-10T14:00:26.601581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:26.601591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:26.601600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:26.601618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592669417469709:3472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:26.604802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592669417469709:3472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:26.606517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592669417469715:3447]
2025-10-10T14:00:26.615351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592669417469709:3472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:26.625952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592669417469709:3472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:26.625996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592669417469709:3472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:26.626012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592669417469709:3472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:26.626043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:26.647326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:26.667671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:26.668577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:26.668594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:26.668653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:26.668903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:26.669080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592667839554213:3278]
2025-10-10T14:00:26.671155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:26.672355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:26.672569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:26.673745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:26.674038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:26.674044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:26.674051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:26.674057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:26.674062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:26.674068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:26.674074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:26.674080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:26.674087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.674095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.674101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.674107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.674151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:26.674246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:26.674289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:26.674333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:26.674379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:26.674422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:26.674464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:26.674507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:26.674548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.674592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.674635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.674677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.674715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:26.674775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:26.674833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:26.674883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:26.674928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:26.674975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:26.675015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:26.675068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:26.675113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:26.675176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:26.675221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:26.675271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:26.675314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:26.675365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:26.675407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:26.675454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:26.675498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.675546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.675587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.675635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.675675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.675726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.675766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.675815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.676224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:26.724745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:26.739694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:26.739738Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:26.739754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:26.739773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:26.739798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 103 [2:7559592667839554213:3278]
2025-10-10T14:00:26.739849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:26.739907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:26.739922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.739934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.739944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.739992Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:26.740014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:26.740035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:26.772844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.772870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.772880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.772889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.772900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:26.775202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 103
2025-10-10T14:00:26.775283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 103
2025-10-10T14:00:26.775347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 103, pipe: [1:7559592669417469715:3447]
2025-10-10T14:00:26.775838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:26.775866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.775992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:26.776157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:26.776356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:26.776463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:26.776553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592669417469715:3447], now have 1 active actors on pipe
2025-10-10T14:00:26.776575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592669417469783:3472], now have 1 active actors on pipe
2025-10-10T14:00:26.776594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592669417469654:2442], now have 1 active actors on pipe
2025-10-10T14:00:26.776638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:26.776661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:26.776712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:26.776726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:26.776737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:26.776749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:26.776788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:26.776868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:26.777037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:26.777054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:26.777114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:26.777164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.777183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.777193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:26.777231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.777276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:26.777409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:26.777431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:26.777471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:26.778206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:26.778225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:26.778238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:26.778251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:26.778276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:26.780188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:26.780216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:26.780287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:26.783875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 104 partition: 0 MaxSeqNo: 36 sessionId: src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0
2025-10-10T14:00:26.784688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ac0452a-cacf612b-a7b59b5c-df224b10_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:26.793323Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 1 CurrentSessionLifetimeMs: 61391 BytesRead: 29286416 MessagesRead: 13 BytesReadCompressed: 29286416 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-10-10T14:00:26.840447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.840478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.840489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.841010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0] Write session: try to update token
2025-10-10T14:00:26.841058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:26.906420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:26.906454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:26.906465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:26.906474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:26.906484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:26.906516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:26.906540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:26.906558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:26.906576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:26.906760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:26.906792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:26.906803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:26.907245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:26.907281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:26.907307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:26.907332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:26.908223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:27.016205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId: src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:27.040844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:27.071668Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:27.084431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:27.084479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:27.084543Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:27.084556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:27.084595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592667839554207:3278]
2025-10-10T14:00:27.084819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:27.085833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:27.085875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:27.085892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:27.086017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592669417469715:3447]
2025-10-10T14:00:27.085408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:27.128804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 104 reason: error at write: Disconnected sessionId: src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0
2025-10-10T14:00:27.129068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 104 sessionId: src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0 is DEAD
2025-10-10T14:00:27.132675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:27.132725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0] Write session will restart in 0.005343s
2025-10-10T14:00:27.132839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0] Write session: Do CDS request
2025-10-10T14:00:27.132884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:27.147990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:27.148015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 105
2025-10-10T14:00:27.148391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:27.148989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:27.149119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:27.149152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:27.149164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:27.150919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 105 sessionId:  describe result for acl check
2025-10-10T14:00:27.151028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:27.151039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:27.151048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:27.151064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592673712437187:3479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:27.153960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592673712437187:3479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:27.169757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592673712437187:3479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:27.180004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592673712437187:3479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:27.180044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592673712437187:3479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:27.180061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592673712437187:3479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:27.180093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:27.182352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:27.185156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:27.185891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:27.185911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:27.185943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:27.186112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:27.186110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592673712437293:3447]
2025-10-10T14:00:27.186226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592672134521694:3287]
2025-10-10T14:00:27.187885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:27.188991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:27.189197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:27.190160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:27.190387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:27.190399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:27.190404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:27.190408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:27.190413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:27.190418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:27.190423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:27.190428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:27.190435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.190442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.190448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.190454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.190499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:27.190567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:27.190597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:27.190627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:27.190659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:27.190689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:27.190728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:27.190767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:27.190799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.190833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.190861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.190890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.190916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:27.190966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:27.191011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:27.191046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:27.191077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:27.191112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:27.191137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:27.191183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:27.191214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:27.191247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:27.191276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:27.191315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:27.191357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:27.191404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:27.191446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:27.191493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:27.191535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.191583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.191622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.191671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.191712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.191757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.191796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.191842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.192207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:27.227793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:27.240938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:27.240980Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:27.240995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:27.241012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:27.241035Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 104 [2:7559592672134521694:3287]
2025-10-10T14:00:27.241087Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:27.244166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 104
2025-10-10T14:00:27.244250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 104, pipe: [1:7559592673712437293:3447]
2025-10-10T14:00:27.244316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 104
2025-10-10T14:00:27.241328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:27.241344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.241355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.241365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.241411Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:27.241433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:27.241453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:27.243512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.243522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.243531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.243539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.243547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:27.243733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:27.243743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.243845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.244003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.244205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.244307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:27.244377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592673712437142:2442], now have 1 active actors on pipe
2025-10-10T14:00:27.244393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592673712437293:3447], now have 1 active actors on pipe
2025-10-10T14:00:27.244405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592673712437290:3479], now have 1 active actors on pipe
2025-10-10T14:00:27.244431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.244441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.244449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.244458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.244486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:27.244534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:27.244538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:27.244549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:27.244561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:27.244571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:27.244668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:27.244685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:27.244803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.244821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:27.244846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:27.244859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:27.244873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:27.244978Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23d27222-18cc122c-6f12fb08-88eb1942_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:27.245003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.245021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.245031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:27.245061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.245092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:27.245863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:27.246737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:27.246765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:27.246824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:27.247163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 105 partition: 0 MaxSeqNo: 36 sessionId: src_id|23d27222-18cc122c-6f12fb08-88eb1942_0
2025-10-10T14:00:27.248580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31ceb952-b22bbfaf-83ea738-7af5ac47_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|23d27222-18cc122c-6f12fb08-88eb1942_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:27.294047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23d27222-18cc122c-6f12fb08-88eb1942_0] Write session: try to update token
2025-10-10T14:00:27.294120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23d27222-18cc122c-6f12fb08-88eb1942_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:27.388317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.388350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.388362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.388415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:27.388429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:27.388442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:27.388452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:27.388463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:27.388499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.388527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.388551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.388576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.388778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:27.388803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.388815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:27.389285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:27.389335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:27.389367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:27.389406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:27.390620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:27.456930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId: src_id|23d27222-18cc122c-6f12fb08-88eb1942_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:27.477074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:27.540194Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:27.553185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:27.553232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:27.553303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:27.553317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:27.553358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592672134521689:3287]
2025-10-10T14:00:27.554954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:27.554975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:27.553720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:27.554496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:27.590937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592673712437293:3447]
2025-10-10T14:00:27.591099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 105 reason: error at write: Disconnected sessionId: src_id|23d27222-18cc122c-6f12fb08-88eb1942_0
2025-10-10T14:00:27.591412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 105 sessionId: src_id|23d27222-18cc122c-6f12fb08-88eb1942_0 is DEAD
2025-10-10T14:00:27.593643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d27222-18cc122c-6f12fb08-88eb1942_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:27.593677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d27222-18cc122c-6f12fb08-88eb1942_0] Write session will restart in 0.009283s
2025-10-10T14:00:27.593776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d27222-18cc122c-6f12fb08-88eb1942_0] Write session: Do CDS request
2025-10-10T14:00:27.593807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d27222-18cc122c-6f12fb08-88eb1942_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:27.608626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23d27222-18cc122c-6f12fb08-88eb1942_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:27.642981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:27.643073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:27.643088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 106
2025-10-10T14:00:27.653358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:27.653522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:27.653543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:27.653556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:27.658566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 106 sessionId:  describe result for acl check
2025-10-10T14:00:27.658721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:27.658732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:27.658741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:27.658760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592673712437392:3489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:27.671548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592673712437392:3489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:27.686026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:27.691426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592673712437454:3447]
2025-10-10T14:00:27.689947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:27.690883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:27.690903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:27.690949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:27.691246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:27.691481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592672134521869:3295]
2025-10-10T14:00:27.694140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:27.695298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:27.695533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:27.696875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:27.697248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:27.697256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:27.697264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:27.697271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:27.697279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:27.697286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:27.697294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:27.697301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:27.697310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.697316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.697326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.697334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.697383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:27.697502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:27.697555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:27.697606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:27.697656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:27.697709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:27.697773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:27.697823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:27.697872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.697924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.697974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.698024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.698064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:27.698138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:27.698202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:27.698262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:27.698315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:27.698378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:27.698427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:27.698485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:27.698536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:27.698597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:27.698645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:27.698704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:27.698757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:27.698820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:27.698869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:27.698931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:27.698988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.699049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.699100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.699178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.699232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.699293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.699345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.699404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.699899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:27.707780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592673712437392:3489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:27.718629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592673712437392:3489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:27.718668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592673712437392:3489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:27.718686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592673712437392:3489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:27.718717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:27.733275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:27.776948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:27.776998Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:27.777017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:27.777037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:27.777060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 105 [2:7559592672134521869:3295]
2025-10-10T14:00:27.777120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:27.777195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:27.777214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.777228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.777240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.777288Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:27.777319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:27.777341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:27.779562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.779580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.779594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.779624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.779637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:27.779930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:27.779947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:27.780099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:27.780301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:27.780549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:27.780678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:27.780750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:27.780767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:27.780780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:27.780794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:27.780841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:27.780928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:27.781081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:27.781097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:27.781109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:27.781120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:27.781119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:27.781995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:27.782162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592673712437351:2442], now have 1 active actors on pipe
2025-10-10T14:00:27.782188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592673712437454:3447], now have 1 active actors on pipe
2025-10-10T14:00:27.782212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592673712437493:3489], now have 1 active actors on pipe
2025-10-10T14:00:27.782233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:27.782272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:27.782256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 105
2025-10-10T14:00:27.782345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 105, pipe: [1:7559592673712437454:3447]
2025-10-10T14:00:27.782423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 105
2025-10-10T14:00:27.782584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:27.783227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:27.783260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:27.783345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:27.783376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.783394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.783406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:27.783441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.783482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:27.783534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:27.784590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:27.784619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:27.784696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:27.785039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 106 partition: 0 MaxSeqNo: 36 sessionId: src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0
2025-10-10T14:00:27.789627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23d27222-18cc122c-6f12fb08-88eb1942_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:27.826989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0] Write session: try to update token
2025-10-10T14:00:27.827048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:27.922596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:27.922630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:27.922668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:27.922786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.922806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.922818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.922929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:27.924787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:27.925353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:27.926039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:27.927260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:27.928419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:27.930317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:27.979481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId: src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:27.999776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:27.999923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:27.999938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:27.999952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:27.999971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:27.999986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:28.000024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:28.000050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:28.000071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:28.000095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592672134521863:3295]
2025-10-10T14:00:28.000205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:28.000241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:28.000243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:28.000271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.000272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:28.000283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:28.000301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:28.008507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:28.022534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:28.151681Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:28.162756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592673712437454:3447]
2025-10-10T14:00:28.162765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:28.162780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:28.162826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:28.161948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:28.161998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:28.163204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:28.174594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 106 reason: error at write: Disconnected sessionId: src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0
2025-10-10T14:00:28.174889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 106 sessionId: src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0 is DEAD
2025-10-10T14:00:28.181388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:28.181431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0] Write session will restart in 0.005073s
2025-10-10T14:00:28.181577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0] Write session: Do CDS request
2025-10-10T14:00:28.181647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:28.210724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:28.213438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:28.213471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 107
2025-10-10T14:00:28.213807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:28.214078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:28.214117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:28.214141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:28.216999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 107 sessionId:  describe result for acl check
2025-10-10T14:00:28.217279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:28.217301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:28.217311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:28.217329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592678007404831:3499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:28.220695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592678007404831:3499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:28.237541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592678007404831:3499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:28.254009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592678007404831:3499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:28.254056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592678007404831:3499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:28.254074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592678007404831:3499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:28.254115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:28.261800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592678007404966:3447]
2025-10-10T14:00:28.268173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:28.272488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:28.273373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:28.273403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:28.273446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:28.273718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:28.273907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592676429489349:3301]
2025-10-10T14:00:28.276112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:28.277079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:28.277297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:28.278511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:28.278821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:28.278840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:28.278846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:28.278851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:28.278858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:28.278863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:28.278869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:28.278874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:28.278880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.278886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.278892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.278898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.278942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:28.279043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:28.279085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:28.279129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:28.279168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:28.279227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:28.279268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:28.279320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:28.279364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.279408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.279449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.279493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.279532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:28.279591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:28.279646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:28.279697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:28.279742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:28.279792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:28.279843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:28.279892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:28.279935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:28.279985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:28.280028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:28.280076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:28.280122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:28.280170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:28.280213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:28.280262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:28.280304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.280351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.280392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.280440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.280483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.280531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.281607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.281668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.282024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:28.323043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:28.349931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:28.349976Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:28.349989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:28.350005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:28.350028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 106 [2:7559592676429489349:3301]
2025-10-10T14:00:28.350081Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:28.350141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:28.350156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.350167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.350179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.350226Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:28.350247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:28.350268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:28.376723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.376754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.376766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.376777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.376786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:28.377048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:28.377062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.377704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.377877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.378140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.378333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:28.378429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592678007404951:3499], now have 1 active actors on pipe
2025-10-10T14:00:28.378458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592678007404816:2442], now have 1 active actors on pipe
2025-10-10T14:00:28.378489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592678007404966:3447], now have 1 active actors on pipe
2025-10-10T14:00:28.378518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.378533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.378544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.378556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.378599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:28.378678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:28.378839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:28.378854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:28.378985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.379004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:28.379690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:28.379710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:28.379720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:28.379733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:28.379758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:28.381593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 106
2025-10-10T14:00:28.381706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 106
2025-10-10T14:00:28.381766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 106, pipe: [1:7559592678007404966:3447]
2025-10-10T14:00:28.384859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:28.384899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:28.384981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:28.385016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.385035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.385044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:28.385082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.385144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:28.385186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:28.387698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 107 partition: 0 MaxSeqNo: 36 sessionId: src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0
2025-10-10T14:00:28.387146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:28.387207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:28.387292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:28.389355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7a9ac08-9e36c441-790ac11c-4a1566b1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:28.441914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0] Write session: try to update token
2025-10-10T14:00:28.441973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:28.452387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.452421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.452432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.585102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:28.585157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:28.585170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:28.585181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:28.585194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:28.585231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.585258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.585284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.585308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.585539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.585552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.585564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.585607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:28.585633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.585645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:28.586898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:28.588958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:28.588995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:28.589014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:28.589033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:28.627639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId: src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:28.656349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:28.734365Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:28.751708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:28.751751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:28.751808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:28.751817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:28.751844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592676429489343:3301]
2025-10-10T14:00:28.752713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:28.753010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:28.754733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592678007404966:3447]
2025-10-10T14:00:28.754777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:28.754959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:28.802928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 107 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0
2025-10-10T14:00:28.803274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 107 sessionId: src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0 is DEAD
2025-10-10T14:00:28.805622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:28.805662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0] Write session will restart in 0.008138s
2025-10-10T14:00:28.805760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0] Write session: Do CDS request
2025-10-10T14:00:28.805790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:28.823814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:28.823760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:28.823793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 108
2025-10-10T14:00:28.824644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:28.824762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:28.824779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:28.824790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:28.826111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 108 sessionId:  describe result for acl check
2025-10-10T14:00:28.826236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:28.826246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:28.826255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:28.826271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592678007405092:3505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:28.828863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592678007405092:3505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:28.834494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592678007405092:3505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:28.840111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:28.841691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592678007405092:3505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:28.841720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592678007405092:3505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:28.841730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592678007405092:3505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:28.841750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:28.843868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:28.844418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:28.844429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:28.844454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:28.844602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:28.844710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592676429489541:3309]
2025-10-10T14:00:28.846051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:28.847046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:28.847274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:28.848571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:28.848894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:28.848912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:28.848919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:28.848927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:28.848933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:28.848939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:28.848947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:28.848956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:28.848963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.848973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.848981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.848990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.849040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:28.849166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:28.849217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:28.849265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:28.849310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:28.849360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:28.849409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:28.849455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:28.849501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.849550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.849606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.849650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.849694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:28.849758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:28.849816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:28.849888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:28.849944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:28.850006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:28.850059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:28.850120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:28.850175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:28.850232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:28.850276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:28.850329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:28.850377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:28.850434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:28.850479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:28.850536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:28.850584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.850641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.850690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.850747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.850801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.850857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.850903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.850949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.851409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:28.857182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592678007405161:3447]
2025-10-10T14:00:28.879182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:28.891896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:28.891944Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:28.891961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:28.891980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:28.892004Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 107 [2:7559592676429489541:3309]
2025-10-10T14:00:28.892058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:28.892119Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:28.892132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.892144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.892155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.892203Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:28.892233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:28.892254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:28.893690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.893717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.893729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.893742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.893754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:28.894019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:28.894038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.894169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:28.894340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:28.894557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:28.894663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:28.894737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592676429489535:3309]
2025-10-10T14:00:28.894751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592676429489535:3309]
2025-10-10T14:00:28.894763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592676429489535:3309]
2025-10-10T14:00:28.894774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592676429489535:3309]
2025-10-10T14:00:28.894816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:28.894896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:28.895073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:28.895089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:28.895232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592676429489535:3309]
2025-10-10T14:00:28.895252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:28.895534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:28.895545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:28.895555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:28.895565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:28.895588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:28.896438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592678007405161:3447], now have 1 active actors on pipe
2025-10-10T14:00:28.896468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592678007405156:3505], now have 1 active actors on pipe
2025-10-10T14:00:28.896490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592678007405003:2442], now have 1 active actors on pipe
2025-10-10T14:00:28.897072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 107, pipe: [1:7559592678007405161:3447]
2025-10-10T14:00:28.897187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 107
2025-10-10T14:00:28.897197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 107
2025-10-10T14:00:28.898163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:28.898202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:28.898294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:28.898326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.898343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.898352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:28.898388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.898434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:28.898478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:28.899415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:28.899437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:28.899501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:28.899792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 108 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0
2025-10-10T14:00:28.902439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cfff787-4d9ccbc7-acc9a32e-2d7f63b2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:28.941885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0] Write session: try to update token
2025-10-10T14:00:28.941946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:28.991342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:28.991394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:28.991417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:28.991436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:28.991447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:28.991497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592676429489535:3309]
2025-10-10T14:00:28.991537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592676429489535:3309]
2025-10-10T14:00:28.991575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592676429489535:3309]
2025-10-10T14:00:28.991610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592676429489535:3309]
2025-10-10T14:00:28.991822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:28.991851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:28.991862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:28.992324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:28.992367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:28.992392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:28.992449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:29.001411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:29.045231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId: src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:29.085615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:29.175236Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:29.178175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:29.178224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:29.182177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:29.186392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592678007405161:3447]
2025-10-10T14:00:29.186539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:29.197609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 108 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0
2025-10-10T14:00:29.197980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 108 sessionId: src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0 is DEAD
2025-10-10T14:00:29.201632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:29.201682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0] Write session will restart in 0.005473s
2025-10-10T14:00:29.201806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0] Write session: Do CDS request
2025-10-10T14:00:29.201840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:29.216651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:29.228059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:29.228197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:29.228211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 109
2025-10-10T14:00:29.228560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:29.228663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:29.228677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:29.228688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:29.234042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 109 sessionId:  describe result for acl check
2025-10-10T14:00:29.234191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:29.234203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:29.234212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:29.234229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592682302372496:3516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:29.236691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592682302372496:3516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:29.287122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592682302372573:3447]
2025-10-10T14:00:29.296210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592682302372496:3516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:29.320338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592682302372496:3516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:29.320383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592682302372496:3516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:29.320401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592682302372496:3516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:29.320433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:29.346662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:29.351897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:29.353210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:29.353243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:29.353295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:29.353613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:29.353823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592680724457015:3318]
2025-10-10T14:00:29.356357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:29.360599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:29.360859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:29.362696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:29.363128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:29.363139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:29.363147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:29.363155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:29.363162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:29.363169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:29.363177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:29.363184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:29.363193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:29.363218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:29.363226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:29.363234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:29.363289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:29.363416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:29.363474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:29.363526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:29.363580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:29.363635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:29.363687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:29.363744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:29.363797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:29.363847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:29.363899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:29.363953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:29.364002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:29.364075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:29.364147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:29.364209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:29.364265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:29.364327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:29.364377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:29.364438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:29.364496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:29.364557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:29.364607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:29.364668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:29.364719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:29.364773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:29.364819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:29.364871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:29.364924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:29.364978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:29.365034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:29.365097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:29.365181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:29.365243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:29.365292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:29.365350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:29.365847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:29.409597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:29.424701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:29.424744Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:29.424764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:29.424786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:29.424809Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 108 [2:7559592680724457015:3318]
2025-10-10T14:00:29.424869Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:29.424934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:29.424950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.424963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.424976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.425027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:29.425059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:29.425083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:29.427723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:29.427763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:29.427779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:29.427794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:29.427806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:29.428144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:29.428176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:29.428341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:29.428557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:29.428835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:29.428980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:29.429075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592682302372492:2442], now have 1 active actors on pipe
2025-10-10T14:00:29.429112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592682302372573:3447], now have 1 active actors on pipe
2025-10-10T14:00:29.429156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592682302372632:3516], now have 1 active actors on pipe
2025-10-10T14:00:29.429183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.429204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.429218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.429231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.429284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:29.429381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:29.429333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 108
2025-10-10T14:00:29.429595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:29.429432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 108, pipe: [1:7559592682302372573:3447]
2025-10-10T14:00:29.429618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:29.429528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 108
2025-10-10T14:00:29.429753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.429783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:29.430647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:29.430679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:29.430693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:29.430704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:29.430732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:29.431113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:29.431153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:29.431255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f461a567-e342c526-982bb069-5768a123_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:29.431292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.431309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.431319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:29.431350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.431389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:29.431435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:29.434267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:29.434311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:29.434388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:29.437349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 109 partition: 0 MaxSeqNo: 36 sessionId: src_id|f461a567-e342c526-982bb069-5768a123_0
2025-10-10T14:00:29.438386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1e3729-deee94cc-d6a44e1a-9e95c8cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f461a567-e342c526-982bb069-5768a123_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:29.495931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f461a567-e342c526-982bb069-5768a123_0] Write session: try to update token
2025-10-10T14:00:29.495988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f461a567-e342c526-982bb069-5768a123_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:29.683524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId: src_id|f461a567-e342c526-982bb069-5768a123_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:29.701006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.701046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.701057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.701114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:29.701146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:29.701161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:29.701174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:29.701185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:29.701222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.701249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.701272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.701296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.701500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:29.701527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:29.701541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:29.702823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:29.705264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:29.705299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:29.705330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:29.705362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:29.725424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:29.869059Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:29.889078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:29.889153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:29.889243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:29.889263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:29.889304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592680724457009:3318]
2025-10-10T14:00:29.889414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:29.889921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:29.895519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:29.895760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592682302372573:3447]
2025-10-10T14:00:29.895910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:29.945862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f461a567-e342c526-982bb069-5768a123_0
2025-10-10T14:00:29.946205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 109 sessionId: src_id|f461a567-e342c526-982bb069-5768a123_0 is DEAD
2025-10-10T14:00:29.949815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f461a567-e342c526-982bb069-5768a123_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:29.949854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f461a567-e342c526-982bb069-5768a123_0] Write session will restart in 0.009022s
2025-10-10T14:00:29.949965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f461a567-e342c526-982bb069-5768a123_0] Write session: Do CDS request
2025-10-10T14:00:29.950001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f461a567-e342c526-982bb069-5768a123_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:29.968019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:29.968052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 110
2025-10-10T14:00:29.969024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f461a567-e342c526-982bb069-5768a123_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:29.969816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:29.970011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:29.970031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:29.970044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:29.971881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 110 sessionId:  describe result for acl check
2025-10-10T14:00:29.972019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:29.972031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:29.972041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:29.972060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592682302372786:3526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:29.975096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592682302372786:3526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:29.982365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592682302372786:3526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:29.992339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592682302372839:3447]
2025-10-10T14:00:29.994505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592682302372786:3526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:29.994546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592682302372786:3526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:29.994563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592682302372786:3526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:29.994598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:29.995741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:30.003131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:30.004062Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:30.004093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:30.004137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:30.004407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:30.004601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592685019424495:3328]
2025-10-10T14:00:30.006868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:30.007966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:30.008137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:30.009154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:30.009409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:30.009414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:30.009419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:30.009423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:30.009427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:30.009430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:30.009435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:30.009439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:30.009444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.009448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.009452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.009456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.009486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:30.009557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:30.009589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:30.009625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:30.009666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:30.009699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:30.009736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:30.009767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:30.009802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.009843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.009872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.009902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.009926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:30.009967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:30.010005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:30.010050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:30.010081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:30.010116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:30.010155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:30.010191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:30.010228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:30.010264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:30.010290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:30.010332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:30.010365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:30.010397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:30.010423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:30.010455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:30.010484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.010516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.010541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.010572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.010599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.010634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.010675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.010714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.011050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:30.065665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:30.092052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:30.092099Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:30.092113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:30.092130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:30.092152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 109 [2:7559592685019424495:3328]
2025-10-10T14:00:30.092202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:30.092258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:30.092274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.092286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.092296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.092341Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:30.092362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:30.092383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:30.123563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.123591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.123602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.123612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.123621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:30.123908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:30.123924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.124048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.124206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.124407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.124508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:30.124573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592680724457192:3328]
2025-10-10T14:00:30.124587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592680724457192:3328]
2025-10-10T14:00:30.124600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592680724457192:3328]
2025-10-10T14:00:30.124611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592680724457192:3328]
2025-10-10T14:00:30.124657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:30.124731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:30.124890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:30.124905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:30.125022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592680724457192:3328]
2025-10-10T14:00:30.125039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:30.126903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 109
2025-10-10T14:00:30.126991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 109, pipe: [1:7559592682302372839:3447]
2025-10-10T14:00:30.127074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 109
2025-10-10T14:00:30.125743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:30.125762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:30.125772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:30.125781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:30.125802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:30.134954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592682302372842:3526], now have 1 active actors on pipe
2025-10-10T14:00:30.134990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592682302372839:3447], now have 1 active actors on pipe
2025-10-10T14:00:30.135011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592682302372686:2442], now have 1 active actors on pipe
2025-10-10T14:00:30.135079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:30.135101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:30.135197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9486a472-43cbf995-75546132-209d7228_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:30.135246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.135265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.135275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:30.135312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.135356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:30.135407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:30.139395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 110 partition: 0 MaxSeqNo: 36 sessionId: src_id|9486a472-43cbf995-75546132-209d7228_0
2025-10-10T14:00:30.138910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:30.138947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:30.139021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:30.140738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f461a567-e342c526-982bb069-5768a123_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9486a472-43cbf995-75546132-209d7228_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:30.192607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.192637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.192649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.197159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9486a472-43cbf995-75546132-209d7228_0] Write session: try to update token
2025-10-10T14:00:30.197214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9486a472-43cbf995-75546132-209d7228_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:30.263142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:30.263176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:30.263189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:30.263200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:30.263211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:30.263263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592680724457192:3328]
2025-10-10T14:00:30.263289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592680724457192:3328]
2025-10-10T14:00:30.263310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592680724457192:3328]
2025-10-10T14:00:30.263336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592680724457192:3328]
2025-10-10T14:00:30.263482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:30.263480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:30.263508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.263511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:30.263518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:30.263539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:30.263585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:30.265362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:30.369238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId: src_id|9486a472-43cbf995-75546132-209d7228_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:30.417265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:30.477970Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:30.479982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:30.480017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:30.482884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:30.482375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592682302372839:3447]
2025-10-10T14:00:30.482458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:30.482604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:30.482616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:30.501988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 110 reason: error at write: Disconnected sessionId: src_id|9486a472-43cbf995-75546132-209d7228_0
2025-10-10T14:00:30.502319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 110 sessionId: src_id|9486a472-43cbf995-75546132-209d7228_0 is DEAD
2025-10-10T14:00:30.506248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9486a472-43cbf995-75546132-209d7228_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:30.506293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9486a472-43cbf995-75546132-209d7228_0] Write session will restart in 0.005491s
2025-10-10T14:00:30.506402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9486a472-43cbf995-75546132-209d7228_0] Write session: Do CDS request
2025-10-10T14:00:30.506440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9486a472-43cbf995-75546132-209d7228_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:30.526613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9486a472-43cbf995-75546132-209d7228_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:30.530352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:30.530377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 111
2025-10-10T14:00:30.531157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:30.531323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:30.531340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:30.531352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:30.546492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 111 sessionId:  describe result for acl check
2025-10-10T14:00:30.546615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:30.546627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:30.546638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:30.546655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592686597340177:3533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:30.550000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592686597340177:3533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:30.556709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592686597340177:3533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:30.568134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592686597340177:3533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:30.568173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592686597340177:3533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:30.568191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592686597340177:3533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:30.568222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:30.583476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592686597340244:3447]
2025-10-10T14:00:30.620854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:30.623787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:30.624422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:30.624433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:30.624459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:30.624630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:30.624750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592685019424694:3337]
2025-10-10T14:00:30.626651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:30.627965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:30.628211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:30.629671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:30.630040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:30.630050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:30.630057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:30.630066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:30.630076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:30.630084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:30.630092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:30.630100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:30.630108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.630116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.630123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.630130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.630186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:30.630311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:30.630363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:30.630420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:30.630473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:30.630524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:30.630573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:30.630622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:30.630674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.630730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.630776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.630825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.630868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:30.630941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:30.631008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:30.631067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:30.631127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:30.631189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:30.631257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:30.631318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:30.631371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:30.631433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:30.631483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:30.631542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:30.631593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:30.631650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:30.631699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:30.631756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:30.631806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.631863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.631910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.631969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.632021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.632102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.632151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.632223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.632727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:30.664727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:30.689527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:30.689574Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:30.689592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:30.689614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:30.689637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 110 [2:7559592685019424694:3337]
2025-10-10T14:00:30.689695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:30.689765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:30.689780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.689793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.689804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.689852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:30.689874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:30.689898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:30.693416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.693449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.693466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.693479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.693489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:30.693769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:30.693786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.693939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:30.694134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:30.694382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:30.694503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:30.694578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.694594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.694609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.694623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.694664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:30.694742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:30.694948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:30.694966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:30.694997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:30.695011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:30.695022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:30.695034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:30.695088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.695110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:30.695279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:30.698300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592686597340215:3533], now have 1 active actors on pipe
2025-10-10T14:00:30.698349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592686597340244:3447], now have 1 active actors on pipe
2025-10-10T14:00:30.698372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592686597340162:2442], now have 1 active actors on pipe
2025-10-10T14:00:30.701065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 110, pipe: [1:7559592686597340244:3447]
2025-10-10T14:00:30.701197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 110
2025-10-10T14:00:30.701418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 110
2025-10-10T14:00:30.703851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:30.703893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:30.703974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:30.705023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 111 partition: 0 MaxSeqNo: 36 sessionId: src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0
2025-10-10T14:00:30.704008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.704027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.704038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:30.704075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.704121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:30.704171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:30.704669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:30.704688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:30.704751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:30.709361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9486a472-43cbf995-75546132-209d7228_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:30.775386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0] Write session: try to update token
2025-10-10T14:00:30.775450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:30.777957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:30.777994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:30.778031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.778158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:30.779154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:30.785313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:30.786598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:30.787861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:30.809889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:30.811818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:30.812204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.812218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.812231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.812287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:30.921527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:30.921565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:30.921578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:30.921589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:30.921600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:30.921641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.921669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.921693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.921719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592685019424688:3337]
2025-10-10T14:00:30.921896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.921911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.921925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.921973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:30.921999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:30.922011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:30.923340Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:30.927907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:30.927959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:30.927988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:30.928020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:30.957073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId: src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:31.006137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:31.090080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:31.103715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:31.103762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:31.104419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:31.104645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:31.104673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:31.138601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592686597340244:3447]
2025-10-10T14:00:31.138688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 111 reason: error at write: Disconnected sessionId: src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0
2025-10-10T14:00:31.139040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 111 sessionId: src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0 is DEAD
2025-10-10T14:00:31.142299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:31.142374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0] Write session will restart in 0.009187s
2025-10-10T14:00:31.142553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0] Write session: Do CDS request
2025-10-10T14:00:31.142611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:31.156770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:31.168970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:31.169251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:31.169273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 112
2025-10-10T14:00:31.169730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:31.169856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:31.169872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:31.169882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:31.172816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 112 sessionId:  describe result for acl check
2025-10-10T14:00:31.172944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:31.172954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:31.172963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:31.172981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592690892307722:3548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:31.175583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592690892307722:3548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:31.190389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592690892307722:3548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:31.204878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:31.209767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592690892307722:3548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:31.209811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592690892307722:3548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:31.209828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592690892307722:3548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:31.209857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:31.209196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:31.209980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:31.209996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:31.210037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:31.210288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:31.210464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592689314392168:3339]
2025-10-10T14:00:31.217363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:31.218734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:31.218995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:31.220266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:31.220571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:31.220580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:31.220587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:31.220592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:31.220599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:31.220605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:31.220611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:31.220618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:31.220623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.220631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.220637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.220643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.220690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:31.220791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:31.220837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:31.220881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:31.220925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:31.220970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:31.221013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:31.221056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:31.221101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.221172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.221215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.221258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.221296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:31.221358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:31.221417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:31.221470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:31.221515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:31.221563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:31.221605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:31.221657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:31.221702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:31.221755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:31.221797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:31.221845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:31.221891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:31.221940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:31.221982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:31.222029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:31.222074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.222121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.222165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.222214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.222259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.222308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.222349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.222397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.222810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:31.239976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592690892307833:3447]
2025-10-10T14:00:31.283017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:31.299259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:31.299309Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:31.299325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:31.299346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:31.299369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 111 [2:7559592689314392168:3339]
2025-10-10T14:00:31.299423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:31.299482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:31.299497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.299510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.299521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.299566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:31.299587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:31.299609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:31.302448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.302478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.302491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.302504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.302514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:31.302781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:31.302797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.302939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.303113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.303350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.303466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:31.303540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.303554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.303565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.303576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.303609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:31.303689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:31.303856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:31.303874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:31.303998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.304016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:31.305505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:31.305534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:31.305544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:31.305555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:31.305582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:31.306367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592690892307827:3548], now have 1 active actors on pipe
2025-10-10T14:00:31.306400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592690892307833:3447], now have 1 active actors on pipe
2025-10-10T14:00:31.306423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592690892307709:2442], now have 1 active actors on pipe
2025-10-10T14:00:31.312534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 111, pipe: [1:7559592690892307833:3447]
2025-10-10T14:00:31.312663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 111
2025-10-10T14:00:31.312758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 111
2025-10-10T14:00:31.316789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:31.316835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:31.316926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34fefe23-dfc78a02-d388f489-3f439539_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:31.316969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.316989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.317002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:31.317048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.317099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:31.317166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:31.320454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:31.320493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:31.320576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:31.321306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 112 partition: 0 MaxSeqNo: 36 sessionId: src_id|34fefe23-dfc78a02-d388f489-3f439539_0
2025-10-10T14:00:31.322224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ea6230-3a209b3a-7d02fb5e-a0c51388_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|34fefe23-dfc78a02-d388f489-3f439539_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:31.351531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:31.351566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:31.351604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.351737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:31.352360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:31.356925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:31.369728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:31.371502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:31.373020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:31.374938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:31.376283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:31.391042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fefe23-dfc78a02-d388f489-3f439539_0] Write session: try to update token
2025-10-10T14:00:31.391093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fefe23-dfc78a02-d388f489-3f439539_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:31.400129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.400164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.400178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.476011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:31.476064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:31.476080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:31.476091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:31.476103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:31.476143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.476171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.476194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.476231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592689314392162:3339]
2025-10-10T14:00:31.476385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:31.476416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:31.476446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.476448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:31.476457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:31.476476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:31.476503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:31.477997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:31.507580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId: src_id|34fefe23-dfc78a02-d388f489-3f439539_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:31.539767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:31.622897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:31.626090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:31.626135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:31.626956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:31.626772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:31.626803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:31.629351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592690892307833:3447]
2025-10-10T14:00:31.629471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:31.638440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 112 reason: error at write: Disconnected sessionId: src_id|34fefe23-dfc78a02-d388f489-3f439539_0
2025-10-10T14:00:31.638764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 112 sessionId: src_id|34fefe23-dfc78a02-d388f489-3f439539_0 is DEAD
2025-10-10T14:00:31.639559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fefe23-dfc78a02-d388f489-3f439539_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:31.639642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fefe23-dfc78a02-d388f489-3f439539_0] Write session will restart in 0.008563s
2025-10-10T14:00:31.639814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fefe23-dfc78a02-d388f489-3f439539_0] Write session: Do CDS request
2025-10-10T14:00:31.639869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fefe23-dfc78a02-d388f489-3f439539_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:31.654281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:31.654326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 113
2025-10-10T14:00:31.654513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fefe23-dfc78a02-d388f489-3f439539_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:31.655352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:31.655574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:31.655596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:31.655616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:31.657589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 113 sessionId:  describe result for acl check
2025-10-10T14:00:31.657798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:31.657828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:31.657844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:31.657864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592690892307873:3555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:31.661209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592690892307873:3555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:31.674882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592690892307873:3555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:31.714508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592690892307873:3555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:31.714552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592690892307873:3555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:31.714567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592690892307873:3555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:31.714599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:31.732014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592690892308014:3447]
2025-10-10T14:00:31.741274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:31.743648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:31.744405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:31.744422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:31.744466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:31.744708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:31.744879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592689314392356:3351]
2025-10-10T14:00:31.746956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:31.747938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:31.748152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:31.749053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:31.749313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:31.749320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:31.749326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:31.749332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:31.749338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:31.749343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:31.749349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:31.749358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:31.749363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.749369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.749375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.749381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.749423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:31.749514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:31.749554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:31.749592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:31.749629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:31.749669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:31.749707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:31.749757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:31.749796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.749837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.749876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.749915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.749951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:31.750010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:31.750056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:31.750101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:31.750138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:31.750181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:31.750218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:31.750265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:31.750297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:31.750335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:31.750372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:31.750415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:31.750453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:31.750500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:31.750539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:31.750584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:31.750626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.750669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.750707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.750746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.750785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.750825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.750850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.750883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.751223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:31.782161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:31.798606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:31.798660Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:31.798677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:31.798696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:31.798720Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 112 [2:7559592689314392356:3351]
2025-10-10T14:00:31.798776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:31.798831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:31.798845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.798856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.798868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.798916Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:31.798939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:31.798961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:31.801657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.801688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.801703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.801717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.801728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:31.801991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:31.802007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.802148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:31.802333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:31.802561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:31.805199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 112, pipe: [1:7559592690892308014:3447]
2025-10-10T14:00:31.802654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:31.802705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592689314392351:3351]
2025-10-10T14:00:31.802714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592689314392351:3351]
2025-10-10T14:00:31.802723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592689314392351:3351]
2025-10-10T14:00:31.802732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592689314392351:3351]
2025-10-10T14:00:31.802764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:31.802837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:31.805302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 112
2025-10-10T14:00:31.803015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:31.805393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 112
2025-10-10T14:00:31.803031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:31.803149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592689314392351:3351]
2025-10-10T14:00:31.803167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:31.803378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:31.803388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:31.803395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:31.803403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:31.803418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:31.803731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592690892308014:3447], now have 1 active actors on pipe
2025-10-10T14:00:31.803890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592690892307973:3555], now have 1 active actors on pipe
2025-10-10T14:00:31.803948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592690892307859:2442], now have 1 active actors on pipe
2025-10-10T14:00:31.809797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 113 partition: 0 MaxSeqNo: 36 sessionId: src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0
2025-10-10T14:00:31.808329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:31.808376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:31.808479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:31.808524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.808543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.808555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:31.808588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.808647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:31.808699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:31.809407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:31.809431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:31.809496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:31.810877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fefe23-dfc78a02-d388f489-3f439539_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:31.857546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0] Write session: try to update token
2025-10-10T14:00:31.857602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:31.927684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.927717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.927729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.927790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:31.927806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:31.927819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:31.927830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:31.927841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:31.927877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592689314392351:3351]
2025-10-10T14:00:31.927904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592689314392351:3351]
2025-10-10T14:00:31.927927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592689314392351:3351]
2025-10-10T14:00:31.927948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592689314392351:3351]
2025-10-10T14:00:31.928089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:31.928096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:31.928116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:31.928127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:31.928128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:31.928164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:31.928200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:31.929213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:32.048168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId: src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:32.078885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:32.145900Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:32.147667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:32.147698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:32.150061Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:32.150934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592690892308014:3447]
2025-10-10T14:00:32.151038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:32.151053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:32.153296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:32.197848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 113 reason: error at write: Disconnected sessionId: src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0
2025-10-10T14:00:32.198183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 113 sessionId: src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0 is DEAD
2025-10-10T14:00:32.201930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:32.201996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0] Write session will restart in 0.005954s
2025-10-10T14:00:32.202186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0] Write session: Do CDS request
2025-10-10T14:00:32.202228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:32.219730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:32.217439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:32.217470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 114
2025-10-10T14:00:32.220473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:32.220617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:32.220633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:32.220645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:32.222919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 114 sessionId:  describe result for acl check
2025-10-10T14:00:32.223029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:32.223039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:32.223048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:32.223064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592695187275394:3562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:32.226358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592695187275394:3562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:32.248395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592695187275394:3562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:32.252701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592695187275455:3447]
2025-10-10T14:00:32.276198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592695187275394:3562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:32.276248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592695187275394:3562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:32.276266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592695187275394:3562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:32.276298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:32.293492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:32.297367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:32.298225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:32.298243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:32.298289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:32.298552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:32.298735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592693609359854:3359]
2025-10-10T14:00:32.301005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:32.302278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:32.302521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:32.303737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:32.304218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:32.304236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:32.304243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:32.304249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:32.304256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:32.304263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:32.304270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:32.304278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:32.304285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.304293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.304299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.304305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.304353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:32.304455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:32.304520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:32.304568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:32.304612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:32.304655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:32.304700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:32.304740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:32.304784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.304833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.304876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.304920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.304963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:32.305030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:32.305087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:32.305159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:32.305212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:32.305271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:32.305320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:32.305375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:32.305427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:32.305482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:32.305530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:32.305583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:32.305628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:32.305679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:32.305721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:32.305769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:32.305816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.305866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.305905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.305956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.306002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.306054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.306098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.306147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.306560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:32.349007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:32.364090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:32.364307Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:32.364324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:32.364344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:32.364365Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 113 [2:7559592693609359854:3359]
2025-10-10T14:00:32.364420Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:32.364483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:32.364498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.364510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.364522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.364568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:32.364591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:32.364613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:32.366118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.366135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.366147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.366161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.366172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:32.366443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:32.366460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.366600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.366771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.366983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.367092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:32.367165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.367179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.367191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.367203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.367236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:32.367331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:32.367504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:32.367521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:32.367670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.367694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:32.370763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 113
2025-10-10T14:00:32.370841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 113, pipe: [1:7559592695187275455:3447]
2025-10-10T14:00:32.370908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 113
2025-10-10T14:00:32.368678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:32.368697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:32.368707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:32.368719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:32.368745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:32.369681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592695187275504:3562], now have 1 active actors on pipe
2025-10-10T14:00:32.369705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592695187275455:3447], now have 1 active actors on pipe
2025-10-10T14:00:32.369723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592695187275351:2442], now have 1 active actors on pipe
2025-10-10T14:00:32.374614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:32.374652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:32.374752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3d95e8e-e320479c-815306c-53c99225_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:32.374789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.374808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.374818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:32.374858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.374906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:32.374955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:32.375670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:32.375695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:32.375755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:32.376106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 114 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3d95e8e-e320479c-815306c-53c99225_0
2025-10-10T14:00:32.381389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd7ce0fc-74948a76-1ae9a07d-6ac968bb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3d95e8e-e320479c-815306c-53c99225_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:32.487670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.487704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.487717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.487778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:32.487792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:32.487831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.487960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:32.489334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:32.491205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d95e8e-e320479c-815306c-53c99225_0] Write session: try to update token
2025-10-10T14:00:32.491258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d95e8e-e320479c-815306c-53c99225_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:32.505688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:32.510275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:32.511491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:32.521161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:32.522894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:32.523346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:32.589018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:32.589054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:32.589068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:32.589080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:32.589091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:32.589156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.589183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.589205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.589228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592693609359848:3359]
2025-10-10T14:00:32.589398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.589410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.589421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.589472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:32.589498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.589509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:32.590619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:32.593252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:32.593286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:32.593314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:32.593344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:32.673284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId: src_id|f3d95e8e-e320479c-815306c-53c99225_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:32.713296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:32.772747Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:32.774657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:32.774702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:32.780691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:32.780832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:32.780844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:32.780106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:32.812760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 114 reason: error at write: Disconnected sessionId: src_id|f3d95e8e-e320479c-815306c-53c99225_0
2025-10-10T14:00:32.813111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 114 sessionId: src_id|f3d95e8e-e320479c-815306c-53c99225_0 is DEAD
2025-10-10T14:00:32.814455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d95e8e-e320479c-815306c-53c99225_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:32.814486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d95e8e-e320479c-815306c-53c99225_0] Write session will restart in 0.006397s
2025-10-10T14:00:32.814584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d95e8e-e320479c-815306c-53c99225_0] Write session: Do CDS request
2025-10-10T14:00:32.814612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d95e8e-e320479c-815306c-53c99225_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:32.830627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d95e8e-e320479c-815306c-53c99225_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:32.829508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592695187275455:3447]
2025-10-10T14:00:32.838948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:32.838975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 115
2025-10-10T14:00:32.844526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:32.844678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:32.844696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:32.844707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:32.846263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 115 sessionId:  describe result for acl check
2025-10-10T14:00:32.846380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:32.846391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:32.846402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:32.846419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592695187275595:3574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:32.849030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592695187275595:3574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:32.888946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592695187275595:3574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:32.926626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592695187275595:3574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:32.926671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592695187275595:3574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:32.926689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592695187275595:3574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:32.926724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:32.927821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592695187275726:3447]
2025-10-10T14:00:32.979402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:32.984545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:32.987978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:32.988012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:32.988078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:32.988466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:32.988676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592693609360035:3362]
2025-10-10T14:00:32.990831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:32.992085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:32.992319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:32.993603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:32.993943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:32.993951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:32.993959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:32.993966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:32.993972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:32.993978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:32.993984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:32.993991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:32.993998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.994004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.994010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.994016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.994062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:32.994162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:32.994209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:32.994253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:32.994297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:32.994368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:32.994411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:32.994455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:32.994497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.994541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.994585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.994627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.994665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:32.994728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:32.994787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:32.994839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:32.994888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:32.994937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:32.994979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:32.995030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:32.995077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:32.995129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:32.995174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:32.995226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:32.995289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:32.995343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:32.995391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:32.995447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:32.995496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.995545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:32.995589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.995664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:32.995717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.995771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:32.995815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.995868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:32.997529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:33.054609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:33.093138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:33.093179Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:33.093193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:33.093209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:33.093231Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 114 [2:7559592693609360035:3362]
2025-10-10T14:00:33.093288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:33.093341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:33.093355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.093366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.093378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.093423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:33.093443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:33.093464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:33.109741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:33.109768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:33.109777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:33.109786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:33.109795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:33.110042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:33.110056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:33.110171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:33.110322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:33.110518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:33.110617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:33.110685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.110698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.110709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.110721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.110752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:33.110827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:33.110988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:33.111003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:33.111125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.111142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:33.111653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:33.111666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:33.111677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:33.111687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:33.111712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:33.113896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 114, pipe: [1:7559592695187275726:3447]
2025-10-10T14:00:33.113985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 114
2025-10-10T14:00:33.114058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 114
2025-10-10T14:00:33.113503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592695187275726:3447], now have 1 active actors on pipe
2025-10-10T14:00:33.113535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592695187275724:3574], now have 1 active actors on pipe
2025-10-10T14:00:33.113554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592695187275569:2442], now have 1 active actors on pipe
2025-10-10T14:00:33.115627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:33.115662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:33.115750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:33.115785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.115802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.115813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:33.115851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.115893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:33.115942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:33.118160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:33.118191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:33.118255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:33.119598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 115 partition: 0 MaxSeqNo: 36 sessionId: src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0
2025-10-10T14:00:33.125429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3d95e8e-e320479c-815306c-53c99225_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:33.234534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0] Write session: try to update token
2025-10-10T14:00:33.234603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:33.275441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.275468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.275479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.275542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:33.275553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:33.275564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:33.275574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:33.275590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:33.275623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.275647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.275668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.275684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.275815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:33.275848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:33.275873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:33.275889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:33.275898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:33.275916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:33.275925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:33.277067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:33.440658Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:33.486367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:33.486397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:33.486437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592693609360025:3362]
2025-10-10T14:00:33.486773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:33.492616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:33.492836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592695187275726:3447]
2025-10-10T14:00:33.492958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:33.492979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:33.493051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 115 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0
2025-10-10T14:00:33.493450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 115 sessionId: src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0 is DEAD
2025-10-10T14:00:33.494881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:00:33.494953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0] Write session will restart in 0.006281s
2025-10-10T14:00:33.495137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0] Write session: Do CDS request
2025-10-10T14:00:33.495189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:33.512392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:33.516097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:33.516119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 116
2025-10-10T14:00:33.517468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:33.517611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:33.517627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:33.517638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:33.519046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 116 sessionId:  describe result for acl check
2025-10-10T14:00:33.519156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:33.519166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:33.519175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:33.519191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592699482243081:3582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:33.523614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592699482243081:3582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:33.546990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592699482243081:3582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:33.563241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592699482243081:3582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:33.563313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592699482243081:3582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:33.563331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592699482243081:3582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:33.563362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:33.595963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592699482243162:3447]
2025-10-10T14:00:33.651516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:33.655973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:33.656897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:33.656932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:33.656979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:33.657324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:33.657535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592697904327548:3374]
2025-10-10T14:00:33.660364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:33.661649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:33.661929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:33.663157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:33.663505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:33.663523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:33.663547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:33.663557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:33.663563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:33.663568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:33.663573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:33.663579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:33.663585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:33.663591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:33.663597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:33.663601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:33.663646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:33.663740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:33.663781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:33.663830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:33.663875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:33.663919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:33.663967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:33.664034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:33.664093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:33.664142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:33.664187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:33.664233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:33.664280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:33.664347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:33.664411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:33.664468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:33.664513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:33.664561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:33.664606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:33.664658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:33.664704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:33.664757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:33.664803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:33.664900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:33.664976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:33.665032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:33.665076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:33.665296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:33.665357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:33.665406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:33.665449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:33.665497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:33.665536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:33.665581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:33.665618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:33.665663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:33.666067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:33.709858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:33.726834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:33.726883Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:33.726900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:33.726920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:33.726947Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 115 [2:7559592697904327548:3374]
2025-10-10T14:00:33.727004Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:33.727074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:33.727089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.727103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.727114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.727166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:33.727187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:33.727209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:33.728869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:33.728887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:33.728900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:33.728914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:33.728925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:33.730562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 115, pipe: [1:7559592699482243162:3447]
2025-10-10T14:00:33.730671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 115
2025-10-10T14:00:33.730760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 115
2025-10-10T14:00:33.729694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:33.729722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:33.729863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:33.730031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:33.730236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:33.730342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:33.730431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592699482243162:3447], now have 1 active actors on pipe
2025-10-10T14:00:33.730453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592699482243069:2442], now have 1 active actors on pipe
2025-10-10T14:00:33.730470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592699482243111:3582], now have 1 active actors on pipe
2025-10-10T14:00:33.730495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:33.730508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:33.730519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:33.730530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:33.730571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:33.730652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:33.730820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:33.730837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:33.730962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:33.730981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:33.731022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:33.731035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:33.731044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:33.731054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:33.731076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:33.733609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:33.733638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:33.733696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:33.733719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.733731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.733738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:33.733774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.733810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:33.733861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:33.734518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:33.734534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:33.734608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:33.734973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 116 partition: 0 MaxSeqNo: 36 sessionId: src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0
2025-10-10T14:00:33.744110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7909e894-8fa6409e-3b0ef1d9-5d2db201_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:33.823220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.823253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.823266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.827551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0] Write session: try to update token
2025-10-10T14:00:33.827620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:34.037154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId: src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:34.047444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.047478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.047490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.047609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:34.047623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:34.047636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:34.047644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:34.047655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:34.047693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:34.047719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:34.047743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:34.047769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:34.049277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:34.049321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:34.050104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:34.050166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:34.110871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:34.124329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:34.124380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:34.124391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:34.125659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:34.331055Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:34.333605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:34.333632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:34.333678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592697904327542:3374]
2025-10-10T14:00:34.333836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:34.333860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:34.334150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:34.334817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:34.337231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592699482243162:3447]
2025-10-10T14:00:34.337380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:34.338634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:34.378108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 116 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0
2025-10-10T14:00:34.378491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 116 sessionId: src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0 is DEAD
2025-10-10T14:00:34.385288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:34.385327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0] Write session will restart in 0.006694s
2025-10-10T14:00:34.385419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0] Write session: Do CDS request
2025-10-10T14:00:34.385445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:34.399483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:34.403267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:34.403295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 117
2025-10-10T14:00:34.405409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:34.405588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:34.405621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:34.405646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:34.406956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 117 sessionId:  describe result for acl check
2025-10-10T14:00:34.407063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:34.407073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:34.407081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:34.407098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592703777210592:3595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:34.414047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592703777210592:3595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:34.433681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592703777210592:3595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:34.434935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592703777210642:3447]
2025-10-10T14:00:34.446961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592703777210592:3595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:34.446998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592703777210592:3595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:34.447015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592703777210592:3595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:34.447047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:34.498647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:34.502578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:34.503451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:34.503471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:34.503519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:34.503795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:34.503973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592702199295017:3382]
2025-10-10T14:00:34.511651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:34.513946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:34.514199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:34.515530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:34.515859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:34.515866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:34.515873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:34.515879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:34.515885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:34.515891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:34.515897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:34.515902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:34.515909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:34.515915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:34.515920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:34.515927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:34.515969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:34.516068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:34.516108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:34.516146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:34.516183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:34.516222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:34.516261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:34.516306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:34.516346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:34.516385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:34.516423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:34.516458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:34.516496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:34.516558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:34.516611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:34.516668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:34.516714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:34.516763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:34.516806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:34.516861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:34.516902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:34.516946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:34.516989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:34.517033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:34.517072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:34.517119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:34.521455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:34.521538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:34.521591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:34.521642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:34.521689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:34.521743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:34.521789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:34.521839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:34.521883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:34.521936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:34.522381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:34.568093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:34.586794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:34.586862Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:34.586882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:34.586904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:34.586928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 116 [2:7559592702199295017:3382]
2025-10-10T14:00:34.586986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:34.587049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:34.587067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.587078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.587091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.587142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:34.587166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:34.587189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:34.662978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:34.663013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:34.663025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:34.663039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:34.663049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:34.663363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:34.663381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:34.663517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:34.663682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:34.663875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:34.663982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:34.664057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:34.664073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:34.664086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:34.664098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:34.664244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:34.664257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:34.664270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:34.664279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:34.665190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:34.665308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:34.665488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:34.665504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:34.665552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592703777210671:3595], now have 1 active actors on pipe
2025-10-10T14:00:34.665574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592703777210580:2442], now have 1 active actors on pipe
2025-10-10T14:00:34.665595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592703777210642:3447], now have 1 active actors on pipe
2025-10-10T14:00:34.665719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:34.665754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:34.665816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:34.665837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:34.665988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9432063f-3894c59b-1348f5af-24a96406_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:34.666021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.666039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.666048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:34.666084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.666127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:34.666128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:34.666187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:34.665321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 116
2025-10-10T14:00:34.665392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 116
2025-10-10T14:00:34.665440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 116, pipe: [1:7559592703777210642:3447]
2025-10-10T14:00:34.670416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:34.670453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:34.670530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:34.676859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2008e288-b5605f1-f8af4c4c-33dce9d2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9432063f-3894c59b-1348f5af-24a96406_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:34.676042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 117 partition: 0 MaxSeqNo: 36 sessionId: src_id|9432063f-3894c59b-1348f5af-24a96406_0
2025-10-10T14:00:34.693237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.693270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.693283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.758069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9432063f-3894c59b-1348f5af-24a96406_0] Write session: try to update token
2025-10-10T14:00:34.758131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9432063f-3894c59b-1348f5af-24a96406_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:34.852923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.852953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.852965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.853019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:34.853033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:34.853045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:34.853057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:34.853071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:34.853106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:34.865251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:34.865323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:34.865347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:34.865482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:34.865514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:34.865544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:34.865571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:34.865671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:34.865707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:34.865718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:34.890266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:34.997284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId: src_id|9432063f-3894c59b-1348f5af-24a96406_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:35.027772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:35.245624Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:35.290568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:35.290604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:35.290656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:35.290667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:35.290703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592702199295011:3382]
2025-10-10T14:00:35.291135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:35.291564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:35.294447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:35.294635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592703777210642:3447]
2025-10-10T14:00:35.294729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:35.316053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9432063f-3894c59b-1348f5af-24a96406_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:35.316104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9432063f-3894c59b-1348f5af-24a96406_0] Write session will restart in 0.009285s
2025-10-10T14:00:35.316208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9432063f-3894c59b-1348f5af-24a96406_0] Write session: Do CDS request
2025-10-10T14:00:35.316238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9432063f-3894c59b-1348f5af-24a96406_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:35.314169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 117 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9432063f-3894c59b-1348f5af-24a96406_0
2025-10-10T14:00:35.314492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 117 sessionId: src_id|9432063f-3894c59b-1348f5af-24a96406_0 is DEAD
2025-10-10T14:00:35.333468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:35.333499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 118
2025-10-10T14:00:35.333891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9432063f-3894c59b-1348f5af-24a96406_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:35.334426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:35.334569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:35.334587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:35.334599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:35.336237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 118 sessionId:  describe result for acl check
2025-10-10T14:00:35.336359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:35.336369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:35.336378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:35.336395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592708072178105:3605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:35.339201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592708072178105:3605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:35.354892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592708072178105:3605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:35.373303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592708072178105:3605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:35.373345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592708072178105:3605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:35.373361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592708072178105:3605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:35.373394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:35.393477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592708072178253:3447]
2025-10-10T14:00:35.400166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:35.403648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:35.404509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:35.404528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:35.404573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:35.404843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:35.405028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592706494262537:3394]
2025-10-10T14:00:35.407212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:35.408214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:35.408423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:35.409740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:35.410060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:35.410068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:35.410076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:35.410083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:35.410091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:35.410098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:35.410106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:35.410114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:35.410121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:35.410128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:35.410137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:35.410146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:35.410197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:35.410339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:35.410401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:35.410449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:35.410500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:35.410550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:35.410599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:35.410646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:35.410692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:35.410743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:35.410790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:35.410834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:35.410879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:35.410962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:35.411022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:35.411076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:35.411129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:35.411180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:35.411227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:35.411281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:35.411348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:35.411403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:35.411450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:35.411498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:35.411546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:35.411594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:35.411642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:35.411692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:35.411741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:35.411788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:35.411832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:35.411880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:35.411966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:35.412022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:35.412066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:35.412117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:35.412553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:35.450032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:35.481743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:35.481798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:35.481818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:35.481841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:35.481869Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 117 [2:7559592706494262537:3394]
2025-10-10T14:00:35.481932Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:35.481995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:35.482012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.482026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.482038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.482091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:35.482115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:35.482138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:35.490719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 117, pipe: [1:7559592708072178253:3447]
2025-10-10T14:00:35.490754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 117
2025-10-10T14:00:35.490834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 117
2025-10-10T14:00:35.489906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:35.489940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:35.489958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:35.489975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:35.489988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:35.490294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:35.490317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:35.490489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:35.490707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:35.490963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:35.491090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:35.491175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592708072178253:3447], now have 1 active actors on pipe
2025-10-10T14:00:35.491202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592708072178174:3605], now have 1 active actors on pipe
2025-10-10T14:00:35.491229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592708072178092:2442], now have 1 active actors on pipe
2025-10-10T14:00:35.491255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592706494262532:3394]
2025-10-10T14:00:35.491270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592706494262532:3394]
2025-10-10T14:00:35.491285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592706494262532:3394]
2025-10-10T14:00:35.491299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592706494262532:3394]
2025-10-10T14:00:35.491358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:35.491442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:35.491642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:35.491653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:35.491661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:35.491671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:35.491684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:35.491695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:35.491784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592706494262532:3394]
2025-10-10T14:00:35.491820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:35.491834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:35.491886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:35.491907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:35.492090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:35.492122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.492141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.492152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:35.492188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.492228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:35.492304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:35.494522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:35.494558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:35.494632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:35.495004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 118 partition: 0 MaxSeqNo: 36 sessionId: src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0
2025-10-10T14:00:35.502127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9432063f-3894c59b-1348f5af-24a96406_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:35.536763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0] Write session: try to update token
2025-10-10T14:00:35.536805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:35.623779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.623814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.623827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.623886Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:35.623901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:35.623917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:35.623931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:35.623943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:35.623997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592706494262532:3394]
2025-10-10T14:00:35.624029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592706494262532:3394]
2025-10-10T14:00:35.624054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592706494262532:3394]
2025-10-10T14:00:35.624077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592706494262532:3394]
2025-10-10T14:00:35.624235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:35.624265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:35.624277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:35.624750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:35.624787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:35.624816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:35.624848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:35.642440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:35.749219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId: src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:35.816998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:35.831977Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:35.836190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:35.836236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:35.841928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592708072178253:3447]
2025-10-10T14:00:35.842031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:35.842045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:35.850875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 118 reason: error at write: Disconnected sessionId: src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0
2025-10-10T14:00:35.851249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 118 sessionId: src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0 is DEAD
2025-10-10T14:00:35.854750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:35.854817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0] Write session will restart in 0.007610s
2025-10-10T14:00:35.854989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0] Write session: Do CDS request
2025-10-10T14:00:35.855072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:35.895932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:35.902944Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:35.917166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:35.917422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:35.917435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 119
2025-10-10T14:00:35.921370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:35.921504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:35.921523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:35.921533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:35.929339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 119 sessionId:  describe result for acl check
2025-10-10T14:00:35.929531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:35.929550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:35.929566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:35.929595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592708072178340:3618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:35.945310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592708072178370:3447]
2025-10-10T14:00:35.945366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592708072178340:3618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:35.963516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592708072178340:3618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:35.992178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592708072178340:3618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:35.992216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592708072178340:3618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:35.992234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592708072178340:3618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:35.992268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:36.003256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:36.006113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:36.006720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:36.006731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:36.006756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:36.006908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:36.007025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592710789230018:3402]
2025-10-10T14:00:36.008821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:36.009963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:36.010208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:36.011647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:36.011987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:36.011996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:36.012003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:36.012011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:36.012019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:36.012027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:36.012034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:36.012041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:36.012049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.012056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.012064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.012070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.012124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:36.012240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:36.012294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:36.012345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:36.012395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:36.012445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:36.012493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:36.012539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:36.012585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.012634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.012678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.012724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.012768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:36.012837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:36.012896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:36.012951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:36.012998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:36.013051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:36.013095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:36.015177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:36.015249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:36.015317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:36.015381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:36.015439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:36.015490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:36.015542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:36.015598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:36.015658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:36.015710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.015761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.015802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.015854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.015895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.015950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.015993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.016046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.016655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:36.045997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:36.061445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:36.061497Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:36.061515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:36.061535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:36.061559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 118 [2:7559592710789230018:3402]
2025-10-10T14:00:36.061617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:36.061674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:36.061688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.061701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.061712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.061758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:36.061780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:36.061801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:36.064183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.064213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.064227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.064241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.064253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:36.064534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:36.064554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.064739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.064934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.065186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.065309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:36.065389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592708072178370:3447], now have 1 active actors on pipe
2025-10-10T14:00:36.065412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592708072178325:2442], now have 1 active actors on pipe
2025-10-10T14:00:36.065434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592708072178457:3618], now have 1 active actors on pipe
2025-10-10T14:00:36.065460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.065475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.065488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.065501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.068950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 118, pipe: [1:7559592708072178370:3447]
2025-10-10T14:00:36.065538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:36.069063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 118
2025-10-10T14:00:36.065619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:36.069209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 118
2025-10-10T14:00:36.065859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:36.065874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:36.065997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.066017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:36.069083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:36.069095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:36.069103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:36.069112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:36.069153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:36.069904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:36.069941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:36.070016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcf7a80f-b1996b8-2b573007-1674539_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:36.070052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.070072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.070087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:36.070125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.070165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:36.070211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:36.070866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:36.070895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:36.070955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:36.071241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 119 partition: 0 MaxSeqNo: 36 sessionId: src_id|bcf7a80f-b1996b8-2b573007-1674539_0
2025-10-10T14:00:36.073359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181f9681-2b9e723b-ff1f6410-ab62e2cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bcf7a80f-b1996b8-2b573007-1674539_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:36.139283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf7a80f-b1996b8-2b573007-1674539_0] Write session: try to update token
2025-10-10T14:00:36.139364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf7a80f-b1996b8-2b573007-1674539_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:36.296536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId: src_id|bcf7a80f-b1996b8-2b573007-1674539_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:36.327370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:36.332314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.332459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.332468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.332510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:36.332519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:36.332527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:36.332532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:36.332537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:36.332558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.332571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.332583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.332593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.332715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:36.332741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:36.332764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:36.332785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:36.332799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:36.332820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:36.332853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:36.332876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.332884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:36.333771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:36.500240Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:36.516733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:36.518256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592708072178370:3447]
2025-10-10T14:00:36.518321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:36.518430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:36.518441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:36.529996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:36.530061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592710789230012:3402]
2025-10-10T14:00:36.530366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:36.530649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:36.560293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 119 reason: error at write: Disconnected sessionId: src_id|bcf7a80f-b1996b8-2b573007-1674539_0
2025-10-10T14:00:36.560661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 119 sessionId: src_id|bcf7a80f-b1996b8-2b573007-1674539_0 is DEAD
2025-10-10T14:00:36.567918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf7a80f-b1996b8-2b573007-1674539_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:36.567963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf7a80f-b1996b8-2b573007-1674539_0] Write session will restart in 0.005947s
2025-10-10T14:00:36.568065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf7a80f-b1996b8-2b573007-1674539_0] Write session: Do CDS request
2025-10-10T14:00:36.568095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf7a80f-b1996b8-2b573007-1674539_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:36.585890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf7a80f-b1996b8-2b573007-1674539_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:36.589523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:36.589550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 120
2025-10-10T14:00:36.589989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:36.590107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:36.590121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:36.590130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:36.591493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 120 sessionId:  describe result for acl check
2025-10-10T14:00:36.591605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:36.591616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:36.591625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:36.591639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592712367145811:3627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:36.594343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592712367145811:3627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:36.603597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592712367145811:3627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:36.621234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592712367145845:3447]
2025-10-10T14:00:36.621971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592712367145811:3627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:36.622000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592712367145811:3627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:36.622017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592712367145811:3627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:36.622050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:36.675233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:36.679528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:36.680411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:36.680429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:36.680473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:36.680719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:36.680895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592710789230225:3413]
2025-10-10T14:00:36.683063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:36.684138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:36.684364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:36.685642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:36.685969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:36.685979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:36.685987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:36.685995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:36.686000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:36.686006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:36.686012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:36.686019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:36.686025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.686031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.686038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.686044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.686090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:36.686195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:36.686243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:36.686285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:36.686329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:36.686376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:36.686418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:36.686463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:36.686505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.686549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.686605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.686651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.686692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:36.686755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:36.686813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:36.686866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:36.686914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:36.686966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:36.687006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:36.687057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:36.687102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:36.687151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:36.687198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:36.687248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:36.687294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:36.687361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:36.687408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:36.687458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:36.687505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.687555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.687594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.687643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.687688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.687736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.687779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.687830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.688245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:36.726318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:36.749568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:36.749618Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:36.749632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:36.749650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:36.749673Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 119 [2:7559592710789230225:3413]
2025-10-10T14:00:36.749725Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:36.749785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:36.749799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.749811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.749820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.749869Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:36.749888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:36.749908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:36.797631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.797664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.797677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.797688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.797698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:36.797966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:36.797982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:36.798104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:36.798263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:36.798478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:36.798578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:36.798645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:36.798659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:36.798671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:36.798682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:36.798725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:36.798798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:36.798957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:36.798971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:36.799099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:36.799118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:36.799801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:36.799818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:36.799829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:36.799839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:36.799860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:36.800961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592712367145848:3627], now have 1 active actors on pipe
2025-10-10T14:00:36.800995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592712367145796:2442], now have 1 active actors on pipe
2025-10-10T14:00:36.801016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592712367145845:3447], now have 1 active actors on pipe
2025-10-10T14:00:36.800957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 119
2025-10-10T14:00:36.801040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 119
2025-10-10T14:00:36.801100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 119, pipe: [1:7559592712367145845:3447]
2025-10-10T14:00:36.801498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:36.801527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:36.801611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:36.801645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.801663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.801672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:36.801707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.801751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:36.801794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:36.802374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:36.802395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:36.802445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:36.802769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 120 partition: 0 MaxSeqNo: 36 sessionId: src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0
2025-10-10T14:00:36.809358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf7a80f-b1996b8-2b573007-1674539_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:36.853356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:36.853391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:36.853425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:36.853544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.853558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.853569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.853628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:36.855501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:36.856607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:36.856738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:36.859712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0] Write session: try to update token
2025-10-10T14:00:36.859766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:36.864885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:36.866841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:36.879195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:36.879712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:37.001608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.001642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.001653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.001710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:37.001725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:37.001738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:37.001748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:37.001759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:37.001804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:37.001832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:37.001853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:37.001877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592710789230219:3413]
2025-10-10T14:00:37.002015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:37.002040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.002052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:37.003176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:37.005078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:37.005142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:37.005178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:37.005208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:37.006861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId: src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:37.031229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:37.152360Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:37.154174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:37.154206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:37.158281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:37.163176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:37.165343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:37.165614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592712367145845:3447]
2025-10-10T14:00:37.169464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 120 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0
2025-10-10T14:00:37.169810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 120 sessionId: src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0 is DEAD
2025-10-10T14:00:37.173638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:37.173660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0] Write session will restart in 0.006269s
2025-10-10T14:00:37.173724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0] Write session: Do CDS request
2025-10-10T14:00:37.173743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:37.194806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:37.194803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:37.194839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 121
2025-10-10T14:00:37.196347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:37.196462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:37.196478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:37.196488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:37.197896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 121 sessionId:  describe result for acl check
2025-10-10T14:00:37.198009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:37.198025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:37.198034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:37.198050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592716662113294:3633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:37.200595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592716662113294:3633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:37.210110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592716662113294:3633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:37.238982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592716662113294:3633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:37.239030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592716662113294:3633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:37.239049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592716662113294:3633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:37.239084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:37.267745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592716662113460:3447]
2025-10-10T14:00:37.273463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:37.276250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:37.276959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:37.276983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:37.277013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:37.277202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:37.277325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592715084197715:3421]
2025-10-10T14:00:37.278804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:37.279833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:37.279999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:37.280871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:37.281119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:37.281167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:37.281172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:37.281177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:37.281181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:37.281185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:37.281189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:37.281194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:37.281199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.281204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.281212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.281217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.281256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:37.281358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:37.281397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:37.281435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:37.281473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:37.281510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:37.281544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:37.281583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:37.281621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.281658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.281693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.281725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.281751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:37.281803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:37.281845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:37.281882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:37.281915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:37.281950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:37.281980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:37.282016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:37.282049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:37.282088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:37.282121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:37.282157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:37.282188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:37.282237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:37.282271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:37.282310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:37.282343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.282380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.282410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.282446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.282477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.282512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.282541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.282575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.282885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:37.303822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:37.317969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:37.318021Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:37.318039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:37.318061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:37.318086Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 120 [2:7559592715084197715:3421]
2025-10-10T14:00:37.318143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:37.318205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:37.318220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.318232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.318244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.318291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:37.318314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:37.318335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:37.350808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.350839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.350848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.350858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.350869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:37.351840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 120
2025-10-10T14:00:37.351922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 120, pipe: [1:7559592716662113460:3447]
2025-10-10T14:00:37.351997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 120
2025-10-10T14:00:37.352461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:37.352492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.352632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.352805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.353025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.353160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:37.353249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592716662113460:3447], now have 1 active actors on pipe
2025-10-10T14:00:37.353273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592716662113339:3633], now have 1 active actors on pipe
2025-10-10T14:00:37.353294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592716662113283:2442], now have 1 active actors on pipe
2025-10-10T14:00:37.353360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:37.353382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:37.353419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.353435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.353449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.353462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.353501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:37.353587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:37.353740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:37.353756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:37.353769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:37.353780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:37.353781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:37.353799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:37.353863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6610aad-1325029b-42f35f12-933a6726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:37.353891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.353907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.353919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:37.353952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.353990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:37.354111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.354143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:37.354197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:37.354227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:37.354707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:37.354728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:37.354790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:37.355221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 121 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6610aad-1325029b-42f35f12-933a6726_0
2025-10-10T14:00:37.356175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ed39f00-daaef4a8-13db7d8f-421c037_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6610aad-1325029b-42f35f12-933a6726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:37.414991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6610aad-1325029b-42f35f12-933a6726_0] Write session: try to update token
2025-10-10T14:00:37.415085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6610aad-1325029b-42f35f12-933a6726_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:37.414039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:37.414073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:37.414111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.414247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:37.416471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:37.425441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:37.427829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:37.429456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:37.431321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:37.432978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:37.433503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.433527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.433540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.433597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:37.613995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId: src_id|b6610aad-1325029b-42f35f12-933a6726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:37.622352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:37.622393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:37.622410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:37.622422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:37.622433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:37.622478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.622503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.622527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.622548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592715084197709:3421]
2025-10-10T14:00:37.622700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:37.622727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.622734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:37.622740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.622752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.622763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:37.622793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:37.622801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:37.622826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.622837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:37.623954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:37.664130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:37.812651Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:37.815364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:37.815426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:37.817687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:37.822464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:37.837731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 121 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6610aad-1325029b-42f35f12-933a6726_0
2025-10-10T14:00:37.839782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6610aad-1325029b-42f35f12-933a6726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:37.839837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6610aad-1325029b-42f35f12-933a6726_0] Write session will restart in 0.007189s
2025-10-10T14:00:37.839972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6610aad-1325029b-42f35f12-933a6726_0] Write session: Do CDS request
2025-10-10T14:00:37.840017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6610aad-1325029b-42f35f12-933a6726_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:37.838194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 121 sessionId: src_id|b6610aad-1325029b-42f35f12-933a6726_0 is DEAD
2025-10-10T14:00:37.856228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6610aad-1325029b-42f35f12-933a6726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:37.874832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592716662113460:3447]
2025-10-10T14:00:37.874913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:37.875031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:37.875046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 122
2025-10-10T14:00:37.875825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:37.875958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:37.875975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:37.875985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:37.877433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 122 sessionId:  describe result for acl check
2025-10-10T14:00:37.877563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:37.877574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:37.877583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:37.877599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592716662113519:3645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:37.880169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592716662113519:3645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:37.889459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592716662113519:3645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:37.908876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592716662113519:3645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:37.908921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592716662113519:3645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:37.908939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592716662113519:3645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:37.908969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:37.944303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:37.956078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:37.956901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:37.956918Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:37.956961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:37.957229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:37.957412Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592715084197916:3425]
2025-10-10T14:00:37.959577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:37.965043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:37.965320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:37.967422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:37.967730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:37.967737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:37.967744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:37.967751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:37.967757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:37.967763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:37.967769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:37.967777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:37.967785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.967791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.967799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.967804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.967848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:37.967947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:37.967993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:37.968039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:37.968086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:37.968128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:37.968169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:37.968211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:37.968251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.973371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592716662113680:3447]
2025-10-10T14:00:37.975288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.975364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.975423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.975475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:37.975542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:37.975600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:37.975655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:37.975706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:37.975760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:37.975806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:37.975858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:37.975905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:37.975959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:37.976002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:37.976054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:37.976096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:37.976145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:37.976186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:37.976236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:37.976281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.976330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:37.976373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.976423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:37.976469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.976520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:37.976562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.976610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:37.977041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:38.009107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:38.024682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:38.024727Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:38.024743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:38.024760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:38.024782Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 121 [2:7559592715084197916:3425]
2025-10-10T14:00:38.024834Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:38.024892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:38.024908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.024921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.024932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.024981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:38.025001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:38.025022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:38.044299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.044333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:38.044342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:38.044353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:38.044363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:38.044621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:38.044643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.046454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 121, pipe: [1:7559592716662113680:3447]
2025-10-10T14:00:38.046551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 121
2025-10-10T14:00:38.046620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 121
2025-10-10T14:00:38.044758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:38.044915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:38.045111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:38.047104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:38.047196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592716662113680:3447], now have 1 active actors on pipe
2025-10-10T14:00:38.047218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592716662113515:2442], now have 1 active actors on pipe
2025-10-10T14:00:38.047237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592716662113583:3645], now have 1 active actors on pipe
2025-10-10T14:00:38.047277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:38.047298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:38.047347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.047360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.047372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.047405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.047442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:38.047527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:38.047688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:38.047706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:38.047768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:38.047799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.047830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.047841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:38.047876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.047919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:38.048051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.048072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:38.048114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:38.048682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:38.048696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:38.048706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:38.048716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:38.048738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:38.053316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:38.053359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:38.053434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:38.056923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 122 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0
2025-10-10T14:00:38.061901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6610aad-1325029b-42f35f12-933a6726_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:38.115097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0] Write session: try to update token
2025-10-10T14:00:38.115154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:38.254621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.254657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.254670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.254725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:38.254742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:38.254756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:38.254768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:38.254779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:38.254818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.254846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.254871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.254895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.255105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:38.255132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.255143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:38.256253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:38.257250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:38.257284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:38.257311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:38.257340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:38.368205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId: src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:38.391362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:38.420965Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:38.441811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:38.441859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:38.441921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:38.441937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:38.441980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592715084197899:3425]
2025-10-10T14:00:38.442637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:38.443290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592716662113680:3447]
2025-10-10T14:00:38.443370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:38.443496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:38.443513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:38.443204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
E1010 14:00:38.497669565  143562 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:00:38.509585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:38.509634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0] Write session will restart in 0.008303s
2025-10-10T14:00:38.509738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0] Write session: Do CDS request
2025-10-10T14:00:38.508293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 122 reason: error at write: Disconnected sessionId: src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0
2025-10-10T14:00:38.509774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:38.508625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 122 sessionId: src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0 is DEAD
2025-10-10T14:00:38.526546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:38.528215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:38.528246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 123
2025-10-10T14:00:38.528601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:38.528689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:38.528704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:38.528712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:38.530252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 123 sessionId:  describe result for acl check
2025-10-10T14:00:38.530386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:38.530402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:38.530412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:38.530430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592720957081142:3654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:38.532573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592720957081142:3654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:38.538709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592720957081142:3654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:38.538817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:38.543201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592720957081166:3447]
2025-10-10T14:00:38.545855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:38.546656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:38.546683Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:38.546723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:38.548019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592720957081142:3654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:38.548060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592720957081142:3654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:38.548078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592720957081142:3654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:38.548108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:38.546969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:38.547158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592719379165418:3437]
2025-10-10T14:00:38.548980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:38.549765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:38.549934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:38.551149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:38.551467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:38.551482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:38.551489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:38.551496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:38.551502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:38.551508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:38.551516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:38.551523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:38.551530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.551548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:38.551554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:38.551561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:38.551606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:38.551703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:38.551748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:38.551792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:38.551839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:38.551886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:38.551932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:38.551981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:38.552025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.552068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:38.552107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:38.552144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:38.552184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:38.552243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:38.552286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:38.552320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:38.552361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:38.552397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:38.552424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:38.552459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:38.552498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:38.552548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:38.552582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:38.552618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:38.552651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:38.552685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:38.552719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:38.552757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:38.552791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.552839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.552872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:38.552909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:38.552952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:38.553001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:38.553062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:38.553102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:38.553475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:38.577581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:38.616163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:38.616206Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:38.616222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:38.616240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:38.616260Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 122 [2:7559592719379165418:3437]
2025-10-10T14:00:38.616309Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:38.616369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:38.616381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.616392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.616403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.616447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:38.616469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:38.616497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:38.617713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.617734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:38.617746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:38.617758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:38.617768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:38.617977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:38.617997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.618110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:38.618249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:38.618454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:38.618562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:38.619034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 122
2025-10-10T14:00:38.618644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592720957081172:3654], now have 1 active actors on pipe
2025-10-10T14:00:38.618665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592720957081003:2442], now have 1 active actors on pipe
2025-10-10T14:00:38.618686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592720957081166:3447], now have 1 active actors on pipe
2025-10-10T14:00:38.618710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.618724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.618736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.618748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.618783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:38.618860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:38.619016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:38.619033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:38.619173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.619192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:38.619511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:38.619534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:38.619546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:38.619557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:38.619583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:38.619976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:38.620006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:38.620092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:38.620137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.620156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.620166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:38.620203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.620252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:38.620310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:38.621495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:38.621522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:38.621582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:38.619193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 122
2025-10-10T14:00:38.619274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 122, pipe: [1:7559592720957081166:3447]
2025-10-10T14:00:38.621875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 123 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0
2025-10-10T14:00:38.629389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e3639-aa2b8910-d5329e59-a5aac929_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:38.673263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0] Write session: try to update token
2025-10-10T14:00:38.673326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:38.754436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:38.754471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:38.754487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:38.754498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:38.754508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:38.754545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.754568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.754591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.754613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.754755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:38.754789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:38.754791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.754804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.754816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.754823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:38.754855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:38.754927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:38.754956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:38.754967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:38.756318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:38.819863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId: src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:38.850755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:38.911706Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:38.940796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:38.940849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:38.940915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:38.940929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:38.940966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592719379165411:3437]
2025-10-10T14:00:38.941249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:38.941598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:38.942604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:38.942631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:38.948802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:38.948957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592720957081166:3447]
2025-10-10T14:00:38.976529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 123 reason: error at write: Disconnected sessionId: src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0
2025-10-10T14:00:38.976853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 123 sessionId: src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0 is DEAD
2025-10-10T14:00:38.977570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:38.977638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0] Write session will restart in 0.007955s
2025-10-10T14:00:38.977839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0] Write session: Do CDS request
2025-10-10T14:00:38.977901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:38.997946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:39.013427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:39.013466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 124
2025-10-10T14:00:39.020310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:39.020467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:39.020483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:39.020496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:39.026434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 124 sessionId:  describe result for acl check
2025-10-10T14:00:39.026557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:39.026568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:39.026578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:39.026596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592725252048532:3662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:39.030678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592725252048532:3662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:39.046742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592725252048565:3447]
2025-10-10T14:00:39.061893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592725252048532:3662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:39.083502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592725252048532:3662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:39.083547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592725252048532:3662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:39.083566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592725252048532:3662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:39.083598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:39.111951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:39.112496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:39.113313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:39.113333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:39.113378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:39.113641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:39.113825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592723674132905:3444]
2025-10-10T14:00:39.116306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:39.117695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:39.117936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:39.119370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:39.119886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:39.119895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:39.119902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:39.119909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:39.119918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:39.119924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:39.119932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:39.119940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:39.119948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.119956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.119963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.119970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.120024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:39.120143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:39.120198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:39.120254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:39.120313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:39.120364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:39.120409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:39.120460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:39.120526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.120575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.120623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.120670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.120715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:39.120786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:39.120847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:39.120906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:39.120958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:39.121013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:39.121060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:39.121116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:39.121186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:39.121246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:39.121293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:39.121347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:39.121396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:39.121453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:39.121497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:39.121548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:39.121597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.121652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.121705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.121767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.121821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.121880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.121931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.121992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.122499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:39.173095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:39.188356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:39.188401Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:39.188418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:39.188438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:39.188461Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 123 [2:7559592723674132905:3444]
2025-10-10T14:00:39.188516Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:39.188571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:39.188586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.188599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.188610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.188656Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:39.188676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:39.188697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:39.191215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.191248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.191263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.191277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.191288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:39.191580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:39.191598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.191746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.191934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.192163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.192285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:39.192356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.192371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.192385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.192397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.192438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:39.192523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:39.192712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:39.192731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:39.192856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.192878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:39.193264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:39.193279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:39.193293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:39.193304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:39.193327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:39.193963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592725252048565:3447], now have 1 active actors on pipe
2025-10-10T14:00:39.194002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592720957081199:2442], now have 1 active actors on pipe
2025-10-10T14:00:39.194029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592725252048657:3662], now have 1 active actors on pipe
2025-10-10T14:00:39.194894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 123
2025-10-10T14:00:39.195022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 123
2025-10-10T14:00:39.195090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 123, pipe: [1:7559592725252048565:3447]
2025-10-10T14:00:39.197238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:39.197273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:39.197353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3022cec-381b0172-f7ceb728-1796911d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:39.197384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.197404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.197415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:39.197453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.197496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:39.197549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:39.198313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:39.198341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:39.198404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:39.198761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 124 partition: 0 MaxSeqNo: 36 sessionId: src_id|f3022cec-381b0172-f7ceb728-1796911d_0
2025-10-10T14:00:39.199706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5e6453-1c81c7d4-49a5fc58-a2905492_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f3022cec-381b0172-f7ceb728-1796911d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:39.248505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3022cec-381b0172-f7ceb728-1796911d_0] Write session: try to update token
2025-10-10T14:00:39.248565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3022cec-381b0172-f7ceb728-1796911d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:39.391559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.391591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.391604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.391727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:39.391742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:39.391756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:39.391767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:39.391777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:39.391811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.391839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.391862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.391884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.392013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:39.392046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:39.392065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:39.392083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:39.426657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:39.426693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.426701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:39.427610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:39.447589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId: src_id|f3022cec-381b0172-f7ceb728-1796911d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:39.472030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:39.584959Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:39.592774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:39.592809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:39.592852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592723674132900:3444]
2025-10-10T14:00:39.592994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:39.592998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:39.593016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:39.594816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:39.594923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:39.594946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:39.599358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592725252048565:3447]
2025-10-10T14:00:39.599505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:39.608713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 124 reason: error at write: Disconnected sessionId: src_id|f3022cec-381b0172-f7ceb728-1796911d_0
2025-10-10T14:00:39.609069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 124 sessionId: src_id|f3022cec-381b0172-f7ceb728-1796911d_0 is DEAD
2025-10-10T14:00:39.617383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3022cec-381b0172-f7ceb728-1796911d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:39.617433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3022cec-381b0172-f7ceb728-1796911d_0] Write session will restart in 0.005545s
2025-10-10T14:00:39.617533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3022cec-381b0172-f7ceb728-1796911d_0] Write session: Do CDS request
2025-10-10T14:00:39.617570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3022cec-381b0172-f7ceb728-1796911d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:39.631871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:39.631907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 125
2025-10-10T14:00:39.633876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3022cec-381b0172-f7ceb728-1796911d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:39.634535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:39.634669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:39.634686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:39.634696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:39.636128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 125 sessionId:  describe result for acl check
2025-10-10T14:00:39.636231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:39.636242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:39.636251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:39.636266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592725252048729:3674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:39.638967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592725252048729:3674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:39.647347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592725252048729:3674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:39.655624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592725252048729:3674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:39.655663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592725252048729:3674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:39.655680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592725252048729:3674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:39.655712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:39.697866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592725252048761:3447]
2025-10-10T14:00:39.789278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:39.798661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:39.799543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:39.799561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:39.799605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:39.799864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:39.800058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592723674133117:3455]
2025-10-10T14:00:39.806010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:39.807519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:39.807730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:39.808913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:39.809231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:39.809238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:39.809244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:39.809250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:39.809258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:39.809265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:39.809272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:39.809279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:39.809285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.809291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.809298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.809331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.809383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:39.809488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:39.809533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:39.809578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:39.809620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:39.809661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:39.809701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:39.809744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:39.809787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.809829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.809867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.809907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.809944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:39.810003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:39.810054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:39.810099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:39.810141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:39.810187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:39.810224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:39.810270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:39.810310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:39.810361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:39.810412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:39.810460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:39.810500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:39.810545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:39.810582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:39.810627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:39.810666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.810708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.810744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.810790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.810829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.810873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.810947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.810995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.817454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:39.851253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:39.904731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:39.904784Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:39.904801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:39.904822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:39.904843Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 124 [2:7559592723674133117:3455]
2025-10-10T14:00:39.904898Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:39.904955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:39.904970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.904982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.904994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.905043Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:39.905064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:39.905086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:39.907756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.907792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.907807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.907821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.907834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:39.908130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:39.908148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:39.908304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:39.908501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:39.908719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:39.908834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:39.908913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592725252048755:3674], now have 1 active actors on pipe
2025-10-10T14:00:39.908936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592725252048761:3447], now have 1 active actors on pipe
2025-10-10T14:00:39.908956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592725252048716:2442], now have 1 active actors on pipe
2025-10-10T14:00:39.908983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:39.908998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:39.909012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:39.909025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:39.909069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:39.909169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:39.909358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:39.909378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:39.909505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:39.909527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:39.909461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 124
2025-10-10T14:00:39.909535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 124, pipe: [1:7559592725252048761:3447]
2025-10-10T14:00:39.909606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 124
2025-10-10T14:00:39.909694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:39.909718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:39.909730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:39.909741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:39.909765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:39.910771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:39.910805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:39.910892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|464c233c-c3a2cf-a498df8-600d06db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:39.910925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.910944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.910954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:39.910988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.911029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:39.911078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:39.912563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:39.912598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:39.912682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:39.913415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 125 partition: 0 MaxSeqNo: 36 sessionId: src_id|464c233c-c3a2cf-a498df8-600d06db_0
2025-10-10T14:00:39.914390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3022cec-381b0172-f7ceb728-1796911d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|464c233c-c3a2cf-a498df8-600d06db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:39.962314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|464c233c-c3a2cf-a498df8-600d06db_0] Write session: try to update token
2025-10-10T14:00:39.962367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|464c233c-c3a2cf-a498df8-600d06db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:40.038899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:40.038937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:40.038953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:40.038966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:40.038978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:40.039017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:40.039046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:40.039070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:40.039097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:40.039317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.039329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.039341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.039383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:40.039411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.039437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:40.039709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:40.039743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:40.039770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:40.039795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:40.040397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:40.099153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId: src_id|464c233c-c3a2cf-a498df8-600d06db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:40.117904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:40.192583Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:40.206989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:40.207034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:40.207100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:40.207113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:40.207149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592723674133111:3455]
2025-10-10T14:00:40.207668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:40.208810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:40.208943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:40.208954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:40.212987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 125 reason: error at write: Disconnected sessionId: src_id|464c233c-c3a2cf-a498df8-600d06db_0
2025-10-10T14:00:40.213288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592725252048761:3447]
2025-10-10T14:00:40.215059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:40.221050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 125 sessionId: src_id|464c233c-c3a2cf-a498df8-600d06db_0 is DEAD
2025-10-10T14:00:40.225677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464c233c-c3a2cf-a498df8-600d06db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:40.225716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464c233c-c3a2cf-a498df8-600d06db_0] Write session will restart in 0.007875s
2025-10-10T14:00:40.225814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464c233c-c3a2cf-a498df8-600d06db_0] Write session: Do CDS request
2025-10-10T14:00:40.225843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464c233c-c3a2cf-a498df8-600d06db_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:40.246527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|464c233c-c3a2cf-a498df8-600d06db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:40.249594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:40.249622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 126
2025-10-10T14:00:40.250046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:40.250189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:40.250213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:40.250229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:40.258505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 126 sessionId:  describe result for acl check
2025-10-10T14:00:40.258636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:40.258648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:40.258657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:40.258687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592729547016224:3680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:40.261558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592729547016224:3680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:40.295620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592729547016224:3680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:40.314969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592729547016334:3447]
2025-10-10T14:00:40.316071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592729547016224:3680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:40.316099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592729547016224:3680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:40.316117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592729547016224:3680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:40.316144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:40.346360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:40.349161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:40.350033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:40.350067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:40.350108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:40.350368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:40.350563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592727969100612:3463]
2025-10-10T14:00:40.352558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:40.353611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:40.353837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:40.355208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:40.355573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:40.355590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:40.355598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:40.355606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:40.355614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:40.355622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:40.355630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:40.355638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:40.355646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.355653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.355660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.355667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.355716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:40.355832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:40.355887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:40.355939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:40.355998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:40.356057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:40.356114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:40.356167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:40.356218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.356270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.356321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.356375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.356430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:40.356499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:40.356563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:40.356625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:40.356678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:40.356735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:40.356784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:40.356842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:40.356896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:40.356955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:40.357004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:40.357061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:40.357112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:40.357210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:40.357265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:40.357317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:40.357367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.357419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.357465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.357525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.357570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.357645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.357696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.357754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.358246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:40.400689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:40.423850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:40.423894Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:40.423912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:40.423930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:40.423952Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 125 [2:7559592727969100612:3463]
2025-10-10T14:00:40.424007Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:40.424058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:40.424072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.424084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.424095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.424139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:40.424160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:40.424180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:40.428246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.428274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.428287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.428299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.428310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:40.428565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:40.428588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.428734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.428919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.429181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.429307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:40.429378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.429398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.429411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.429423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.429459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:40.429540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:40.429711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:40.429727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:40.429846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.429863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:40.430086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:40.430099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:40.430111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:40.430122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:40.430144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:40.431839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592729547016334:3447], now have 1 active actors on pipe
2025-10-10T14:00:40.431870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592729547016337:3680], now have 1 active actors on pipe
2025-10-10T14:00:40.431910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592729547016208:2442], now have 1 active actors on pipe
2025-10-10T14:00:40.433999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 125, pipe: [1:7559592729547016334:3447]
2025-10-10T14:00:40.434105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 125
2025-10-10T14:00:40.434172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 125
2025-10-10T14:00:40.440798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:40.440842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:40.440959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:40.441001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.441020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.441031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:40.441075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.441116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:40.441182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:40.460305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:40.460352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:40.460446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:40.463760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464c233c-c3a2cf-a498df8-600d06db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:40.460805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 126 partition: 0 MaxSeqNo: 36 sessionId: src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0
2025-10-10T14:00:40.515621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0] Write session: try to update token
2025-10-10T14:00:40.515677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:40.621596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.621633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.621647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.621763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:40.621787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:40.621801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:40.621813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:40.621825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:40.621862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.621890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.621922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.621944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.622654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:40.622698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:40.622728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:40.622755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:40.634444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:40.634498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.634510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:40.635622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:40.699503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId: src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:40.734565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:40.778885Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:40.781363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:40.781401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:40.781448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592727969100607:3463]
2025-10-10T14:00:40.781596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:40.781622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:40.782402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:40.783121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592729547016334:3447]
2025-10-10T14:00:40.783256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:40.783276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:40.784241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:40.812485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 126 reason: error at write: Disconnected sessionId: src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0
2025-10-10T14:00:40.812797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 126 sessionId: src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0 is DEAD
2025-10-10T14:00:40.813486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:40.813521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0] Write session will restart in 0.007812s
2025-10-10T14:00:40.813614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0] Write session: Do CDS request
2025-10-10T14:00:40.813642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:40.830385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:40.832545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:40.833498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:40.833525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 127
2025-10-10T14:00:40.835600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:40.835737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:40.835752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:40.835762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:40.838006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 127 sessionId:  describe result for acl check
2025-10-10T14:00:40.838130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:40.838142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:40.838152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:40.838170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592729547016483:3694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:40.840898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592729547016483:3694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:40.852042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592729547016483:3694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:40.863615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592729547016483:3694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:40.863653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592729547016483:3694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:40.863668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592729547016483:3694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:40.863698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:40.864962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:40.871580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:40.872469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:40.872489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:40.872534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:40.872806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:40.873004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592727969100804:3467]
2025-10-10T14:00:40.876998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:40.878479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:40.878739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:40.880126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:40.880498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:40.880518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:40.880526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:40.880533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:40.880540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:40.880547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:40.880556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:40.880564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:40.880571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.880578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.880585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.880592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.880641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:40.880754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:40.880805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:40.880864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:40.880914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:40.880965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:40.881023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:40.881070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:40.881118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.881188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.881234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.881284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.881328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:40.881398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:40.881473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:40.881542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:40.881597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:40.881653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:40.881702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:40.881759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:40.881816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:40.881874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:40.881923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:40.881982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:40.882034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:40.882090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:40.882141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:40.882197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:40.882251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.882306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.882358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.882416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.882464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.882518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.882565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.882622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.883092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:40.885227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592729547016609:3447]
2025-10-10T14:00:40.922308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:40.946000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:40.946051Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:40.946067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:40.946087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:40.946110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 126 [2:7559592727969100804:3467]
2025-10-10T14:00:40.946169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:40.946223Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:40.946237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.946250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.946261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.946308Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:40.946329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:40.946350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:40.948793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.948825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.948840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.948856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.948867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:40.949183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:40.949203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:40.949349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:40.949558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:40.951079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 126
2025-10-10T14:00:40.951176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 126
2025-10-10T14:00:40.951248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 126, pipe: [1:7559592729547016609:3447]
2025-10-10T14:00:40.949816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:40.949967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:40.950046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:40.950062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:40.950076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:40.950091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:40.950124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:40.950147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:40.950162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:40.950174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:40.950186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:40.950214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:40.950434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:40.950452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:40.950499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592729547016602:3694], now have 1 active actors on pipe
2025-10-10T14:00:40.950524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592729547016470:2442], now have 1 active actors on pipe
2025-10-10T14:00:40.950546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592729547016609:3447], now have 1 active actors on pipe
2025-10-10T14:00:40.950663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:40.950694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:40.951317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:40.962604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:40.962654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:40.962751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:40.962783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.962801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.962814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:40.962849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.962891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:40.962941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:40.969415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:40.969466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:40.969553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:40.971103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6222346a-ed18b81d-b728a8b2-354e9bfb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:40.970311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 127 partition: 0 MaxSeqNo: 36 sessionId: src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0
2025-10-10T14:00:41.031883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0] Write session: try to update token
2025-10-10T14:00:41.031938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:41.099851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.099884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.099892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.099983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:41.099993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:41.100003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:41.100011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:41.100021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:41.100048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:41.100066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:41.100088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:41.100112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:41.100223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:41.100253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:41.100280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:41.100306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:41.114912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:41.114970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:41.114981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:41.116859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:41.253332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId: src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:41.278703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:41.318973Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:41.322697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:41.322728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:41.322766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592727969100797:3467]
2025-10-10T14:00:41.322898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:41.322921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:41.323944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:41.325871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:41.325898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:41.325010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:41.326248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:41.326402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592729547016609:3447]
2025-10-10T14:00:41.332943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 127 reason: error at write: Disconnected sessionId: src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0
2025-10-10T14:00:41.333392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 127 sessionId: src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0 is DEAD
2025-10-10T14:00:41.336448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:41.336491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0] Write session will restart in 0.008619s
2025-10-10T14:00:41.336595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0] Write session: Do CDS request
2025-10-10T14:00:41.336656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:41.354867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:41.355498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:41.355519Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 128
2025-10-10T14:00:41.355723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:41.355791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:41.355800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:41.355810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:41.359155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 128 sessionId:  describe result for acl check
2025-10-10T14:00:41.359308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:41.359328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:41.359344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:41.359370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592733841983944:3702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:41.362506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592733841983944:3702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:41.381629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592733841983944:3702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:41.395150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592733841983944:3702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:41.395190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592733841983944:3702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:41.395208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592733841983944:3702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:41.395240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:41.426899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592733841984034:3447]
2025-10-10T14:00:41.470403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:41.471271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:41.471995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:41.472011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:41.472047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:41.472206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:41.472321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592732264068305:3477]
2025-10-10T14:00:41.473684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:41.480165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:41.480402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:41.481445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:41.481696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:41.481711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:41.481718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:41.481724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:41.481731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:41.481738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:41.481744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:41.481752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:41.481759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:41.481764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:41.481771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:41.481777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:41.481821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:41.481921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:41.481981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:41.482030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:41.482081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:41.482129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:41.482185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:41.482235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:41.482283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:41.482334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:41.482382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:41.482457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:41.482502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:41.482592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:41.482661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:41.482717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:41.482768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:41.482823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:41.482869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:41.482928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:41.482984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:41.483048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:41.483102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:41.483155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:41.483200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:41.483250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:41.483298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:41.483347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:41.483390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:41.483437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:41.483490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:41.483537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:41.483577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:41.483625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:41.483675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:41.483729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:41.484060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:41.524977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:41.538943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:41.538991Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:41.539008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:41.539025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:41.539049Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 127 [2:7559592732264068305:3477]
2025-10-10T14:00:41.539101Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:41.539160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:41.539180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.539197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.539209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.539260Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:41.539282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:41.539306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:41.566472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:41.566506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:41.566520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:41.566533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:41.566544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:41.566861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:41.566881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:41.567028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:41.567332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:41.567624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:41.567741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:41.567826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.567840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.567851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.567862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.567892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:41.567919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:41.567931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:41.567941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:41.567952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:41.567966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592733841984034:3447], now have 1 active actors on pipe
2025-10-10T14:00:41.567988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592733841983931:2442], now have 1 active actors on pipe
2025-10-10T14:00:41.568009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592733841983972:3702], now have 1 active actors on pipe
2025-10-10T14:00:41.568042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:41.568213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:41.568247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:41.568461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.568519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:41.568699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:41.568824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 127, pipe: [1:7559592733841984034:3447]
2025-10-10T14:00:41.568930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 127
2025-10-10T14:00:41.569017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 127
2025-10-10T14:00:41.569385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:41.569418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:41.569494Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dda394c-cfe6037b-7695f33f-adda2792_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:41.569527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.569545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.569554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:41.569591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.569636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:41.569676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:41.571022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 128 partition: 0 MaxSeqNo: 36 sessionId: src_id|9dda394c-cfe6037b-7695f33f-adda2792_0
2025-10-10T14:00:41.570514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:41.570553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:41.570619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:41.572429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5958ba16-d206b5e3-9843d69e-35620c0d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9dda394c-cfe6037b-7695f33f-adda2792_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:41.630810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dda394c-cfe6037b-7695f33f-adda2792_0] Write session: try to update token
2025-10-10T14:00:41.630872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dda394c-cfe6037b-7695f33f-adda2792_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:41.636704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.636740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.636752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.648109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:41.648162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:41.648201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.648334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:41.651076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:41.651408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:41.652615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:41.653807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:41.654980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:41.656580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:41.662863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:41.771044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.771086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.771104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.771167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:41.771181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:41.771197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:41.771209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:41.771223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:41.771269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.771300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.771325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.771350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592732264068300:3477]
2025-10-10T14:00:41.771527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:41.771557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:41.771571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:41.772290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:41.772349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:41.772388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:41.772425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:41.778680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:41.828415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId: src_id|9dda394c-cfe6037b-7695f33f-adda2792_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:41.851421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:41.962125Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:41.972384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:41.972435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:41.974590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:41.978943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592733841984034:3447]
2025-10-10T14:00:41.979129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:41.979379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:42.000617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 128 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9dda394c-cfe6037b-7695f33f-adda2792_0
2025-10-10T14:00:42.001000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 128 sessionId: src_id|9dda394c-cfe6037b-7695f33f-adda2792_0 is DEAD
2025-10-10T14:00:42.001821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dda394c-cfe6037b-7695f33f-adda2792_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:42.001883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dda394c-cfe6037b-7695f33f-adda2792_0] Write session will restart in 0.009622s
2025-10-10T14:00:42.002064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dda394c-cfe6037b-7695f33f-adda2792_0] Write session: Do CDS request
2025-10-10T14:00:42.002109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dda394c-cfe6037b-7695f33f-adda2792_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:42.018724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dda394c-cfe6037b-7695f33f-adda2792_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:42.020645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:42.020698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 129
2025-10-10T14:00:42.021415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:42.021594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:42.021619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:42.021640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:42.024509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 129 sessionId:  describe result for acl check
2025-10-10T14:00:42.024711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:42.024728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:42.024748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:42.024778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592738136951459:3709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:42.028030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592738136951459:3709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:42.039539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592738136951459:3709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:42.059626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592738136951459:3709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:42.059663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592738136951459:3709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:42.059681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592738136951459:3709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:42.059714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:42.078093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592738136951571:3447]
2025-10-10T14:00:42.120806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:42.124023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:42.124760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:42.124788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:42.124831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:42.125030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:42.125234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592736559035813:3486]
2025-10-10T14:00:42.126682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:42.132837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:42.133117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:42.134407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:42.134760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:42.134780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:42.134786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:42.134792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:42.134801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:42.134807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:42.134813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:42.134819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:42.134826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:42.134831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:42.134838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:42.134844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:42.134887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:42.134991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:42.135036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:42.135078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:42.135127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:42.135177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:42.135227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:42.135274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:42.135322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:42.135372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:42.135419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:42.135477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:42.135519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:42.135584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:42.135645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:42.135700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:42.135755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:42.135822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:42.135870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:42.135918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:42.135974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:42.136028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:42.136071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:42.136125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:42.136170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:42.136226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:42.136271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:42.136322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:42.136370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:42.136425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:42.136468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:42.136519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:42.136569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:42.136619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:42.136666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:42.136714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:42.137113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:42.188013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:42.199751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:42.199801Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:42.199817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:42.199836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:42.199858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 128 [2:7559592736559035813:3486]
2025-10-10T14:00:42.199912Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:42.199973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:42.199995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.200008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.200019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.200065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:42.200093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:42.200119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:42.201349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:42.201382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:42.201390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:42.201398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:42.201406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:42.201588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:42.201596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:42.201674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:42.201845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:42.202038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:42.202141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:42.202214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.202228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.202240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.202251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.202292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:42.202372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:42.202535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:42.202551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:42.202676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.202695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:42.205398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 128
2025-10-10T14:00:42.205492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 128, pipe: [1:7559592738136951571:3447]
2025-10-10T14:00:42.205564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 128
2025-10-10T14:00:42.203712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:42.203736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:42.203745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:42.203756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:42.203778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:42.207184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592738136951541:3709], now have 1 active actors on pipe
2025-10-10T14:00:42.207224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592733841984148:2442], now have 1 active actors on pipe
2025-10-10T14:00:42.207244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592738136951571:3447], now have 1 active actors on pipe
2025-10-10T14:00:42.207309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:42.207330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:42.207409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:42.207460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.207490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.207499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:42.207548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.207596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:42.207646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:42.208499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:42.208527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:42.208600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:42.209034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 129 partition: 0 MaxSeqNo: 36 sessionId: src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0
2025-10-10T14:00:42.209910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dda394c-cfe6037b-7695f33f-adda2792_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:42.267649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0] Write session: try to update token
2025-10-10T14:00:42.267710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:42.301822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.301869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.301882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.468590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId: src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:42.475535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.475576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.475589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.475705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:42.475720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:42.475734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:42.475745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:42.475757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:42.475795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.475822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.475844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.475865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.477604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:42.477658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:42.477688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:42.477718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:42.512541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:42.512602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:42.512615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:42.513621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:42.554720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:42.820737Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:42.834667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:42.834711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:42.834757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592736559035807:3486]
2025-10-10T14:00:42.834903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:42.834927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:42.839186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:42.839333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592738136951571:3447]
2025-10-10T14:00:42.839409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:42.839420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:42.837493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:42.842830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:42.880224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 129 reason: error at write: Disconnected sessionId: src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0
2025-10-10T14:00:42.880573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 129 sessionId: src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0 is DEAD
2025-10-10T14:00:42.889343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:42.889385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0] Write session will restart in 0.008966s
2025-10-10T14:00:42.889482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0] Write session: Do CDS request
2025-10-10T14:00:42.889512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:42.907268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:42.907311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 130
2025-10-10T14:00:42.914246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:42.915048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:42.915179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:42.915193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:42.915204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:42.916819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 130 sessionId:  describe result for acl check
2025-10-10T14:00:42.916925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:42.916935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:42.916944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:42.916960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592738136951676:3721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:42.920049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592738136951676:3721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:42.937880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592738136951676:3721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:42.952680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592738136951713:3447]
2025-10-10T14:00:42.975795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592738136951676:3721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:42.975849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592738136951676:3721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:42.975866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592738136951676:3721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:42.975898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:43.048377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:43.052645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:43.053494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:43.053511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:43.053568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:43.053818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:43.053993Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592740854003323:3496]
2025-10-10T14:00:43.056127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:43.057236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:43.057516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:43.058792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:43.059101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:43.059110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:43.059116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:43.059123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:43.059130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:43.059137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:43.059144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:43.059150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:43.059157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.059163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.059169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.059175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.059220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:43.059319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:43.059363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:43.059406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:43.059446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:43.059505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:43.059545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:43.059581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:43.059618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.059658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.059697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.059735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.059774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:43.059836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:43.059896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:43.059940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:43.059980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:43.060026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:43.060064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:43.060109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:43.060150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:43.060197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:43.060238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:43.060288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:43.060327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:43.060370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:43.060408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:43.060454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:43.060539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.060595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.060637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.060684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.060725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.060770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.060811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.060854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.065659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:43.125812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:43.141370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:43.141423Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:43.141437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:43.141455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:43.141479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 129 [2:7559592740854003323:3496]
2025-10-10T14:00:43.141538Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:43.141597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:43.141612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.141624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.141635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.141680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:43.141701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:43.141723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:43.158835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.158875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.158887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.158899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.158909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:43.159183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:43.159199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.159340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.159526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.159734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.159840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:43.159912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592740854003317:3496]
2025-10-10T14:00:43.159926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592740854003317:3496]
2025-10-10T14:00:43.159938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592740854003317:3496]
2025-10-10T14:00:43.159951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592740854003317:3496]
2025-10-10T14:00:43.159984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:43.160063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:43.160172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:43.160186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:43.160198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:43.160212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:43.160228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:43.160245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:43.160390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592738136951713:3447], now have 1 active actors on pipe
2025-10-10T14:00:43.160410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592740854003317:3496]
2025-10-10T14:00:43.160440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:43.160472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592738136951747:3721], now have 1 active actors on pipe
2025-10-10T14:00:43.160493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592738136951665:2442], now have 1 active actors on pipe
2025-10-10T14:00:43.160643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:43.160930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 129, pipe: [1:7559592738136951713:3447]
2025-10-10T14:00:43.161070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 129
2025-10-10T14:00:43.161182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 129
2025-10-10T14:00:43.162341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:43.162467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:43.162567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:43.162599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.162617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.162628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:43.162665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.162710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:43.162760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:43.168803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:43.168852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:43.168924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:43.169428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 130 partition: 0 MaxSeqNo: 36 sessionId: src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0
2025-10-10T14:00:43.173370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c4b277-7434d06e-c76b8f05-7aac6366_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:43.245431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.245477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.245489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.250852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0] Write session: try to update token
2025-10-10T14:00:43.250921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:43.315945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:43.315987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:43.316002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:43.316013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:43.316025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:43.316062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592740854003317:3496]
2025-10-10T14:00:43.316087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592740854003317:3496]
2025-10-10T14:00:43.316109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592740854003317:3496]
2025-10-10T14:00:43.316127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592740854003317:3496]
2025-10-10T14:00:43.316271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:43.316312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.316325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:43.317746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:43.322646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:43.322724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:43.322752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:43.322775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:43.423991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId: src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:43.447947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:43.516780Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:43.528759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:43.528823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:43.530885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592738136951713:3447]
2025-10-10T14:00:43.531100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:43.531126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:43.532293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:43.532988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:43.609092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 130 reason: error at write: Disconnected sessionId: src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0
2025-10-10T14:00:43.613607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 130 sessionId: src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0 is DEAD
2025-10-10T14:00:43.617759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:43.617802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0] Write session will restart in 0.006691s
2025-10-10T14:00:43.617916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0] Write session: Do CDS request
2025-10-10T14:00:43.617951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:43.634738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:43.633039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592742431919255:3447]
2025-10-10T14:00:43.634529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:43.634546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 131
2025-10-10T14:00:43.635310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:43.635427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:43.635443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:43.635454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:43.636879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 131 sessionId:  describe result for acl check
2025-10-10T14:00:43.636984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:43.636993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:43.637001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:43.637018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592742431919267:3730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:43.639647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592742431919267:3730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:43.662155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592742431919267:3730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:43.694092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592742431919267:3730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:43.694153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592742431919267:3730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:43.694175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592742431919267:3730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:43.694223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:43.698567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:43.705738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:43.706645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:43.706664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:43.706705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:43.706993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:43.707187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592740854003536:3506]
2025-10-10T14:00:43.713514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:43.714847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:43.715078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:43.716354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:43.716677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:43.716685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:43.716692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:43.716698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:43.716705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:43.716712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:43.716719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:43.716727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:43.716733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.716740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.716747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.716753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.716805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:43.717930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:43.717992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:43.718043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:43.718088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:43.718134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:43.718181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:43.718229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:43.718277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.718326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.718372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.718444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.718495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:43.718572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:43.718635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:43.718690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:43.718743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:43.718814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:43.718864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:43.718915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:43.718961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:43.719011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:43.719056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:43.719108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:43.719155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:43.719206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:43.719253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:43.719307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:43.719363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.719419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.719478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.719547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.719592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.719643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.719688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.719740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.720196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:43.752016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:43.764798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:43.764854Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:43.764877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:43.765213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:43.765248Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 130 [2:7559592740854003536:3506]
2025-10-10T14:00:43.765308Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:43.765367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:43.765380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.765391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.765402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.765449Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:43.765473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:43.765495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:43.766713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.766727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.766738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.766752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.766762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:43.767024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:43.767045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:43.767185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:43.767365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:43.767636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:43.767760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:43.767840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592740854003530:3506]
2025-10-10T14:00:43.767854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592740854003530:3506]
2025-10-10T14:00:43.767866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592740854003530:3506]
2025-10-10T14:00:43.767878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592740854003530:3506]
2025-10-10T14:00:43.767920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:43.767997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:43.768170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:43.768186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:43.768317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592740854003530:3506]
2025-10-10T14:00:43.768333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:43.769467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:43.769502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:43.769511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:43.769521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:43.769544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:43.770540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592742431919170:2442], now have 1 active actors on pipe
2025-10-10T14:00:43.770576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592742431919255:3447], now have 1 active actors on pipe
2025-10-10T14:00:43.770602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592742431919363:3730], now have 1 active actors on pipe
2025-10-10T14:00:43.776491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:43.776545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:43.776635Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:43.776673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.776692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.776712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:43.776755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.775697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 130
2025-10-10T14:00:43.775800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 130, pipe: [1:7559592742431919255:3447]
2025-10-10T14:00:43.775877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 130
2025-10-10T14:00:43.778823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 131 partition: 0 MaxSeqNo: 36 sessionId: src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0
2025-10-10T14:00:43.780110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8717fdcf-e5c23a-d5bc91e8-d4087868_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:43.776809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:43.776871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:43.777476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:43.777498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:43.777564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:43.842368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0] Write session: try to update token
2025-10-10T14:00:43.842438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:43.865100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.865159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.865169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.057237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId: src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:44.058642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.058684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.058696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.058751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:44.058764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:44.058777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:44.058788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:44.058799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:44.058839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592740854003530:3506]
2025-10-10T14:00:44.058866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592740854003530:3506]
2025-10-10T14:00:44.058890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592740854003530:3506]
2025-10-10T14:00:44.058910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592740854003530:3506]
2025-10-10T14:00:44.059049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:44.059075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:44.059087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:44.060566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:44.060617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:44.060649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:44.060679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:44.061094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:44.103023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1010 14:00:44.231664646  107741 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:00:44.233327Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:00:44.300686Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:44.303745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:44.303799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:44.307647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:44.307885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:44.308015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592742431919255:3447]
2025-10-10T14:00:44.308089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:44.308099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:44.346557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 131 reason: error at write: Disconnected sessionId: src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0
2025-10-10T14:00:44.349804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 131 sessionId: src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0 is DEAD
2025-10-10T14:00:44.353339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:44.353373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0] Write session will restart in 0.008169s
2025-10-10T14:00:44.353463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0] Write session: Do CDS request
2025-10-10T14:00:44.353489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:44.375257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:44.402388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:44.402422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 132
2025-10-10T14:00:44.405489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:44.405637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:44.405653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:44.405665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:44.409845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 132 sessionId:  describe result for acl check
2025-10-10T14:00:44.409965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:44.409974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:44.409983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:44.409999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592746726886756:3742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:44.418412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592746726886775:3447]
2025-10-10T14:00:44.421002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592746726886756:3742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:44.452934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592746726886756:3742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:44.480737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:44.478976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592746726886756:3742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:44.479020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592746726886756:3742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:44.479036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592746726886756:3742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:44.479068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:44.495904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:44.496704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:44.496721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:44.496764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:44.496993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:44.497181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592745148971045:3515]
2025-10-10T14:00:44.499191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:44.500406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:44.500602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:44.501727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:44.502006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:44.502013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:44.502019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:44.502025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:44.502032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:44.502038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:44.502044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:44.502052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:44.502059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:44.502064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:44.502070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:44.502076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:44.502117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:44.502207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:44.502247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:44.502286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:44.502323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:44.502358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:44.502396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:44.502434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:44.502471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:44.502509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:44.502546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:44.502586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:44.502620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:44.502675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:44.502725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:44.502770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:44.502811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:44.502854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:44.502893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:44.502936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:44.502975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:44.503021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:44.503059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:44.503104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:44.503145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:44.503189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:44.503229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:44.503275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:44.503314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:44.503359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:44.503396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:44.503440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:44.503476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:44.503536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:44.503571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:44.503613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:44.503969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:44.567789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:44.598206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:44.598263Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:44.598278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:44.598295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:44.598318Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 131 [2:7559592745148971045:3515]
2025-10-10T14:00:44.598369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:44.598424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:44.598436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.598447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.598457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.598506Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:44.598528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:44.598548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:44.601066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:44.601082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:44.601095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:44.601107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:44.601117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:44.603355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:44.603398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:44.603532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:44.603688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:44.603899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:44.603998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:44.604071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:44.604094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:44.604106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:44.604117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:44.604147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:44.604223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:44.604378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:44.604395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:44.604532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:44.604552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:44.604779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:44.604791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:44.604801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:44.604812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:44.604833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:44.607855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 131, pipe: [1:7559592746726886775:3447]
2025-10-10T14:00:44.607968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 131
2025-10-10T14:00:44.608033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 131
2025-10-10T14:00:44.609642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592746726886775:3447], now have 1 active actors on pipe
2025-10-10T14:00:44.609692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592746726886875:3742], now have 1 active actors on pipe
2025-10-10T14:00:44.609711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592746726886701:2442], now have 1 active actors on pipe
2025-10-10T14:00:44.609766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:44.609788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:44.609878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:44.609913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.609930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.609940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:44.609977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.610024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:44.610072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:44.618085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:44.618141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:44.618227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:44.623066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 132 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0
2025-10-10T14:00:44.625377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6de8ac58-4b5afc64-ae5bd203-f431a5a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:44.705650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.705696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.705707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.710344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0] Write session: try to update token
2025-10-10T14:00:44.710395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:44.860525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:44.860573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:44.860585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:44.860596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:44.860606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:44.861205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId: src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:44.860641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:44.860668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:44.860688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:44.860706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:44.860859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.860871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.860883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.860982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:44.861006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:44.861016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:44.861402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:44.861431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:44.861458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:44.861485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:44.862498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:44.891129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:45.038647Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:45.049758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:45.049828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:45.049909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:45.049922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:45.049967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592745148971037:3515]
2025-10-10T14:00:45.051174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:45.051326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592746726886775:3447]
2025-10-10T14:00:45.051406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:45.051438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:45.050498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:45.056776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:45.105373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:45.105464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0] Write session will restart in 0.007921s
2025-10-10T14:00:45.102993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 132 reason: error at write: Disconnected sessionId: src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0
2025-10-10T14:00:45.105659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0] Write session: Do CDS request
2025-10-10T14:00:45.103390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 132 sessionId: src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0 is DEAD
2025-10-10T14:00:45.105708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:45.121173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:45.121214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 133
2025-10-10T14:00:45.121882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:45.122649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:45.122779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:45.122795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:45.122805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:45.124209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 133 sessionId:  describe result for acl check
2025-10-10T14:00:45.124317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:45.124326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:45.124336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:45.124354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592751021854243:3752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:45.126829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592751021854243:3752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:45.150902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592751021854301:3447]
2025-10-10T14:00:45.154454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592751021854243:3752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:45.169340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592751021854243:3752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:45.169391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592751021854243:3752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:45.169408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592751021854243:3752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:45.169443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:45.229183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:45.234999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:45.235977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:45.235999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:45.236050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:45.236332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:45.236518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592749443938565:3526]
2025-10-10T14:00:45.238938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:45.240986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:45.241261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:45.242532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:45.242871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:45.242893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:45.242901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:45.242909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:45.242917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:45.242924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:45.242931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:45.242937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:45.242944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.242950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.242958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.242964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.243009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:45.243117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:45.243167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:45.243212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:45.243255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:45.243297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:45.243344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:45.243391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:45.243434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.243480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.243544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.243594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.243638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:45.243706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:45.243763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:45.243822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:45.243872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:45.243925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:45.243970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:45.244022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:45.244069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:45.244122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:45.244167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:45.244218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:45.244263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:45.244314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:45.244360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:45.244411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:45.244458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.244512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.244556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.244613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.244662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.244713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.244758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.244813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.246326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:45.270403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:45.329706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:45.329765Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:45.329781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:45.329801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:45.329826Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 132 [2:7559592749443938565:3526]
2025-10-10T14:00:45.329878Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:45.329938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:45.329952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.329966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.329978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.330026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:45.330047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:45.330070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:45.331357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.331372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.331386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.331398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.331408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:45.331699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:45.331738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.331874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.332097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.332362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.332364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 132, pipe: [1:7559592751021854301:3447]
2025-10-10T14:00:45.332485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 132
2025-10-10T14:00:45.332487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:45.332584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592751021854301:3447], now have 1 active actors on pipe
2025-10-10T14:00:45.332608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592751021854225:2442], now have 1 active actors on pipe
2025-10-10T14:00:45.332629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592751021854341:3752], now have 1 active actors on pipe
2025-10-10T14:00:45.332655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.332669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.332682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.332695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.332734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:45.332820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:45.332996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:45.333025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:45.332590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 132
2025-10-10T14:00:45.333204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:45.333244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:45.333246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.333255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:45.333266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:45.333267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:45.333292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:45.333408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:45.333429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:45.333517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e96512fa-9dadab1e-416f7140-c880aa03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:45.333550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.333568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.333578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:45.333614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.333654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:45.333696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:45.334768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:45.334802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:45.334864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:45.335177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 133 partition: 0 MaxSeqNo: 36 sessionId: src_id|e96512fa-9dadab1e-416f7140-c880aa03_0
2025-10-10T14:00:45.336089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea0904d-61f2ab3e-3b553279-25159cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e96512fa-9dadab1e-416f7140-c880aa03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:45.376969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e96512fa-9dadab1e-416f7140-c880aa03_0] Write session: try to update token
2025-10-10T14:00:45.377031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e96512fa-9dadab1e-416f7140-c880aa03_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:45.621305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId: src_id|e96512fa-9dadab1e-416f7140-c880aa03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:45.626823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.626886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.626899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.626962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:45.626978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:45.626994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:45.627007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:45.627019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:45.627062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.627092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.627118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.627146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.627263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:45.627306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:45.627325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:45.627342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:45.627372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:45.627402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.627434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:45.634399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:45.675949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:45.789959Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:45.802857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:45.802917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:45.802988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:45.803000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:45.803042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592749443938559:3526]
2025-10-10T14:00:45.803406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:45.804082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:45.804676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592751021854301:3447]
2025-10-10T14:00:45.804751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:45.804878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:45.804889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:45.837543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96512fa-9dadab1e-416f7140-c880aa03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:45.837579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96512fa-9dadab1e-416f7140-c880aa03_0] Write session will restart in 0.006672s
2025-10-10T14:00:45.837663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96512fa-9dadab1e-416f7140-c880aa03_0] Write session: Do CDS request
2025-10-10T14:00:45.837688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96512fa-9dadab1e-416f7140-c880aa03_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:45.835482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 133 reason: error at write: Disconnected sessionId: src_id|e96512fa-9dadab1e-416f7140-c880aa03_0
2025-10-10T14:00:45.835877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 133 sessionId: src_id|e96512fa-9dadab1e-416f7140-c880aa03_0 is DEAD
2025-10-10T14:00:45.854606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e96512fa-9dadab1e-416f7140-c880aa03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:45.855326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:45.855357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 134
2025-10-10T14:00:45.855750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:45.855866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:45.855882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:45.855892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:45.857300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 134 sessionId:  describe result for acl check
2025-10-10T14:00:45.857407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:45.857417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:45.857426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:45.857441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592751021854475:3766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:45.859914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592751021854475:3766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:45.871682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592751021854475:3766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:45.882293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592751021854475:3766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:45.882335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592751021854475:3766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:45.882352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592751021854475:3766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:45.882383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:45.900922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592751021854583:3447]
2025-10-10T14:00:45.931216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:45.932863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:45.933627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:45.933645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:45.933686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:45.933927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:45.934100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592749443938771:3529]
2025-10-10T14:00:45.936258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:45.937306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:45.937517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:45.938675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:45.938969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:45.938976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:45.938982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:45.938988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:45.938995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:45.939003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:45.939010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:45.939017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:45.939023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.939028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.939035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.939041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.939086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:45.939189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:45.939234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:45.939273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:45.939314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:45.939358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:45.939397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:45.939438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:45.939478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.939519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.939579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.939619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.939655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:45.939712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:45.939764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:45.939812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:45.939857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:45.939902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:45.939941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:45.940724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:45.940793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:45.940845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:45.940902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:45.940955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:45.941003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:45.941053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:45.941112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:45.941177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:45.941227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.941276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:45.941319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.941368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:45.941411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.941459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:45.941499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.941545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:45.941935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:45.976132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:46.044143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:46.047828Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:46.047876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:46.047893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:46.047924Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 133 [2:7559592749443938771:3529]
2025-10-10T14:00:46.047975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:46.048030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:46.048044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.048056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.048066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.048110Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:46.048134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:46.048156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:46.061152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.061206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:46.061217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:46.061229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:46.061240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:46.061522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:46.061536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.061653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:46.061803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:46.061990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:46.062087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:46.062154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.062168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.062181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.062191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.062241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:46.062314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:46.062464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:46.062480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:46.062603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.062620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:46.062940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:46.062953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:46.062964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:46.062972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:46.062995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:46.064082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592751021854583:3447], now have 1 active actors on pipe
2025-10-10T14:00:46.064107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592751021854533:3766], now have 1 active actors on pipe
2025-10-10T14:00:46.064126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592751021854459:2442], now have 1 active actors on pipe
2025-10-10T14:00:46.065269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 133, pipe: [1:7559592751021854583:3447]
2025-10-10T14:00:46.065373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 133
2025-10-10T14:00:46.065437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 133
2025-10-10T14:00:46.065898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:46.065966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:46.066070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89ec7226-9164f01e-c2386dfc-81564500_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:46.066106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.066124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.066134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:46.066170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.066215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:46.066261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:46.073277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:46.073337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:46.073425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:46.077929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e96512fa-9dadab1e-416f7140-c880aa03_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89ec7226-9164f01e-c2386dfc-81564500_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:46.077104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 134 partition: 0 MaxSeqNo: 36 sessionId: src_id|89ec7226-9164f01e-c2386dfc-81564500_0
2025-10-10T14:00:46.131065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ec7226-9164f01e-c2386dfc-81564500_0] Write session: try to update token
2025-10-10T14:00:46.131117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ec7226-9164f01e-c2386dfc-81564500_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:46.280232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.280272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.280286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.280396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:46.280408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:46.280420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:46.280430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:46.280441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:46.280472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.280498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.280519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.280538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.281299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:46.281330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:46.281358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:46.281382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:46.298420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:46.298468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.298476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:46.306960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId: src_id|89ec7226-9164f01e-c2386dfc-81564500_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:46.309094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:46.340151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:46.460875Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:46.462924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:46.462944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:46.462987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592749443938766:3529]
2025-10-10T14:00:46.463138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:46.463166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:46.464404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:46.466276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:46.465810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:46.465956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592751021854583:3447]
2025-10-10T14:00:46.466054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:46.466068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:46.519348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 134 reason: error at write: Disconnected sessionId: src_id|89ec7226-9164f01e-c2386dfc-81564500_0
2025-10-10T14:00:46.519679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 134 sessionId: src_id|89ec7226-9164f01e-c2386dfc-81564500_0 is DEAD
2025-10-10T14:00:46.521602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ec7226-9164f01e-c2386dfc-81564500_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:46.521630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ec7226-9164f01e-c2386dfc-81564500_0] Write session will restart in 0.009310s
2025-10-10T14:00:46.521717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ec7226-9164f01e-c2386dfc-81564500_0] Write session: Do CDS request
2025-10-10T14:00:46.521744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ec7226-9164f01e-c2386dfc-81564500_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:46.547247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ec7226-9164f01e-c2386dfc-81564500_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:46.553225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:46.553259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 135
2025-10-10T14:00:46.560030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:46.560190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:46.560207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:46.560217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:46.562415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 135 sessionId:  describe result for acl check
2025-10-10T14:00:46.562553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:46.562564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:46.562574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:46.562593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592755316822026:3774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:46.565529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592755316822026:3774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:46.569516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592755316822049:3447]
2025-10-10T14:00:46.592564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592755316822026:3774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:46.619453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592755316822026:3774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:46.619507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592755316822026:3774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:46.619525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592755316822026:3774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:46.619581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:46.626491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:46.633988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:46.634907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:46.634926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:46.634969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:46.635225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:46.635409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592753738906292:3542]
2025-10-10T14:00:46.637986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:46.642420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:46.642710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:46.644375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:46.644768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:46.644777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:46.644785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:46.644793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:46.644801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:46.644807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:46.644815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:46.644822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:46.644830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.644837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:46.644846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:46.644852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:46.644905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:46.645034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:46.645094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:46.645169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:46.645223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:46.645280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:46.645335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:46.645386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:46.645440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.645498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:46.645552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:46.645602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:46.645646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:46.645722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:46.645787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:46.645852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:46.645911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:46.645971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:46.646025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:46.646094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:46.646151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:46.646216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:46.646271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:46.646334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:46.646391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:46.646453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:46.646510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:46.646573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:46.646629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.646693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.646747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:46.646811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:46.646866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:46.646926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:46.646981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:46.647041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:46.647573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:46.767882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:46.800097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 134
2025-10-10T14:00:46.800186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 134, pipe: [1:7559592755316822049:3447]
2025-10-10T14:00:46.800264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 134
2025-10-10T14:00:46.796383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:46.796451Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:46.796472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:46.796494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:46.796519Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 134 [2:7559592753738906292:3542]
2025-10-10T14:00:46.796585Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:46.796646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:46.796663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.796677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.796690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.796738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:46.796762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:46.796786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:46.798070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.798090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:46.798106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:46.798123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:46.798136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:46.798411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:46.798431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.798588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:46.798786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:46.799036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:46.799165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:46.799244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592755316821963:2442], now have 1 active actors on pipe
2025-10-10T14:00:46.799269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592755316822049:3447], now have 1 active actors on pipe
2025-10-10T14:00:46.799293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592755316822141:3774], now have 1 active actors on pipe
2025-10-10T14:00:46.799318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592753738906286:3542]
2025-10-10T14:00:46.799333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592753738906286:3542]
2025-10-10T14:00:46.799348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592753738906286:3542]
2025-10-10T14:00:46.799360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592753738906286:3542]
2025-10-10T14:00:46.799402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:46.799484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:46.799694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:46.799712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:46.799829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592753738906286:3542]
2025-10-10T14:00:46.799848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:46.799946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:46.799959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:46.799971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:46.799984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:46.800007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:46.801707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:46.801756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:46.801860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:46.801891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.801911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.801923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:46.801959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.802002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:46.802046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:46.809192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:46.809256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:46.809344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:46.809856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 135 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0
2025-10-10T14:00:46.810609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ec7226-9164f01e-c2386dfc-81564500_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:46.848960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0] Write session: try to update token
2025-10-10T14:00:46.849019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:46.897337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.897386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.897401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.926568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:46.942461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:46.942509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:46.942519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:46.942531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:46.942569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592753738906286:3542]
2025-10-10T14:00:46.942594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592753738906286:3542]
2025-10-10T14:00:46.942617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592753738906286:3542]
2025-10-10T14:00:46.942640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592753738906286:3542]
2025-10-10T14:00:46.942802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:46.942830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:46.942841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:46.943969Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:46.949248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:46.949323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:46.949357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:46.949394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:47.089908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId: src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:47.142746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:47.234785Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:47.236708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:47.236756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:47.240014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:47.240204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592755316822049:3447]
2025-10-10T14:00:47.240293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:47.240307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:47.252078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:47.252166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0] Write session will restart in 0.008976s
2025-10-10T14:00:47.252378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0] Write session: Do CDS request
2025-10-10T14:00:47.252445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:47.251232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 135 reason: error at write: Disconnected sessionId: src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0
2025-10-10T14:00:47.251593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 135 sessionId: src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0 is DEAD
2025-10-10T14:00:47.269804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:47.272718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:47.272750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 136
2025-10-10T14:00:47.273166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:47.273325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:47.273349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:47.273372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:47.275081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 136 sessionId:  describe result for acl check
2025-10-10T14:00:47.275203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:47.275214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:47.275224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:47.275242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592759611789498:3781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:47.278252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592759611789498:3781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:47.303350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592759611789498:3781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:47.306705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:47.337666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592759611789574:3447]
2025-10-10T14:00:47.338368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592759611789498:3781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:47.338386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592759611789498:3781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:47.338400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592759611789498:3781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:47.338424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:47.421746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:47.428704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:47.429696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:47.429717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:47.429762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:47.430042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:47.430227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592758033873791:3549]
2025-10-10T14:00:47.433089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:47.434315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:47.434556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:47.435879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:47.436219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:47.436240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:47.436248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:47.436255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:47.436262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:47.436269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:47.436276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:47.436283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:47.436290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:47.436295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:47.436303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:47.436310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:47.436358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:47.436468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:47.436519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:47.436566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:47.436610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:47.436656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:47.436702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:47.436751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:47.436797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:47.436846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:47.436892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:47.436937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:47.436979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:47.437051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:47.437110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:47.437698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:47.437766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:47.437826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:47.437873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:47.437927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:47.437973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:47.438026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:47.438070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:47.438121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:47.438166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:47.438220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:47.438265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:47.438318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:47.438364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:47.438417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:47.438459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:47.438515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:47.438559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:47.438618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:47.438663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:47.438718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:47.439175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:47.512780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:47.541089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:47.541164Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:47.541183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:47.541205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:47.541230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 135 [2:7559592758033873791:3549]
2025-10-10T14:00:47.541291Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:47.541349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:47.541365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.541379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.541391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.541438Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:47.541460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:47.541484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:47.550725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:47.550773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:47.550790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:47.550810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:47.550824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:47.551118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:47.551138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:47.551301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:47.551502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:47.551751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:47.551873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:47.551951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:47.551968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:47.551984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:47.551998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:47.552043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:47.552127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:47.552324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:47.552342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:47.556288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:47.556351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:47.557788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 135
2025-10-10T14:00:47.557897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 135
2025-10-10T14:00:47.557978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 135, pipe: [1:7559592759611789574:3447]
2025-10-10T14:00:47.556679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:47.556708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:47.556721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:47.556734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:47.556759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:47.560826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592759611789577:3781], now have 1 active actors on pipe
2025-10-10T14:00:47.560887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592759611789484:2442], now have 1 active actors on pipe
2025-10-10T14:00:47.560912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592759611789574:3447], now have 1 active actors on pipe
2025-10-10T14:00:47.560971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:47.560997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:47.561089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:47.561139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.561157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.561168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:47.561209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.561253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:47.561306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:47.567121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 136 partition: 0 MaxSeqNo: 36 sessionId: src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0
2025-10-10T14:00:47.570140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f42c365-31a2d292-3bc76e7a-8b962d92_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:47.566651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:47.566710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:47.566805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:47.631063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0] Write session: try to update token
2025-10-10T14:00:47.631124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:47.645358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.645410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.645422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.832447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:47.832494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:47.832506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:47.832514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:47.832526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:47.832560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:47.832584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:47.832605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:47.832622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:47.832781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.832792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.832802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.832902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:47.832923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:47.832933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:47.833987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:47.837676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:47.837731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:47.837765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:47.837792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:47.844980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId: src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:47.897203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:48.033708Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:48.057530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592759611789574:3447]
2025-10-10T14:00:48.057647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:48.057660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:48.054527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:48.054589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:48.054657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:48.054670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:48.054711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592758033873785:3549]
2025-10-10T14:00:48.055075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:48.057047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:48.103693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:48.103841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 136 reason: error at write: Disconnected sessionId: src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0
2025-10-10T14:00:48.104198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 136 sessionId: src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0 is DEAD
2025-10-10T14:00:48.110137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:48.110181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0] Write session will restart in 0.009874s
2025-10-10T14:00:48.110281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0] Write session: Do CDS request
2025-10-10T14:00:48.110311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:48.128124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:48.137438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:48.137472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 137
2025-10-10T14:00:48.141513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:48.141668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:48.141684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:48.141695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:48.143411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 137 sessionId:  describe result for acl check
2025-10-10T14:00:48.143531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:48.143540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:48.143549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:48.143565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592763906757049:3794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:48.146027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592763906757049:3794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:48.161635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592763906757076:3447]
2025-10-10T14:00:48.185504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592763906757049:3794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:48.203623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592763906757049:3794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:48.203668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592763906757049:3794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:48.203684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592763906757049:3794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:48.203718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:48.245069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:48.252025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:48.252921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:48.252940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:48.252983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:48.253261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:48.253436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592762328841332:3559]
2025-10-10T14:00:48.255643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:48.258181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:48.258463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:48.259760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:48.260084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:48.260092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:48.260097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:48.260103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:48.260108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:48.260114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:48.260119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:48.260125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:48.260131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.260137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.260143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.260149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.260189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:48.260300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:48.260338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:48.260373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:48.260431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:48.260471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:48.260512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:48.260552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:48.260594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.260633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.260667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.260703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.260740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:48.260801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:48.260852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:48.260897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:48.260932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:48.260973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:48.261009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:48.261050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:48.261088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:48.278702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:48.278856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:48.278945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:48.278987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:48.279037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:48.279079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:48.279121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:48.279163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.279208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.279244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.279287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.279327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.279396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.279431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.279474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.279895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:48.332353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:48.352717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 136, pipe: [1:7559592763906757076:3447]
2025-10-10T14:00:48.352820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 136
2025-10-10T14:00:48.352899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 136
2025-10-10T14:00:48.348847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:48.348919Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:48.348939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:48.348962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:48.348989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 136 [2:7559592762328841332:3559]
2025-10-10T14:00:48.349051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:48.349111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:48.349165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.349181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.349195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.349247Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:48.349269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:48.349294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:48.350652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.350672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.350688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.350705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.350718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:48.350989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:48.351007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.351164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.351359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.353604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.353732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:48.353822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592763906757076:3447], now have 1 active actors on pipe
2025-10-10T14:00:48.353877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592763906757026:2442], now have 1 active actors on pipe
2025-10-10T14:00:48.353899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592763906757162:3794], now have 1 active actors on pipe
2025-10-10T14:00:48.353963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:48.353984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:48.354020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.354036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.354050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.354065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.354102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:48.354180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:48.354351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:48.354369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:48.354432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:48.354461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.354477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.354487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:48.354523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.354560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:48.354681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.354703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:48.354747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:48.355710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:48.355724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:48.355734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:48.355743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:48.355765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:48.363476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:48.363540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:48.363646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:48.369163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 137 partition: 0 MaxSeqNo: 36 sessionId: src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0
2025-10-10T14:00:48.370106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d0b1d8-c84adab1-d021d52e-4b24c9d9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:48.419808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0] Write session: try to update token
2025-10-10T14:00:48.419871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:48.449837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.449890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.449904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.594779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:48.594834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:48.594849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:48.594863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:48.594874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:48.594913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.594940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.594968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.594992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.595166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.595181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.595194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.595302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:48.595331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.595343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:48.596474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:48.597277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:48.597311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:48.597341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:48.597369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:48.655931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId: src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:48.707843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:48.754015Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:48.764506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:48.764571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:48.764637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:48.764651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:48.764690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592762328841326:3559]
2025-10-10T14:00:48.765172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:48.765425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:48.766506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592763906757076:3447]
2025-10-10T14:00:48.766678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:48.766893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:48.817467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 137 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0
2025-10-10T14:00:48.817811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 137 sessionId: src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0 is DEAD
2025-10-10T14:00:48.825325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:48.825369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0] Write session will restart in 0.005058s
2025-10-10T14:00:48.825474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0] Write session: Do CDS request
2025-10-10T14:00:48.825504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:48.838448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:48.849249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:48.849280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 138
2025-10-10T14:00:48.851556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:48.851725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:48.851753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:48.851763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:48.854516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 138 sessionId:  describe result for acl check
2025-10-10T14:00:48.854643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:48.854654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:48.854665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:48.854682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592763906757350:3803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:48.860522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592763906757350:3803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:48.866692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592763906757383:3447]
2025-10-10T14:00:48.878370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592763906757350:3803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:48.887141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:48.889994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592763906757350:3803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:48.890035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592763906757350:3803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:48.890051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592763906757350:3803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:48.890081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:48.891751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:48.892600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:48.892617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:48.892659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:48.892906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:48.893094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592762328841526:3569]
2025-10-10T14:00:48.895351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:48.896355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:48.896588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:48.897868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:48.898183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:48.898191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:48.898198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:48.898206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:48.898214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:48.898222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:48.898229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:48.898236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:48.898244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.898250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.898257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.898264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.898314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:48.898426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:48.898480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:48.898532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:48.898580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:48.898626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:48.898677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:48.898728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:48.898773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.898824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.898872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.898921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.898961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:48.899031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:48.899095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:48.899154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:48.899216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:48.899272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:48.899317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:48.899376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:48.899424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:48.899483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:48.899529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:48.899582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:48.899647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:48.899706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:48.899756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:48.899809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:48.899860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.899917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.899964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.900017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.900063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.900122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.900169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.900230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.900699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:48.932682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:48.947393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:48.947456Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:48.947475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:48.947496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:48.947522Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 137 [2:7559592762328841526:3569]
2025-10-10T14:00:48.947583Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:48.947661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:48.947678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.947691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.947703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.947750Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:48.947774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:48.947797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:48.987377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.987421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.987431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.987442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.987453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:48.987769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:48.987787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:48.987916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:48.988066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:48.988256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:48.988372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:48.988448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:48.988463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:48.988478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:48.988493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:48.988538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:48.988630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:48.988839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:48.988857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:48.988992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:48.989013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:48.989276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:48.989292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:48.989305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:48.989317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:48.989348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:48.990506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592763906757383:3447], now have 1 active actors on pipe
2025-10-10T14:00:48.990565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592763906757428:3803], now have 1 active actors on pipe
2025-10-10T14:00:48.990600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592763906757242:2442], now have 1 active actors on pipe
2025-10-10T14:00:48.991948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 137, pipe: [1:7559592763906757383:3447]
2025-10-10T14:00:48.992061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 137
2025-10-10T14:00:48.992136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 137
2025-10-10T14:00:48.997382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:48.997439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:48.997533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b8442d-41e6e77a-33013b73-8d426351_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:48.997568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.997586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.997597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:48.997633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.997678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:48.997729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:49.004510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:49.004573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:49.004666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:49.005220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 138 partition: 0 MaxSeqNo: 36 sessionId: src_id|5b8442d-41e6e77a-33013b73-8d426351_0
2025-10-10T14:00:49.006101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ace8c2f0-4fb4361c-e012bb43-ef84d58b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5b8442d-41e6e77a-33013b73-8d426351_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:49.042325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:49.042372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:49.042409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:49.042530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:49.044397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:49.045206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:49.050081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:49.057832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:49.061250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:49.063249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:49.063691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.063705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.063716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.063772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:49.068176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8442d-41e6e77a-33013b73-8d426351_0] Write session: try to update token
2025-10-10T14:00:49.068228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8442d-41e6e77a-33013b73-8d426351_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:49.198506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.198560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.198573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.198629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:49.198645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:49.198660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:49.198673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:49.198686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:49.198729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:49.198759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:49.198784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:49.198807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592762328841519:3569]
2025-10-10T14:00:49.198951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:49.198958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:49.198984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:49.198985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:49.198997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:49.199012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:49.199044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:49.200034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:49.238471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId: src_id|5b8442d-41e6e77a-33013b73-8d426351_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:49.269151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:49.391055Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:49.403571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592763906757383:3447]
2025-10-10T14:00:49.403700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:49.402199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:49.402254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:49.402943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:49.415930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:49.416058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 138 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b8442d-41e6e77a-33013b73-8d426351_0
2025-10-10T14:00:49.416355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 138 sessionId: src_id|5b8442d-41e6e77a-33013b73-8d426351_0 is DEAD
2025-10-10T14:00:49.417518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8442d-41e6e77a-33013b73-8d426351_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:49.417563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8442d-41e6e77a-33013b73-8d426351_0] Write session will restart in 0.009289s
2025-10-10T14:00:49.417677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8442d-41e6e77a-33013b73-8d426351_0] Write session: Do CDS request
2025-10-10T14:00:49.417710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8442d-41e6e77a-33013b73-8d426351_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:49.441936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8442d-41e6e77a-33013b73-8d426351_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:49.455518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:49.455550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 139
2025-10-10T14:00:49.459036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:49.459244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:49.459269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:49.459279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:49.465253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 139 sessionId:  describe result for acl check
2025-10-10T14:00:49.465380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:49.465390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:49.465399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:49.465416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592768201724766:3814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:49.467937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592768201724766:3814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:49.485677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592768201724766:3814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:49.503091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592768201724846:3447]
2025-10-10T14:00:49.505245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592768201724766:3814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:49.505285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592768201724766:3814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:49.505301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592768201724766:3814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:49.505331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:49.546601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:49.554563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:49.555532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:49.555552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:49.555608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:49.555907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:49.556124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592766623809043:3578]
2025-10-10T14:00:49.558620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:49.559995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:49.560234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:49.561445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:49.561769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:49.561777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:49.561783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:49.561789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:49.561795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:49.561803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:49.561809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:49.561816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:49.561825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:49.561831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:49.561839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:49.561845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:49.561892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:49.561995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:49.562037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:49.562087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:49.562130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:49.562174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:49.562212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:49.562254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:49.562294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:49.562340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:49.562383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:49.562426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:49.562466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:49.562534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:49.562592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:49.562646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:49.562691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:49.562741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:49.562785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:49.562837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:49.562885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:49.562939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:49.562987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:49.563042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:49.563092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:49.563147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:49.563191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:49.563245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:49.563295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:49.563349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:49.563398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:49.563456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:49.563504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:49.563558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:49.563604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:49.563673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:49.565428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:49.610654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:49.653718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:49.653777Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:49.653795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:49.653815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:49.653840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 138 [2:7559592766623809043:3578]
2025-10-10T14:00:49.653895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:49.653960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:49.653977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.653989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.654001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.654052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:49.654075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:49.654098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:49.655981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:49.656001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:49.656015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:49.656028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:49.656038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:49.656328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:49.656346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:49.656488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:49.656667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:49.656888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:49.657001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:49.657078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:49.657094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:49.657107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:49.657119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:49.658419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 138
2025-10-10T14:00:49.658527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 138
2025-10-10T14:00:49.658588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 138, pipe: [1:7559592768201724846:3447]
2025-10-10T14:00:49.658398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:49.658513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:49.658698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:49.658718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:49.658766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592768201724850:3814], now have 1 active actors on pipe
2025-10-10T14:00:49.658791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592768201724846:3447], now have 1 active actors on pipe
2025-10-10T14:00:49.658814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592768201724755:2442], now have 1 active actors on pipe
2025-10-10T14:00:49.658841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:49.658854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:49.658866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:49.658877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:49.658942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:49.658963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:49.658986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:49.659087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:49.659108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:49.660261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:49.660319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.660340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.660351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:49.660389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.660433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:49.660523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:49.665134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:49.665192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:49.665290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:49.666191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 139 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0
2025-10-10T14:00:49.667475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b8442d-41e6e77a-33013b73-8d426351_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:49.749458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0] Write session: try to update token
2025-10-10T14:00:49.749515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:49.756941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.756995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.757009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.884714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:49.899431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:49.899481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:49.899492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:49.899503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:49.899539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:49.899565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:49.899588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:49.899609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:49.899819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.899833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.899845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.900149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:49.900185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:49.900216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:49.900247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:50.004792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:50.004860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:50.004871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:50.005241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId: src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:50.011148Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:50.045479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:50.226269Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:50.227979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:50.227997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:50.228044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592766623809037:3578]
2025-10-10T14:00:50.228198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:50.228223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:50.228583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:50.229599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:50.231971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592768201724846:3447]
2025-10-10T14:00:50.232165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:50.233293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:50.247405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:00:50.247454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0] Write session will restart in 0.007341s
2025-10-10T14:00:50.247566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0] Write session: Do CDS request
2025-10-10T14:00:50.247600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:50.241972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 139 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0
2025-10-10T14:00:50.242337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 139 sessionId: src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0 is DEAD
2025-10-10T14:00:50.268002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:50.269621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:50.269655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 140
2025-10-10T14:00:50.270089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:50.270225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:50.270241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:50.270253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:50.272079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 140 sessionId:  describe result for acl check
2025-10-10T14:00:50.272223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:50.272236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:50.272246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:50.272266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592772496692298:3824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:50.275373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592772496692298:3824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:50.296231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592772496692298:3824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:50.330467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592772496692331:3447]
2025-10-10T14:00:50.339316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592772496692298:3824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:50.339368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592772496692298:3824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:50.339385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592772496692298:3824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:50.339422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:50.506991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:50.515780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:50.516777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:50.516796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:50.516845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:50.517116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:50.517333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592770918776574:3589]
2025-10-10T14:00:50.520673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:50.522088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:50.522318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:50.523233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:50.523431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:50.523436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:50.523440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:50.523445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:50.523450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:50.523456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:50.523461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:50.523465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:50.523470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:50.523475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:50.523479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:50.523483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:50.523513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:50.523588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:50.523619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:50.523671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:50.523700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:50.523729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:50.523759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:50.523803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:50.523833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:50.523860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:50.523888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:50.523918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:50.523945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:50.523986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:50.524021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:50.524059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:50.524103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:50.524152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:50.524180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:50.524214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:50.524242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:50.524273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:50.524302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:50.524334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:50.524362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:50.524394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:50.524420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:50.524451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:50.524479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:50.524510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:50.524537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:50.524571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:50.524599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:50.524631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:50.524657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:50.524688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:50.524948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:50.573028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:50.604140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:50.604201Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:50.604219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:50.604242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:50.604267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 139 [2:7559592770918776574:3589]
2025-10-10T14:00:50.604322Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:50.604386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:50.604401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.604414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.604425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.604474Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:50.604500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:50.604523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:50.680527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:50.680566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:50.680580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:50.680594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:50.680606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:50.680889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:50.680905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:50.681051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:50.681255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:50.681531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:50.681652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:50.681733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:50.681748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:50.681761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:50.681775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:50.681819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:50.681903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:50.682076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:50.682091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:50.682212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:50.682229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:50.682998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:50.683022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:50.683034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:50.683054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:50.683080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:50.684539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592772496692335:3824], now have 1 active actors on pipe
2025-10-10T14:00:50.684575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592772496692331:3447], now have 1 active actors on pipe
2025-10-10T14:00:50.684607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592772496692290:2442], now have 1 active actors on pipe
2025-10-10T14:00:50.685611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 139
2025-10-10T14:00:50.685647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 139, pipe: [1:7559592772496692331:3447]
2025-10-10T14:00:50.685694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 139
2025-10-10T14:00:50.689652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:50.689697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:50.689798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:50.689833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.689851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.689862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:50.689900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.689948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:50.689998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:50.690780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:50.690807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:50.690866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:50.691200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 140 partition: 0 MaxSeqNo: 36 sessionId: src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0
2025-10-10T14:00:50.696117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d756e42-ce4ce206-b573c9c1-d9b1f3e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:50.702908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.702943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.702955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.753871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0] Write session: try to update token
2025-10-10T14:00:50.753926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:50.832807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:50.832882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:50.832911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:50.832938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:50.832954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:50.833022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:50.833069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:50.833115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:50.833184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:50.833366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:50.833442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:50.833495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:50.833530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.833555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.833576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.833573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:50.833655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:50.833702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:50.833721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:50.844083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:50.888395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId: src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:50.927766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:50.996389Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:51.008130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:51.008190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:51.008261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:51.008276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:51.008321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592770918776568:3589]
2025-10-10T14:00:51.009531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:51.010347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:51.010377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:51.013669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:51.017315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592772496692331:3447]
2025-10-10T14:00:51.017403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:51.041520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 140 reason: error at write: Disconnected sessionId: src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0
2025-10-10T14:00:51.041863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 140 sessionId: src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0 is DEAD
2025-10-10T14:00:51.045867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:51.045905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0] Write session will restart in 0.007864s
2025-10-10T14:00:51.046003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0] Write session: Do CDS request
2025-10-10T14:00:51.046032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:51.064273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:51.067936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:51.067970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 141
2025-10-10T14:00:51.073302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:51.073459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:51.073476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:51.073487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:51.075070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 141 sessionId:  describe result for acl check
2025-10-10T14:00:51.075186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:51.075196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:51.075205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:51.075223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592776791659835:3833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:51.080173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592776791659835:3833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:51.095067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592776791659835:3833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:51.121246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592776791659913:3447]
2025-10-10T14:00:51.135319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592776791659835:3833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:51.135360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592776791659835:3833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:51.135379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592776791659835:3833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:51.135411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:51.169845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:51.180049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:51.180887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:51.180903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:51.180964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:51.181219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:51.181401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592775213744090:3598]
2025-10-10T14:00:51.183386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:51.184657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:51.184843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:51.185896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:51.186319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:51.186326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:51.186331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:51.186336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:51.186340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:51.186346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:51.186351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:51.186355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:51.186360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.186369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.186374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.186378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.186417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:51.186506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:51.186547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:51.186586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:51.186621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:51.186657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:51.186693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:51.186732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:51.186771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.186809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.186847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.186885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.186920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:51.186977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:51.187032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:51.187079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:51.187119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:51.187166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:51.187204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:51.187252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:51.187294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:51.187342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:51.187379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:51.187427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:51.187468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:51.187516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:51.187556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:51.187600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:51.187711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.187758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.187797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.187849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.187889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.187934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.187971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.188012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.188369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:51.256358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:51.272270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:51.272786Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:51.272808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:51.272824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:51.272844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 140 [2:7559592775213744090:3598]
2025-10-10T14:00:51.272900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:51.272954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:51.272965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.272975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.272985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.273026Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:51.273045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:51.273076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:51.275634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.275649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.275675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.275687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.275696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:51.277269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 140, pipe: [1:7559592776791659913:3447]
2025-10-10T14:00:51.277381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 140
2025-10-10T14:00:51.277453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 140
2025-10-10T14:00:51.277611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:51.277641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.277775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.277939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.278146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.278246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:51.278289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592776791659913:3447], now have 1 active actors on pipe
2025-10-10T14:00:51.278309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592776791659822:2442], now have 1 active actors on pipe
2025-10-10T14:00:51.278327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592776791659960:3833], now have 1 active actors on pipe
2025-10-10T14:00:51.278410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:51.278430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:51.278476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592775213744084:3598]
2025-10-10T14:00:51.278491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592775213744084:3598]
2025-10-10T14:00:51.278502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592775213744084:3598]
2025-10-10T14:00:51.278515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592775213744084:3598]
2025-10-10T14:00:51.278552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:51.278624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:51.278778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:51.278793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:51.278864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:51.278895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.278911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.278920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:51.278953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.278996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:51.279121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592775213744084:3598]
2025-10-10T14:00:51.279140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:51.279178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:51.279273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:51.279290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:51.279302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:51.279313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:51.279342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:51.280789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:51.280825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:51.280889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:51.281398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 141 partition: 0 MaxSeqNo: 36 sessionId: src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0
2025-10-10T14:00:51.283297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c341d9-2c7fb7c9-ee5f75a8-57197e87_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:51.347542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0] Write session: try to update token
2025-10-10T14:00:51.347597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:51.501412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.501447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.501460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.501517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:51.501531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:51.501544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:51.501553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:51.501563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:51.501600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592775213744084:3598]
2025-10-10T14:00:51.501624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592775213744084:3598]
2025-10-10T14:00:51.501645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592775213744084:3598]
2025-10-10T14:00:51.501665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592775213744084:3598]
2025-10-10T14:00:51.501796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:51.501820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.501831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:51.501916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:51.501944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:51.501968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:51.501996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:51.521069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:51.568533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId: src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:51.593363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:51.687628Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:51.701263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:51.701547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:51.701567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:51.699861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:51.699910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:51.703708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:51.738984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 141 reason: error at write: Disconnected sessionId: src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0
2025-10-10T14:00:51.739356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 141 sessionId: src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0 is DEAD
2025-10-10T14:00:51.741796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:51.741830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0] Write session will restart in 0.006269s
2025-10-10T14:00:51.741923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0] Write session: Do CDS request
2025-10-10T14:00:51.741951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:51.753908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592776791659913:3447]
2025-10-10T14:00:51.757744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:51.767209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:51.767237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 142
2025-10-10T14:00:51.770091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:51.770333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:51.770365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:51.770387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:51.773524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 142 sessionId:  describe result for acl check
2025-10-10T14:00:51.773643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:51.773653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:51.773661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:51.773678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592776791660099:3845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:51.777117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592776791660099:3845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:51.807696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592776791660099:3845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:51.819016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592776791660099:3845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:51.819056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592776791660099:3845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:51.819072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592776791660099:3845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:51.819102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:51.836430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:51.840538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:51.841457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:51.841477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:51.841520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:51.841791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:51.841966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592775213744312:3607]
2025-10-10T14:00:51.844125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:51.845328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:51.845536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:51.846780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:51.847100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:51.847108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:51.847115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:51.847121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:51.847127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:51.847134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:51.847140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:51.847147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:51.847154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.847161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.847168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.847175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.847221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:51.847330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:51.847369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:51.847405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:51.847472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:51.847565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:51.847604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:51.847636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:51.847701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.847750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.847787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.847820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.847854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:51.847921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:51.847981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:51.848026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:51.848073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:51.848117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:51.848151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:51.848194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:51.848229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:51.848266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:51.848301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:51.848379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:51.848436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:51.848479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:51.848510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:51.848545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:51.848578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.848615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.848658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.848703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.848745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.848787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.848819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.848856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.850200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:51.855877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592776791660263:3447]
2025-10-10T14:00:51.931656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:51.944509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:51.944572Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:51.944601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:51.944618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:51.944645Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 141 [2:7559592775213744312:3607]
2025-10-10T14:00:51.944692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:51.944743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:51.944754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.944763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.944773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.944808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:51.944825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:51.944842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:51.949206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 141
2025-10-10T14:00:51.949315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 141, pipe: [1:7559592776791660263:3447]
2025-10-10T14:00:51.949389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 141
2025-10-10T14:00:51.946445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.946471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.946482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.946491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.946499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:51.946730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:51.946742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:51.946841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:51.946959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:51.947071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:51.947153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:51.947207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:51.947217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:51.947232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:51.947244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:51.947288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:51.947345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:51.947483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:51.947501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:51.947624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:51.947646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:51.948001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:51.948010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:51.948017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:51.948025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:51.948040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:51.948464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592776791660040:2442], now have 1 active actors on pipe
2025-10-10T14:00:51.948483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592776791660263:3447], now have 1 active actors on pipe
2025-10-10T14:00:51.948498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592776791660243:3845], now have 1 active actors on pipe
2025-10-10T14:00:51.950081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:51.950110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:51.950202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:51.950239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.950258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.950268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:51.950306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.950351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:51.950393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:51.954259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:51.954315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:51.954397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:51.954756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 142 partition: 0 MaxSeqNo: 36 sessionId: src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0
2025-10-10T14:00:51.962121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45d04dd7-dede7c87-a0f0ec1e-77252be6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:52.005358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0] Write session: try to update token
2025-10-10T14:00:52.005423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:52.179340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.179381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.179394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.179453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:52.179466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:52.179479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:52.179489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:52.179499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:52.179534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:52.179558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:52.179580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:52.179599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:52.179814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:52.179840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:52.179851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:52.180878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:52.181272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:52.181298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:52.181325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:52.181348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:52.200076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId: src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:52.222407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:52.460494Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:52.490869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592776791660263:3447]
2025-10-10T14:00:52.491002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:52.491015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:52.489522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:52.489579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:52.489654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:52.489669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:52.489708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592775213744306:3607]
2025-10-10T14:00:52.490180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:52.491427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:52.494346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:52.501952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 142 reason: error at write: Disconnected sessionId: src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0
2025-10-10T14:00:52.502284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 142 sessionId: src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0 is DEAD
2025-10-10T14:00:52.505611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:52.505648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0] Write session will restart in 0.005219s
2025-10-10T14:00:52.505750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0] Write session: Do CDS request
2025-10-10T14:00:52.505780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:52.517155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:52.518806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:52.518836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 143
2025-10-10T14:00:52.519302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:52.519407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:52.519421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:52.519431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:52.521959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 143 sessionId:  describe result for acl check
2025-10-10T14:00:52.522066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:52.522074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:52.522082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:52.522103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592781086627587:3853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:52.524350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592781086627587:3853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:52.538174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592781086627587:3853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:52.556830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592781086627587:3853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:52.556881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592781086627587:3853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:52.556900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592781086627587:3853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:52.556934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:52.591187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592781086627695:3447]
2025-10-10T14:00:52.655393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:52.662435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:52.663416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:52.663438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:52.663490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:52.663821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:52.664025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592779508711832:3612]
2025-10-10T14:00:52.670759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:52.677769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:52.678089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:52.679395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:52.679729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:52.679738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:52.679745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:52.679752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:52.679759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:52.679765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:52.679772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:52.681976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:52.682029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:52.682039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:52.682047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:52.682054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:52.682109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:52.682226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:52.682277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:52.682325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:52.682385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:52.682433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:52.682483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:52.682533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:52.682578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:52.682629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:52.682680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:52.682734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:52.682787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:52.682861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:52.682926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:52.682978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:52.683031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:52.683086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:52.683132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:52.683182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:52.683228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:52.683280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:52.683328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:52.683380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:52.683427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:52.683478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:52.683521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:52.683572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:52.683617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:52.683665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:52.683724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:52.683774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:52.683816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:52.683867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:52.683909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:52.683959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:52.684408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:52.726195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:52.753853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:52.753907Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:52.753923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:52.753944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:52.753966Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 142 [2:7559592779508711832:3612]
2025-10-10T14:00:52.754021Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:52.754077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:52.754093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.754106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.754118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.754168Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:52.754189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:52.754211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:52.804080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:52.804124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:52.804139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:52.804152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:52.804161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:52.805245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:52.805263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:52.805395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:52.805559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:52.805798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:52.805926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:52.805995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592779508711826:3612]
2025-10-10T14:00:52.806010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592779508711826:3612]
2025-10-10T14:00:52.806022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592779508711826:3612]
2025-10-10T14:00:52.806034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592779508711826:3612]
2025-10-10T14:00:52.806067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:52.806145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:52.806323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:52.806338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:52.806458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592779508711826:3612]
2025-10-10T14:00:52.806477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:52.807658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:52.807673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:52.807698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:52.807713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:52.807739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:52.810632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592781086627627:3853], now have 1 active actors on pipe
2025-10-10T14:00:52.810687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592781086627575:2442], now have 1 active actors on pipe
2025-10-10T14:00:52.810711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592781086627695:3447], now have 1 active actors on pipe
2025-10-10T14:00:52.813369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 142
2025-10-10T14:00:52.813462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 142
2025-10-10T14:00:52.813539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 142, pipe: [1:7559592781086627695:3447]
2025-10-10T14:00:52.819482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 143 partition: 0 MaxSeqNo: 36 sessionId: src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0
2025-10-10T14:00:52.817736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:52.817792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:52.817902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:52.817942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.817960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.817973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:52.818016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.818066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:52.818118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:52.819065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:52.819094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:52.819175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:52.820631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13256a6f-6cdc1da7-7282420-5b80e60a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:52.857271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.857315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.857330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.918029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0] Write session: try to update token
2025-10-10T14:00:52.918092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:53.038077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.038124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.038137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.038193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:53.038209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:53.038223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:53.038234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:53.038246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:53.038284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592779508711826:3612]
2025-10-10T14:00:53.038311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592779508711826:3612]
2025-10-10T14:00:53.038337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592779508711826:3612]
2025-10-10T14:00:53.038359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592779508711826:3612]
2025-10-10T14:00:53.038517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:53.038544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:53.038556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:53.040053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:53.041350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:53.041387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:53.041419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:53.041451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:53.176975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId: src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:53.219510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:53.267563Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:53.276577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:53.276632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:53.280892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:53.280942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:53.293309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:53.293464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592781086627695:3447]
2025-10-10T14:00:53.293533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 143 reason: error at write: Disconnected sessionId: src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0
2025-10-10T14:00:53.293859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 143 sessionId: src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0 is DEAD
2025-10-10T14:00:53.295164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:53.295198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0] Write session will restart in 0.007635s
2025-10-10T14:00:53.295301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0] Write session: Do CDS request
2025-10-10T14:00:53.295362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:53.314833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:53.331257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:53.336432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:53.337742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 144
2025-10-10T14:00:53.338921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:53.339121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:53.339150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:53.339169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:53.341763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 144 sessionId:  describe result for acl check
2025-10-10T14:00:53.341883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:53.341895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:53.341904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:53.341922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592785381595127:3866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:53.344603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592785381595127:3866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:53.373484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592785381595127:3866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:53.397100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592785381595191:3447]
2025-10-10T14:00:53.413853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592785381595127:3866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:53.413899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592785381595127:3866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:53.413919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592785381595127:3866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:53.413950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:53.474545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:53.478892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:53.479848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:53.479868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:53.479917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:53.480208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:53.480403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592783803679356:3627]
2025-10-10T14:00:53.482990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:53.484283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:53.484520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:53.485894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:53.486251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:53.486271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:53.486279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:53.486287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:53.486295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:53.486302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:53.486310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:53.486317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:53.486324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:53.486332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:53.486342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:53.486349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:53.486398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:53.486513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:53.486568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:53.486621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:53.486673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:53.486738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:53.486791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:53.486843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:53.486904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:53.486957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:53.487015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:53.487066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:53.487112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:53.487201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:53.487268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:53.487338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:53.487397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:53.487458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:53.487510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:53.487568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:53.487620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:53.487685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:53.487756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:53.487817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:53.487874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:53.487934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:53.487982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:53.488044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:53.488108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:53.488182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:53.488238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:53.488296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:53.488349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:53.488414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:53.488466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:53.488535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:53.489010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:53.553300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:53.571349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:53.571411Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:53.571430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:53.571449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:53.571474Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 143 [2:7559592783803679356:3627]
2025-10-10T14:00:53.571531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:53.571586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:53.571603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.571614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.571625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.571671Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:53.571693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:53.571734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:53.574321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:53.574356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:53.574371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:53.574386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:53.574398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:53.574688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:53.574708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:53.574860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:53.575082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:53.575333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:53.575460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:53.575533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592783803679350:3627]
2025-10-10T14:00:53.575550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592783803679350:3627]
2025-10-10T14:00:53.575564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592783803679350:3627]
2025-10-10T14:00:53.575578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592783803679350:3627]
2025-10-10T14:00:53.575625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:53.575724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:53.575832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:53.575851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:53.575870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:53.575893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:53.575911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:53.575928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:53.576053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592783803679350:3627]
2025-10-10T14:00:53.576075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:53.576154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:53.576233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592785381595191:3447], now have 1 active actors on pipe
2025-10-10T14:00:53.576265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592785381595117:2442], now have 1 active actors on pipe
2025-10-10T14:00:53.576288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592785381595223:3866], now have 1 active actors on pipe
2025-10-10T14:00:53.580301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:53.580353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:53.580430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2391ff0b-4318719c-3a847681-985cbaed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:53.580462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.580481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.580493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:53.580530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.580586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:53.580637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:53.579054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 143, pipe: [1:7559592785381595191:3447]
2025-10-10T14:00:53.579181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 143
2025-10-10T14:00:53.579269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 143
2025-10-10T14:00:53.582179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:53.582219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:53.582302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:53.582738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 144 partition: 0 MaxSeqNo: 36 sessionId: src_id|2391ff0b-4318719c-3a847681-985cbaed_0
2025-10-10T14:00:53.585225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f4b30f-8d75ce33-ffe9378c-3922686c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2391ff0b-4318719c-3a847681-985cbaed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:53.623935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:00:53.623988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-10T14:00:53.630197Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:00:53.631160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 3 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:00:53.631303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:00:53.668772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.668812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.668823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.674299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2391ff0b-4318719c-3a847681-985cbaed_0] Write session: try to update token
2025-10-10T14:00:53.674362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2391ff0b-4318719c-3a847681-985cbaed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:53.775630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:53.775673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:53.775685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:53.775693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:53.775701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:53.775748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592783803679350:3627]
2025-10-10T14:00:53.775772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592783803679350:3627]
2025-10-10T14:00:53.775794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592783803679350:3627]
2025-10-10T14:00:53.775813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592783803679350:3627]
2025-10-10T14:00:53.775912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:53.775935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:53.775957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:53.775979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:53.779821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.779859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.779873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.779920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:53.779946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:53.779957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:53.781203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:53.819274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId: src_id|2391ff0b-4318719c-3a847681-985cbaed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:53.858338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:53.948248Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:53.949892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:53.949930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:53.952963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:53.953594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592785381595191:3447]
2025-10-10T14:00:53.953686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:53.953809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:53.953828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:53.970229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 144 reason: error at write: Disconnected sessionId: src_id|2391ff0b-4318719c-3a847681-985cbaed_0
2025-10-10T14:00:53.970574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 144 sessionId: src_id|2391ff0b-4318719c-3a847681-985cbaed_0 is DEAD
2025-10-10T14:00:53.971699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2391ff0b-4318719c-3a847681-985cbaed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:53.971759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2391ff0b-4318719c-3a847681-985cbaed_0] Write session will restart in 0.007983s
2025-10-10T14:00:53.971869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2391ff0b-4318719c-3a847681-985cbaed_0] Write session: Do CDS request
2025-10-10T14:00:53.971900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2391ff0b-4318719c-3a847681-985cbaed_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:53.984270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:53.984303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 145
2025-10-10T14:00:53.989318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2391ff0b-4318719c-3a847681-985cbaed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:53.997424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:53.997594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:53.997612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:53.997624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:54.002454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 145 sessionId:  describe result for acl check
2025-10-10T14:00:54.002597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:54.002608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:54.002619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:54.002646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592789676562679:3875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:54.006538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592789676562679:3875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:54.013680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592789676562679:3875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:54.028952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592789676562679:3875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:54.028998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592789676562679:3875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:54.029016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592789676562679:3875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:54.029047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:54.051064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592789676562761:3447]
2025-10-10T14:00:54.100649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:54.107687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:54.108476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:54.108505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:54.108540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:54.108736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:54.108892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592788098646861:3633]
2025-10-10T14:00:54.111233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:54.114264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:54.114534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:54.115661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:54.115926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:54.115942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:54.115950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:54.115957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:54.115965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:54.115973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:54.115981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:54.115986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:54.115991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.115997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.116001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.116006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.116047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:54.116135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:54.116172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:54.116213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:54.116251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:54.116297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:54.116335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:54.116372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:54.116409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.116456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.116498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.116532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.116558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:54.116606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:54.116649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:54.116689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:54.116725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:54.116765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:54.116798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:54.116838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:54.116876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:54.116916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:54.116955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:54.116998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:54.117034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:54.117072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:54.117107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:54.117181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:54.117235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.117292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.117341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.117398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.117446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.117503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.117552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.117613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.118092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:54.162651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:54.177300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:54.177363Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:54.177383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:54.177405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:54.177431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 144 [2:7559592788098646861:3633]
2025-10-10T14:00:54.177490Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:54.177552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:54.177568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.177581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.177593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.177641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:54.177663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:54.177686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:54.179144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.179162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.179177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.179193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.179206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:54.179476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:54.179495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.179658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.179883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.180138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.181612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 144
2025-10-10T14:00:54.181724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 144
2025-10-10T14:00:54.181816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 144, pipe: [1:7559592789676562761:3447]
2025-10-10T14:00:54.181302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:54.181417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592785381595367:2442], now have 1 active actors on pipe
2025-10-10T14:00:54.181442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592789676562723:3875], now have 1 active actors on pipe
2025-10-10T14:00:54.181467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592789676562761:3447], now have 1 active actors on pipe
2025-10-10T14:00:54.181495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.181511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.181525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.181537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.181572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:54.181661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:54.181867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:54.181885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:54.182012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.182032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:54.182526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:54.182548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:54.182561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:54.182574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:54.182597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:54.183599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:54.183632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:54.183707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:54.183753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.183773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.183783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:54.183820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.183859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:54.183906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:54.185310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:54.185340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:54.185408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:54.185934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 145 partition: 0 MaxSeqNo: 36 sessionId: src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0
2025-10-10T14:00:54.187182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2391ff0b-4318719c-3a847681-985cbaed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:54.247166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0] Write session: try to update token
2025-10-10T14:00:54.247221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:54.278052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.278101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.278112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.435843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:54.435883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:54.435896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:54.435907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:54.435918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:54.435954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.435981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.436003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.436022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.436194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.436206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.436215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.436723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:54.436757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:54.436796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:54.436822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:54.473730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId: src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:54.481629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:54.481684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.481696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:54.482794Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:54.496668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:54.646752Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:54.651104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:54.651137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:54.651178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592788098646856:3633]
2025-10-10T14:00:54.651313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:54.651336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:54.651605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:54.654214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:54.656308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:54.656442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:54.656453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:54.677013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:54.677089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0] Write session will restart in 0.005889s
2025-10-10T14:00:54.677218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0] Write session: Do CDS request
2025-10-10T14:00:54.677250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:54.673709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592789676562761:3447]
2025-10-10T14:00:54.673811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 145 reason: error at write: Disconnected sessionId: src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0
2025-10-10T14:00:54.674043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 145 sessionId: src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0 is DEAD
2025-10-10T14:00:54.689064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:54.718266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:54.718295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 146
2025-10-10T14:00:54.721461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:54.721600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:54.721615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:54.721625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:54.723491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 146 sessionId:  describe result for acl check
2025-10-10T14:00:54.723686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:54.723710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:54.723746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:54.723779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592789676562897:3884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:54.735280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592789676562897:3884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:54.759742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592789676562897:3884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:54.774011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592789676563000:3447]
2025-10-10T14:00:54.780124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592789676562897:3884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:54.780168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592789676562897:3884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:54.780186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592789676562897:3884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:54.780216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:54.865390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:54.883338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:54.884303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:54.884322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:54.884369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:54.884940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:54.885171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592788098647105:3643]
2025-10-10T14:00:54.887558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:54.888815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:54.896664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:54.898282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:54.898696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:54.898707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:54.898716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:54.898724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:54.898733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:54.898740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:54.898749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:54.898757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:54.898766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.898774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.898781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.898790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.898844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:54.898966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:54.899022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:54.899077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:54.899133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:54.899188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:54.899240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:54.899293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:54.899348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.899405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.899457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.899508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.899561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:54.899639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:54.899709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:54.899795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:54.899855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:54.899916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:54.899969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:54.900032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:54.900088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:54.900152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:54.900204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:54.900268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:54.900322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:54.900384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:54.900435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:54.900497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:54.900553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.900611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.900666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.900728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.900782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.900843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.900896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.900957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.901683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:54.940105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:54.991581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:54.991645Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:54.991664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:54.991684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:54.991710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 145 [2:7559592788098647105:3643]
2025-10-10T14:00:54.991785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:54.991852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:54.991867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.991880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.991892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.991940Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:54.991963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:54.991988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:54.995133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.995174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.995189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.995202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.995214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:54.995507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:54.995524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:54.995685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:54.995916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:54.996170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:54.996299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:54.996376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592788098647099:3643]
2025-10-10T14:00:54.996392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592788098647099:3643]
2025-10-10T14:00:54.996405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592788098647099:3643]
2025-10-10T14:00:54.996418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592788098647099:3643]
2025-10-10T14:00:54.996464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:54.996556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:54.996751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:54.996768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:54.996896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592788098647099:3643]
2025-10-10T14:00:54.996915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:54.997725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:54.997754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:54.997766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:54.997779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:54.997804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:54.999030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592789676563014:3884], now have 1 active actors on pipe
2025-10-10T14:00:54.999071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592789676562875:2442], now have 1 active actors on pipe
2025-10-10T14:00:54.999095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592789676563000:3447], now have 1 active actors on pipe
2025-10-10T14:00:55.003495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 145
2025-10-10T14:00:55.003601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 145
2025-10-10T14:00:55.003669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 145, pipe: [1:7559592789676563000:3447]
2025-10-10T14:00:55.009417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:55.009484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:55.009599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:55.009634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.009654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.009666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:55.009706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.009755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:55.009810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:55.012602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:55.012656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:55.012737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:55.013340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 146 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0
2025-10-10T14:00:55.014243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92391849-ba90a9ce-d29f28d2-5e42622b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:55.060120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0] Write session: try to update token
2025-10-10T14:00:55.060176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:55.097252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.097299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.097310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.175130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:55.175171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:55.175184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:55.175193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:55.175203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:55.175238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592788098647099:3643]
2025-10-10T14:00:55.175263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592788098647099:3643]
2025-10-10T14:00:55.175285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592788098647099:3643]
2025-10-10T14:00:55.175309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592788098647099:3643]
2025-10-10T14:00:55.175436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:55.175451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:55.175470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:55.175478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:55.175490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:55.175501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:55.175528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:55.199539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:55.308860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId: src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:55.330442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:55.475597Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:55.477791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:55.477841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:55.481525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592789676563000:3447]
2025-10-10T14:00:55.481654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:55.481664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:55.483929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:55.504859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 146 reason: error at write: Disconnected sessionId: src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0
2025-10-10T14:00:55.505605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:55.505643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0] Write session will restart in 0.005980s
2025-10-10T14:00:55.505795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0] Write session: Do CDS request
2025-10-10T14:00:55.505840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:55.505426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 146 sessionId: src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0 is DEAD
2025-10-10T14:00:55.516540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:55.517243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:55.517275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 147
2025-10-10T14:00:55.518389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:55.518512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:55.518528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:55.518538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:55.518377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:55.520395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 147 sessionId:  describe result for acl check
2025-10-10T14:00:55.520562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:55.520582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:55.520594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:55.520614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592793971530436:3896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:55.525113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592793971530436:3896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:55.534473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592793971530436:3896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:55.551354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592793971530436:3896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:55.551394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592793971530436:3896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:55.551413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592793971530436:3896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:55.551443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:55.582378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592793971530592:3447]
2025-10-10T14:00:55.638167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:55.640008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:55.640798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:55.640817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:55.640860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:55.641116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:55.641757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592792393614622:3653]
2025-10-10T14:00:55.643817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:55.645414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:55.645627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:55.646858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:55.647195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:55.647202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:55.647211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:55.647217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:55.647224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:55.647231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:55.647238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:55.647245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:55.647253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:55.647260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:55.647268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:55.647273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:55.647321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:55.647430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:55.647479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:55.647528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:55.647573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:55.647619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:55.647665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:55.647707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:55.647764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:55.647809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:55.647851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:55.647892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:55.647936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:55.648000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:55.648055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:55.648108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:55.648151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:55.648201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:55.648244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:55.648296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:55.648341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:55.648389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:55.648432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:55.648486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:55.648529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:55.648579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:55.648622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:55.648668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:55.648713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:55.649594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:55.649665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:55.649737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:55.649810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:55.649878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:55.649936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:55.649992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:55.650421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:55.690807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:55.779711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:55.779794Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:55.779812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:55.779833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:55.779858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 146 [2:7559592792393614622:3653]
2025-10-10T14:00:55.779918Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:55.779979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:55.779996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.780009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.780022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.780075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:55.780099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:55.780121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:55.782446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:55.782465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:55.782481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:55.782498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:55.782510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:55.782822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:55.782842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:55.783002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:55.783215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:55.783465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:55.783595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:55.783671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.783689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.783704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.783717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.783918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:55.783930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:55.783942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:55.783955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:55.785742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 146, pipe: [1:7559592793971530592:3447]
2025-10-10T14:00:55.785860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 146
2025-10-10T14:00:55.785944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 146
2025-10-10T14:00:55.787289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:55.787426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:55.787657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:55.787676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:55.787730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592793971530592:3447], now have 1 active actors on pipe
2025-10-10T14:00:55.787768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592793971530424:2442], now have 1 active actors on pipe
2025-10-10T14:00:55.787791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592793971530496:3896], now have 1 active actors on pipe
2025-10-10T14:00:55.787923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.788343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:55.787961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:55.788704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:55.788730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:55.788870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f494089-f599e713-f15914c1-603197b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:55.788904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.788923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.788935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:55.788970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.789015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:55.789087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:55.790877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:55.790912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:55.790986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:55.792331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d29635c-2336dfa1-53932d92-fa008ab0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f494089-f599e713-f15914c1-603197b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:55.791452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 147 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f494089-f599e713-f15914c1-603197b_0
2025-10-10T14:00:55.847175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f494089-f599e713-f15914c1-603197b_0] Write session: try to update token
2025-10-10T14:00:55.847235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f494089-f599e713-f15914c1-603197b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:55.867289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:55.867331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:55.867369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.867497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:55.869375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:55.869533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:55.883816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:55.885098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:55.886367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:55.888083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:55.889898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.889934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.889945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.890001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:55.979140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:55.979182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:55.979196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:55.979206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:55.979216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:55.979257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.979284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.979306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.979330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592792393614617:3653]
2025-10-10T14:00:55.979476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:55.979504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:55.979516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:55.980652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:55.981075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:55.981112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:55.981163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:55.981193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:56.030154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId: src_id|4f494089-f599e713-f15914c1-603197b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:56.051766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:56.127197Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:56.129865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:56.129917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:56.134280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592793971530592:3447]
2025-10-10T14:00:56.134350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:56.134460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:56.134470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:56.140696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:56.153567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f494089-f599e713-f15914c1-603197b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:56.151199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 147 reason: error at write: Disconnected sessionId: src_id|4f494089-f599e713-f15914c1-603197b_0
2025-10-10T14:00:56.153611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f494089-f599e713-f15914c1-603197b_0] Write session will restart in 0.009797s
2025-10-10T14:00:56.151533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 147 sessionId: src_id|4f494089-f599e713-f15914c1-603197b_0 is DEAD
2025-10-10T14:00:56.153721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f494089-f599e713-f15914c1-603197b_0] Write session: Do CDS request
2025-10-10T14:00:56.153751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f494089-f599e713-f15914c1-603197b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:56.185754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:56.185791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 148
2025-10-10T14:00:56.185981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f494089-f599e713-f15914c1-603197b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:56.186491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:56.186631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:56.186656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:56.186667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:56.188114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 148 sessionId:  describe result for acl check
2025-10-10T14:00:56.188244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:56.188274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:56.188298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:56.188330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592798266497963:3905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:56.194010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592798266497963:3905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:56.231465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592798266497963:3905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:56.235161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592798266497987:3447]
2025-10-10T14:00:56.247813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592798266497963:3905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:56.247854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592798266497963:3905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:56.247872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592798266497963:3905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:56.247905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 148 sessionId:  partition: 0 expectedGeneration: (NULL)
E1010 14:00:56.274775779  107741 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:00:56.278691Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:00:56.389483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:56.396553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:56.397425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:56.397457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:56.397499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:56.397751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:56.397972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592796688582165:3662]
2025-10-10T14:00:56.400148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:56.401148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:56.401366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:56.402619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:56.402966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:56.402975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:56.402982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:56.402989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:56.402997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:56.403004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:56.403012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:56.403019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:56.403025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:56.403031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:56.403039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:56.403046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:56.403094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:56.403197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:56.403246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:56.403294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:56.403338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:56.403395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:56.403442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:56.403490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:56.403535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:56.403584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:56.403635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:56.403681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:56.403721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:56.403803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:56.403862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:56.403916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:56.403966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:56.404016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:56.404082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:56.404141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:56.404195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:56.404251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:56.404298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:56.404351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:56.404396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:56.404450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:56.404494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:56.404556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:56.404611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:56.404666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:56.404711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:56.404764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:56.404824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:56.404881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:56.404926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:56.404976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:56.405700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:56.464377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:56.529696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:56.529753Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:56.529771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:56.529788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:56.529812Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 147 [2:7559592796688582165:3662]
2025-10-10T14:00:56.529870Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:56.529930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:56.529943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.529955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.529964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.530009Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:56.530031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:56.530053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:56.532503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:56.532522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:56.532536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:56.532549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:56.532560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:56.532843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:56.532861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:56.533008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:56.533216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:56.533464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:56.533606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:56.533676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:56.533700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:56.533713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:56.533727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:56.533767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:56.533848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:56.534025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:56.534046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:56.534169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:56.534194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:56.534501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:56.534520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:56.534530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:56.534541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:56.534564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:56.536756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 147
2025-10-10T14:00:56.536854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 147
2025-10-10T14:00:56.536923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 147, pipe: [1:7559592798266497987:3447]
2025-10-10T14:00:56.537981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592798266498002:3905], now have 1 active actors on pipe
2025-10-10T14:00:56.538031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592798266497955:2442], now have 1 active actors on pipe
2025-10-10T14:00:56.538053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592798266497987:3447], now have 1 active actors on pipe
2025-10-10T14:00:56.538103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:56.538126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:56.538213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86561603-e7f5d2b-8156201b-56c9448c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:56.538256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.538274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.538283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:56.538318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.538361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:56.538409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:56.538973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:56.539003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:56.539097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:56.539393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 148 partition: 0 MaxSeqNo: 36 sessionId: src_id|86561603-e7f5d2b-8156201b-56c9448c_0
2025-10-10T14:00:56.540274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f494089-f599e713-f15914c1-603197b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86561603-e7f5d2b-8156201b-56c9448c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:56.591657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86561603-e7f5d2b-8156201b-56c9448c_0] Write session: try to update token
2025-10-10T14:00:56.591713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86561603-e7f5d2b-8156201b-56c9448c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:56.792806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId: src_id|86561603-e7f5d2b-8156201b-56c9448c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:56.828559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.828603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.828614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.828670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:56.828684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:56.828696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:56.828709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:56.828720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:56.828756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:56.828782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:56.828807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:56.828827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:56.829036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:56.829062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:56.829073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:56.829626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:56.829677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:56.829718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:56.829749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:56.841775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:56.852131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:57.000013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:57.015567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:57.015628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:57.015697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:57.015711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:57.015752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592796688582159:3662]
2025-10-10T14:00:57.018761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:57.018777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:57.018790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:57.018942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592798266497987:3447]
2025-10-10T14:00:57.017427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:57.018233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:57.060254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 148 reason: error at write: Disconnected sessionId: src_id|86561603-e7f5d2b-8156201b-56c9448c_0
2025-10-10T14:00:57.060577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 148 sessionId: src_id|86561603-e7f5d2b-8156201b-56c9448c_0 is DEAD
2025-10-10T14:00:57.061573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86561603-e7f5d2b-8156201b-56c9448c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:57.061616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86561603-e7f5d2b-8156201b-56c9448c_0] Write session will restart in 0.008793s
2025-10-10T14:00:57.061719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86561603-e7f5d2b-8156201b-56c9448c_0] Write session: Do CDS request
2025-10-10T14:00:57.061752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86561603-e7f5d2b-8156201b-56c9448c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:57.076770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86561603-e7f5d2b-8156201b-56c9448c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:57.081417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:57.081450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 149
2025-10-10T14:00:57.081906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:57.082036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:57.082054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:57.082066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:57.093406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 149 sessionId:  describe result for acl check
2025-10-10T14:00:57.093572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:57.093583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:57.093594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:57.093613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592802561465532:3920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:57.096709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592802561465532:3920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:57.114891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592802561465568:3447]
2025-10-10T14:00:57.117841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592802561465532:3920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:57.144907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592802561465532:3920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:57.150657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592802561465532:3920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:57.150690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592802561465532:3920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:57.150733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:57.191488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:57.196970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:57.198099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:57.198142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:57.198189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:57.198511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:57.198730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592800983549673:3673]
2025-10-10T14:00:57.201435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:57.202692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:57.202977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:57.204223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:57.204600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:57.204610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:57.204618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:57.204626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:57.204633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:57.204640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:57.204649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:57.204656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:57.204663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:57.204671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:57.204679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:57.204687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:57.204743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:57.204863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:57.204919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:57.204976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:57.205029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:57.205084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:57.205157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:57.205214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:57.205270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:57.205326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:57.205376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:57.205432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:57.205482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:57.205561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:57.205631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:57.205696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:57.205750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:57.205809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:57.205861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:57.205917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:57.205971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:57.206030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:57.206079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:57.206138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:57.206192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:57.206251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:57.206302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:57.206358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:57.206412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:57.209349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:57.209454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:57.209526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:57.209586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:57.209653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:57.209723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:57.209798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:57.210340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:57.249227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:57.344677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:57.344991Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:57.345018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:57.345041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:57.345068Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 148 [2:7559592800983549673:3673]
2025-10-10T14:00:57.345148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:57.345217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:57.345233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.345247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.345260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.345311Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:57.345335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:57.345357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:57.347825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:57.347844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:57.347858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:57.347873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:57.347884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:57.349082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:57.349120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:57.349287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:57.349487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:57.349727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:57.349862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:57.349907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592802561465568:3447], now have 1 active actors on pipe
2025-10-10T14:00:57.349932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592802561465495:2442], now have 1 active actors on pipe
2025-10-10T14:00:57.349956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592802561465625:3920], now have 1 active actors on pipe
2025-10-10T14:00:57.350023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.350039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.350054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.350067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.350105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:57.350188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:57.350375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:57.350394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:57.350516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.350537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:57.350973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:57.350986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:57.350997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:57.351009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:57.351032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:57.349974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 148, pipe: [1:7559592802561465568:3447]
2025-10-10T14:00:57.350077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 148
2025-10-10T14:00:57.350155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 148
2025-10-10T14:00:57.365317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:57.365377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:57.365469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8158566b-fdf3408c-9902d24e-7b05b836_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:57.365506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.365524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.365537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:57.365577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.365626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:57.365675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:57.366541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:57.366572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:57.366641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:57.367137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 149 partition: 0 MaxSeqNo: 36 sessionId: src_id|8158566b-fdf3408c-9902d24e-7b05b836_0
2025-10-10T14:00:57.373500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86561603-e7f5d2b-8156201b-56c9448c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8158566b-fdf3408c-9902d24e-7b05b836_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:57.441876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8158566b-fdf3408c-9902d24e-7b05b836_0] Write session: try to update token
2025-10-10T14:00:57.441939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8158566b-fdf3408c-9902d24e-7b05b836_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:57.462477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:57.462524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:57.462565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.462702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.462717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.462729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.462763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:57.462793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:57.464693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:57.486087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:57.547323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:57.548651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:57.550476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:57.550934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:57.569295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.569342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.569354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.647971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:57.648015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:57.648031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:57.648044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:57.648056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:57.648100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.648129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.648155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.648178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592800983549668:3673]
2025-10-10T14:00:57.648324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:57.648355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:57.648368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:57.657272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:57.657330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:57.657357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:57.657386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:57.665613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:57.784838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId: src_id|8158566b-fdf3408c-9902d24e-7b05b836_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:57.818892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:57.940903Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:57.986270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:57.986331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:57.990611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:57.990439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:57.990470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:57.997833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592802561465568:3447]
2025-10-10T14:00:57.998012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:58.012491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 149 reason: error at write: Disconnected sessionId: src_id|8158566b-fdf3408c-9902d24e-7b05b836_0
2025-10-10T14:00:58.013890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8158566b-fdf3408c-9902d24e-7b05b836_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:58.013962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8158566b-fdf3408c-9902d24e-7b05b836_0] Write session will restart in 0.008934s
2025-10-10T14:00:58.014141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8158566b-fdf3408c-9902d24e-7b05b836_0] Write session: Do CDS request
2025-10-10T14:00:58.014201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8158566b-fdf3408c-9902d24e-7b05b836_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:58.012904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 149 sessionId: src_id|8158566b-fdf3408c-9902d24e-7b05b836_0 is DEAD
2025-10-10T14:00:58.031373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:58.037985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8158566b-fdf3408c-9902d24e-7b05b836_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:58.041245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 150
2025-10-10T14:00:58.045425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:58.045592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:58.045609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:58.045619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:58.047671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 150 sessionId:  describe result for acl check
2025-10-10T14:00:58.047933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:58.047960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:58.047975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:58.047993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592806856433045:3927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:58.062203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592806856433045:3927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:58.070651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592806856433045:3927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:58.101343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592806856433045:3927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:58.101388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592806856433045:3927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:58.101407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592806856433045:3927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:58.101440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:58.102027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592806856433092:3447]
2025-10-10T14:00:58.229152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:58.236591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:58.237680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:58.237714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:58.237761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:58.238301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:58.238510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592805278517219:3683]
2025-10-10T14:00:58.240916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:58.243161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:58.243409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:58.244809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:58.245163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:58.245171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:58.245179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:58.245187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:58.245195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:58.245203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:58.245211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:58.245219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:58.245226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.245233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.245240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.245248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.245299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:58.245416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:58.245471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:58.245522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:58.245572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:58.245643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:58.245690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:58.245740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:58.245790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.245842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.245893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.245942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.245984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:58.246592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:58.246681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:58.246748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:58.246800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:58.246858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:58.246911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:58.246968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:58.247024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:58.247083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:58.247135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:58.247191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:58.247243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:58.247304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:58.247351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:58.247410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:58.247462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.247522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.247571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.247631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.247680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.247737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.247782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.247853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.248334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:58.285461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:58.301756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:58.301815Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:58.301833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:58.301853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:58.301877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 149 [2:7559592805278517219:3683]
2025-10-10T14:00:58.301935Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:58.301990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:58.302005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.302018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.302046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.302096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:58.302118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:58.302140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:58.305105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.305285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.305305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.305320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.305331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:58.305628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:58.305648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.305803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.306006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.306258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.306387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:58.306468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592806856433092:3447], now have 1 active actors on pipe
2025-10-10T14:00:58.306495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592806856433091:3927], now have 1 active actors on pipe
2025-10-10T14:00:58.306518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592802561465736:2442], now have 1 active actors on pipe
2025-10-10T14:00:58.306542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.306557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.306571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.306582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.306628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:58.306711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:58.306899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:58.306918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:58.307040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.307060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:58.307711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:58.307740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:58.307752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:58.307765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:58.307790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:58.309413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 149, pipe: [1:7559592806856433092:3447]
2025-10-10T14:00:58.309528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 149
2025-10-10T14:00:58.309620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 149
2025-10-10T14:00:58.311099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:58.311143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:58.311235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:58.311268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.311287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.311298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:58.311335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.311379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:58.311438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:58.316869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:58.316923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:58.317006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:58.317674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 150 partition: 0 MaxSeqNo: 36 sessionId: src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0
2025-10-10T14:00:58.318508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8158566b-fdf3408c-9902d24e-7b05b836_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:58.359272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0] Write session: try to update token
2025-10-10T14:00:58.359340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:58.405244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.405291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.405305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.569067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.569113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.569141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.569200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:58.569218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:58.569233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:58.569246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:58.569259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:58.569297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.569330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.569358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.569384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.569601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:58.569631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.569643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:58.570629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:58.570657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:58.570677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:58.570696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:58.570787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:58.606152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId: src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:58.647421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:58.767573Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:58.779227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:58.779304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:58.779385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:58.779405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:58.779454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592805278517214:3683]
2025-10-10T14:00:58.780352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:58.783154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:58.780763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:58.780798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:58.781404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:58.781669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592806856433092:3447]
2025-10-10T14:00:58.844146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 150 reason: error at write: Disconnected sessionId: src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0
2025-10-10T14:00:58.845469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:58.845539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0] Write session will restart in 0.007594s
2025-10-10T14:00:58.845749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0] Write session: Do CDS request
2025-10-10T14:00:58.845804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:58.844476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 150 sessionId: src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0 is DEAD
2025-10-10T14:00:58.862758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:58.863551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:58.863592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 151
2025-10-10T14:00:58.863965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:58.864114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:58.864140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:58.864152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:58.865751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 151 sessionId:  describe result for acl check
2025-10-10T14:00:58.865890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:58.865912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:58.865922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:58.865939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592806856433311:3942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:58.869070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592806856433311:3942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:58.887228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592806856433331:3447]
2025-10-10T14:00:58.896826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592806856433311:3942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:58.920549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592806856433311:3942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:58.920591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592806856433311:3942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:58.920608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592806856433311:3942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:58.920639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:58.956362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:58.960117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:58.961029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:58.961046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:58.961089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:58.961359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:58.961551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592805278517443:3693]
2025-10-10T14:00:58.963804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:58.964827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:58.965048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:58.966431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:58.966794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:58.966804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:58.966811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:58.966820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:58.966829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:58.966836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:58.966843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:58.966851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:58.966857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.966865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.966874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.966881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.966931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:58.967049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:58.967101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:58.967152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:58.967199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:58.967253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:58.967303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:58.967353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:58.967404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.967453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.967501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.967549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.967591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:58.967661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:58.967723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:58.967786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:58.967851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:58.967910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:58.967958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:58.968017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:58.968072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:58.968128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:58.968178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:58.968234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:58.968286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:58.968341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:58.968389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:58.968446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:58.968506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.968574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:58.968620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.968677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:58.968726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.968784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:58.968832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.968889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:58.969388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:59.032073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:59.059430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:59.059488Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:59.059505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:59.059522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:59.059546Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 150 [2:7559592805278517443:3693]
2025-10-10T14:00:59.059601Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:59.059665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:59.059680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.059692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.059703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.059750Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:59.059771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:59.059791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:59.108615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:59.108659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:59.108672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:59.108685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:59.108697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:59.109009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:59.109025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:59.110713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 150
2025-10-10T14:00:59.110816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 150, pipe: [1:7559592806856433331:3447]
2025-10-10T14:00:59.110886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 150
2025-10-10T14:00:59.111342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:59.111541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:59.111752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:59.111875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:59.111973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592806856433331:3447], now have 1 active actors on pipe
2025-10-10T14:00:59.111995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592806856433394:3942], now have 1 active actors on pipe
2025-10-10T14:00:59.112012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592806856433287:2442], now have 1 active actors on pipe
2025-10-10T14:00:59.112075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:59.112096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:59.112134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.112151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.112163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.112174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.112214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:59.112300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:59.112471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:59.112489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:59.112560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9349eb51-50629a00-82e65633-5b741a73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:59.112592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.112609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.112620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:59.112658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.112701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:59.112836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.112856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:59.112900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:59.113908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:59.113934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:59.113943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:59.113954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:59.113977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:59.115555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:59.115589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:59.115662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:59.116379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 151 partition: 0 MaxSeqNo: 36 sessionId: src_id|9349eb51-50629a00-82e65633-5b741a73_0
2025-10-10T14:00:59.121388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e17ea-627c022a-529bbe2c-d8fa8780_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9349eb51-50629a00-82e65633-5b741a73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:59.161295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.161333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.161345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.190713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9349eb51-50629a00-82e65633-5b741a73_0] Write session: try to update token
2025-10-10T14:00:59.190775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9349eb51-50629a00-82e65633-5b741a73_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:00:59.209059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:00:59.209113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:59.212638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.212809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:00:59.214950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:00:59.215407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:00:59.216321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:59.238117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:59.239316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:00:59.240984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:00:59.245253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:00:59.265279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.265326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.265339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.430950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.437758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.437796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.437858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:00:59.437873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:00:59.437884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:00:59.437894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:00:59.437907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:00:59.437946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.437973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.437997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.438021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592805278517438:3693]
2025-10-10T14:00:59.438177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:00:59.438204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:59.438230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:00:59.439305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:00:59.441627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:00:59.441679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:00:59.441706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:00:59.441734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:00:59.458382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId: src_id|9349eb51-50629a00-82e65633-5b741a73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:59.520800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:59.620931Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:00:59.623323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:59.623375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:59.630678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:00:59.626420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:00:59.626445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:00:59.629148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:00:59.629377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592806856433331:3447]
2025-10-10T14:00:59.676521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 151 reason: error at write: Disconnected sessionId: src_id|9349eb51-50629a00-82e65633-5b741a73_0
2025-10-10T14:00:59.677518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9349eb51-50629a00-82e65633-5b741a73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:00:59.677579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9349eb51-50629a00-82e65633-5b741a73_0] Write session will restart in 0.007435s
2025-10-10T14:00:59.677705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9349eb51-50629a00-82e65633-5b741a73_0] Write session: Do CDS request
2025-10-10T14:00:59.677739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9349eb51-50629a00-82e65633-5b741a73_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:00:59.677153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 151 sessionId: src_id|9349eb51-50629a00-82e65633-5b741a73_0 is DEAD
2025-10-10T14:00:59.696868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9349eb51-50629a00-82e65633-5b741a73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:59.695983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:59.696023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 152
2025-10-10T14:00:59.701379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:59.701604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:00:59.701629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:00:59.701645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:59.703110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 152 sessionId:  describe result for acl check
2025-10-10T14:00:59.703222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:59.703238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:59.703250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:59.703274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592811151400843:3954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:59.706397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592811151400843:3954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:59.726696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592811151400843:3954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:59.729967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592811151400913:3447]
2025-10-10T14:00:59.741417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592811151400843:3954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:59.741461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592811151400843:3954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:59.741478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592811151400843:3954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:59.741509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:59.796025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:00:59.802055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:00:59.802938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:00:59.802970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:00:59.803013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:00:59.803895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:00:59.804124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592809573484973:3703]
2025-10-10T14:00:59.806493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:00:59.810807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:00:59.811069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:00:59.812496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:00:59.812816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:59.812825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:59.812833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:59.812839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:59.812845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:59.812852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:59.812858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:59.812863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:59.812869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:59.812875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:59.812882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:59.812887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:59.812932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:59.813034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:59.813079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:59.813120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:59.813188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:59.813230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:59.813270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:59.813311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:59.813350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:59.813390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:59.813428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:59.813468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:59.813508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:59.813567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:00:59.813622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:59.813670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:00:59.813715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:59.813760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:00:59.813800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:59.813847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:00:59.813890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:59.813935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:00:59.813974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:59.814020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:00:59.814062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:59.814109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:00:59.814151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:59.814197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:00:59.814238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:59.814286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:59.814325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:59.814370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:59.814411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:59.814456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:59.814498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:59.814542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:59.814940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:00:59.870035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:00:59.887416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:00:59.887466Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:00:59.887484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:00:59.887513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:00:59.887536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 151 [2:7559592809573484973:3703]
2025-10-10T14:00:59.887593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:00:59.887651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:00:59.887665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.887676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.887687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.887730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:00:59.887751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:00:59.887773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:00:59.893299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:59.893337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:59.893351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:59.893364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:59.893375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:00:59.893643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:00:59.893658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:00:59.893795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:00:59.893963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:00:59.894175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:00:59.894276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:00:59.894345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592809573484968:3703]
2025-10-10T14:00:59.894357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592809573484968:3703]
2025-10-10T14:00:59.894367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592809573484968:3703]
2025-10-10T14:00:59.894379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592809573484968:3703]
2025-10-10T14:00:59.894426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:00:59.894504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592811151400813:2442], now have 1 active actors on pipe
2025-10-10T14:00:59.894526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592811151400949:3954], now have 1 active actors on pipe
2025-10-10T14:00:59.894547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592811151400913:3447], now have 1 active actors on pipe
2025-10-10T14:00:59.894578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:00:59.894741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:00:59.894757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:00:59.894870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592809573484968:3703]
2025-10-10T14:00:59.894887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:00:59.895696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:00:59.895718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:00:59.895729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:00:59.895741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:00:59.895773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:00:59.898276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 151
2025-10-10T14:00:59.898383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 151
2025-10-10T14:00:59.898441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 151, pipe: [1:7559592811151400913:3447]
2025-10-10T14:00:59.899500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:59.899537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:59.899617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df304229-2abcef62-2a2011c7-beed6a36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:59.899651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.899679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.899689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:59.899728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.899781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:59.899824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:59.902792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:59.902837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:59.902909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:59.903476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 152 partition: 0 MaxSeqNo: 36 sessionId: src_id|df304229-2abcef62-2a2011c7-beed6a36_0
2025-10-10T14:00:59.906662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9349eb51-50629a00-82e65633-5b741a73_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df304229-2abcef62-2a2011c7-beed6a36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:00:59.956443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df304229-2abcef62-2a2011c7-beed6a36_0] Write session: try to update token
2025-10-10T14:00:59.956497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df304229-2abcef62-2a2011c7-beed6a36_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:00.137775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.137822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.137834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.137891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:00.137906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:00.137919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:00.137930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:00.137942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:00.137979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592809573484968:3703]
2025-10-10T14:01:00.138004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592809573484968:3703]
2025-10-10T14:01:00.138030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592809573484968:3703]
2025-10-10T14:01:00.138051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592809573484968:3703]
2025-10-10T14:01:00.138154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:00.138183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:00.138205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:00.138224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:00.138264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:00.138291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:00.138303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:00.139288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:00.178122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId: src_id|df304229-2abcef62-2a2011c7-beed6a36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:00.211059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:00.299494Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:00.322855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:00.322921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:00.323017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:00.323033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:00.323077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592809573484968:3703]
2025-10-10T14:01:00.323770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:00.323820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:00.325394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592811151400913:3447]
2025-10-10T14:01:00.325523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:00.326694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:00.341991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df304229-2abcef62-2a2011c7-beed6a36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:00.342054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df304229-2abcef62-2a2011c7-beed6a36_0] Write session will restart in 0.008711s
2025-10-10T14:01:00.342178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df304229-2abcef62-2a2011c7-beed6a36_0] Write session: Do CDS request
2025-10-10T14:01:00.342207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df304229-2abcef62-2a2011c7-beed6a36_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:00.341323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 152 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df304229-2abcef62-2a2011c7-beed6a36_0
2025-10-10T14:01:00.341649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 152 sessionId: src_id|df304229-2abcef62-2a2011c7-beed6a36_0 is DEAD
2025-10-10T14:01:00.372011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df304229-2abcef62-2a2011c7-beed6a36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:00.372250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:00.372286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 153
2025-10-10T14:01:00.372670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:00.372831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:00.372859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:00.372872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:00.375167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 153 sessionId:  describe result for acl check
2025-10-10T14:01:00.375356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:00.375385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:00.375405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:00.375456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592815446368392:3964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:00.383441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592815446368392:3964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:00.389558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592815446368392:3964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:00.402537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592815446368392:3964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:00.402580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592815446368392:3964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:00.402597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592815446368392:3964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:00.402629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:00.425624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592815446368456:3447]
2025-10-10T14:01:00.475634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:00.478687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:00.479561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:00.479595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:00.479642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:00.479929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:00.480143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592813868452504:3713]
2025-10-10T14:01:00.482512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:00.483403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:00.483632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:00.484773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:00.485054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:00.485059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:00.485065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:00.485070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:00.485075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:00.485079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:00.485084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:00.485089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:00.485094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:00.485099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:00.485104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:00.485110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:00.485174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:00.485302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:00.485359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:00.485413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:00.485461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:00.485513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:00.485563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:00.485616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:00.485665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:00.485715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:00.485764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:00.485814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:00.485858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:00.485930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:00.485992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:00.486049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:00.486088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:00.486132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:00.486166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:00.486239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:00.486289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:00.486332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:00.486381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:00.486424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:00.486470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:00.486512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:00.486548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:00.486590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:00.486628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:00.486670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:00.486709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:00.486756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:00.486802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:00.486846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:00.486883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:00.486929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:00.487405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:00.533060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:00.619467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:00.619525Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:00.619546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:00.619568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:00.619595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 152 [2:7559592813868452504:3713]
2025-10-10T14:01:00.619657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:00.619719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:00.619736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.619750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.619762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.619809Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:00.619833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:00.619876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:00.621382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:00.621403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:00.621419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:00.621436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:00.621449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:00.621746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:00.621767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:00.621936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:00.622148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:00.622411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:00.622547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:00.623921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 152
2025-10-10T14:01:00.624034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 152, pipe: [1:7559592815446368456:3447]
2025-10-10T14:01:00.623684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:00.623720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:00.623735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:00.623748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:00.623786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:00.623902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:00.624120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:00.624139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:00.624190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592815446368435:3964], now have 1 active actors on pipe
2025-10-10T14:01:00.624217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592815446368456:3447], now have 1 active actors on pipe
2025-10-10T14:01:00.624241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592815446368377:2442], now have 1 active actors on pipe
2025-10-10T14:01:00.624359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:00.624382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:00.624857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:00.624882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:00.624894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:00.624906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:00.624932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:00.625481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:00.625511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:00.625607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0171800-5a23d202-51ba379f-df2592a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:00.625641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.625661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.625673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:00.625709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.625794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:00.625860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:00.624129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 152
2025-10-10T14:01:00.628726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:00.628760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:00.628814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:00.629504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 153 partition: 0 MaxSeqNo: 36 sessionId: src_id|a0171800-5a23d202-51ba379f-df2592a4_0
2025-10-10T14:01:00.630238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df304229-2abcef62-2a2011c7-beed6a36_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a0171800-5a23d202-51ba379f-df2592a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:00.695457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0171800-5a23d202-51ba379f-df2592a4_0] Write session: try to update token
2025-10-10T14:01:00.695520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0171800-5a23d202-51ba379f-df2592a4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:00.824805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:00.824856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:00.824872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:00.824882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:00.824892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:00.824919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:00.824938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:00.824955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:00.824972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:00.825093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.825101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.825109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.825253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:00.825301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:00.825337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:00.825370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:00.845081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:00.845258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:00.845278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:00.850363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:00.890056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId: src_id|a0171800-5a23d202-51ba379f-df2592a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:00.924137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:00.997352Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:01.001695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:01.001736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:01.001781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592813868452499:3713]
2025-10-10T14:01:01.001930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:01.001956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:01.002048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:01.003075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:01.003585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:01.003738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:01.003752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:01.009299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592815446368456:3447]
2025-10-10T14:01:01.013885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 153 reason: error at write: Disconnected sessionId: src_id|a0171800-5a23d202-51ba379f-df2592a4_0
2025-10-10T14:01:01.014190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 153 sessionId: src_id|a0171800-5a23d202-51ba379f-df2592a4_0 is DEAD
2025-10-10T14:01:01.017526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0171800-5a23d202-51ba379f-df2592a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:01.017564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0171800-5a23d202-51ba379f-df2592a4_0] Write session will restart in 0.007072s
2025-10-10T14:01:01.017663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0171800-5a23d202-51ba379f-df2592a4_0] Write session: Do CDS request
2025-10-10T14:01:01.017693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0171800-5a23d202-51ba379f-df2592a4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:01.042386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0171800-5a23d202-51ba379f-df2592a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:01.049418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:01.049453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 154
2025-10-10T14:01:01.049893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:01.050025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:01.050043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:01.050055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:01.051537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 154 sessionId:  describe result for acl check
2025-10-10T14:01:01.051655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:01.051666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:01.051676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:01.051693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592819741335919:3972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:01.054539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592819741335919:3972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:01.084086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592819741335919:3972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:01.102288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592819741335973:3447]
2025-10-10T14:01:01.115046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592819741335919:3972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:01.115094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592819741335919:3972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:01.115112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592819741335919:3972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:01.115146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:01.199858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:01.206061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:01.206936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:01.206954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:01.207081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:01.207368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:01.207563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592818163420036:3722]
2025-10-10T14:01:01.210033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:01.213191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:01.213488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:01.214832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:01.215160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:01.215168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:01.215174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:01.215182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:01.215191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:01.215198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:01.215203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:01.215210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:01.215217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.215224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.215231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.215238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.215286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:01.215419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:01.215488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:01.215535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:01.215583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:01.215633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:01.215678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:01.215727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:01.215776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.215827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.215890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.215938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.215982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:01.216048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:01.216105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:01.216157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:01.216204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:01.216257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:01.216298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:01.216370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:01.216435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:01.216485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:01.216529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:01.216583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:01.216627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:01.216677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:01.216735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:01.216789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:01.216847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.216899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.216939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.216994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.217039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.217091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.225354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.225472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.225966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:01.281303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:01.310436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:01.310494Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:01.310511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:01.310530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:01.310556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 153 [2:7559592818163420036:3722]
2025-10-10T14:01:01.310617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:01.310672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:01.310687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.310700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.310712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.310761Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:01.310786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:01.310807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:01.315793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.315840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.315856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.315888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.315902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:01.316236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:01.316256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.316415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.316622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.316853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.316986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:01.317073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592819741335973:3447], now have 1 active actors on pipe
2025-10-10T14:01:01.317100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592819741335996:3972], now have 1 active actors on pipe
2025-10-10T14:01:01.317159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592819741335903:2442], now have 1 active actors on pipe
2025-10-10T14:01:01.317191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592818163420031:3722]
2025-10-10T14:01:01.317207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592818163420031:3722]
2025-10-10T14:01:01.317222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592818163420031:3722]
2025-10-10T14:01:01.317235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592818163420031:3722]
2025-10-10T14:01:01.317279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:01.317368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:01.317559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:01.317579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:01.317708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592818163420031:3722]
2025-10-10T14:01:01.317728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:01.318501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:01.318535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:01.318548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:01.318560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:01.318587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:01.320065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:01.320111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:01.320199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:01.320233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.320252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.320262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:01.320300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.320342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:01.320396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:01.321198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:01.321232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:01.321312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:01.318653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 153, pipe: [1:7559592819741335973:3447]
2025-10-10T14:01:01.318776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 153
2025-10-10T14:01:01.318848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 153
2025-10-10T14:01:01.321749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 154 partition: 0 MaxSeqNo: 36 sessionId: src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0
2025-10-10T14:01:01.322649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0171800-5a23d202-51ba379f-df2592a4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:01.351277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0] Write session: try to update token
2025-10-10T14:01:01.351335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:01.430964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.431007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.431019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.431078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:01.431093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:01.431107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:01.431120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:01.431133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:01.431171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592818163420031:3722]
2025-10-10T14:01:01.431201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592818163420031:3722]
2025-10-10T14:01:01.431227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592818163420031:3722]
2025-10-10T14:01:01.431250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592818163420031:3722]
2025-10-10T14:01:01.431406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:01.431441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:01.431445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.431459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:01.431493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:01.431538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:01.431578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:01.432580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:01.525582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId: src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:01.557691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:01.582641Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:01.588152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:01.588209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:01.590573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592819741335973:3447]
2025-10-10T14:01:01.590745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:01.590778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:01.592715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:01.637631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:01.637777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 154 reason: error at write: Disconnected sessionId: src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0
2025-10-10T14:01:01.638141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 154 sessionId: src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0 is DEAD
2025-10-10T14:01:01.657385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:01.657431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0] Write session will restart in 0.009491s
2025-10-10T14:01:01.657534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0] Write session: Do CDS request
2025-10-10T14:01:01.657567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:01.690783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592819741336163:3447]
2025-10-10T14:01:01.697468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:01.697503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 155
2025-10-10T14:01:01.698209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:01.713653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:01.713844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:01.713864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:01.713876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:01.715665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 155 sessionId:  describe result for acl check
2025-10-10T14:01:01.715808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:01.715820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:01.715831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:01.715850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592819741336183:3983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:01.719067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592819741336183:3983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:01.745997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592819741336183:3983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:01.797489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592819741336183:3983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:01.797539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592819741336183:3983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:01.797557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592819741336183:3983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:01.797593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:01.854273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:01.858228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:01.859167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:01.859186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:01.859228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:01.859478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:01.859653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592818163420275:3730]
2025-10-10T14:01:01.861998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:01.863057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:01.863282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:01.864623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:01.864939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:01.864947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:01.864954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:01.864962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:01.864969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:01.864977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:01.864984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:01.864991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:01.864996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.865003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.865010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.865018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.865065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:01.865195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:01.865242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:01.865287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:01.865330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:01.865375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:01.865417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:01.865461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:01.865503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.865549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.865593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.865635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.865672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:01.865748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:01.865806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:01.865860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:01.871353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:01.871472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:01.871517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:01.871585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:01.871634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:01.871686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:01.871745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:01.871798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:01.871843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:01.871910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:01.871962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:01.872016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:01.872063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.872114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.872158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.872213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.872268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.872320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.872363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.872411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.872850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:01.919034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:01.933362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:01.933423Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:01.933441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:01.933461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:01.933488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 154 [2:7559592818163420275:3730]
2025-10-10T14:01:01.933548Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:01.933616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:01.933633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.933646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.933657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.933704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:01.933726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:01.933749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:01.968848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.968882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.968892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.968902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.968913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:01.969391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:01.969411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:01.969536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:01.969692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:01.969881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:01.969982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:01.970072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592819741336163:3447], now have 1 active actors on pipe
2025-10-10T14:01:01.970095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592819741336154:2442], now have 1 active actors on pipe
2025-10-10T14:01:01.970113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592819741336316:3983], now have 1 active actors on pipe
2025-10-10T14:01:01.970140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:01.970154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:01.970167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:01.970179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:01.970216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:01.970297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:01.970469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:01.970487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:01.970623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:01.970641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:01.971111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 154, pipe: [1:7559592819741336163:3447]
2025-10-10T14:01:01.971242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 154
2025-10-10T14:01:01.971333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 154
2025-10-10T14:01:01.971260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:01.971280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:01.971291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:01.971301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:01.971323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:01.978922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:01.978977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:01.979079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:01.979126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.979144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.979156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:01.979197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.979247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:01.979300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:01.983249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:01.983301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:01.983391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:01.984433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 155 partition: 0 MaxSeqNo: 36 sessionId: src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0
2025-10-10T14:01:01.985542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb02bb67-2dc67849-2b3958fa-1fa39184_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:02.018149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0] Write session: try to update token
2025-10-10T14:01:02.018199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:02.129097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.129178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.129191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.129311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:02.129327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:02.129341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:02.129354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:02.129366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:02.129404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:02.129432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:02.129457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:02.129481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:02.130193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:02.130230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:02.130267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:02.130299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:02.141840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:02.141899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:02.141912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:02.143059Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:02.160581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId: src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:02.182312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:02.306690Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:02.308434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:02.308451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:02.308496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592818163420270:3730]
2025-10-10T14:01:02.308650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:02.308677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:02.309839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:02.309870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:02.309044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:02.312588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592819741336163:3447]
2025-10-10T14:01:02.312732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:02.311661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:02.331971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 155 reason: error at write: Disconnected sessionId: src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0
2025-10-10T14:01:02.332280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 155 sessionId: src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0 is DEAD
2025-10-10T14:01:02.338951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:02.339029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0] Write session will restart in 0.009209s
2025-10-10T14:01:02.339268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0] Write session: Do CDS request
2025-10-10T14:01:02.339326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:02.359020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:02.359049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 156
2025-10-10T14:01:02.360244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:02.362503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:02.362654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:02.362672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:02.362683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:02.366326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 156 sessionId:  describe result for acl check
2025-10-10T14:01:02.366444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:02.366461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:02.366470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:02.366485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592824036303712:3993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:02.368437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592824036303712:3993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:02.387440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592824036303712:3993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:02.400753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592824036303712:3993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:02.400794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592824036303712:3993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:02.400811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592824036303712:3993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:02.400847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:02.413800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592824036303834:3447]
2025-10-10T14:01:02.450494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:02.454016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:02.454913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:02.454932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:02.454969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:02.455396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:02.455837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592822458387794:3736]
2025-10-10T14:01:02.458545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:02.460261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:02.460489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:02.462252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:02.462629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:02.462650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:02.462658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:02.462666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:02.462674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:02.462682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:02.462689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:02.462695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:02.462702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:02.462709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:02.462716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:02.462723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:02.462768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:02.462891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:02.462943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:02.462998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:02.463044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:02.463097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:02.463148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:02.463196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:02.463247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:02.463300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:02.463385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:02.463486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:02.463571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:02.463655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:02.463718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:02.463772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:02.463811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:02.463852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:02.463885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:02.463942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:02.463981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:02.464023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:02.464060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:02.464102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:02.464139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:02.464180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:02.464214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:02.464257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:02.464313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:02.464383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:02.464440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:02.464498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:02.464549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:02.464604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:02.464658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:02.464719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:02.466090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:02.506591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:02.572244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:02.572292Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:02.572302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:02.572325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:02.572342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 155 [2:7559592822458387794:3736]
2025-10-10T14:01:02.572384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:02.572432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:02.572444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.572456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.572464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.572501Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:02.572518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:02.572535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:02.575473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:02.575511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:02.575529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:02.575543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:02.575555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:02.575864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:02.575905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:02.576049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:02.576227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:02.576453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:02.576563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:02.576644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.576660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.576674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.576687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.576736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:02.576819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:02.577003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:02.577019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:02.577182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.577205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:02.579621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:02.579658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:02.579670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:02.579682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:02.579708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:02.579793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592824036303834:3447], now have 1 active actors on pipe
2025-10-10T14:01:02.579820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592824036303796:3993], now have 1 active actors on pipe
2025-10-10T14:01:02.579841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592824036303699:2442], now have 1 active actors on pipe
2025-10-10T14:01:02.582719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 155, pipe: [1:7559592824036303834:3447]
2025-10-10T14:01:02.582822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 155
2025-10-10T14:01:02.582894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 155
2025-10-10T14:01:02.584652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:02.584706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:02.584801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b0974fa-d97a2662-4c00d574-44160a38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:02.584834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.584854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.584865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:02.584901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.584943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:02.584997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:02.589255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:02.589301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:02.589377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:02.594657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 156 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b0974fa-d97a2662-4c00d574-44160a38_0
2025-10-10T14:01:02.597332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|587d5b30-a5d96e60-8764b1ba-b69a8cc2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b0974fa-d97a2662-4c00d574-44160a38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:02.637542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0974fa-d97a2662-4c00d574-44160a38_0] Write session: try to update token
2025-10-10T14:01:02.637717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0974fa-d97a2662-4c00d574-44160a38_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:02.779875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.779938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.779952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.849317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId: src_id|7b0974fa-d97a2662-4c00d574-44160a38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:02.858961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:02.859005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:02.859016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:02.859026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:02.859035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:02.859067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.859085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.859103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.859118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.859222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:02.859231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:02.859249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592822458387788:3736]
2025-10-10T14:01:02.859310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:02.859340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:02.859353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:02.861377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:02.861434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:02.861463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:02.861488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:02.861534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:02.868072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:02.897310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:03.031300Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:03.047327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:03.047387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:03.050297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:03.050570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592824036303834:3447]
2025-10-10T14:01:03.050676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:03.050690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:03.064158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:03.064310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 156 reason: error at write: Disconnected sessionId: src_id|7b0974fa-d97a2662-4c00d574-44160a38_0
2025-10-10T14:01:03.064608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 156 sessionId: src_id|7b0974fa-d97a2662-4c00d574-44160a38_0 is DEAD
2025-10-10T14:01:03.066679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0974fa-d97a2662-4c00d574-44160a38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:03.066717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0974fa-d97a2662-4c00d574-44160a38_0] Write session will restart in 0.006591s
2025-10-10T14:01:03.066812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0974fa-d97a2662-4c00d574-44160a38_0] Write session: Do CDS request
2025-10-10T14:01:03.066845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0974fa-d97a2662-4c00d574-44160a38_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:03.090453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0974fa-d97a2662-4c00d574-44160a38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:03.109937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:03.109970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 157
2025-10-10T14:01:03.110563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:03.110677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:03.110694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:03.110705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:03.112249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 157 sessionId:  describe result for acl check
2025-10-10T14:01:03.112370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:03.112379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:03.112387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:03.112406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592828331271252:4005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:03.115079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592828331271252:4005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:03.130221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592828331271252:4005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:03.151177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592828331271252:4005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:03.151225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592828331271252:4005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:03.151241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592828331271252:4005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:03.151273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:03.151846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592828331271334:3447]
2025-10-10T14:01:03.219707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:03.220747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:03.221589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:03.221606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:03.221657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:03.221927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:03.222131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592826753355343:3750]
2025-10-10T14:01:03.224283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:03.225772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:03.226026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:03.227250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:03.227603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:03.227611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:03.227617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:03.227624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:03.227630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:03.227638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:03.227644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:03.227651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:03.227658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.227665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.227672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.227678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.227723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:03.227824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:03.227872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:03.227937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:03.227983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:03.228028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:03.228072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:03.228115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:03.228156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.228201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.228244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.228291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.228335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:03.228397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:03.228459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:03.228513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:03.228560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:03.228612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:03.228656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:03.228707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:03.228755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:03.228808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:03.228855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:03.228906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:03.228954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:03.229003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:03.229299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:03.229357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:03.229410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.229463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.229509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.229559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.229606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.229656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.229710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.229768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.230221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:03.268297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:03.289828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:03.289885Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:03.289902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:03.289919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:03.289941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 156 [2:7559592826753355343:3750]
2025-10-10T14:01:03.289997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:03.290060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:03.290074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.290086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.290098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.290143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:03.290166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:03.290189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:03.292671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.292712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.292726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.292741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.292753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:03.293049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:03.293068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.295151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 156, pipe: [1:7559592828331271334:3447]
2025-10-10T14:01:03.295248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 156
2025-10-10T14:01:03.295315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 156
2025-10-10T14:01:03.294265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.294453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.294661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.294771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:03.294891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592828331271334:3447], now have 1 active actors on pipe
2025-10-10T14:01:03.294917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592828331271333:4005], now have 1 active actors on pipe
2025-10-10T14:01:03.294937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592828331271241:2442], now have 1 active actors on pipe
2025-10-10T14:01:03.294962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.294976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.294989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.295000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.295043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:03.295127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:03.295292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:03.295310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:03.295437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.295454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:03.295659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:03.295671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:03.295682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:03.295692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:03.295717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:03.296938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:03.296976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:03.297067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:03.297102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.297120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.297147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:03.297198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.297246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:03.297309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:03.299407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:03.299448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:03.299525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:03.306961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b0974fa-d97a2662-4c00d574-44160a38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:03.301723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 157 partition: 0 MaxSeqNo: 36 sessionId: src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0
2025-10-10T14:01:03.370266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0] Write session: try to update token
2025-10-10T14:01:03.370325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:03.511562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.511610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.511621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.511675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:03.511691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:03.511704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:03.511713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:03.511722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:03.511757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.511780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.511802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.511824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.512038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:03.512064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.512075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:03.513380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:03.513432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:03.513439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:03.513471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:03.513501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:03.566531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId: src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:03.592984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:03.676741Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:03.737082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:03.737305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:03.737401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:03.737420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:03.737468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592826753355338:3750]
2025-10-10T14:01:03.737801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:03.739176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592828331271334:3447]
2025-10-10T14:01:03.739283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:03.739296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:03.741146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:03.743836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:03.773297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 157 reason: error at write: Disconnected sessionId: src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0
2025-10-10T14:01:03.773632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 157 sessionId: src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0 is DEAD
2025-10-10T14:01:03.781366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:03.781414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0] Write session will restart in 0.007542s
2025-10-10T14:01:03.781514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0] Write session: Do CDS request
2025-10-10T14:01:03.781544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:03.801303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:03.801335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 158
2025-10-10T14:01:03.806011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:03.813288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:03.813472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:03.813493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:03.813504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:03.815321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 158 sessionId:  describe result for acl check
2025-10-10T14:01:03.815450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:03.815461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:03.815471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:03.815489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592828331271521:4013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:03.820091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592828331271521:4013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:03.839382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592828331271521:4013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:03.842328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592828331271581:3447]
2025-10-10T14:01:03.862436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592828331271521:4013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:03.862484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592828331271521:4013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:03.862503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592828331271521:4013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:03.862536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:03.897242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:03.906795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:03.907748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:03.907767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:03.907815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:03.908114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:03.908311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592826753355561:3755]
2025-10-10T14:01:03.910954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:03.912036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:03.912204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:03.913182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:03.913476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:03.913486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:03.913494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:03.913500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:03.913508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:03.913515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:03.913522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:03.913530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:03.913538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.913546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.913553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.913561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.913612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:03.913735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:03.913793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:03.913845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:03.913897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:03.913948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:03.913998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:03.914044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:03.914093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.914144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.914193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.914244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.914287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:03.914362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:03.914430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:03.914492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:03.914547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:03.914611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:03.914663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:03.914715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:03.914753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:03.914794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:03.914827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:03.915390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:03.915444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:03.915487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:03.915522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:03.915562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:03.915601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.915641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.915676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.915725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.915771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.915815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.915856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.915899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.916318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:03.942429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:03.967881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:03.967948Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:03.967967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:03.967987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:03.968011Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 157 [2:7559592826753355561:3755]
2025-10-10T14:01:03.968071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:03.968135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:03.968163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.968176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.968202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.968252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:03.968284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:03.968307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:03.974374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.974416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.974432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.974447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.974459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:03.974778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:03.974797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:03.974944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:03.975124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:03.975347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:03.975462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:03.975552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592828331271581:3447], now have 1 active actors on pipe
2025-10-10T14:01:03.975575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592828331271658:4013], now have 1 active actors on pipe
2025-10-10T14:01:03.975598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592828331271495:2442], now have 1 active actors on pipe
2025-10-10T14:01:03.975622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:03.975639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:03.975651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:03.975663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:03.975710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:03.975744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:03.975758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:03.975770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:03.975779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:03.975791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:03.975978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:03.975995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:03.976119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:03.976149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:03.976165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:03.977403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 157
2025-10-10T14:01:03.977427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 157, pipe: [1:7559592828331271581:3447]
2025-10-10T14:01:03.977519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 157
2025-10-10T14:01:03.987679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:03.987742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:03.987877Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:03.987933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.987954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.987964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:03.988007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.988057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:03.988114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:03.994318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:03.994369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:03.994455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:03.994948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 158 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0
2025-10-10T14:01:03.995849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e91d8b50-1dc22ab2-b16dadbb-bc0bf897_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:04.047031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0] Write session: try to update token
2025-10-10T14:01:04.047076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:04.084538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.084586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.084597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.084655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:04.084668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:04.084705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:04.084823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:04.087386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:04.088219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:04.101969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:04.103071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:04.104099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:04.109569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:04.110000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:04.280985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId: src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:04.282800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.282838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.282848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.282903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:04.282916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:04.282927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:04.282935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:04.282944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:04.282979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:04.283001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:04.283021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:04.283041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592826753355555:3755]
2025-10-10T14:01:04.283183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:04.283207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:04.283217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:04.284308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:04.285099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:04.285156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:04.285188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:04.285220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:04.320697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:04.435072Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:04.449940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:04.449991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:04.453309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:04.453338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:04.452394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:04.465274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:04.465535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592828331271581:3447]
2025-10-10T14:01:04.509825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 158 reason: error at write: Disconnected sessionId: src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0
2025-10-10T14:01:04.510181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 158 sessionId: src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0 is DEAD
2025-10-10T14:01:04.512285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:04.512318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0] Write session will restart in 0.005530s
2025-10-10T14:01:04.512410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0] Write session: Do CDS request
2025-10-10T14:01:04.512438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:04.531898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:04.532181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:04.532213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 159
2025-10-10T14:01:04.534496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:04.534641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:04.534657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:04.534668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:04.536302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 159 sessionId:  describe result for acl check
2025-10-10T14:01:04.536428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:04.536437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:04.536454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:04.536478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592832626239050:4020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:04.539305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592832626239050:4020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:04.551596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592832626239050:4020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:04.566234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592832626239075:3447]
2025-10-10T14:01:04.580070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592832626239050:4020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:04.580147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592832626239050:4020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:04.580172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592832626239050:4020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:04.580216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:04.677185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:04.684321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:04.686521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:04.686563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:04.686609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:04.686872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:04.687052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592831048323116:3765]
2025-10-10T14:01:04.689375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:04.690867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:04.691102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:04.692365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:04.692700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:04.692708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:04.692715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:04.692723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:04.692731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:04.692738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:04.692744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:04.692750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:04.692757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:04.692763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:04.692770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:04.692778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:04.692822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:04.692933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:04.692984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:04.693030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:04.693078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:04.693150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:04.693195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:04.693240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:04.693287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:04.693332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:04.693376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:04.693420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:04.693460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:04.693524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:04.693582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:04.693635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:04.693685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:04.693734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:04.693776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:04.693827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:04.693876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:04.693927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:04.693970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:04.694021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:04.694062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:04.695090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:04.695165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:04.695225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:04.695276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:04.695330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:04.695373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:04.695426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:04.695471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:04.695524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:04.695566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:04.695634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:04.696106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:04.741839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:04.806669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:04.806730Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:04.806747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:04.806767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:04.806792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 158 [2:7559592831048323116:3765]
2025-10-10T14:01:04.806846Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:04.806915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:04.806930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.806942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.806955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.807004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:04.807027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:04.807050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:04.808373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:04.808391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:04.808404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:04.808418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:04.808429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:04.808695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:04.808711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:04.808851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:04.809030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:04.813834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 158
2025-10-10T14:01:04.813920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 158, pipe: [1:7559592832626239075:3447]
2025-10-10T14:01:04.813993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 158
2025-10-10T14:01:04.813630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:04.813767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:04.813876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592832626239088:4020], now have 1 active actors on pipe
2025-10-10T14:01:04.813903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592832626239075:3447], now have 1 active actors on pipe
2025-10-10T14:01:04.813927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592832626239027:2442], now have 1 active actors on pipe
2025-10-10T14:01:04.813954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:04.813968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:04.813979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:04.813993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:04.814036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:04.814122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:04.814298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:04.814316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:04.814444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:04.814467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:04.814952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:04.814976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:04.814986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:04.814995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:04.815018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:04.821987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:04.822047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:04.822156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:04.822198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.822220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.822230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:04.822273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.822320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:04.822375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:04.829357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:04.829416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:04.829509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:04.834344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 159 partition: 0 MaxSeqNo: 36 sessionId: src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0
2025-10-10T14:01:04.836681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f40c37f-76e8bdf8-e560569a-62546c62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:04.896245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0] Write session: try to update token
2025-10-10T14:01:04.896311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:04.906986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.907026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.907039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.011107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:05.011153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:05.011165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:05.011176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:05.011187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:05.011224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:05.011252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:05.011275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:05.011297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:05.011526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.011540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.011553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.011598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:05.011627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:05.011640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:05.012826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:05.013656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:05.013709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:05.013736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:05.013765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:05.118559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId: src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:05.171671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:05.185795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:05.199299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:05.199358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:05.199417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:05.199433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:05.199474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592831048323098:3765]
2025-10-10T14:01:05.200112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:05.200993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:05.204578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:05.204620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:05.274286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 159 reason: error at write: Disconnected sessionId: src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0
2025-10-10T14:01:05.274623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 159 sessionId: src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0 is DEAD
2025-10-10T14:01:05.280503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:05.280554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0] Write session will restart in 0.007670s
2025-10-10T14:01:05.280667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0] Write session: Do CDS request
2025-10-10T14:01:05.280702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:05.296136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592832626239075:3447]
2025-10-10T14:01:05.297632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:05.298331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:05.298353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 160
2025-10-10T14:01:05.305933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:05.313633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:05.313780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:05.313799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:05.313809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:05.321411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 160 sessionId:  describe result for acl check
2025-10-10T14:01:05.321538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:05.321547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:05.321556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:05.321575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592836921206682:4032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:05.324211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592836921206682:4032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:05.360930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592836921206682:4032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:05.366325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:05.375603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:05.376418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:05.376435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:05.376477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:05.376712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:05.376874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592835343290637:3774]
2025-10-10T14:01:05.379215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:05.380810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:05.381010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:05.382369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:05.382672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:05.382679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:05.382685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:05.382693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:05.382700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:05.382707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:05.382714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:05.382721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:05.382727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:05.382734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:05.382743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:05.382750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:05.382797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:05.382902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:05.382948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:05.382994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:05.383036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:05.383080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:05.383123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:05.383164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:05.383210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:05.383255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:05.383300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:05.383343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:05.383382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:05.383446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:05.383500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:05.383550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:05.383599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:05.383649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:05.383693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:05.383747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:05.383798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:05.383850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:05.383892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:05.383945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:05.384008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:05.384059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:05.384104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:05.384153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:05.384198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:05.384247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:05.384293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:05.384343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:05.384390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:05.384436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:05.384481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:05.384530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:05.384907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:05.389980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592836921206682:4032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:05.390023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592836921206682:4032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:05.390039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592836921206682:4032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:05.390075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:05.405248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592836921206788:3447]
2025-10-10T14:01:05.437468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:05.454105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 159, pipe: [1:7559592836921206788:3447]
2025-10-10T14:01:05.454209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 159
2025-10-10T14:01:05.454280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 159
2025-10-10T14:01:05.451037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:05.451092Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:05.451109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:05.451128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:05.451153Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 159 [2:7559592835343290637:3774]
2025-10-10T14:01:05.451211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:05.451273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:05.451287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.451299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.451310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.451362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:05.451385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:05.451407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:05.452809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:05.452825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:05.452838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:05.452853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:05.452865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:05.462053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:05.462099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:05.462231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:05.462398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:05.462615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:05.462716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:05.462780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592836921206788:3447], now have 1 active actors on pipe
2025-10-10T14:01:05.462801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592836921206782:4032], now have 1 active actors on pipe
2025-10-10T14:01:05.462820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592836921206625:2442], now have 1 active actors on pipe
2025-10-10T14:01:05.462870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:05.462892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:05.462992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592835343290631:3774]
2025-10-10T14:01:05.463007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592835343290631:3774]
2025-10-10T14:01:05.463019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592835343290631:3774]
2025-10-10T14:01:05.463030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592835343290631:3774]
2025-10-10T14:01:05.463071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:05.463174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:05.463207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.463225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.463236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:05.463271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.463318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:05.463371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:05.463538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:05.463555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:05.463690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:05.463742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592835343290631:3774]
2025-10-10T14:01:05.463762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:05.465062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:05.465096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:05.465109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:05.465120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:05.465160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:05.477428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:05.477473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:05.477550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:05.477916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 160 partition: 0 MaxSeqNo: 36 sessionId: src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0
2025-10-10T14:01:05.481369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56332f69-46ef4bca-a8c16045-5e057bbb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:05.554423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.554464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.554476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.562773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0] Write session: try to update token
2025-10-10T14:01:05.562831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:05.669636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:05.669686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:05.669700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:05.669711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:05.669724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:05.669762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592835343290631:3774]
2025-10-10T14:01:05.669792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592835343290631:3774]
2025-10-10T14:01:05.669819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592835343290631:3774]
2025-10-10T14:01:05.669844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592835343290631:3774]
2025-10-10T14:01:05.669956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:05.669991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:05.670024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.670026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:05.670039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.670051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.670059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:05.670101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:05.670127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:05.670141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:05.671221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:05.765201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId: src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:05.787495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:05.829229Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:05.832103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:05.832155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:05.835371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:05.835413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:05.837926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:05.838165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592836921206788:3447]
2025-10-10T14:01:05.855801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 160 reason: error at write: Disconnected sessionId: src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0
2025-10-10T14:01:05.856141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 160 sessionId: src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0 is DEAD
2025-10-10T14:01:05.861403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:05.861446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0] Write session will restart in 0.009909s
2025-10-10T14:01:05.861544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0] Write session: Do CDS request
2025-10-10T14:01:05.861573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:05.886612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:05.889384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:05.889421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 161
2025-10-10T14:01:05.893269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:05.893422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:05.893446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:05.893456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:05.894936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 161 sessionId:  describe result for acl check
2025-10-10T14:01:05.895074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:05.895093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:05.895103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:05.895121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592836921206837:4043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:05.900699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:05.902126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592836921206837:4043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:05.915019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592836921206837:4043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:05.923707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592836921206837:4043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:05.923746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592836921206837:4043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:05.923767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592836921206837:4043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:05.923800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:05.938445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592836921206869:3447]
2025-10-10T14:01:06.031241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:06.036510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:06.037402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:06.037421Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:06.037464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:06.037723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:06.037900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592839638258170:3784]
2025-10-10T14:01:06.040147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:06.041168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:06.041396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:06.042625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:06.042940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:06.042948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:06.042955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:06.042962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:06.042969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:06.042976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:06.042983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:06.042990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:06.042998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.043005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.043010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.043016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.043066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:06.043177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:06.043242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:06.043292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:06.043338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:06.043390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:06.043437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:06.043486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:06.043540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.043593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.043640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.043686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.043724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:06.043793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:06.043856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:06.043912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:06.043976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:06.044034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:06.044080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:06.044134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:06.044187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:06.044241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:06.044289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:06.044340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:06.044389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:06.044461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:06.044511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:06.044589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:06.044640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.044695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.044739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.044792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.044840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.044895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.044942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.044997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.046070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:06.074725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:06.129686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:06.129750Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:06.129770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:06.129794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:06.129820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 160 [2:7559592839638258170:3784]
2025-10-10T14:01:06.129885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:06.129948Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:06.129963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.129978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.129992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.130042Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:06.130064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:06.130088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:06.131692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.131732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.131747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.131762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.131774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:06.132105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:06.132137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.132297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.132515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.132872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.133013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:06.134292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 160
2025-10-10T14:01:06.134380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 160, pipe: [1:7559592836921206869:3447]
2025-10-10T14:01:06.134454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 160
2025-10-10T14:01:06.133139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.133161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.133175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.133189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.133224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:06.133309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:06.133376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:06.133390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:06.133404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:06.133416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:06.133507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:06.133525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:06.133678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592836921206824:2442], now have 1 active actors on pipe
2025-10-10T14:01:06.133704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592836921206869:3447], now have 1 active actors on pipe
2025-10-10T14:01:06.133728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592836921206866:4043], now have 1 active actors on pipe
2025-10-10T14:01:06.133747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.133779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:06.134588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:06.135882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:06.135909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:06.136018Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9aac16d1-2defe637-75865c1b-89c03fee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:06.136049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.136078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.136098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:06.136133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.136177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:06.136242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:06.139689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 161 partition: 0 MaxSeqNo: 36 sessionId: src_id|9aac16d1-2defe637-75865c1b-89c03fee_0
2025-10-10T14:01:06.139166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:06.139222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:06.139296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:06.141591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|627c8b3d-6ae6b186-645fa8-546b6f35_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9aac16d1-2defe637-75865c1b-89c03fee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:06.166105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aac16d1-2defe637-75865c1b-89c03fee_0] Write session: try to update token
2025-10-10T14:01:06.166161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aac16d1-2defe637-75865c1b-89c03fee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:06.294945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:06.294996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:06.295009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:06.295017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:06.295027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:06.295059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.295080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.295103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.295123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.295347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.295359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.295371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.295414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:06.295438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.295450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:06.296548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:06.297117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:06.297168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:06.297203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:06.297235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:06.308247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId: src_id|9aac16d1-2defe637-75865c1b-89c03fee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:06.335558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:06.458604Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:06.495149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:06.495208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:06.495278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:06.495293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:06.495335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592839638258165:3784]
2025-10-10T14:01:06.496981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592836921206869:3447]
2025-10-10T14:01:06.497090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:06.497103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:06.495651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:06.496146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:06.509485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aac16d1-2defe637-75865c1b-89c03fee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:06.509550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aac16d1-2defe637-75865c1b-89c03fee_0] Write session will restart in 0.006294s
2025-10-10T14:01:06.509715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aac16d1-2defe637-75865c1b-89c03fee_0] Write session: Do CDS request
2025-10-10T14:01:06.508371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:06.509764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aac16d1-2defe637-75865c1b-89c03fee_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:06.508560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 161 reason: error at write: Disconnected sessionId: src_id|9aac16d1-2defe637-75865c1b-89c03fee_0
2025-10-10T14:01:06.508869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 161 sessionId: src_id|9aac16d1-2defe637-75865c1b-89c03fee_0 is DEAD
2025-10-10T14:01:06.522544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aac16d1-2defe637-75865c1b-89c03fee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:06.530175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:06.530210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 162
2025-10-10T14:01:06.530738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:06.530897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:06.530922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:06.530933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:06.535302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 162 sessionId:  describe result for acl check
2025-10-10T14:01:06.535436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:06.535447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:06.535457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:06.535475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592841216174383:4055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:06.538475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592841216174383:4055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:06.550464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592841216174383:4055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:06.562113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592841216174383:4055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:06.562157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592841216174383:4055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:06.562176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592841216174383:4055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:06.562207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:06.597560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592841216174500:3447]
2025-10-10T14:01:06.644693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:06.653270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:06.654118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:06.654136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:06.654179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:06.654425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:06.654628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592839638258417:3793]
2025-10-10T14:01:06.656706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:06.658468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:06.658685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:06.659994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:06.660302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:06.660310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:06.660317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:06.660323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:06.660329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:06.660336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:06.660342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:06.660348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:06.660355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.660361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.660369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.660376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.660418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:06.660515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:06.660559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:06.660602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:06.660645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:06.660689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:06.660733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:06.660773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:06.660817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.660856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.660894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.660935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.660971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:06.661028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:06.661080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:06.661154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:06.661199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:06.661251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:06.661292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:06.661342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:06.661386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:06.661436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:06.661476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:06.661523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:06.661564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:06.661611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:06.661650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:06.661698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:06.661742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.661792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.661836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.661885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.661928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.661977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.662019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.662066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.662472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:06.689834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:06.796542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:06.796602Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:06.796617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:06.796636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:06.796659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 161 [2:7559592839638258417:3793]
2025-10-10T14:01:06.796711Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:06.796767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:06.796780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.796792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.796802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.796848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:06.796870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:06.796891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:06.799458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.799501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.799515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.799529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.799540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:06.799822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:06.799840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:06.799999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:06.800193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:06.800727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 161
2025-10-10T14:01:06.800835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 161
2025-10-10T14:01:06.800925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 161, pipe: [1:7559592841216174500:3447]
2025-10-10T14:01:06.800769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:06.800897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:06.800984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592841216174423:4055], now have 1 active actors on pipe
2025-10-10T14:01:06.801008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592841216174370:2442], now have 1 active actors on pipe
2025-10-10T14:01:06.801030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592841216174500:3447], now have 1 active actors on pipe
2025-10-10T14:01:06.801054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:06.801069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:06.801085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:06.801097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:06.801143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:06.801227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:06.801308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:06.801323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:06.801336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:06.801348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:06.801420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:06.801438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:06.801603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:06.801646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:06.801692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:06.801728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:06.801847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:06.801886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.801910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.801920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:06.801952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.801998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:06.802091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:06.802396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:06.806084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:06.806140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:06.806218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:06.807601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 162 partition: 0 MaxSeqNo: 36 sessionId: src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0
2025-10-10T14:01:06.808310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aac16d1-2defe637-75865c1b-89c03fee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:06.847111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0] Write session: try to update token
2025-10-10T14:01:06.847166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:06.860735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:06.860778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:06.860815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:06.860937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:06.862082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:06.862885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:06.870632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:06.871818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:06.872979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:06.874856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:06.875287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:06.910457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.910500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.910512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.021063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:07.021173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:07.021197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:07.021220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:07.021239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:07.021298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:07.021340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:07.021374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:07.021408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592839638258411:3793]
2025-10-10T14:01:07.021565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.021577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.021588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.021632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:07.021657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.021667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:07.022718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:07.025300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:07.025361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:07.025402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:07.025436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:07.032031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId: src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:07.056329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:07.180591Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:07.182439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:07.182488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:07.184408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:07.184440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:07.183869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:07.187018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:07.187318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592841216174500:3447]
2025-10-10T14:01:07.196193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 162 reason: error at write: Disconnected sessionId: src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0
2025-10-10T14:01:07.196490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 162 sessionId: src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0 is DEAD
2025-10-10T14:01:07.202229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:07.202273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0] Write session will restart in 0.007177s
2025-10-10T14:01:07.202371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0] Write session: Do CDS request
2025-10-10T14:01:07.202403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:07.239035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:07.249482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:07.249531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 163
2025-10-10T14:01:07.250124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:07.250266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:07.250283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:07.250293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:07.251800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 163 sessionId:  describe result for acl check
2025-10-10T14:01:07.251913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:07.251925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:07.251934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:07.251951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592845511141927:4064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:07.254635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592845511141927:4064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:07.279193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592845511141927:4064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:07.289584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592845511141991:3447]
E1010 14:01:07.298924095  150464 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:01:07.298657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592845511141927:4064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:07.298711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592845511141927:4064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:07.298729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592845511141927:4064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:07.298764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:07.372596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:07.383029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:07.384394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:07.384416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:07.384469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:07.384784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:07.384991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592843933225965:3799]
2025-10-10T14:01:07.389825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:07.394481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:07.394794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:07.396297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:07.396675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:07.396683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:07.396691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:07.396706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:07.396718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:07.396725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:07.396734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:07.396741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:07.396748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.396756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.396763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.396772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.396821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:07.396937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:07.396986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:07.397037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:07.397085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:07.397156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:07.397218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:07.397272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:07.397324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.397374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.397424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.397470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.397514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:07.397584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:07.397649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:07.397709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:07.397765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:07.397826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:07.397876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:07.397937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:07.397987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:07.398045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:07.398094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:07.398152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:07.398205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:07.398262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:07.398338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:07.398396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:07.398450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.398511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.398561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.398621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.398671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.398726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.398773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.398830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.399338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:07.426148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:07.440351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:07.440408Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:07.440425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:07.440445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:07.440469Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 162 [2:7559592843933225965:3799]
2025-10-10T14:01:07.440522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:07.440586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:07.440600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.440612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.440624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.440669Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:07.440692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:07.440714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:07.443426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.443461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.443473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.443484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.443494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:07.443780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:07.443798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.443937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.444131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.444342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.444453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:07.444531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.444545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.444556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.444569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.444615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:07.444698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:07.444877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:07.444895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:07.445029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.445049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:07.447163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 162
2025-10-10T14:01:07.447271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 162
2025-10-10T14:01:07.447344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 162, pipe: [1:7559592845511141991:3447]
2025-10-10T14:01:07.445737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:07.445760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:07.445772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:07.445783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:07.445807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:07.453822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592845511142014:4064], now have 1 active actors on pipe
2025-10-10T14:01:07.453878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592845511141911:2442], now have 1 active actors on pipe
2025-10-10T14:01:07.453913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592845511141991:3447], now have 1 active actors on pipe
2025-10-10T14:01:07.453997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:07.454017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:07.454151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:07.454188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.454206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.454216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:07.454291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.454350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:07.454402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:07.459273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:07.459317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:07.459393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:07.459823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 163 partition: 0 MaxSeqNo: 36 sessionId: src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0
2025-10-10T14:01:07.464825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6cad4ee-a18ca15e-bb80331f-d26cd8aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:07.531049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0] Write session: try to update token
2025-10-10T14:01:07.531108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:07.609750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.609790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.609800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.609856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:07.609868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:07.609879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:07.609888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:07.609896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:07.609928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.609952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.609972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.609989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.610185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:07.610209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.610219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:07.611847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:07.613283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:07.613316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:07.613343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:07.613371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:07.683282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId: src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:07.710126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:07.780283Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:07.794298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:07.794355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:07.794590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:07.794603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:07.796069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:07.794641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592843933225959:3799]
2025-10-10T14:01:07.796099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:07.795065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:07.796593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:07.801272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:07.801422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592845511141991:3447]
2025-10-10T14:01:07.848211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:07.848302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0] Write session will restart in 0.008549s
2025-10-10T14:01:07.848475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0] Write session: Do CDS request
2025-10-10T14:01:07.848536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:07.846961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 163 reason: error at write: Disconnected sessionId: src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0
2025-10-10T14:01:07.847302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 163 sessionId: src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0 is DEAD
2025-10-10T14:01:07.870885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:07.870917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 164
2025-10-10T14:01:07.872470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:07.873160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:07.873318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:07.873336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:07.873348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:07.875298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 164 sessionId:  describe result for acl check
2025-10-10T14:01:07.875431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:07.875442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:07.875451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:07.875469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592845511142208:4070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:07.878115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592845511142208:4070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:07.894273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592845511142208:4070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:07.902654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592845511142288:3447]
2025-10-10T14:01:07.910794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592845511142208:4070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:07.910831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592845511142208:4070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:07.910842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592845511142208:4070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:07.910864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:07.933921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:07.937397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:07.938481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:07.938502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:07.938539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:07.938726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:07.938845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592843933226200:3812]
2025-10-10T14:01:07.940152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:07.941296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:07.941493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:07.942461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:07.942707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:07.942722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:07.942729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:07.942735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:07.942742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:07.942748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:07.942756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:07.942762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:07.942769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.942775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.942781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.942790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.942836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:07.943091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:07.943147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:07.943198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:07.943249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:07.943298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:07.943346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:07.943392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:07.943440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.943490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.943536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.943586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.943632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:07.943700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:07.943763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:07.943820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:07.943872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:07.943930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:07.943975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:07.944045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:07.944098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:07.944153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:07.944200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:07.944262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:07.944312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:07.944368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:07.944415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:07.944470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:07.944520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.944590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.944648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.944707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.944756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.944815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.944861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.944916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.945331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:07.979446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:07.993420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:07.993479Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:07.993496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:07.993514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:07.993540Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 163 [2:7559592843933226200:3812]
2025-10-10T14:01:07.993595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:07.993658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:07.993673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.993685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.993696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.993745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:07.993766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:07.993788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:07.995083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.995099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.995112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.995124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.995135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:07.995421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:07.995437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:07.995572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:07.995746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:07.995957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:07.996087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:07.996166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592845511142155:2442], now have 1 active actors on pipe
2025-10-10T14:01:07.996188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592845511142314:4070], now have 1 active actors on pipe
2025-10-10T14:01:07.996208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592845511142288:3447], now have 1 active actors on pipe
2025-10-10T14:01:07.996231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592843933226194:3812]
2025-10-10T14:01:07.996245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592843933226194:3812]
2025-10-10T14:01:07.996257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592843933226194:3812]
2025-10-10T14:01:07.996706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 163
2025-10-10T14:01:07.996267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592843933226194:3812]
2025-10-10T14:01:07.996796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 163
2025-10-10T14:01:07.996330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:07.996341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:07.996855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 163, pipe: [1:7559592845511142288:3447]
2025-10-10T14:01:07.996351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:07.996360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:07.997312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:07.997415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:07.997602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:07.997619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:07.997739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592843933226194:3812]
2025-10-10T14:01:07.997767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:07.998111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:07.999431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:07.999461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:07.999538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:07.999572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.999589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.999608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:07.999654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.999698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:07.999761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:08.001991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 164 partition: 0 MaxSeqNo: 36 sessionId: src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0
2025-10-10T14:01:08.000968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:08.001000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:08.001071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:08.002891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a4e7a5-8cc5b900-e1b38310-feebc72f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:08.030803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0] Write session: try to update token
2025-10-10T14:01:08.030860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:08.097353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.097394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.097407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.211198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId: src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:08.214467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.214518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.214529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.214587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:08.214602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:08.214615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:08.214628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:08.214642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:08.214683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592843933226194:3812]
2025-10-10T14:01:08.214712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592843933226194:3812]
2025-10-10T14:01:08.214740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592843933226194:3812]
2025-10-10T14:01:08.214766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592843933226194:3812]
2025-10-10T14:01:08.214919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:08.214960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:08.214974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:08.216148Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:08.220097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:08.220162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:08.220194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:08.220225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:08.272188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:08.368761Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:08.371719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:08.371774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:08.375520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:08.375929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592845511142288:3447]
2025-10-10T14:01:08.376028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:08.376139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:08.376148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:08.417159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 164 reason: error at write: Disconnected sessionId: src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0
2025-10-10T14:01:08.417529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 164 sessionId: src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0 is DEAD
2025-10-10T14:01:08.421430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:08.421497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0] Write session will restart in 0.005338s
2025-10-10T14:01:08.421651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0] Write session: Do CDS request
2025-10-10T14:01:08.421708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:08.437048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:08.437249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:08.437086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 165
2025-10-10T14:01:08.438047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:08.438167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:08.438183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:08.438191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:08.439623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 165 sessionId:  describe result for acl check
2025-10-10T14:01:08.439718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:08.439727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:08.439736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:08.439751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592849806109711:4081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:08.442200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592849806109711:4081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:08.457159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592849806109711:4081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:08.486045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592849806109819:3447]
2025-10-10T14:01:08.491723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592849806109711:4081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:08.491802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592849806109711:4081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:08.491820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592849806109711:4081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:08.491853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:08.527558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:08.529159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:08.529987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:08.530026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:08.530072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:08.530333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:08.530521Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592848228193729:3816]
2025-10-10T14:01:08.532506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:08.533665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:08.533897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:08.535121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:08.535433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:08.535441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:08.535448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:08.535455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:08.535462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:08.535467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:08.535474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:08.535480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:08.535487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:08.535494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:08.535501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:08.535507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:08.535556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:08.535662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:08.535714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:08.535760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:08.535806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:08.535853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:08.535895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:08.535936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:08.535981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:08.536042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:08.536086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:08.536132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:08.536169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:08.536233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:08.536292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:08.536345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:08.536395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:08.536446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:08.536490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:08.536541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:08.536589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:08.536644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:08.536686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:08.536735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:08.536780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:08.536836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:08.536879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:08.536930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:08.536977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:08.537025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:08.537070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:08.537181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:08.537237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:08.537297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:08.537340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:08.537391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:08.537810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:08.580463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:08.596231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:08.596437Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:08.596460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:08.596481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:08.596505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 164 [2:7559592848228193729:3816]
2025-10-10T14:01:08.596559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:08.596619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:08.596635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.596646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.599222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 164
2025-10-10T14:01:08.596657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.599329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 164
2025-10-10T14:01:08.596706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:08.596726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:08.599404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 164, pipe: [1:7559592849806109819:3447]
2025-10-10T14:01:08.596748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:08.598355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:08.598373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:08.598386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:08.598399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:08.598409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:08.598697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:08.598714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:08.598857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:08.599035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:08.599254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:08.599362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:08.599452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592849806109844:4081], now have 1 active actors on pipe
2025-10-10T14:01:08.599476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592849806109694:2442], now have 1 active actors on pipe
2025-10-10T14:01:08.599498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592849806109819:3447], now have 1 active actors on pipe
2025-10-10T14:01:08.599522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592848228193724:3816]
2025-10-10T14:01:08.599537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592848228193724:3816]
2025-10-10T14:01:08.599550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592848228193724:3816]
2025-10-10T14:01:08.599561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592848228193724:3816]
2025-10-10T14:01:08.599640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:08.599651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:08.599664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:08.599674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:08.600047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:08.600134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:08.600307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:08.600323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:08.600383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:08.600402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:08.600552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592848228193724:3816]
2025-10-10T14:01:08.600600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:08.600631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:08.600670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:08.600701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.600719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.600728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:08.600762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.600802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:08.600957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:08.605405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:08.605452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:08.605535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:08.606000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 165 partition: 0 MaxSeqNo: 36 sessionId: src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0
2025-10-10T14:01:08.606956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|971f22c2-bbdbbdc5-4a187af1-5d3164bb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:08.648057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0] Write session: try to update token
2025-10-10T14:01:08.648118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:08.711093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.711134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.711147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.711207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:08.711222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:08.711236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:08.711247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:08.711259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:08.711296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592848228193724:3816]
2025-10-10T14:01:08.711323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592848228193724:3816]
2025-10-10T14:01:08.711347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592848228193724:3816]
2025-10-10T14:01:08.711369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592848228193724:3816]
2025-10-10T14:01:08.711505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:08.711530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:08.711542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:08.712595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:08.717727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:08.717778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:08.717806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:08.717832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:08.847772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId: src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:08.869571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:08.924902Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:08.926605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:08.926650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:08.928260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:08.928622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592849806109819:3447]
2025-10-10T14:01:08.928785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:08.928806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:08.930810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:08.970741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 165 reason: error at write: Disconnected sessionId: src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0
2025-10-10T14:01:08.971074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 165 sessionId: src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0 is DEAD
2025-10-10T14:01:08.973609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:08.973653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0] Write session will restart in 0.005579s
2025-10-10T14:01:08.973762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0] Write session: Do CDS request
2025-10-10T14:01:08.973799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:08.990136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:08.990190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 166
2025-10-10T14:01:08.993914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:08.995905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:08.996105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:08.996125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:08.996137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:08.999524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 166 sessionId:  describe result for acl check
2025-10-10T14:01:08.999619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:08.999625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:08.999632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:08.999643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592849806109988:4090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:09.001877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592849806109988:4090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:09.027094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592849806109988:4090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:09.029928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592854101077368:3447]
2025-10-10T14:01:09.038585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592849806109988:4090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:09.038631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592849806109988:4090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:09.038648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592849806109988:4090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:09.038677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:09.079521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:09.083592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:09.084392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:09.084404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:09.084441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:09.084911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:09.085078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592852523161264:3826]
2025-10-10T14:01:09.087321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:09.089490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:09.089781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:09.090947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:09.091252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:09.091259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:09.091265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:09.091271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:09.091284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:09.091290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:09.091295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:09.091300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:09.091306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.091311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.091316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.091321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.091365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:09.091464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:09.091509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:09.091553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:09.091598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:09.091640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:09.091683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:09.091722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:09.091764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.091811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.091850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.091888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.091926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:09.091988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:09.092059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:09.092109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:09.092155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:09.092204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:09.092245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:09.092295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:09.092338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:09.092385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:09.092428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:09.092472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:09.092516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:09.092560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:09.092607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:09.092654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:09.092699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.092748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.092790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.092840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.092885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.092928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.092969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.093012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.093431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:09.120244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:09.132344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:09.132419Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:09.132438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:09.132459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:09.132480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 165 [2:7559592852523161264:3826]
2025-10-10T14:01:09.132521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:09.132574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:09.132586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.132595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.132603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.132639Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:09.132661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:09.132683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:09.134314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.134337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.134344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.134351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.134357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:09.134622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:09.134638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.134771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.134945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.135093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.135164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:09.135296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592854101077368:3447], now have 1 active actors on pipe
2025-10-10T14:01:09.135319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592849806109953:2442], now have 1 active actors on pipe
2025-10-10T14:01:09.135333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592854101077399:4090], now have 1 active actors on pipe
2025-10-10T14:01:09.135350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.135361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.135369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.135377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.135407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:09.135441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:09.135453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:09.135467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:09.135477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:09.135488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:09.135624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:09.135635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:09.135742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.135783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:09.135781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:09.136642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 165, pipe: [1:7559592854101077368:3447]
2025-10-10T14:01:09.136682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 165
2025-10-10T14:01:09.136763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 165
2025-10-10T14:01:09.137511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:09.137547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:09.137621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2be5318-a7293e26-baff6596-d29ee1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:09.137654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.137681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.137691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:09.137733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.137778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:09.137838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:09.138566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:09.138593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:09.138654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:09.139652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 166 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2be5318-a7293e26-baff6596-d29ee1_0
2025-10-10T14:01:09.142575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4130173b-cd0aa2e4-9e91b345-9bd30acb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2be5318-a7293e26-baff6596-d29ee1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:09.225143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2be5318-a7293e26-baff6596-d29ee1_0] Write session: try to update token
2025-10-10T14:01:09.225202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2be5318-a7293e26-baff6596-d29ee1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:09.363884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:09.363926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:09.363964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.364067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:09.364101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.364113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.364125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.364236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:09.382260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:09.383687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:09.384869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:09.399552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:09.401491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:09.430383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId: src_id|a2be5318-a7293e26-baff6596-d29ee1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:09.464900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:09.465074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:09.465085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:09.465094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:09.465102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:09.465110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:09.465165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.465190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.465214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.465235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592852523161259:3826]
2025-10-10T14:01:09.465374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.465388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.465401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.465446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:09.465469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.465483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:09.466647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:09.466858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:09.466917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:09.466997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:09.467060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:09.500593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:09.614055Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:09.629330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:09.629384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:09.632360Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:09.632847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592854101077368:3447]
2025-10-10T14:01:09.632927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:09.633035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:09.633044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:09.721266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 166 reason: error at write: Disconnected sessionId: src_id|a2be5318-a7293e26-baff6596-d29ee1_0
2025-10-10T14:01:09.721645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 166 sessionId: src_id|a2be5318-a7293e26-baff6596-d29ee1_0 is DEAD
2025-10-10T14:01:09.725059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2be5318-a7293e26-baff6596-d29ee1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:09.725092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2be5318-a7293e26-baff6596-d29ee1_0] Write session will restart in 0.009129s
2025-10-10T14:01:09.725208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2be5318-a7293e26-baff6596-d29ee1_0] Write session: Do CDS request
2025-10-10T14:01:09.725238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2be5318-a7293e26-baff6596-d29ee1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:09.747711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2be5318-a7293e26-baff6596-d29ee1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:09.768472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592854101077549:3447]
2025-10-10T14:01:09.768601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:09.768611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 167
2025-10-10T14:01:09.770892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:09.771023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:09.771039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:09.771049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:09.772509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 167 sessionId:  describe result for acl check
2025-10-10T14:01:09.772633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:09.772643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:09.772652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:09.772668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592854101077561:4101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:09.775129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592854101077561:4101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:09.808774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592854101077561:4101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:09.826754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592854101077561:4101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:09.826794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592854101077561:4101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:09.826811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592854101077561:4101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:09.826844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:09.853912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:09.864656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:09.865595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:09.865625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:09.865671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:09.865948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:09.866139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592852523161517:3835]
2025-10-10T14:01:09.868933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:09.870896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:09.871121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:09.872368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:09.872695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:09.872704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:09.872710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:09.872736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:09.872743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:09.872750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:09.872756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:09.872763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:09.872768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.872775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.872785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.872791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.872834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:09.872956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:09.873012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:09.873057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:09.873103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:09.873162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:09.873206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:09.873252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:09.873299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.873346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.873395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.873439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.873484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:09.873545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:09.873601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:09.873651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:09.873698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:09.873748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:09.873790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:09.873839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:09.873886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:09.873959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:09.874008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:09.874060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:09.874112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:09.874166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:09.874208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:09.874261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:09.874306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.874354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.874396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.874452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.874495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.874542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.874582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.874631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.875042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:09.912612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:09.928970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:09.930391Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:09.930430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:09.930453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:09.930478Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 166 [2:7559592852523161517:3835]
2025-10-10T14:01:09.930542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:09.930607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:09.930622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.930635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.930648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.930700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:09.930724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:09.930748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:09.956067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.956258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.956270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.956280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.956289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:09.956578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:09.956602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:09.956728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:09.956880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:09.957071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:09.957184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:09.957270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:09.957284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:09.957296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:09.957305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:09.957340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:09.957417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:09.957583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:09.957610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:09.957729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:09.957746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:09.957753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:09.957763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:09.957795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592854101077702:4101], now have 1 active actors on pipe
2025-10-10T14:01:09.957806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:09.957818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:09.957823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592854101077549:3447], now have 1 active actors on pipe
2025-10-10T14:01:09.957844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:09.957881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592854101077485:2442], now have 1 active actors on pipe
2025-10-10T14:01:09.959185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 166
2025-10-10T14:01:09.959265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 166, pipe: [1:7559592854101077549:3447]
2025-10-10T14:01:09.959343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 166
2025-10-10T14:01:09.959515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:09.959549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:09.959642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:09.959674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.959692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.959701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:09.959736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.959778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:09.959830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:09.960970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:09.961003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:09.961073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:09.963337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2be5318-a7293e26-baff6596-d29ee1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:09.961522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 167 partition: 0 MaxSeqNo: 36 sessionId: src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0
2025-10-10T14:01:10.010988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0] Write session: try to update token
2025-10-10T14:01:10.011045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:10.043322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.043361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.043383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.043437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:10.043450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:10.043486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:10.043602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:10.045402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:10.046718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:10.047474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:10.082679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:10.083901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:10.089656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:10.090114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:10.231291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId: src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:10.238384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.238423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.238433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.238487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:10.238500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:10.238513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:10.238524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:10.238533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:10.238574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:10.238598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:10.238620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:10.238640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592852523161511:3835]
2025-10-10T14:01:10.238777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:10.238809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:10.238819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:10.241275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:10.241321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:10.241348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:10.241372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:10.242784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:10.286235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:10.454740Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:10.456464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:10.456512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:10.457709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:10.461282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:10.461311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:10.462172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592854101077549:3447]
2025-10-10T14:01:10.462348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
E1010 14:01:10.484480400  150464 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:01:10.486700Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:01:10.532396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 167 reason: error at write: Disconnected sessionId: src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0
2025-10-10T14:01:10.532760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 167 sessionId: src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0 is DEAD
2025-10-10T14:01:10.549336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:10.549383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0] Write session will restart in 0.009042s
2025-10-10T14:01:10.549474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0] Write session: Do CDS request
2025-10-10T14:01:10.549503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:10.562162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592858396045072:3447]
2025-10-10T14:01:10.566664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:10.569206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:10.569239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 168
2025-10-10T14:01:10.573387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:10.573529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:10.573546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:10.573557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:10.575113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 168 sessionId:  describe result for acl check
2025-10-10T14:01:10.575242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:10.575254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:10.575264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:10.575283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592858396045083:4111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:10.580752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592858396045083:4111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:10.631642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592858396045083:4111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:10.666312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592858396045083:4111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:10.666359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592858396045083:4111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:10.666375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592858396045083:4111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:10.666405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:10.706814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:10.711787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:10.712736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:10.712753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:10.712798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:10.713043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:10.713238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592856818129070:3847]
2025-10-10T14:01:10.715263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:10.716431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:10.716623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:10.717819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:10.718107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:10.718113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:10.718118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:10.718125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:10.718130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:10.718135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:10.718141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:10.718148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:10.718154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:10.718160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:10.718166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:10.718172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:10.718213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:10.718304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:10.718345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:10.718383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:10.718420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:10.718455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:10.718490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:10.718524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:10.718561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:10.718599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:10.718635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:10.718687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:10.718724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:10.718780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:10.718826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:10.718872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:10.718912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:10.718955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:10.718995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:10.719040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:10.719079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:10.719122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:10.719161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:10.719208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:10.719247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:10.719290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:10.719343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:10.719388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:10.719432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:10.719484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:10.719523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:10.719568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:10.719610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:10.719652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:10.719700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:10.719746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:10.720141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:10.755892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:10.776582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:10.777013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:10.777036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:10.777055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:10.777077Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 167 [2:7559592856818129070:3847]
2025-10-10T14:01:10.777138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:10.777196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:10.777208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.777220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.777228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.777271Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:10.777291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:10.777312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:10.779283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:10.779298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:10.779311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:10.779324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:10.779334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:10.779589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:10.779605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:10.779735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:10.779898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:10.780131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:10.780234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:10.780300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592856818129064:3847]
2025-10-10T14:01:10.780313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592856818129064:3847]
2025-10-10T14:01:10.780324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592856818129064:3847]
2025-10-10T14:01:10.780335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592856818129064:3847]
2025-10-10T14:01:10.780379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:10.780456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:10.780511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:10.780526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:10.780540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:10.780551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:10.780617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:10.780633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:10.780765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592856818129064:3847]
2025-10-10T14:01:10.780785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:10.780844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:10.780893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592858396045236:4111], now have 1 active actors on pipe
2025-10-10T14:01:10.780914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592858396045057:2442], now have 1 active actors on pipe
2025-10-10T14:01:10.780934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592858396045072:3447], now have 1 active actors on pipe
2025-10-10T14:01:10.782904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 167
2025-10-10T14:01:10.782986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 167, pipe: [1:7559592858396045072:3447]
2025-10-10T14:01:10.783063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 167
2025-10-10T14:01:10.792558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:10.792609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:10.792692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26fd8464-9b69804e-317ea5ff-f6219408_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:10.792726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.792744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.792754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:10.792795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.792853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:10.792913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:10.796247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:10.796302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:10.796393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:10.799111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 168 partition: 0 MaxSeqNo: 36 sessionId: src_id|26fd8464-9b69804e-317ea5ff-f6219408_0
2025-10-10T14:01:10.805411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7d2bbe6-fde6bdd-ccf72387-4bcca9f7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|26fd8464-9b69804e-317ea5ff-f6219408_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:10.834662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26fd8464-9b69804e-317ea5ff-f6219408_0] Write session: try to update token
2025-10-10T14:01:10.834718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26fd8464-9b69804e-317ea5ff-f6219408_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:10.881303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.881341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.881352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.991320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:10.991367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:10.991381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:10.991391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:10.991403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:10.991441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592856818129064:3847]
2025-10-10T14:01:10.991468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592856818129064:3847]
2025-10-10T14:01:10.991494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592856818129064:3847]
2025-10-10T14:01:10.991515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592856818129064:3847]
2025-10-10T14:01:10.991688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.991702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.991713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.991764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:10.991788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:10.991799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:10.997790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:11.001431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:11.001491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:11.001518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:11.001544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:11.049218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId: src_id|26fd8464-9b69804e-317ea5ff-f6219408_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:11.070215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:11.201264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:11.202889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:11.202940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:11.205313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:11.205454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:11.205488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:11.209448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:11.209810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592858396045072:3447]
2025-10-10T14:01:11.240877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 168 reason: error at write: Disconnected sessionId: src_id|26fd8464-9b69804e-317ea5ff-f6219408_0
2025-10-10T14:01:11.242839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26fd8464-9b69804e-317ea5ff-f6219408_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:11.242882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26fd8464-9b69804e-317ea5ff-f6219408_0] Write session will restart in 0.006875s
2025-10-10T14:01:11.242985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26fd8464-9b69804e-317ea5ff-f6219408_0] Write session: Do CDS request
2025-10-10T14:01:11.243014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26fd8464-9b69804e-317ea5ff-f6219408_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:11.245535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 168 sessionId: src_id|26fd8464-9b69804e-317ea5ff-f6219408_0 is DEAD
2025-10-10T14:01:11.255414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26fd8464-9b69804e-317ea5ff-f6219408_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:11.257484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:11.257517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 169
2025-10-10T14:01:11.257923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:11.258035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:11.258051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:11.258062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:11.261478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 169 sessionId:  describe result for acl check
2025-10-10T14:01:11.261599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:11.261612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:11.261622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:11.261638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592862691012658:4120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:11.263417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592862691012658:4120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:11.280575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592862691012658:4120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:11.298541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592862691012658:4120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:11.298585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592862691012658:4120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:11.298601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592862691012658:4120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:11.298635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:11.311105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592862691012797:3447]
2025-10-10T14:01:11.337647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:11.341249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:11.341916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:11.341934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:11.341972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:11.342142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:11.342249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592861113096620:3856]
2025-10-10T14:01:11.343555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:11.347827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:11.348090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:11.349202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:11.349429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:11.349433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:11.349438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:11.349443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:11.349447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:11.349451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:11.349455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:11.349459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:11.349464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:11.349467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:11.349471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:11.349475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:11.349505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:11.349577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:11.349607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:11.349636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:11.349666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:11.349694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:11.349725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:11.349765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:11.349793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:11.349822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:11.349851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:11.349876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:11.349901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:11.349942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:11.349977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:11.350009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:11.350038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:11.350067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:11.350095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:11.350129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:11.350155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:11.350189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:11.350216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:11.350247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:11.350277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:11.350309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:11.350336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:11.350366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:11.350392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:11.350424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:11.350450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:11.350482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:11.350506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:11.350538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:11.350564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:11.350595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:11.350863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:11.375693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:11.388293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:11.388333Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:11.388345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:11.388358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:11.388376Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 168 [2:7559592861113096620:3856]
2025-10-10T14:01:11.388413Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:11.388468Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:11.388482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.388492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.388500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.388536Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:11.388552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:11.388568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:11.407503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:11.407541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:11.407551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:11.407561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:11.407570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:11.407841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:11.407863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:11.407979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:11.408147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:11.408346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:11.408463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:11.408557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592862691012797:3447], now have 1 active actors on pipe
2025-10-10T14:01:11.408583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592862691012768:4120], now have 1 active actors on pipe
2025-10-10T14:01:11.408600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592862691012617:2442], now have 1 active actors on pipe
2025-10-10T14:01:11.408624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.408642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.408279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 168, pipe: [1:7559592862691012797:3447]
2025-10-10T14:01:11.408663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.408674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.408382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 168
2025-10-10T14:01:11.408709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:11.408446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 168
2025-10-10T14:01:11.408783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:11.408863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:11.408886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:11.408897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:11.408908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:11.408938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:11.408953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:11.409101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:11.410562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:11.410670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.410716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:11.410846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:11.410891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.410910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.410920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:11.410963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.411010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:11.411158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:11.411287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:11.413828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26fd8464-9b69804e-317ea5ff-f6219408_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:11.412942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 169 partition: 0 MaxSeqNo: 36 sessionId: src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0
2025-10-10T14:01:11.412495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:11.412530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:11.412601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:11.469308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0] Write session: try to update token
2025-10-10T14:01:11.469368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:11.488402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.488437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.488450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.606249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:11.606316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:11.606344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:11.606369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:11.606395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:11.606454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.606505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.606546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.606586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.606870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.606895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.606919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.607732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:11.607756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:11.607774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:11.607790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:11.700533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId: src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:11.736907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:11.759078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:11.759140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:11.759151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:11.760305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:11.933817Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:11.935840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:11.935879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:11.935927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592861113096614:3856]
2025-10-10T14:01:11.936085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:11.936129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:11.936301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:11.939396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:11.937759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592862691012797:3447]
2025-10-10T14:01:11.937860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:11.937873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:11.938380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:11.984842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:11.984910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0] Write session will restart in 0.008064s
2025-10-10T14:01:11.985163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0] Write session: Do CDS request
2025-10-10T14:01:11.983504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 169 reason: error at write: Disconnected sessionId: src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0
2025-10-10T14:01:11.985220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:11.983866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 169 sessionId: src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0 is DEAD
2025-10-10T14:01:12.012976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:12.013405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:12.013439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 170
2025-10-10T14:01:12.013865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:12.013996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:12.014013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:12.014024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:12.015612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 170 sessionId:  describe result for acl check
2025-10-10T14:01:12.015756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:12.015768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:12.015779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:12.015797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592866985980214:4135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:12.018918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592866985980214:4135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:12.033573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592866985980214:4135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:12.036958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592866985980251:3447]
2025-10-10T14:01:12.056260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592866985980214:4135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:12.056308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592866985980214:4135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:12.056328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592866985980214:4135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:12.056363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:12.123064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:12.133234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:12.134080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:12.134096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:12.134139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:12.134380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:12.134577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592865408064152:3860]
2025-10-10T14:01:12.136610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:12.138231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:12.138468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:12.139815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:12.140124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:12.140140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:12.140145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:12.140150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:12.140157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:12.140165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:12.140173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:12.140183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:12.140190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.140200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.140207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.140213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.140267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:12.140380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:12.140420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:12.140458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:12.140494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:12.140540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:12.140595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:12.140648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:12.140694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.140738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.140780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.140901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.140941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:12.140995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:12.141047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:12.141108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:12.141170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:12.141219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:12.141272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:12.141339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:12.141392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:12.141440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:12.141481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:12.141545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:12.141610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:12.141679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:12.141739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:12.141804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:12.141864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.141929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.141993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.142063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.142120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.142187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.142248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.142313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.142867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:12.177005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:12.192868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:12.192929Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:12.192946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:12.192966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:12.192988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 169 [2:7559592865408064152:3860]
2025-10-10T14:01:12.193041Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:12.193100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:12.193135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.193148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.193161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.193214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:12.193237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:12.193258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:12.194729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.194762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.194774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.194787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.194800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:12.195070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:12.195086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.195226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.195408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.195636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.195751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:12.195825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.195840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.195854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.195864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.195913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:12.195996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:12.196184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:12.196201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:12.196333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.196352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:12.197249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:12.197263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:12.197275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:12.197286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:12.197313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:12.199287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 169
2025-10-10T14:01:12.199390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 169
2025-10-10T14:01:12.199470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 169, pipe: [1:7559592866985980251:3447]
2025-10-10T14:01:12.198201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592866985980251:3447], now have 1 active actors on pipe
2025-10-10T14:01:12.198241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592866985980294:4135], now have 1 active actors on pipe
2025-10-10T14:01:12.198261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592862691012895:2442], now have 1 active actors on pipe
2025-10-10T14:01:12.202263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:12.202311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:12.202413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0333b6-718156d4-11fec468-b7124dd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:12.202450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.202469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.202479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:12.202520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.202571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:12.203859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:12.205146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:12.205172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:12.205239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:12.205547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 170 partition: 0 MaxSeqNo: 36 sessionId: src_id|d0333b6-718156d4-11fec468-b7124dd2_0
2025-10-10T14:01:12.209545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54da5b3-7d485cb2-74f4f9a5-87453720_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d0333b6-718156d4-11fec468-b7124dd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:12.271071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:12.271121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:12.271157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.271278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:12.271426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:12.274571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0333b6-718156d4-11fec468-b7124dd2_0] Write session: try to update token
2025-10-10T14:01:12.274627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0333b6-718156d4-11fec468-b7124dd2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:12.285756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:12.295796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:12.299085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:12.300410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:12.306001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:12.306479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.306492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.306504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.306562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:12.363871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:12.365440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:12.365507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:12.365534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:12.365550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:12.365657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.365725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.365804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.365862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592865408064146:3860]
2025-10-10T14:01:12.366156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:12.366215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.366231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:12.369300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:12.369360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:12.369386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:12.369413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:12.377904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:12.420037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId: src_id|d0333b6-718156d4-11fec468-b7124dd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:12.449024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:12.533524Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:12.536787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:12.536811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:12.538148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592866985980251:3447]
2025-10-10T14:01:12.538268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:12.538281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:12.540481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:12.540142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:12.566203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 170 reason: error at write: Disconnected sessionId: src_id|d0333b6-718156d4-11fec468-b7124dd2_0
2025-10-10T14:01:12.566534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 170 sessionId: src_id|d0333b6-718156d4-11fec468-b7124dd2_0 is DEAD
2025-10-10T14:01:12.567258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0333b6-718156d4-11fec468-b7124dd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:12.567290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0333b6-718156d4-11fec468-b7124dd2_0] Write session will restart in 0.005470s
2025-10-10T14:01:12.567382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0333b6-718156d4-11fec468-b7124dd2_0] Write session: Do CDS request
2025-10-10T14:01:12.567413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0333b6-718156d4-11fec468-b7124dd2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:12.591085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:12.591120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 171
2025-10-10T14:01:12.594316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0333b6-718156d4-11fec468-b7124dd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:12.595912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:12.596208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:12.596236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:12.596257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:12.601612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 171 sessionId:  describe result for acl check
2025-10-10T14:01:12.601761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:12.601772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:12.601782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:12.601799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592866985980434:4140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:12.605751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592866985980434:4140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:12.615977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592866985980434:4140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:12.624510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592866985980434:4140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:12.624551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592866985980434:4140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:12.624569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592866985980434:4140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:12.624600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:12.637464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592866985980482:3447]
2025-10-10T14:01:12.731312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:12.736585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:12.737524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:12.737559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:12.737604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:12.737885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:12.738070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592865408064418:3870]
2025-10-10T14:01:12.740038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:12.741345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:12.741586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:12.742856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:12.743256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:12.743265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:12.743271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:12.743278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:12.743284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:12.743290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:12.743297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:12.743303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:12.743346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.743354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.743361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.743368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.743411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:12.743542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:12.743587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:12.743631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:12.743677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:12.743721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:12.743766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:12.743806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:12.743849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.743897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.743938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.743980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.744025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:12.744089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:12.744164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:12.744220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:12.744268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:12.744321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:12.744368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:12.744418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:12.744468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:12.744520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:12.744563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:12.744614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:12.744663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:12.744717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:12.744759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:12.744811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:12.744857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.744911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.744956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.745008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.745056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.745106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.745170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.745221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.745655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:12.780592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:12.812430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:12.812494Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:12.812510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:12.812529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:12.812555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 170 [2:7559592865408064418:3870]
2025-10-10T14:01:12.812610Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:12.812677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:12.812692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.812704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.812715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.812759Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:12.812782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:12.812803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:12.814074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.814089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.814101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.814114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.814125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:12.814363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:12.814373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:12.814476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:12.814621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:12.814824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:12.814894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:12.814956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:12.814964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:12.814973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:12.814982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:12.815012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:12.815077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:12.815241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:12.815259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:12.815356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:12.815369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:12.816966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:12.816978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:12.816989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:12.816999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:12.817023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:12.817049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592866985980420:2442], now have 1 active actors on pipe
2025-10-10T14:01:12.817340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592866985980464:4140], now have 1 active actors on pipe
2025-10-10T14:01:12.817593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592866985980482:3447], now have 1 active actors on pipe
2025-10-10T14:01:12.819134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 170
2025-10-10T14:01:12.819273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 170
2025-10-10T14:01:12.819348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 170, pipe: [1:7559592866985980482:3447]
2025-10-10T14:01:12.824381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:12.824435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:12.824529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:12.824566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.824586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.824597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:12.824639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.824685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:12.824729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:12.833847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 171 partition: 0 MaxSeqNo: 36 sessionId: src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0
2025-10-10T14:01:12.833177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:12.833245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:12.833349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:12.835228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0333b6-718156d4-11fec468-b7124dd2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:12.887094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0] Write session: try to update token
2025-10-10T14:01:12.887156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:12.927526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.927569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.927583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.927643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:12.927659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:12.927701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:12.927818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:12.929628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:12.929975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:12.930885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:12.939171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:12.940442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:12.942159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:12.942457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:13.063671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId: src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:13.079532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.079573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.079585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.079644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:13.079657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:13.079670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:13.079680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:13.079689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:13.079732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:13.079768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:13.079791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:13.079813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592865408064412:3870]
2025-10-10T14:01:13.079974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:13.080000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:13.080010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:13.080404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:13.080430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:13.080453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:13.080481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:13.088560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:13.133849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:13.348751Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:13.358801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:13.358857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:13.361812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:13.366410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592866985980482:3447]
2025-10-10T14:01:13.366500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:13.409025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:13.409095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0] Write session will restart in 0.007115s
2025-10-10T14:01:13.408165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:13.409231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0] Write session: Do CDS request
2025-10-10T14:01:13.408313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 171 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0
2025-10-10T14:01:13.409261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:13.408634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 171 sessionId: src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0 is DEAD
2025-10-10T14:01:13.431951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:13.451927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:13.451963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 172
2025-10-10T14:01:13.456703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:13.456850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:13.456866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:13.456874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:13.458432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 172 sessionId:  describe result for acl check
2025-10-10T14:01:13.458541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:13.458552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:13.458560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:13.458577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592871280948009:4153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:13.461044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592871280948009:4153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:13.465647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592871280948021:3447]
2025-10-10T14:01:13.475118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592871280948009:4153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:13.512174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592871280948009:4153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:13.512222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592871280948009:4153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:13.512239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592871280948009:4153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:13.512270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:13.621576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:13.630021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:13.630960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:13.630976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:13.631021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:13.631278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:13.631457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592869703031954:3879]
2025-10-10T14:01:13.633600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:13.638491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:13.638780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:13.640073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:13.640412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:13.640422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:13.640428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:13.640434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:13.640441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:13.640448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:13.640454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:13.640460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:13.640466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:13.640471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:13.640478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:13.640484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:13.640528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:13.640630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:13.640675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:13.640717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:13.640760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:13.640804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:13.640850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:13.640893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:13.640935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:13.640979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:13.641023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:13.641066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:13.641104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:13.641188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:13.641246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:13.641296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:13.641344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:13.641396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:13.641439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:13.641492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:13.641539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:13.641588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:13.641631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:13.641681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:13.641723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:13.641773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:13.641813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:13.641861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:13.641906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:13.641960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:13.641999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:13.642044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:13.642082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:13.642130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:13.642170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:13.642218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:13.642623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:13.768159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:13.798802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:13.798862Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:13.798877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:13.798894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:13.798917Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 171 [2:7559592869703031954:3879]
2025-10-10T14:01:13.798969Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:13.799027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:13.799040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.799051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.799061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.799106Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:13.799129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:13.799152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:13.807692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:13.807732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:13.807745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:13.807758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:13.807769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:13.808067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:13.808084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:13.808236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:13.808405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:13.808614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:13.808717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:13.808792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592869703031949:3879]
2025-10-10T14:01:13.808806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592869703031949:3879]
2025-10-10T14:01:13.808818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592869703031949:3879]
2025-10-10T14:01:13.808829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592869703031949:3879]
2025-10-10T14:01:13.808879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:13.808957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:13.809110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:13.809145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:13.809275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592869703031949:3879]
2025-10-10T14:01:13.809294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:13.810118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:13.810146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:13.810156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:13.810181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:13.810204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:13.813489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592871280948080:4153], now have 1 active actors on pipe
2025-10-10T14:01:13.813541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592871280948021:3447], now have 1 active actors on pipe
2025-10-10T14:01:13.813560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592871280947991:2442], now have 1 active actors on pipe
2025-10-10T14:01:13.815825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 171
2025-10-10T14:01:13.815901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 171, pipe: [1:7559592871280948021:3447]
2025-10-10T14:01:13.815967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 171
2025-10-10T14:01:13.818123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:13.818167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:13.818258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:13.818291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.818310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.818318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:13.818354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.818399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:13.818446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:13.824955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:13.825008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:13.825086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:13.833481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 172 partition: 0 MaxSeqNo: 36 sessionId: src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0
2025-10-10T14:01:13.837413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f97a3-761e80fb-7fb7e666-c25aba52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:13.940037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.940084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.940095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.940170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:13.940184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:13.940197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:13.940208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:13.940218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:13.940256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592869703031949:3879]
2025-10-10T14:01:13.940282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592869703031949:3879]
2025-10-10T14:01:13.940307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592869703031949:3879]
2025-10-10T14:01:13.940328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592869703031949:3879]
2025-10-10T14:01:13.940475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:13.940501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:13.940501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:13.940514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:13.940557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:13.940595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:13.940630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:13.941629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:13.951308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0] Write session: try to update token
2025-10-10T14:01:13.951371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:14.073228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId: src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:14.110230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:14.121034Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:14.140735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:14.140792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:14.144120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:14.146269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:14.147670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592871280948021:3447]
2025-10-10T14:01:14.147778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:14.159358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 172 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0
2025-10-10T14:01:14.159709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 172 sessionId: src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0 is DEAD
2025-10-10T14:01:14.161407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:14.161469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0] Write session will restart in 0.006490s
2025-10-10T14:01:14.161622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0] Write session: Do CDS request
2025-10-10T14:01:14.161683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:14.185165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:14.185210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 173
2025-10-10T14:01:14.187488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:14.195088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:14.195250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:14.195266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:14.195275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:14.200688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 173 sessionId:  describe result for acl check
2025-10-10T14:01:14.200834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:14.200845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:14.200854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:14.200872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592875575915568:4163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:14.203438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592875575915568:4163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:14.213449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592875575915568:4163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:14.221962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592875575915568:4163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:14.222003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592875575915568:4163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:14.222020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592875575915568:4163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:14.222048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:14.253228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592875575915621:3447]
2025-10-10T14:01:14.368507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:14.372155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:14.372779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:14.372807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:14.372846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:14.373037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:14.373225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592873997999530:3889]
2025-10-10T14:01:14.380479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:14.385477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:14.385798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:14.387253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:14.387613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:14.387635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:14.387642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:14.387649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:14.387656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:14.387663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:14.387669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:14.387679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:14.387686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:14.387694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:14.387702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:14.387709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:14.387763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:14.387889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:14.387946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:14.388012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:14.388062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:14.388109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:14.388174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:14.388225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:14.388279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:14.388329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:14.388378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:14.388428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:14.388474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:14.388547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:14.388612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:14.388671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:14.388727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:14.388783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:14.388834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:14.388891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:14.388944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:14.389001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:14.389052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:14.389615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:14.389691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:14.389760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:14.389814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:14.389881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:14.389936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:14.389996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:14.390047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:14.390106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:14.390159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:14.390216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:14.390270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:14.390328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:14.390859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:14.428930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:14.452122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:14.452210Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:14.452228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:14.452248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:14.452276Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 172 [2:7559592873997999530:3889]
2025-10-10T14:01:14.452335Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:14.452405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:14.452420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.452433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.452446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.452496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:14.452522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:14.452546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:14.456163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:14.456204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:14.456219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:14.456232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:14.456244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:14.456539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:14.456559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:14.456707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:14.456885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:14.457106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:14.457280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:14.457353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.457368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.457380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.457392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.457423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:14.457496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:14.457502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:14.457508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:14.457521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:14.457533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:14.457663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:14.457680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:14.457723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592875575915555:2442], now have 1 active actors on pipe
2025-10-10T14:01:14.457745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592875575915598:4163], now have 1 active actors on pipe
2025-10-10T14:01:14.457763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592875575915621:3447], now have 1 active actors on pipe
2025-10-10T14:01:14.457884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.458519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:14.458893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:14.459053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:14.459077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:14.459214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12316395-7fbbe272-2bdbec90-cd837b82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:14.459249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.459267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.459277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:14.459317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.459361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:14.459423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:14.458112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 172
2025-10-10T14:01:14.458229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 172
2025-10-10T14:01:14.458298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 172, pipe: [1:7559592875575915621:3447]
2025-10-10T14:01:14.467780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:14.467831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:14.467918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:14.468481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 173 partition: 0 MaxSeqNo: 36 sessionId: src_id|12316395-7fbbe272-2bdbec90-cd837b82_0
2025-10-10T14:01:14.469937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0e72563-ce3a57b1-a1f1e38f-713304d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|12316395-7fbbe272-2bdbec90-cd837b82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:14.539912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12316395-7fbbe272-2bdbec90-cd837b82_0] Write session: try to update token
2025-10-10T14:01:14.539980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12316395-7fbbe272-2bdbec90-cd837b82_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:14.553885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.553927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.553941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.710507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.710547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.710560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.710617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:14.710630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:14.710643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:14.710655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:14.710665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:14.710699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.710724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.710747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.710767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.710962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:14.710988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:14.710998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:14.712037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:14.713256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:14.713291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:14.713318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:14.713344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:14.774879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId: src_id|12316395-7fbbe272-2bdbec90-cd837b82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:14.799227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:14.902122Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:14.923748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:14.923809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:14.923881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:14.923894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:14.923934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592873997999524:3889]
2025-10-10T14:01:14.924297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:14.924708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:14.928564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:14.928802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:14.932389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592875575915621:3447]
2025-10-10T14:01:14.937526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12316395-7fbbe272-2bdbec90-cd837b82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:14.937577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12316395-7fbbe272-2bdbec90-cd837b82_0] Write session will restart in 0.005127s
2025-10-10T14:01:14.937690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12316395-7fbbe272-2bdbec90-cd837b82_0] Write session: Do CDS request
2025-10-10T14:01:14.937720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12316395-7fbbe272-2bdbec90-cd837b82_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:14.936813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 173 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12316395-7fbbe272-2bdbec90-cd837b82_0
2025-10-10T14:01:14.939619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 173 sessionId: src_id|12316395-7fbbe272-2bdbec90-cd837b82_0 is DEAD
2025-10-10T14:01:14.952598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12316395-7fbbe272-2bdbec90-cd837b82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:14.953807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:14.953840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 174
2025-10-10T14:01:14.954259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:14.954395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:14.954410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:14.954421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:14.955810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 174 sessionId:  describe result for acl check
2025-10-10T14:01:14.955941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:14.955959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:14.955971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:14.955988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592875575915814:4168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:14.958511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592875575915814:4168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:14.979087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592875575915814:4168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:14.992985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592875575915814:4168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:14.993028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592875575915814:4168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:14.993044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592875575915814:4168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:14.993076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:15.033249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592879870883261:3447]
2025-10-10T14:01:15.067020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:15.076804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:15.077714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:15.077733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:15.077781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:15.078049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:15.078241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592878292967054:3898]
2025-10-10T14:01:15.080411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:15.082167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:15.082409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:15.083532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:15.083789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:15.083794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:15.083798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:15.083803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:15.083808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:15.083813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:15.083817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:15.083822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:15.083826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.083831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.083836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.083840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.083873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:15.083972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:15.084008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:15.084042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:15.084077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:15.084114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:15.084151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:15.084210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:15.084245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.084279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.084313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.084345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.084372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:15.084428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:15.084474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:15.084511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:15.084544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:15.084580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:15.084610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:15.084648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:15.084680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:15.084716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:15.084747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:15.084780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:15.084810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:15.084848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:15.084878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:15.084917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:15.084960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.085002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.085037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.085076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.085107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.085179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.085221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.085272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.085710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:15.124867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:15.223152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:15.223214Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:15.223232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:15.223250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:15.223274Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 173 [2:7559592878292967054:3898]
2025-10-10T14:01:15.223328Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:15.223387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:15.223404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.223416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.223428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.223477Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:15.223500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:15.223524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:15.232456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.232498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.232513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.232526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.232537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:15.232816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:15.232839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.232967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.233155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.233395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.233264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 173
2025-10-10T14:01:15.233354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 173
2025-10-10T14:01:15.233420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 173, pipe: [1:7559592879870883261:3447]
2025-10-10T14:01:15.233513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:15.233626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592875575915876:4168], now have 1 active actors on pipe
2025-10-10T14:01:15.233653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592875575915802:2442], now have 1 active actors on pipe
2025-10-10T14:01:15.233673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592879870883261:3447], now have 1 active actors on pipe
2025-10-10T14:01:15.233700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.233715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.233727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.233742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.233784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:15.233867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:15.234050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:15.234065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:15.234143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:15.234176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:15.234313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.234335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:15.234412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:15.234444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.234462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.234475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:15.234513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.234561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:15.234691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:15.235353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:15.235366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:15.235376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:15.235386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:15.235409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:15.236853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:15.236902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:15.236981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:15.239112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 174 partition: 0 MaxSeqNo: 36 sessionId: src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0
2025-10-10T14:01:15.240013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12316395-7fbbe272-2bdbec90-cd837b82_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:15.281013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0] Write session: try to update token
2025-10-10T14:01:15.281069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:15.364527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.365102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.365142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.365212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:15.365227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:15.365245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:15.365273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:15.365292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:15.365352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.365403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.365451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.365491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.365813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:15.365858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.365879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:15.366482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:15.366538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:15.366573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:15.366607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:15.378386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:15.471987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId: src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:15.504865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:15.551835Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:15.576206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:15.576262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:15.576317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:15.576330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:15.576369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592878292967048:3898]
2025-10-10T14:01:15.577092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:15.578729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:15.581281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:15.581426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592879870883261:3447]
2025-10-10T14:01:15.581532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:15.581550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:15.593328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:15.593367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0] Write session will restart in 0.007316s
2025-10-10T14:01:15.593520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0] Write session: Do CDS request
2025-10-10T14:01:15.593563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:15.592035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 174 reason: error at write: Disconnected sessionId: src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0
2025-10-10T14:01:15.592348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 174 sessionId: src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0 is DEAD
2025-10-10T14:01:15.618603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:15.618687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:15.618724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 175
2025-10-10T14:01:15.619233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:15.619355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:15.619370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:15.619381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:15.620626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 175 sessionId:  describe result for acl check
2025-10-10T14:01:15.620744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:15.620754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:15.620763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:15.620780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592879870883370:4180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:15.623342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592879870883370:4180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:15.643403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592879870883370:4180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:15.654321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592879870883370:4180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:15.654365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592879870883370:4180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:15.654382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592879870883370:4180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:15.654414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:15.682117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592879870883495:3447]
2025-10-10T14:01:15.729483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:15.734348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:15.735313Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:15.735329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:15.735378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:15.735671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:15.735888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592878292967317:3908]
2025-10-10T14:01:15.738151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:15.739293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:15.739516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:15.740883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:15.741271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:15.741290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:15.741295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:15.741301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:15.741306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:15.741313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:15.741319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:15.741325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:15.741333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.741339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.741345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.741351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.741398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:15.741514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:15.741560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:15.741610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:15.741658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:15.741705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:15.741749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:15.741793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:15.741835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.741879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.741922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.741963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.742003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:15.742067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:15.742124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:15.742173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:15.742220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:15.742272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:15.742319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:15.742372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:15.742433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:15.742483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:15.742528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:15.742582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:15.742633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:15.742683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:15.742725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:15.742778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:15.742826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.742877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.742919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.742971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.743015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.743063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.743109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.743158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.743598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:15.792735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:15.831754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:15.831808Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:15.831824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:15.831842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:15.831866Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 174 [2:7559592878292967317:3908]
2025-10-10T14:01:15.831920Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:15.831977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:15.831993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.832005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.832015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.832063Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:15.832084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:15.832105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:15.833853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.833870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.833884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.833899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.837295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 174, pipe: [1:7559592879870883495:3447]
2025-10-10T14:01:15.833910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:15.837408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 174
2025-10-10T14:01:15.834178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:15.837505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 174
2025-10-10T14:01:15.834194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:15.834338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:15.834516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:15.834743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:15.834854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:15.834928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:15.834943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:15.834956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:15.834969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:15.835012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:15.835088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:15.835258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:15.835274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:15.835399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:15.835415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:15.835791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:15.835804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:15.835814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:15.835825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:15.835847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:15.846333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592879870883495:3447], now have 1 active actors on pipe
2025-10-10T14:01:15.846390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592879870883426:4180], now have 1 active actors on pipe
2025-10-10T14:01:15.846418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592879870883357:2442], now have 1 active actors on pipe
2025-10-10T14:01:15.846475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:15.846500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:15.846596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:15.846632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.846652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.846662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:15.846701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.846750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:15.846801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:15.848044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:15.848081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:15.848148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:15.848599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 175 partition: 0 MaxSeqNo: 36 sessionId: src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0
2025-10-10T14:01:15.852044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab3a8a4-ff35408a-1fd90a33-59afd667_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:15.885380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0] Write session: try to update token
2025-10-10T14:01:15.885440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:15.942774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:15.942817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:15.942858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:15.942982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.942995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.943007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.943073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:15.943340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:15.945091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:15.957173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:15.962318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:15.965590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:15.975690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:15.976767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:16.004224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:16.004269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:16.004282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:16.004291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:16.004301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:16.004338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:16.004361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:16.004380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:16.004400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592878292967311:3908]
2025-10-10T14:01:16.004544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:16.004569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:16.004581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:16.006537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:16.009057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:16.009108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:16.009157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:16.009186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:16.081246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId: src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:16.102603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:16.184043Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:16.186140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:16.186190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:16.186914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:16.187178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592879870883495:3447]
2025-10-10T14:01:16.187300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:16.187313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:16.190658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:16.196079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 175 reason: error at write: Disconnected sessionId: src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0
2025-10-10T14:01:16.196701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 175 sessionId: src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0 is DEAD
2025-10-10T14:01:16.197436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:16.197484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0] Write session will restart in 0.006225s
2025-10-10T14:01:16.197629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0] Write session: Do CDS request
2025-10-10T14:01:16.197674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:16.210472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:16.210513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 176
2025-10-10T14:01:16.210887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:16.211700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:16.211823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:16.211849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:16.211861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:16.213097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 176 sessionId:  describe result for acl check
2025-10-10T14:01:16.213239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:16.213251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:16.213259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:16.213277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592884165850940:4192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:16.217270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592884165850940:4192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:16.225829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592884165850940:4192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:16.257100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592884165850940:4192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:16.257165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592884165850940:4192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:16.257183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592884165850940:4192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:16.257218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:16.287439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592884165851057:3447]
2025-10-10T14:01:16.319602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:16.324111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:16.325089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:16.325110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:16.325174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:16.325464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:16.325683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592882587934875:3917]
2025-10-10T14:01:16.327820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:16.328992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:16.329276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:16.330518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:16.330852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:16.330861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:16.330868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:16.330874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:16.330881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:16.330887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:16.330894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:16.330900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:16.330906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:16.330914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:16.330921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:16.330927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:16.330975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:16.331080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:16.331131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:16.331178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:16.331222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:16.331292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:16.331338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:16.331383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:16.331425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:16.331472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:16.331518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:16.331566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:16.331613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:16.331675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:16.331731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:16.331779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:16.331825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:16.331876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:16.331920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:16.331970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:16.332019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:16.332084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:16.332127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:16.332197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:16.332245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:16.332298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:16.332343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:16.332399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:16.332449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:16.332499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:16.332544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:16.332601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:16.332648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:16.332698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:16.332740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:16.332791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:16.334502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:16.363955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:16.377484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:16.377550Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:16.377568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:16.377588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:16.377616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 175 [2:7559592882587934875:3917]
2025-10-10T14:01:16.377674Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:16.377743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:16.377757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.377769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.377780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.377831Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:16.377854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:16.377878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:16.379410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:16.379450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:16.379465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:16.379478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:16.379490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:16.379772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:16.379797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:16.379936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:16.380118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:16.380353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:16.380469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:16.380557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.380576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.380587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.380598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.380642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:16.380717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:16.380888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:16.380914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:16.381049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.381077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:16.381396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:16.381422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:16.381433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:16.381446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:16.381486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:16.381842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592884165850991:4192], now have 1 active actors on pipe
2025-10-10T14:01:16.381878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592884165851057:3447], now have 1 active actors on pipe
2025-10-10T14:01:16.381898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592884165850928:2442], now have 1 active actors on pipe
2025-10-10T14:01:16.382101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 175
2025-10-10T14:01:16.382113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 175, pipe: [1:7559592884165851057:3447]
2025-10-10T14:01:16.382215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 175
2025-10-10T14:01:16.382974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:16.383012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:16.383100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:16.383140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.383163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.383175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:16.383213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.383274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:16.383331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:16.390301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:16.390357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:16.390451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:16.390855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 176 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0
2025-10-10T14:01:16.393689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8441a21b-23e6d7b6-96d334d5-e584bafd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:16.439445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0] Write session: try to update token
2025-10-10T14:01:16.439507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:16.616156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.616222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.616235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.616303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:16.616326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:16.616344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:16.616361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:16.616375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:16.616426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.616464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.616490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.616509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.616723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:16.616748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:16.616759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:16.617252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:16.617284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:16.617308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:16.617342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:16.622493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:16.626204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId: src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:16.647925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:16.793666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:16.851031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:16.851089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:16.851160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:16.851174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:16.851219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592882587934870:3917]
2025-10-10T14:01:16.851527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:16.854221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:16.852996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592884165851057:3447]
2025-10-10T14:01:16.853082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:16.853216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:16.853228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:16.870993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 176 reason: error at write: Disconnected sessionId: src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0
2025-10-10T14:01:16.871397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 176 sessionId: src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0 is DEAD
2025-10-10T14:01:16.871890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:16.871946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0] Write session will restart in 0.008565s
2025-10-10T14:01:16.872115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0] Write session: Do CDS request
2025-10-10T14:01:16.872178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:16.910596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:16.910629Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 177
2025-10-10T14:01:16.914088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:16.921590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:16.921785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:16.921804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:16.921816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:16.923704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 177 sessionId:  describe result for acl check
2025-10-10T14:01:16.923830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:16.923843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:16.923852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:16.923869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592884165851199:4203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:16.927756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592884165851199:4203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:16.944414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592884165851199:4203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:16.954009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592884165851231:3447]
2025-10-10T14:01:16.960710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592884165851199:4203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:16.960762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592884165851199:4203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:16.960780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592884165851199:4203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:16.960814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:17.042237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:17.043857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:17.044668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:17.044687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:17.044734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:17.044986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:17.045195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592886882902408:3921]
2025-10-10T14:01:17.047265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:17.048777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:17.049031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:17.050339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:17.050649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:17.050656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:17.050663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:17.050669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:17.050676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:17.050683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:17.050689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:17.050696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:17.050702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.050708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.050715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.050723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.050767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:17.050872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:17.050921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:17.050967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:17.051011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:17.051055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:17.051098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:17.051144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:17.051184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.051232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.051276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.051318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.051361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:17.051453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:17.051513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:17.051571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:17.051621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:17.051674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:17.051718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:17.051779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:17.051829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:17.051881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:17.051924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:17.051974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:17.052021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:17.052073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:17.052116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:17.052166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:17.052230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.052280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.052324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.052375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.052422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.052471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.052514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.052566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.052990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:17.095107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:17.121853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:17.121913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:17.121930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:17.121949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:17.121971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 176 [2:7559592886882902408:3921]
2025-10-10T14:01:17.122028Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:17.122084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:17.122099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.122111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.122124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.122170Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:17.122191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:17.122212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:17.124773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.124924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.124944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.124959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.124971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:17.125279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:17.125298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.125450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.125648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.125894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.126035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:17.126104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.126120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.126134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.126147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.126189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:17.126269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:17.126451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:17.126469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:17.126597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.126617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:17.127496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:17.127526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:17.127538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:17.127548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:17.127571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:17.128424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592884165851231:3447], now have 1 active actors on pipe
2025-10-10T14:01:17.128464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592884165851237:4203], now have 1 active actors on pipe
2025-10-10T14:01:17.128488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592884165851180:2442], now have 1 active actors on pipe
2025-10-10T14:01:17.132067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 176, pipe: [1:7559592884165851231:3447]
2025-10-10T14:01:17.132181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 176
2025-10-10T14:01:17.132297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 176
2025-10-10T14:01:17.134231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:17.134280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:17.134376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6600d2b-740e9d99-efebce79-267d7727_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:17.134411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.134432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.134443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:17.134482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.134529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:17.134578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:17.135871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:17.135933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:17.136008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:17.136402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 177 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6600d2b-740e9d99-efebce79-267d7727_0
2025-10-10T14:01:17.137521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6839d45-e65c1663-a2c041cb-c6ad2569_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6600d2b-740e9d99-efebce79-267d7727_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:17.203044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6600d2b-740e9d99-efebce79-267d7727_0] Write session: try to update token
2025-10-10T14:01:17.203105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6600d2b-740e9d99-efebce79-267d7727_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:17.222835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.222879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.222892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.309537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:17.309578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:17.309588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:17.309597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:17.309606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:17.309631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.309649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.309667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.309683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.309830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:17.309851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.309859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:17.309859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:17.309904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:17.309945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:17.309977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:17.310833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:17.408722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId: src_id|d6600d2b-740e9d99-efebce79-267d7727_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:17.432485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:17.462861Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:17.494840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:17.494893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:17.494931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:17.494942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:17.494970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592886882902403:3921]
2025-10-10T14:01:17.496166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:17.496614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:17.498881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592884165851231:3447]
2025-10-10T14:01:17.499000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:17.501368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:17.516193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 177 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6600d2b-740e9d99-efebce79-267d7727_0
2025-10-10T14:01:17.516556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 177 sessionId: src_id|d6600d2b-740e9d99-efebce79-267d7727_0 is DEAD
2025-10-10T14:01:17.517814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6600d2b-740e9d99-efebce79-267d7727_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:17.517886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6600d2b-740e9d99-efebce79-267d7727_0] Write session will restart in 0.005179s
2025-10-10T14:01:17.518075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6600d2b-740e9d99-efebce79-267d7727_0] Write session: Do CDS request
2025-10-10T14:01:17.518129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6600d2b-740e9d99-efebce79-267d7727_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:17.531321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6600d2b-740e9d99-efebce79-267d7727_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:17.533434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:17.533475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 178
2025-10-10T14:01:17.533834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:17.533948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:17.533965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:17.533976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:17.535624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 178 sessionId:  describe result for acl check
2025-10-10T14:01:17.535753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:17.535772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:17.535781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:17.535805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592888460818759:4212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:17.539444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592888460818759:4212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:17.557702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592888460818759:4212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:17.571656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592888460818759:4212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:17.571705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592888460818759:4212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:17.571721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592888460818759:4212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:17.571750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:17.606440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592888460818805:3447]
2025-10-10T14:01:17.721758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:17.728537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:17.729405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:17.729422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:17.729468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:17.729725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:17.729915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592886882902689:3933]
2025-10-10T14:01:17.732022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:17.743726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:17.743951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:17.744874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:17.745149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:17.745154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:17.745161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:17.745168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:17.745175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:17.745182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:17.745188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:17.745194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:17.745200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.745208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.745214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.745221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.745267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:17.745375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:17.745422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:17.745466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:17.745511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:17.745558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:17.745601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:17.745645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:17.745705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.745752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.745796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.745843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.745888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:17.745961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:17.746021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:17.746079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:17.746133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:17.746187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:17.746239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:17.746291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:17.746336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:17.746387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:17.746431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:17.746484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:17.746529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:17.746578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:17.746620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:17.746668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:17.746718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.746768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.746811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.746862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.746910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.746960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.747000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.747053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.747478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:17.777957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:17.833503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:17.833553Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:17.833571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:17.833592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:17.833617Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 177 [2:7559592886882902689:3933]
2025-10-10T14:01:17.833676Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:17.833739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:17.833756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.833769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.833780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.833833Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:17.833856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:17.833879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:17.835390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.835407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.835421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.835434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.835445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:17.835712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:17.835730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.835872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:17.836059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:17.836298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:17.836410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:17.836490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592886882902684:3933]
2025-10-10T14:01:17.836505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592886882902684:3933]
2025-10-10T14:01:17.836518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592886882902684:3933]
2025-10-10T14:01:17.836531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592886882902684:3933]
2025-10-10T14:01:17.836672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:17.836683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:17.836694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:17.836705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:17.838306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 177
2025-10-10T14:01:17.838435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 177
2025-10-10T14:01:17.838494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 177, pipe: [1:7559592888460818805:3447]
2025-10-10T14:01:17.840150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:17.840291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:17.840492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:17.840510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:17.840563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592888460818749:2442], now have 1 active actors on pipe
2025-10-10T14:01:17.840590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592888460818788:4212], now have 1 active actors on pipe
2025-10-10T14:01:17.840616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592888460818805:3447], now have 1 active actors on pipe
2025-10-10T14:01:17.840685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:17.840705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:17.840849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592886882902684:3933]
2025-10-10T14:01:17.840885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:17.840960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:17.840993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.841012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.841022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:17.841063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.841106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:17.841257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:17.841744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:17.843036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:17.843072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:17.843156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:17.843618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 178 partition: 0 MaxSeqNo: 36 sessionId: src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0
2025-10-10T14:01:17.845448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6600d2b-740e9d99-efebce79-267d7727_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:17.888688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0] Write session: try to update token
2025-10-10T14:01:17.888751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:17.937485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:17.937533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:17.937547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:17.937562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:17.937576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:17.937614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592886882902684:3933]
2025-10-10T14:01:17.937644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592886882902684:3933]
2025-10-10T14:01:17.937670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592886882902684:3933]
2025-10-10T14:01:17.937693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592886882902684:3933]
2025-10-10T14:01:17.937871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.937886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.937898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.937944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:17.937969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:17.937981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:17.939084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:17.941476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:17.941532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:17.941561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:17.941591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:18.032956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId: src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:18.059305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:18.136512Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:18.138399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:18.138432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:18.141513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:18.141653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:18.141666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:18.142828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592888460818805:3447]
2025-10-10T14:01:18.157353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:18.157401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0] Write session will restart in 0.005931s
2025-10-10T14:01:18.157506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0] Write session: Do CDS request
2025-10-10T14:01:18.157538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:18.155168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 178 reason: error at write: Disconnected sessionId: src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0
2025-10-10T14:01:18.155468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 178 sessionId: src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0 is DEAD
2025-10-10T14:01:18.183635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:18.183934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:18.183999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 179
2025-10-10T14:01:18.184596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:18.184808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:18.184845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:18.184861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:18.187744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 179 sessionId:  describe result for acl check
2025-10-10T14:01:18.187874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:18.187886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:18.187897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:18.187915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592892755786312:4218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:18.193598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592892755786312:4218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:18.199117Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:18.214290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592892755786312:4218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:18.233103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592892755786312:4218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:18.236296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592892755786312:4218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:18.236331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592892755786312:4218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:18.236379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:18.240215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592892755786414:3447]
2025-10-10T14:01:18.274256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:18.280270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:18.281160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:18.281179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:18.281218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:18.281481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:18.281677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592891177870219:3940]
2025-10-10T14:01:18.284247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:18.285482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:18.285708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:18.287063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:18.287405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:18.287423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:18.287431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:18.287438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:18.287445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:18.287454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:18.287463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:18.287469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:18.287476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.287482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.287490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.287496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.287547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:18.287662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:18.287715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:18.287767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:18.287819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:18.287872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:18.287933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:18.287991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:18.288041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.288089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.288136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.288187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.288244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:18.288316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:18.288379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:18.288438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:18.288502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:18.288561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:18.288617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:18.288679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:18.288735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:18.288797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:18.288851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:18.288908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:18.288955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:18.289011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:18.289057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:18.289113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:18.289355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.289421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.289472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.289540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.289592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.289655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.289709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.289771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.290270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:18.322828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:18.336210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:18.336279Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:18.336293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:18.336307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:18.336326Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 178 [2:7559592891177870219:3940]
2025-10-10T14:01:18.336369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:18.336414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:18.336426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.336437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.336446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.336482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:18.336500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:18.336519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:18.359582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.359619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.359627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.359636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.359645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:18.359901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:18.359917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.360041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.360192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.360413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.360527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:18.360594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.360607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.360618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.360630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.360668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:18.360746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:18.360925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:18.360940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:18.361061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.361079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:18.361277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:18.361291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:18.361305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:18.361316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:18.361337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:18.362381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 178
2025-10-10T14:01:18.362460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 178, pipe: [1:7559592892755786414:3447]
2025-10-10T14:01:18.362525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 178
2025-10-10T14:01:18.362796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592892755786403:4218], now have 1 active actors on pipe
2025-10-10T14:01:18.362843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592892755786414:3447], now have 1 active actors on pipe
2025-10-10T14:01:18.362864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592892755786296:2442], now have 1 active actors on pipe
2025-10-10T14:01:18.362931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:18.362954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:18.363042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:18.363073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.363090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.363100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:18.363133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.363171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:18.363216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:18.364702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:18.364746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:18.364817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:18.365109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 179 partition: 0 MaxSeqNo: 36 sessionId: src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0
2025-10-10T14:01:18.367190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c790a66b-77db6f5f-5e0f696b-f4e8e1be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:18.431010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0] Write session: try to update token
2025-10-10T14:01:18.431081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:18.478266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.478317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.478332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.478452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:18.478469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:18.478484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:18.478496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:18.478508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:18.478546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.478575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.478617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.481222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.483474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:18.483541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:18.483586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:18.483621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:18.545843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:18.545906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.545918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:18.548801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:18.586257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId: src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:18.614447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:18.708913Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:18.712029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:18.712052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:18.712100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592891177870213:3940]
2025-10-10T14:01:18.712255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:18.712285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:18.712309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:18.713147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:18.713576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:18.713604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:18.754014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592892755786414:3447]
2025-10-10T14:01:18.754093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:18.754211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 179 reason: error at write: Disconnected sessionId: src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0
2025-10-10T14:01:18.754548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 179 sessionId: src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0 is DEAD
2025-10-10T14:01:18.761458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:18.761528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0] Write session will restart in 0.005597s
2025-10-10T14:01:18.761673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0] Write session: Do CDS request
2025-10-10T14:01:18.761722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:18.774268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:18.774957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:18.774999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 180
2025-10-10T14:01:18.775945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:18.776060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:18.776076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:18.776085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:18.778295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 180 sessionId:  describe result for acl check
2025-10-10T14:01:18.778454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:18.778464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:18.778584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:18.778608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592892755786574:4229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:18.781295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592892755786574:4229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:18.799223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592892755786574:4229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:18.819700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592892755786574:4229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:18.819743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592892755786574:4229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:18.819758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592892755786574:4229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:18.819791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:18.835088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:18.836919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:18.837532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:18.837544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:18.837575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:18.837751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:18.837878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592891177870476:3950]
2025-10-10T14:01:18.839174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:18.839964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:18.840092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:18.840974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:18.841210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:18.841214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:18.841218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:18.841223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:18.841227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:18.841231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:18.841235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:18.841239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:18.841244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.841247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.841251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.841255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.841285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:18.841354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:18.841383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:18.841412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:18.841443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:18.841471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:18.841502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:18.841530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:18.841556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.841585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.841614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.841643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.841665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:18.841702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:18.841736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:18.841767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:18.841796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:18.841834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:18.841870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:18.841901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:18.841930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:18.841960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:18.841986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:18.842017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:18.842046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:18.842076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:18.842101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:18.842132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:18.842159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.842188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.842214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.842246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.842273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.842304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.842328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.842358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.842617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:18.851719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592892755786794:3447]
2025-10-10T14:01:18.868484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:18.900453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:18.900512Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:18.900527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:18.900547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:18.900571Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 179 [2:7559592891177870476:3950]
2025-10-10T14:01:18.900623Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:18.900689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:18.900705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.900716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.900727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.900780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:18.900804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:18.900828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:18.903686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.903723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.903735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.903746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.903755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:18.904044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:18.904062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:18.904194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:18.904377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:18.904575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:18.904673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:18.904773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592892755786568:2442], now have 1 active actors on pipe
2025-10-10T14:01:18.904795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592892755786737:4229], now have 1 active actors on pipe
2025-10-10T14:01:18.904812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592892755786794:3447], now have 1 active actors on pipe
2025-10-10T14:01:18.904838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592891177870471:3950]
2025-10-10T14:01:18.904852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592891177870471:3950]
2025-10-10T14:01:18.904863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592891177870471:3950]
2025-10-10T14:01:18.904873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592891177870471:3950]
2025-10-10T14:01:18.904918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:18.904972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:18.904986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:18.904997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:18.905003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:18.905007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:18.905247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 179
2025-10-10T14:01:18.905357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 179
2025-10-10T14:01:18.905555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 179, pipe: [1:7559592892755786794:3447]
2025-10-10T14:01:18.905736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:18.905768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:18.905977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:18.905998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:18.906032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592891177870471:3950]
2025-10-10T14:01:18.906065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:18.906094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:18.906203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:18.906239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.906258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.906269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:18.906318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.906384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:18.906497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:18.908307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:18.908345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:18.908411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:18.908730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 180 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0
2025-10-10T14:01:18.909684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8504a4d4-498776c4-e9b4dad1-f21e1681_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:18.951185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0] Write session: try to update token
2025-10-10T14:01:18.951254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:19.029563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.029619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.029632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.029697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:19.029712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:19.029726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:19.029740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:19.029754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:19.029798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592891177870471:3950]
2025-10-10T14:01:19.029830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592891177870471:3950]
2025-10-10T14:01:19.029859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592891177870471:3950]
2025-10-10T14:01:19.029881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592891177870471:3950]
2025-10-10T14:01:19.030084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:19.030092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:19.030127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.030140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:19.030142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:19.030167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:19.030198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:19.031375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:19.113377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId: src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:19.154103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:19.184577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:19.189266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:19.189339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:19.192444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:19.192592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:19.192603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:19.192135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:19.200740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592892755786794:3447]
2025-10-10T14:01:19.248682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 180 reason: error at write: Disconnected sessionId: src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0
2025-10-10T14:01:19.249094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 180 sessionId: src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0 is DEAD
2025-10-10T14:01:19.253925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:19.253961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0] Write session will restart in 0.007463s
2025-10-10T14:01:19.254065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0] Write session: Do CDS request
2025-10-10T14:01:19.254103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:19.267708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:19.270513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:19.270540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 181
2025-10-10T14:01:19.271061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:19.271300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:19.271327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:19.271351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:19.274323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 181 sessionId:  describe result for acl check
2025-10-10T14:01:19.274445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:19.274455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:19.274464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:19.274480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592897050754224:4239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:19.276368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592897050754224:4239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:19.297359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592897050754224:4239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:19.299004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592897050754349:3447]
2025-10-10T14:01:19.305261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:19.314226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592897050754224:4239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:19.314272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592897050754224:4239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:19.314291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592897050754224:4239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:19.314324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:19.317963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:19.318729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:19.318744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:19.318780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:19.319008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:19.319131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592895472838035:3959]
2025-10-10T14:01:19.320628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:19.321653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:19.321912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:19.323237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:19.323576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:19.323595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:19.323602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:19.323610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:19.323617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:19.323625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:19.323632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:19.323639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:19.323647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.323654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.323662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.323669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.323722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:19.323841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:19.323907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:19.323955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:19.324006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:19.324054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:19.324108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:19.324158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:19.324211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.324285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.324338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.324389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.324436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:19.324509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:19.324574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:19.324633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:19.324686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:19.324749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:19.324800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:19.324862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:19.324917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:19.324979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:19.325031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:19.325091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:19.327137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:19.327234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:19.327295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:19.327363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:19.327423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.327484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.327543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.327608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.327662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.327724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.327779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.327839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.328377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:19.359894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:19.373306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:19.373367Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:19.373392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:19.373413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:19.373439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 180 [2:7559592895472838035:3959]
2025-10-10T14:01:19.373502Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:19.373563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:19.373579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.373592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.373605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.373657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:19.373681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:19.373704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:19.375172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.375191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.375206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.375220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.375231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:19.375514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:19.375533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.375689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.375892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.376134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.377403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 180, pipe: [1:7559592897050754349:3447]
2025-10-10T14:01:19.377518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 180
2025-10-10T14:01:19.377612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 180
2025-10-10T14:01:19.376281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:19.376350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.376367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.376381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.376394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.376439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:19.376521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:19.376674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:19.376688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:19.376700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:19.376711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:19.376712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:19.376728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:19.376871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592897050754349:3447], now have 1 active actors on pipe
2025-10-10T14:01:19.376892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.376912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:19.376931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:19.377000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592897050754120:2442], now have 1 active actors on pipe
2025-10-10T14:01:19.377023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592897050754358:4239], now have 1 active actors on pipe
2025-10-10T14:01:19.379483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:19.379511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:19.379586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:19.379616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.379635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.379646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:19.379682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.379722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:19.379769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:19.384218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:19.384291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:19.384375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:19.384857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 181 partition: 0 MaxSeqNo: 36 sessionId: src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0
2025-10-10T14:01:19.387820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b98b32-ae5be6e7-54f4dd6d-8da720f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:19.415277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0] Write session: try to update token
2025-10-10T14:01:19.415324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:19.475061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.475104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.475116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.536225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId: src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:19.559768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:19.559808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:19.559820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:19.559833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:19.559844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:19.559879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.559906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.559935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.559958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.560327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:19.560363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:19.560394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:19.560424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:19.560705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:19.560739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.560751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:19.561833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:19.588333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:19.718722Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:19.741195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:19.741266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:19.741340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:19.741355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:19.741399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592895472838029:3959]
2025-10-10T14:01:19.741732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:19.742594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:19.744066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:19.744227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:19.745361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592897050754349:3447]
2025-10-10T14:01:19.752935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 181 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0
2025-10-10T14:01:19.753231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 181 sessionId: src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0 is DEAD
2025-10-10T14:01:19.757342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:19.757390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0] Write session will restart in 0.005022s
2025-10-10T14:01:19.757496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0] Write session: Do CDS request
2025-10-10T14:01:19.757525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:19.770833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:19.770877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 182
2025-10-10T14:01:19.771237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:19.771803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:19.771921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:19.771942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:19.771952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:19.774457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 182 sessionId:  describe result for acl check
2025-10-10T14:01:19.774587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:19.774599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:19.774609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:19.774627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592897050754387:4243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:19.777478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592897050754387:4243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:19.790247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592897050754387:4243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:19.804359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592897050754387:4243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:19.804405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592897050754387:4243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:19.804423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592897050754387:4243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:19.804457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:19.853227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592897050754553:3447]
2025-10-10T14:01:19.877914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:19.884385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:19.885321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:19.885358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:19.885403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:19.885670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:19.885868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592895472838284:3963]
2025-10-10T14:01:19.888143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:19.889205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:19.889429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:19.890736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:19.891086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:19.891095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:19.891101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:19.891108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:19.891116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:19.891124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:19.891133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:19.891140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:19.891148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.891156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.891163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.891171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.891220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:19.891338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:19.892036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:19.892102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:19.892154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:19.892203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:19.892251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:19.892316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:19.892366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.892420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.892484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.892535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.892580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:19.892651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:19.892716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:19.892775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:19.892827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:19.892887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:19.892938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:19.892996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:19.893050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:19.893107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:19.893191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:19.893280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:19.893339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:19.893401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:19.893467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:19.893531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:19.893598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.893669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.893720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.893779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.893829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.893891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.893942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.893999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.894507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:19.923515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:19.937535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:19.937595Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:19.937615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:19.937636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:19.937661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 181 [2:7559592895472838284:3963]
2025-10-10T14:01:19.937724Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:19.937783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:19.937798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.937810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.937823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.937870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:19.937891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:19.937914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:19.939670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.939705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.940899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 181, pipe: [1:7559592897050754553:3447]
2025-10-10T14:01:19.939722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.939737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.940999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 181
2025-10-10T14:01:19.939750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:19.941018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 181
2025-10-10T14:01:19.940026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:19.940044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:19.940199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:19.940415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:19.940667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:19.940784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:19.940866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592897050754421:4243], now have 1 active actors on pipe
2025-10-10T14:01:19.940891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592897050754374:2442], now have 1 active actors on pipe
2025-10-10T14:01:19.940912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592897050754553:3447], now have 1 active actors on pipe
2025-10-10T14:01:19.940939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:19.940954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:19.940968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:19.940980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:19.941022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:19.941101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:19.941208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:19.941226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:19.941239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:19.941252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:19.941310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:19.941327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:19.941442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:19.941460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:19.941506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:19.941560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:19.941582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:19.941688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94c2c93a-c9b95d20-a07552-a8591574_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:19.941717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.941735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.941746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:19.941779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.941813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:19.941879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:19.943545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:19.943582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:19.943654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:19.944047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 182 partition: 0 MaxSeqNo: 36 sessionId: src_id|94c2c93a-c9b95d20-a07552-a8591574_0
2025-10-10T14:01:19.945327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42b029a4-f36e268-7a7b62cf-e3a2eed4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94c2c93a-c9b95d20-a07552-a8591574_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:19.993051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94c2c93a-c9b95d20-a07552-a8591574_0] Write session: try to update token
2025-10-10T14:01:19.993118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94c2c93a-c9b95d20-a07552-a8591574_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:20.105088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.109221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.109277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.109440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:20.109457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:20.109472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:20.109486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:20.109498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:20.109539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:20.109568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:20.109592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:20.109614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:20.109807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:20.109854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:20.109888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:20.109930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:20.207341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId: src_id|94c2c93a-c9b95d20-a07552-a8591574_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:20.293615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:20.293689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:20.293702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:20.294881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:20.333576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:20.495737Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:20.511849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:20.511877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:20.510535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:20.510581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:20.510625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592895472838278:3963]
2025-10-10T14:01:20.510764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:20.510791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:20.510961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:20.512614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:20.537106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:20.544489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592897050754553:3447]
2025-10-10T14:01:20.546018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 182 reason: error at write: Disconnected sessionId: src_id|94c2c93a-c9b95d20-a07552-a8591574_0
2025-10-10T14:01:20.546333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 182 sessionId: src_id|94c2c93a-c9b95d20-a07552-a8591574_0 is DEAD
2025-10-10T14:01:20.553401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c2c93a-c9b95d20-a07552-a8591574_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:20.553462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c2c93a-c9b95d20-a07552-a8591574_0] Write session will restart in 0.008207s
2025-10-10T14:01:20.553605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c2c93a-c9b95d20-a07552-a8591574_0] Write session: Do CDS request
2025-10-10T14:01:20.553646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c2c93a-c9b95d20-a07552-a8591574_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:20.569858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94c2c93a-c9b95d20-a07552-a8591574_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:20.568778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:20.568817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 183
2025-10-10T14:01:20.570423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:20.570578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:20.570592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:20.570603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:20.572090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 183 sessionId:  describe result for acl check
2025-10-10T14:01:20.572190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:20.572206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:20.572219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:20.572236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592901345721964:4256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:20.575200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592901345721964:4256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:20.581735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592901345721964:4256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:20.598224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592901345721964:4256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:20.598274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592901345721964:4256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:20.598289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592901345721964:4256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:20.598321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:20.644509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592901345722131:3447]
2025-10-10T14:01:20.668091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:20.674557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:20.675408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:20.675445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:20.675490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:20.675785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:20.676014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592899767805862:3972]
2025-10-10T14:01:20.678335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:20.680338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:20.680576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:20.682836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:20.683180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:20.683188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:20.683194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:20.683200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:20.683206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:20.683212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:20.683218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:20.683224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:20.683232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:20.683238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:20.683244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:20.683250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:20.683293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:20.683419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:20.683458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:20.683498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:20.683539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:20.683603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:20.683639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:20.683672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:20.683704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:20.683744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:20.683780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:20.683814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:20.683850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:20.683954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:20.684030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:20.684073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:20.684107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:20.684145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:20.684177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:20.684213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:20.684304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:20.684411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:20.684494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:20.684583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:20.684627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:20.685564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:20.685635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:20.685682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:20.685758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:20.685826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:20.685862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:20.685900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:20.685934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:20.685978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:20.686014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:20.686081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:20.686879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:20.755892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:20.770090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:20.770146Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:20.770162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:20.770181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:20.770204Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 182 [2:7559592899767805862:3972]
2025-10-10T14:01:20.770257Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:20.770311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:20.770325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.770337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.770348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.770395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:20.770417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:20.770439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:20.772707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 182, pipe: [1:7559592901345722131:3447]
2025-10-10T14:01:20.772850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 182
2025-10-10T14:01:20.772858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 182
2025-10-10T14:01:20.771840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:20.771874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:20.771888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:20.771903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:20.771912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:20.772175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:20.772192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:20.772338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:20.772517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:20.772691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:20.772786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:20.772872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592901345722131:3447], now have 1 active actors on pipe
2025-10-10T14:01:20.772891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592901345721953:2442], now have 1 active actors on pipe
2025-10-10T14:01:20.772907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592901345722011:4256], now have 1 active actors on pipe
2025-10-10T14:01:20.772930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.772943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.772954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.772966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.772996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:20.773021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:20.773035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:20.773047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:20.773057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:20.773060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:20.773276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:20.773291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:20.773361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:20.773380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:20.773499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.773520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:20.773587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:20.773618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.773635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.773644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:20.773680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.773720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:20.773827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:20.774321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:20.777859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:20.777919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:20.777995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:20.781334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 183 partition: 0 MaxSeqNo: 36 sessionId: src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0
2025-10-10T14:01:20.782450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94c2c93a-c9b95d20-a07552-a8591574_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:20.818621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:20.818665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:20.818708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.818844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:20.821079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:20.821438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:20.822979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:20.824497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:20.849959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:20.852231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0] Write session: try to update token
2025-10-10T14:01:20.852299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:20.853605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:20.854078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:20.896013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.896076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.896086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.984451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:20.984497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:20.984509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:20.984519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:20.984529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:20.984569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.984593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.984614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.984635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592899767805839:3972]
2025-10-10T14:01:20.984783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:20.984810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:20.984807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:20.984821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:20.984849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:20.984895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:20.984942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:20.986123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:21.031927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId: src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:21.071490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:21.149041Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:21.151928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:21.151983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:21.153583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592901345722131:3447]
2025-10-10T14:01:21.153676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:21.153924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:21.152663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:21.173340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:21.173385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0] Write session will restart in 0.006346s
2025-10-10T14:01:21.173481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0] Write session: Do CDS request
2025-10-10T14:01:21.173509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:21.167919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 183 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0
2025-10-10T14:01:21.168315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 183 sessionId: src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0 is DEAD
2025-10-10T14:01:21.186602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:21.191276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:21.191323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 184
2025-10-10T14:01:21.191951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:21.192136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:21.192164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:21.192182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:21.198321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 184 sessionId:  describe result for acl check
2025-10-10T14:01:21.198444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:21.198454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:21.198463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:21.198480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592905640689537:4267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:21.200987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592905640689537:4267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:21.213963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592905640689537:4267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:21.240658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592905640689537:4267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:21.240706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592905640689537:4267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:21.240724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592905640689537:4267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:21.240757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:21.254450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592905640689723:3447]
2025-10-10T14:01:21.271837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:21.276384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:21.277223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:21.277242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:21.277288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:21.277549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:21.277731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592904062773406:3982]
2025-10-10T14:01:21.279871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:21.282263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:21.282490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:21.283789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:21.284096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:21.284104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:21.284110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:21.284116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:21.284123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:21.284129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:21.284137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:21.284144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:21.284152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.284159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.284166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.284172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.284217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:21.284334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:21.284379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:21.284423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:21.284466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:21.284513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:21.284558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:21.284602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:21.284646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.284690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.284732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.284772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.284811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:21.284874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:21.284932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:21.284984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:21.285032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:21.285083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:21.285807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:21.285885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:21.285935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:21.285987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:21.286033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:21.286085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:21.286132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:21.286186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:21.286232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:21.286284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:21.286331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.286380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.286423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.286476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.286520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.286574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.286617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.286669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.287098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:21.322431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:21.352635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:21.352702Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:21.352725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:21.352747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:21.352776Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 183 [2:7559592904062773406:3982]
2025-10-10T14:01:21.352844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:21.352908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:21.352924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.352936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.352946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.352984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:21.353001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:21.353019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:21.354844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.354882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.354892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.354903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.354911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:21.355177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:21.355198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.355362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.355569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.355859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.356001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:21.356102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.356120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.356135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.356150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.356185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:21.356306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:21.356933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 183
2025-10-10T14:01:21.356935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 183
2025-10-10T14:01:21.357024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 183, pipe: [1:7559592905640689723:3447]
2025-10-10T14:01:21.356436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:21.356473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:21.356486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:21.356499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:21.356534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:21.356555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:21.356722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592905640689666:4267], now have 1 active actors on pipe
2025-10-10T14:01:21.356748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592905640689521:2442], now have 1 active actors on pipe
2025-10-10T14:01:21.356774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592905640689723:3447], now have 1 active actors on pipe
2025-10-10T14:01:21.356797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.356836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:21.357027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:21.362094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:21.362159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:21.362271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|add6fdba-b26097fa-94c496cd-d4efee53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:21.362310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.362331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.362345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:21.362388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.362442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:21.362501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:21.366274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:21.366337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:21.366424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:21.367647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf9630cd-2a51e984-4bebc866-84d18c5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|add6fdba-b26097fa-94c496cd-d4efee53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:21.366823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 184 partition: 0 MaxSeqNo: 36 sessionId: src_id|add6fdba-b26097fa-94c496cd-d4efee53_0
2025-10-10T14:01:21.405152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add6fdba-b26097fa-94c496cd-d4efee53_0] Write session: try to update token
2025-10-10T14:01:21.405215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add6fdba-b26097fa-94c496cd-d4efee53_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:21.513859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.513901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.513912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.513968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:21.513981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:21.513991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:21.514001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:21.514011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:21.514044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.514065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.514083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.514099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.514735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:21.514775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:21.514801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:21.514828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:21.533597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:21.533679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.533691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:21.544266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId: src_id|add6fdba-b26097fa-94c496cd-d4efee53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:21.545790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:21.590798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:21.719434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:21.722573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:21.722620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:21.722665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592904062773398:3982]
2025-10-10T14:01:21.722814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:21.722839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:21.723601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:21.724203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:21.728704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:21.768754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|add6fdba-b26097fa-94c496cd-d4efee53_0
2025-10-10T14:01:21.769083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 184 sessionId: src_id|add6fdba-b26097fa-94c496cd-d4efee53_0 is DEAD
2025-10-10T14:01:21.772354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6fdba-b26097fa-94c496cd-d4efee53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:21.772396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6fdba-b26097fa-94c496cd-d4efee53_0] Write session will restart in 0.008129s
2025-10-10T14:01:21.772488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6fdba-b26097fa-94c496cd-d4efee53_0] Write session: Do CDS request
2025-10-10T14:01:21.772518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6fdba-b26097fa-94c496cd-d4efee53_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:21.772236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:21.772403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592905640689723:3447]
2025-10-10T14:01:21.794191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add6fdba-b26097fa-94c496cd-d4efee53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:21.796963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:21.796994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 185
2025-10-10T14:01:21.797497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:21.797611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:21.797627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:21.797638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:21.799009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 185 sessionId:  describe result for acl check
2025-10-10T14:01:21.799131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:21.799141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:21.799150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:21.799167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592905640689816:4278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:21.809355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592905640689816:4278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:21.821746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592905640689816:4278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:21.854661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592905640689816:4278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:21.854701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592905640689816:4278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:21.854721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592905640689816:4278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:21.854756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:21.875604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592905640689970:3447]
2025-10-10T14:01:21.894601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:21.905349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:21.906253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:21.906294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:21.906338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:21.906597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:21.906800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592904062773670:3992]
2025-10-10T14:01:21.909151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:21.910223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:21.910476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:21.911779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:21.912114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:21.912139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:21.912146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:21.912153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:21.912161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:21.912168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:21.912176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:21.912183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:21.912190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.912197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.912203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.912210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.912260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:21.912392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:21.912444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:21.912492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:21.912537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:21.913003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:21.913065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:21.913112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:21.913180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.913234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.913285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.913342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.913386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:21.913455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:21.913514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:21.913574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:21.913631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:21.913710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:21.913759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:21.913819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:21.913870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:21.913925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:21.914392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:21.914462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:21.914526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:21.914593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:21.914649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:21.914707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:21.914757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.914810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.914865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.914929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.914978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.915033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.915088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.915142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.915624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:21.943859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:21.959012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:21.959072Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:21.959089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:21.959108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:21.959131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 184 [2:7559592904062773670:3992]
2025-10-10T14:01:21.959186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:21.959241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:21.959257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.959270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.959282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.959327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:21.959350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:21.959374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:21.986407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.986453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.986467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.986479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.986490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:21.986765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:21.986781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:21.986918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:21.987103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:21.987326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:21.987443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:21.987511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592904062773664:3992]
2025-10-10T14:01:21.987526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592904062773664:3992]
2025-10-10T14:01:21.987538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592904062773664:3992]
2025-10-10T14:01:21.987551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592904062773664:3992]
2025-10-10T14:01:21.987596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:21.987675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:21.987856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:21.987873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:21.987995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592904062773664:3992]
2025-10-10T14:01:21.988014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:21.988262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:21.988276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:21.988286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:21.988296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:21.988337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:21.990076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592905640689970:3447], now have 1 active actors on pipe
2025-10-10T14:01:21.990131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592905640689924:4278], now have 1 active actors on pipe
2025-10-10T14:01:21.990156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592905640689793:2442], now have 1 active actors on pipe
2025-10-10T14:01:21.990283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 184, pipe: [1:7559592905640689970:3447]
2025-10-10T14:01:21.990397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 184
2025-10-10T14:01:21.990485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 184
2025-10-10T14:01:21.990855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:21.990896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:21.990981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:21.991022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.991041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.991052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:21.991087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.991131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:21.991188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:21.992064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:21.992099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:21.992161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:21.992508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 185 partition: 0 MaxSeqNo: 36 sessionId: src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0
2025-10-10T14:01:21.995640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add6fdba-b26097fa-94c496cd-d4efee53_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:22.035773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0] Write session: try to update token
2025-10-10T14:01:22.035832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:22.093106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.101402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.101444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.101508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:22.101519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:22.101528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:22.101536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:22.101543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:22.101573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592904062773664:3992]
2025-10-10T14:01:22.101592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592904062773664:3992]
2025-10-10T14:01:22.101608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592904062773664:3992]
2025-10-10T14:01:22.101622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592904062773664:3992]
2025-10-10T14:01:22.101741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:22.101762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:22.101770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:22.101786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:22.101797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:22.101797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:22.101823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:22.104740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:22.205755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId: src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:22.234089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:22.293440Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:22.295390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:22.295439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:22.297853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592905640689970:3447]
2025-10-10T14:01:22.297969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:22.297991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:22.298680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:22.303300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 185 reason: error at write: Disconnected sessionId: src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0
2025-10-10T14:01:22.305529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:22.305575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0] Write session will restart in 0.005202s
2025-10-10T14:01:22.305678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0] Write session: Do CDS request
2025-10-10T14:01:22.305711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:22.309405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 185 sessionId: src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0 is DEAD
2025-10-10T14:01:22.323287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:22.323857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:22.323890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 186
2025-10-10T14:01:22.324248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:22.324378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:22.324394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:22.324403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:22.325872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 186 sessionId:  describe result for acl check
2025-10-10T14:01:22.325992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:22.326002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:22.326011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:22.326028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592909935657365:4287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:22.328636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592909935657365:4287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:22.336260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:22.363851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592909935657365:4287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:22.394432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592909935657365:4287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:22.394480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592909935657365:4287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:22.394497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592909935657365:4287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:22.394529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:22.401304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592909935657402:3447]
2025-10-10T14:01:22.525008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:22.537150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:22.537982Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:22.538000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:22.538040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:22.538281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:22.538479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592908357741232:4002]
2025-10-10T14:01:22.540553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:22.543068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:22.543297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:22.544518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:22.544804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:22.544810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:22.544817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:22.544823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:22.544830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:22.544837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:22.544843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:22.544850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:22.544855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:22.544862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:22.544869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:22.544876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:22.544925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:22.545032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:22.545080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:22.545145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:22.545191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:22.545232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:22.545276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:22.545321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:22.545364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:22.545410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:22.545455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:22.545498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:22.545541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:22.545605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:22.545667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:22.545719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:22.545765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:22.545815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:22.545859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:22.545913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:22.545956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:22.546004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:22.546048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:22.546097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:22.546141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:22.546188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:22.546232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:22.546286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:22.546334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:22.546384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:22.546426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:22.546480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:22.546522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:22.546573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:22.546613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:22.546665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:22.547102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:22.594236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:22.717160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:22.717223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:22.717241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:22.717262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:22.717287Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 185 [2:7559592908357741232:4002]
2025-10-10T14:01:22.717345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:22.717409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:22.717423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.717435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.717446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.717499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:22.717522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:22.717545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:22.718972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:22.719010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:22.719027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:22.719040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:22.719051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:22.719343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:22.719361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:22.719516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:22.719724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:22.719971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:22.720089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:22.720166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.720181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.720197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.720212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.720375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:22.720387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:22.720403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:22.720414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:22.720918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 185, pipe: [1:7559592909935657402:3447]
2025-10-10T14:01:22.720971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 185
2025-10-10T14:01:22.721030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 185
2025-10-10T14:01:22.724675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:22.724814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:22.725010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:22.725027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:22.725077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592909935657402:3447], now have 1 active actors on pipe
2025-10-10T14:01:22.725102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592909935657396:4287], now have 1 active actors on pipe
2025-10-10T14:01:22.725137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592909935657356:2442], now have 1 active actors on pipe
2025-10-10T14:01:22.725188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:22.725210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:22.725360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.725396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:22.725468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:22.725497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.725516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.725526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:22.725562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.725599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:22.725723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:22.729243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:22.733287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:22.733335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:22.733421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:22.738800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 186 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0
2025-10-10T14:01:22.739827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30d179c-6acfa05a-c962eaa1-fb5822e2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:22.822803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:22.822846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:22.822892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.823022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.823036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.823048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.823111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:22.824729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:22.824764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:22.826921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0] Write session: try to update token
2025-10-10T14:01:22.826975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:22.841764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:22.842900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:22.843903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:22.853515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:22.946025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.946060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.946068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.946115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:22.984662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:22.984707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:22.984724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:22.984734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:22.984744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:22.984788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.984813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.984836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.984858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592908357741226:4002]
2025-10-10T14:01:22.985010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:22.985037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:22.985049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:22.985244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:22.985291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:22.985321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:22.985348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:22.986263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:23.009244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId: src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:23.031328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:23.144419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592909935657402:3447]
2025-10-10T14:01:23.144457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:23.144475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:23.144512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:23.141876Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:23.143654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:23.143688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:23.144407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:23.153119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 186 reason: error at write: Disconnected sessionId: src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0
2025-10-10T14:01:23.154920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 186 sessionId: src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0 is DEAD
2025-10-10T14:01:23.157867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:23.157928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0] Write session will restart in 0.006826s
2025-10-10T14:01:23.158122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0] Write session: Do CDS request
2025-10-10T14:01:23.158176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:23.183191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:23.189037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:23.189073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 187
2025-10-10T14:01:23.190267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:23.190393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:23.190410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:23.190419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:23.192272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 187 sessionId:  describe result for acl check
2025-10-10T14:01:23.192410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:23.192421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:23.192429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:23.192446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592914230624936:4294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:23.196197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592914230624936:4294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:23.219959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592914230624936:4294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:23.235679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592914230624936:4294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:23.235737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592914230624936:4294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:23.235754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592914230624936:4294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:23.235786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:23.242747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592914230625087:3447]
2025-10-10T14:01:23.276707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:23.284560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:23.285474Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:23.285513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:23.285561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:23.285845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:23.286029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592912652708787:4005]
2025-10-10T14:01:23.288107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:23.289040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:23.289289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:23.290640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:23.291015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:23.291036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:23.291044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:23.291052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:23.291060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:23.291068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:23.291075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:23.291083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:23.291091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.291098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.291105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.291112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.291163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:23.291278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:23.291334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:23.291389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:23.291445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:23.291494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:23.291544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:23.291600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:23.291649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.291700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.291748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.291806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.291853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:23.291925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:23.291994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:23.292060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:23.292112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:23.292167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:23.292234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:23.292315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:23.292384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:23.292446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:23.292499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:23.292561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:23.292613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:23.292670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:23.292712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:23.292754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:23.292814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.292872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.292919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.292977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.293028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.293084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.293142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.293199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.293663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:23.317027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:23.328850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:23.328900Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:23.328911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:23.328924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:23.328942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 186 [2:7559592912652708787:4005]
2025-10-10T14:01:23.328981Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:23.329022Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:23.329032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.329040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.329047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.329079Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:23.329094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:23.329108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:23.348202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.348244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.348257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.348269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.348280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:23.348573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:23.348590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.348724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.348896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.349116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.350379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 186, pipe: [1:7559592914230625087:3447]
2025-10-10T14:01:23.350472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 186
2025-10-10T14:01:23.350533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 186
2025-10-10T14:01:23.350331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:23.350456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592914230625087:3447], now have 1 active actors on pipe
2025-10-10T14:01:23.350482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592914230625049:4294], now have 1 active actors on pipe
2025-10-10T14:01:23.350501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592914230624920:2442], now have 1 active actors on pipe
2025-10-10T14:01:23.350526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592912652708780:4005]
2025-10-10T14:01:23.350541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592912652708780:4005]
2025-10-10T14:01:23.350554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592912652708780:4005]
2025-10-10T14:01:23.350566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592912652708780:4005]
2025-10-10T14:01:23.350604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:23.350683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:23.350836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:23.350847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:23.350855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:23.350863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:23.350866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:23.350882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:23.351008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592912652708780:4005]
2025-10-10T14:01:23.351036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:23.351195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:23.356026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:23.356085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:23.356184Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff59b269-9b2305f5-d237e908-6eda4049_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:23.356218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.356236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.356247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:23.356281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.356325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:23.356389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:23.358523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:23.358570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:23.358652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:23.363068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1f08ed-4346c200-a9aa3139-db0c7f0d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff59b269-9b2305f5-d237e908-6eda4049_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:23.362265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 187 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff59b269-9b2305f5-d237e908-6eda4049_0
2025-10-10T14:01:23.411624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff59b269-9b2305f5-d237e908-6eda4049_0] Write session: try to update token
2025-10-10T14:01:23.411674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff59b269-9b2305f5-d237e908-6eda4049_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:23.450141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.450185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.450196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.450241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:23.450254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:23.450266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:23.450276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:23.450287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:23.450320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592912652708780:4005]
2025-10-10T14:01:23.450344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592912652708780:4005]
2025-10-10T14:01:23.450366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592912652708780:4005]
2025-10-10T14:01:23.450386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592912652708780:4005]
2025-10-10T14:01:23.450515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:23.450514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:23.450538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.450547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:23.450548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:23.450578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:23.450616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:23.451495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:23.561754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId: src_id|ff59b269-9b2305f5-d237e908-6eda4049_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:23.589377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:23.617190Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:23.623847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:01:23.623936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-10T14:01:23.626373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:23.626429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:23.629369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592914230625087:3447]
2025-10-10T14:01:23.629505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:23.629537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:23.630746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:23.654849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:23.654926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-10T14:01:23.656577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 187 reason: error at write: Disconnected sessionId: src_id|ff59b269-9b2305f5-d237e908-6eda4049_0
2025-10-10T14:01:23.656916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 187 sessionId: src_id|ff59b269-9b2305f5-d237e908-6eda4049_0 is DEAD
2025-10-10T14:01:23.657719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff59b269-9b2305f5-d237e908-6eda4049_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:23.657792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff59b269-9b2305f5-d237e908-6eda4049_0] Write session will restart in 0.005891s
2025-10-10T14:01:23.657943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff59b269-9b2305f5-d237e908-6eda4049_0] Write session: Do CDS request
2025-10-10T14:01:23.657991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff59b269-9b2305f5-d237e908-6eda4049_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:23.674171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff59b269-9b2305f5-d237e908-6eda4049_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:23.676585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:23.676619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 188
2025-10-10T14:01:23.677405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:23.677546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:23.677569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:23.677579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:23.678472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 188 sessionId:  describe result for acl check
2025-10-10T14:01:23.678546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:23.678557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:23.678562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:23.678572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592914230625220:4305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:23.680521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592914230625220:4305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:23.689562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592914230625220:4305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:23.700659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592914230625220:4305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:23.700706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592914230625220:4305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:23.700721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592914230625220:4305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:23.700749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:23.730136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592914230625436:3447]
2025-10-10T14:01:23.736326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:23.741685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:23.742515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:23.742547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:23.742591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:23.742836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:23.743054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592912652709056:4014]
2025-10-10T14:01:23.745401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:23.746869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:23.747118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:23.748313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:23.748646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:23.748665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:23.748672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:23.748680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:23.748688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:23.748694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:23.748702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:23.748708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:23.748714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.748720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.748726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.748733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.748777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:23.748886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:23.748938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:23.748985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:23.749038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:23.749089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:23.749147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:23.749191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:23.749247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.749302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.749352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.749396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.749436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:23.749498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:23.749558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:23.749613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:23.749661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:23.749712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:23.749757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:23.749807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:23.749854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:23.749904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:23.749947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:23.749996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:23.750044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:23.750094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:23.750140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:23.750190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:23.750245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.750298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.750341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.750396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.750446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.750501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.750547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.750597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.750996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:23.785916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:23.799754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:23.799799Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:23.799810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:23.799824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:23.799844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 187 [2:7559592912652709056:4014]
2025-10-10T14:01:23.799892Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:23.799942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:23.799952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.799962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.799972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.800006Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:23.800028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:23.800044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:23.818983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.819013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.819018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.819023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.819030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:23.819222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:23.819237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.819335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:23.819465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:23.819615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:23.819680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:23.819761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592914230625436:3447], now have 1 active actors on pipe
2025-10-10T14:01:23.819787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592914230625336:4305], now have 1 active actors on pipe
2025-10-10T14:01:23.819807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592914230625203:2442], now have 1 active actors on pipe
2025-10-10T14:01:23.819830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:23.819843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:23.819854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:23.819865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:23.819892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:23.819919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:23.819930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:23.819941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:23.819626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 187, pipe: [1:7559592914230625436:3447]
2025-10-10T14:01:23.819951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:23.819742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 187
2025-10-10T14:01:23.819959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:23.819837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 187
2025-10-10T14:01:23.820072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:23.820089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:23.820126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:23.820144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:23.820283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:23.820307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:23.820329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:23.820383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:23.820413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.820430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.820440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:23.820477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.820522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:23.820672Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:01:23.820845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:23.821262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 4 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:01:23.821397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:01:23.821459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:23.821520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:23.821603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:23.822170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 188 partition: 0 MaxSeqNo: 36 sessionId: src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0
2025-10-10T14:01:23.822897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff59b269-9b2305f5-d237e908-6eda4049_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:23.851635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0] Write session: try to update token
2025-10-10T14:01:23.851693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:23.900229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:23.900277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:23.900290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:23.900300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:23.900310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:23.900356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:23.900382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:23.900405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:23.900425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:23.900648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.900671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.900682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.900729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:23.900752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:23.900769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:23.900876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:23.900907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:23.900933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:23.900962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:23.902061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:23.977248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId: src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:24.017682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:24.085390Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:24.095318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:24.095382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:24.095451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:24.095464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:24.095506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592912652709051:4014]
2025-10-10T14:01:24.095823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:24.096218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:24.096487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592914230625436:3447]
2025-10-10T14:01:24.096590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:24.101427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:24.142848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 188 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0
2025-10-10T14:01:24.143209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 188 sessionId: src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0 is DEAD
2025-10-10T14:01:24.145641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:24.145681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0] Write session will restart in 0.008592s
2025-10-10T14:01:24.145779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0] Write session: Do CDS request
2025-10-10T14:01:24.145808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:24.159547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:24.159583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 189
2025-10-10T14:01:24.161510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:24.161972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:24.162108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:24.162128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:24.162139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:24.163117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 189 sessionId:  describe result for acl check
2025-10-10T14:01:24.163222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:24.163236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:24.163245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:24.163260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592918525592792:4314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:24.165081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592918525592792:4314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:24.177719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592918525592792:4314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:24.190704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592918525592792:4314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:24.190751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592918525592792:4314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:24.190767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592918525592792:4314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:24.190799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:24.199441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592918525592935:3447]
2025-10-10T14:01:24.225599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:24.229053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:24.230043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:24.230097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:24.230145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:24.230439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:24.230636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592916947676613:4025]
2025-10-10T14:01:24.232967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:24.236531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:24.236854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:24.238361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:24.238756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:24.238767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:24.238774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:24.238782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:24.238790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:24.238797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:24.238806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:24.238815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:24.238821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.238829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.238837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.238844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.238901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:24.239026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:24.239084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:24.239141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:24.239195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:24.239251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:24.239303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:24.239356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:24.239408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.239462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.239513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.239562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.239610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:24.239687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:24.239757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:24.239821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:24.239878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:24.239939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:24.239989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:24.240045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:24.240101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:24.240159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:24.240208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:24.240266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:24.240319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:24.240398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:24.240449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:24.240513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:24.240567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.240627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.240678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.240739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.240795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.240858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.240908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.240967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.242588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:24.272932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:24.303219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:24.303278Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:24.303297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:24.303317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:24.303341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 188 [2:7559592916947676613:4025]
2025-10-10T14:01:24.303395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:24.303463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:24.303488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.303500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.303511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.303563Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:24.303586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:24.303610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:24.304859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.304874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.304887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.304901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.304911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:24.305604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:24.305634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.305772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.305945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.306169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.306280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:24.306362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592918525592935:3447], now have 1 active actors on pipe
2025-10-10T14:01:24.306385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592918525592905:4314], now have 1 active actors on pipe
2025-10-10T14:01:24.306408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592918525592767:2442], now have 1 active actors on pipe
2025-10-10T14:01:24.306432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.306448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.306462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.306474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.306516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:24.306596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:24.306773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:24.306790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:24.306914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.306933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:24.307080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:24.307096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:24.307108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:24.307120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:24.307149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:24.310212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:24.310256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:24.310359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:24.310393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.310410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.310419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:24.310454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.310502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:24.309469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 188, pipe: [1:7559592918525592935:3447]
2025-10-10T14:01:24.310549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:24.309520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 188
2025-10-10T14:01:24.309576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 188
2025-10-10T14:01:24.311416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:24.311444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:24.311506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:24.316394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e937c4c6-f3d5a6de-7335a470-9e303ccd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:24.312025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 189 partition: 0 MaxSeqNo: 36 sessionId: src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0
2025-10-10T14:01:24.361464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0] Write session: try to update token
2025-10-10T14:01:24.361529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:24.458122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:24.458170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:24.458181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:24.458191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:24.458200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:24.458234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.458255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.458274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.458294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.458483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.458497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.458506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.458600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:24.458626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.458637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:24.458798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:24.458835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:24.458864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:24.458889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:24.462570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:24.509217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId: src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:24.532145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:24.620171Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:24.630998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:24.631067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:24.631148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:24.631163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:24.631210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592916947676607:4025]
2025-10-10T14:01:24.631556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:24.632604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:24.632223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592918525592935:3447]
2025-10-10T14:01:24.632336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:24.632349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:24.633299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:24.660729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 189 reason: error at write: Disconnected sessionId: src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0
2025-10-10T14:01:24.661069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 189 sessionId: src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0 is DEAD
2025-10-10T14:01:24.664389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:24.664448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0] Write session will restart in 0.005399s
2025-10-10T14:01:24.664607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0] Write session: Do CDS request
2025-10-10T14:01:24.664652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:24.674153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:24.674344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:24.674374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 190
2025-10-10T14:01:24.674733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:24.674851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:24.674873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:24.674882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:24.676155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 190 sessionId:  describe result for acl check
2025-10-10T14:01:24.676267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:24.676283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:24.676292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:24.676307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592918525593043:4319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:24.678882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592918525593043:4319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:24.686109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592918525593043:4319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:24.699290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592918525593043:4319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:24.699326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592918525593043:4319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:24.699337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592918525593043:4319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:24.699360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:24.730274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592918525593205:3447]
2025-10-10T14:01:24.755258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:24.759888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:24.760673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:24.760707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:24.760749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:24.760981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:24.761190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592916947676871:4028]
2025-10-10T14:01:24.764252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:24.766800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:24.767040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:24.768276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:24.768681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:24.768701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:24.768709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:24.768717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:24.768725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:24.768732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:24.768740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:24.768748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:24.768754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.768762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.768769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.768775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.768822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:24.768925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:24.768970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:24.769020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:24.769067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:24.769108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:24.769166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:24.769213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:24.769258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.769307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.769356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.769404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.769453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:24.769520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:24.769576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:24.769639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:24.769686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:24.769735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:24.769776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:24.769826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:24.769871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:24.769921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:24.769965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:24.770013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:24.770055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:24.770104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:24.770146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:24.770198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:24.770239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.770287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.770322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.770368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.770409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.770458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.770502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.770567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.770974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:24.800984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:24.815651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:24.815707Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:24.815720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:24.815741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:24.815765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 189 [2:7559592916947676871:4028]
2025-10-10T14:01:24.815816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:24.815875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:24.815888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.815899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.815910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.815957Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:24.815979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:24.816001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:24.839043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.839084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.839097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.839107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.839117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:24.839386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:24.839416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:24.839602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:24.839827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 189
2025-10-10T14:01:24.839962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 189
2025-10-10T14:01:24.840042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 189, pipe: [1:7559592918525593205:3447]
2025-10-10T14:01:24.839755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:24.839982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:24.840094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:24.840189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592918525593016:2442], now have 1 active actors on pipe
2025-10-10T14:01:24.840216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592918525593077:4319], now have 1 active actors on pipe
2025-10-10T14:01:24.840234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592918525593205:3447], now have 1 active actors on pipe
2025-10-10T14:01:24.840259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:24.840273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:24.840285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:24.840296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:24.840325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:24.840344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:24.840356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:24.840382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:24.840392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:24.840417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:24.840593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:24.840611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:24.840684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:24.840701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:24.840827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:24.840848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:24.840858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:24.840916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:24.840948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.840965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.840974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:24.841009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.841049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:24.841186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:24.842512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:24.842542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:24.842607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:24.842963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 190 partition: 0 MaxSeqNo: 36 sessionId: src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0
2025-10-10T14:01:24.845335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73659065-f1bed175-79b2b0f8-25ff9b50_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:24.879946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0] Write session: try to update token
2025-10-10T14:01:24.879999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:24.907505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:24.907543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:24.907573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:24.907677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:24.907690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:24.909119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:24.913513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:24.914822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:24.915991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:24.923993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:24.924639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.924653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.924663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.924717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
E1010 14:01:25.037500429  150464 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:01:25.073176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.073220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.073231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.073287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:25.073301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:25.073313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:25.073324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:25.073332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:25.073371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:25.073403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:25.073427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:25.073449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592916947676866:4028]
2025-10-10T14:01:25.073601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:25.073629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:25.073640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:25.074385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:25.074437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:25.074464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:25.074490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:25.078997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:25.081246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId: src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:25.122744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:25.232257Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:25.235559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:25.235614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:25.236936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:25.237375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:25.237528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:25.237539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:25.237569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592918525593205:3447]
2025-10-10T14:01:25.250453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 190 reason: error at write: Disconnected sessionId: src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0
2025-10-10T14:01:25.250803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 190 sessionId: src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0 is DEAD
2025-10-10T14:01:25.254590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:25.254658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0] Write session will restart in 0.005238s
2025-10-10T14:01:25.254812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0] Write session: Do CDS request
2025-10-10T14:01:25.254869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:25.274792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:25.275598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:25.275667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 191
2025-10-10T14:01:25.276288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:25.276524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:25.276565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:25.276576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:25.278355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 191 sessionId:  describe result for acl check
2025-10-10T14:01:25.278481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:25.278493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:25.278504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:25.278523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592922820560627:4334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:25.281551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592922820560627:4334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:25.289826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592922820560627:4334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:25.313302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592922820560627:4334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:25.313345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592922820560627:4334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:25.313361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592922820560627:4334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:25.313388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:25.341285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592922820560675:3447]
2025-10-10T14:01:25.409251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:25.416677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:25.417388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:25.417400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:25.417430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:25.417591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:25.417696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592921242644452:4039]
2025-10-10T14:01:25.419410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:25.421332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:25.421546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:25.422787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:25.423090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:25.423095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:25.423100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:25.423105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:25.423110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:25.423114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:25.423120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:25.423144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:25.423154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:25.423158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:25.423162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:25.423166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:25.423209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:25.423299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:25.423339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:25.423377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:25.423427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:25.423465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:25.423515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:25.423557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:25.423593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:25.423626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:25.423659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:25.423704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:25.423736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:25.423790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:25.423945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:25.424008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:25.424049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:25.424117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:25.424154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:25.424194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:25.424237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:25.424275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:25.424310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:25.424349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:25.424396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:25.424472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:25.424509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:25.424545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:25.424579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:25.424616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:25.424646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:25.424686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:25.424720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:25.424756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:25.424787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:25.424825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:25.425214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:25.468279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:25.484116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:25.484165Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:25.484179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:25.484196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:25.484218Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 190 [2:7559592921242644452:4039]
2025-10-10T14:01:25.484270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:25.484339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:25.484357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.484368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.484393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.484437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:25.484456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:25.484475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:25.522813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:25.522852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:25.522866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:25.522879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:25.525883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 190
2025-10-10T14:01:25.526026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 190
2025-10-10T14:01:25.526110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 190, pipe: [1:7559592922820560675:3447]
2025-10-10T14:01:25.522890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:25.523165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:25.523183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:25.523329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:25.523517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:25.523722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:25.523826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:25.523895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:25.523908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:25.523921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:25.523931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:25.523978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:25.524055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:25.524160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:25.524174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:25.524183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:25.524192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:25.524219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:25.524235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:25.524357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:25.524375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:25.524460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:25.524502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592922820560613:2442], now have 1 active actors on pipe
2025-10-10T14:01:25.524524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592922820560656:4334], now have 1 active actors on pipe
2025-10-10T14:01:25.524558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592922820560675:3447], now have 1 active actors on pipe
2025-10-10T14:01:25.527798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:25.527844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:25.527927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7273793b-3a327744-ed5bc80d-9122d129_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:25.527964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.527984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.527995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:25.528035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.528080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:25.528124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:25.533252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:25.533312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:25.533405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:25.537380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 191 partition: 0 MaxSeqNo: 36 sessionId: src_id|7273793b-3a327744-ed5bc80d-9122d129_0
2025-10-10T14:01:25.538257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|769a7819-b702912e-69a5b42e-21d0f4c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7273793b-3a327744-ed5bc80d-9122d129_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:25.580913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7273793b-3a327744-ed5bc80d-9122d129_0] Write session: try to update token
2025-10-10T14:01:25.580976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7273793b-3a327744-ed5bc80d-9122d129_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:25.585002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.585044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.585056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.771915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId: src_id|7273793b-3a327744-ed5bc80d-9122d129_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:25.784063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:25.784105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:25.784119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:25.784132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:25.784142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:25.784178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:25.784205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:25.784229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:25.784249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:25.784424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.784435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.784446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.789629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:25.789677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:25.789705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:25.789731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:25.812925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:25.846614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:25.848973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:25.849008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:25.850064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:26.009063Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:26.010919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:26.010956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:26.011006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592921242644446:4039]
2025-10-10T14:01:26.011157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:26.011185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:26.011509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:26.012347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:26.012474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592922820560675:3447]
2025-10-10T14:01:26.012567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:26.012585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:26.012386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:26.019921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 191 reason: error at write: Disconnected sessionId: src_id|7273793b-3a327744-ed5bc80d-9122d129_0
2025-10-10T14:01:26.020315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 191 sessionId: src_id|7273793b-3a327744-ed5bc80d-9122d129_0 is DEAD
2025-10-10T14:01:26.021243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7273793b-3a327744-ed5bc80d-9122d129_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 482 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 15769614 MessagesInflight: 10 }
2025-10-10T14:01:26.021409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7273793b-3a327744-ed5bc80d-9122d129_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:26.021466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7273793b-3a327744-ed5bc80d-9122d129_0] Write session will restart in 0.005930s
2025-10-10T14:01:26.021648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7273793b-3a327744-ed5bc80d-9122d129_0] Write session: Do CDS request
2025-10-10T14:01:26.021701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7273793b-3a327744-ed5bc80d-9122d129_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:26.033801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:26.033835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 192
2025-10-10T14:01:26.041931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7273793b-3a327744-ed5bc80d-9122d129_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:26.043435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:26.043737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:26.043771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:26.043794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:26.046936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 192 sessionId:  describe result for acl check
2025-10-10T14:01:26.047072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:26.047082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:26.047091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:26.047106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592927115528203:4345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:26.064381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592927115528203:4345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:26.089852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592927115528203:4345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:26.111665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592927115528203:4345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:26.111714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592927115528203:4345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:26.111733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592927115528203:4345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:26.111766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:26.112988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592927115528266:3447]
2025-10-10T14:01:26.220515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:26.225636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:26.226531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:26.226550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:26.226593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:26.226843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:26.227042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592925537612007:4048]
2025-10-10T14:01:26.229053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:26.236046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:26.236311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:26.237580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:26.237901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:26.237909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:26.237916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:26.237924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:26.237930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:26.237937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:26.237944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:26.237950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:26.237957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.237963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.237970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.237976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.238025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:26.238123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:26.238167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:26.238209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:26.238249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:26.238291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:26.238331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:26.238401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:26.238445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.238489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.238538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.238577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.238619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:26.238680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:26.238732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:26.238777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:26.238826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:26.238874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:26.238917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:26.238968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:26.239012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:26.239057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:26.239103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:26.239156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:26.239199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:26.239253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:26.239298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:26.239348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:26.239392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.240571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.240638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.240694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.240739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.240796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.240841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.240894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.241312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:26.279475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:26.293197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:26.293248Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:26.293266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:26.293285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:26.293308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 191 [2:7559592925537612007:4048]
2025-10-10T14:01:26.293363Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:26.293422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:26.293437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.293450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.293460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.293509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:26.293529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:26.293550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:26.322842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.322878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.322888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.322897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.322906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:26.323158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:26.323170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.323284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.323426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.323603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.323700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:26.323766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592925537612001:4048]
2025-10-10T14:01:26.323778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592925537612001:4048]
2025-10-10T14:01:26.323788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592925537612001:4048]
2025-10-10T14:01:26.323799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592925537612001:4048]
2025-10-10T14:01:26.323853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:26.323925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:26.324092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:26.324108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:26.324226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592925537612001:4048]
2025-10-10T14:01:26.324241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:26.325069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:26.325096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:26.325109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:26.325119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:26.325160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:26.327389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592927115528195:2442], now have 1 active actors on pipe
2025-10-10T14:01:26.327417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592927115528266:3447], now have 1 active actors on pipe
2025-10-10T14:01:26.327437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592927115528264:4345], now have 1 active actors on pipe
2025-10-10T14:01:26.327908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:26.327950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:26.328029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f966bcc1-592db0bf-62b023d3-5f000102_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:26.328065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.328083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.328094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:26.328143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.328188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:26.328230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:26.326912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 191
2025-10-10T14:01:26.327023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 191, pipe: [1:7559592927115528266:3447]
2025-10-10T14:01:26.327117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 191
2025-10-10T14:01:26.330201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:26.330236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:26.330302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:26.331485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 192 partition: 0 MaxSeqNo: 36 sessionId: src_id|f966bcc1-592db0bf-62b023d3-5f000102_0
2025-10-10T14:01:26.334822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7273793b-3a327744-ed5bc80d-9122d129_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f966bcc1-592db0bf-62b023d3-5f000102_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:26.393885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.393921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.393930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.408301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f966bcc1-592db0bf-62b023d3-5f000102_0] Write session: try to update token
2025-10-10T14:01:26.408360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f966bcc1-592db0bf-62b023d3-5f000102_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:26.490003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:26.490058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:26.490069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:26.490077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:26.490086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:26.490118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592925537612001:4048]
2025-10-10T14:01:26.490152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592925537612001:4048]
2025-10-10T14:01:26.490171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592925537612001:4048]
2025-10-10T14:01:26.490190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592925537612001:4048]
2025-10-10T14:01:26.490340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:26.490368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.490377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:26.491035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:26.491073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:26.491097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:26.491120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:26.491348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:26.649822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId: src_id|f966bcc1-592db0bf-62b023d3-5f000102_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:26.678710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:26.711800Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:26.716196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:26.716254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:26.719734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:26.719919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592927115528266:3447]
2025-10-10T14:01:26.720016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:26.720058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:26.721455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:26.750842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 192 reason: error at write: Disconnected sessionId: src_id|f966bcc1-592db0bf-62b023d3-5f000102_0
2025-10-10T14:01:26.751188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 192 sessionId: src_id|f966bcc1-592db0bf-62b023d3-5f000102_0 is DEAD
2025-10-10T14:01:26.753319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f966bcc1-592db0bf-62b023d3-5f000102_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:26.753351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f966bcc1-592db0bf-62b023d3-5f000102_0] Write session will restart in 0.007439s
2025-10-10T14:01:26.753449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f966bcc1-592db0bf-62b023d3-5f000102_0] Write session: Do CDS request
2025-10-10T14:01:26.753476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f966bcc1-592db0bf-62b023d3-5f000102_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:26.769319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:26.769382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 193
2025-10-10T14:01:26.769452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f966bcc1-592db0bf-62b023d3-5f000102_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:26.770371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:26.770491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:26.770506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:26.770517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:26.771914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 193 sessionId:  describe result for acl check
2025-10-10T14:01:26.772031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:26.772041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:26.772048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:26.772065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592927115528498:4359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:26.774462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592927115528498:4359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:26.791977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592927115528498:4359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:26.811789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592927115528498:4359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:26.811833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592927115528498:4359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:26.811849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592927115528498:4359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:26.811880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:26.820741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592927115528642:3447]
2025-10-10T14:01:26.847959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:26.853298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:26.854171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:26.854188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:26.854232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:26.854596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:26.854774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592925537612281:4058]
2025-10-10T14:01:26.857114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:26.858164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:26.858376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:26.859623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:26.859923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:26.859930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:26.859937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:26.859943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:26.859949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:26.859956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:26.859963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:26.859970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:26.859975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.859983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.859989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.859998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.860039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:26.860134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:26.860186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:26.860230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:26.860277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:26.860320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:26.860363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:26.860422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:26.860467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.860511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.860554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.860597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.860632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:26.860691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:26.860743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:26.860808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:26.860857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:26.860917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:26.860962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:26.861017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:26.861061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:26.861111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:26.861188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:26.861242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:26.861286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:26.861341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:26.861383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:26.861433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:26.861478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.861535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.861579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.861634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.861679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.861728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.861770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.861819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.862239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:26.898513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:26.935800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:26.935856Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:26.935871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:26.935892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:26.935913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 192 [2:7559592925537612281:4058]
2025-10-10T14:01:26.935964Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:26.936018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:26.936031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.936042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.936052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.936095Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:26.936113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:26.936134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:26.937300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.937328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.937341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.937355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.937365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:26.937579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:26.937594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:26.937688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:26.937804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:26.937969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:26.938055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:26.938126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592927115528614:4359], now have 1 active actors on pipe
2025-10-10T14:01:26.938145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592927115528482:2442], now have 1 active actors on pipe
2025-10-10T14:01:26.938159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592927115528642:3447], now have 1 active actors on pipe
2025-10-10T14:01:26.938175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:26.938184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:26.938192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:26.938197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:26.938223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:26.938272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:26.938278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:26.938285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:26.938292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:26.938294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:26.938303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:26.938332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:26.938447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:26.938469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:26.938613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dda995b5-8c169703-e14654bf-bf421c89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:26.938652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.938669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.938678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:26.938714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.938752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:26.938800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:26.938831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:26.938864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:26.938911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:26.939292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:26.939319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:26.939370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:26.940276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f966bcc1-592db0bf-62b023d3-5f000102_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dda995b5-8c169703-e14654bf-bf421c89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:26.937950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 192
2025-10-10T14:01:26.937990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 192
2025-10-10T14:01:26.938043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 192, pipe: [1:7559592927115528642:3447]
2025-10-10T14:01:26.939600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 193 partition: 0 MaxSeqNo: 36 sessionId: src_id|dda995b5-8c169703-e14654bf-bf421c89_0
2025-10-10T14:01:26.959259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda995b5-8c169703-e14654bf-bf421c89_0] Write session: try to update token
2025-10-10T14:01:26.959315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda995b5-8c169703-e14654bf-bf421c89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:26.980648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:26.980704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:26.980742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:26.980879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:26.981281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:26.982748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:26.984001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:26.985685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:26.990231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:26.991896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:26.992294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:27.044348Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 1 CurrentSessionLifetimeMs: 121642 BytesRead: 29286416 MessagesRead: 13 BytesReadCompressed: 29286416 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-10-10T14:01:27.042775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:27.042818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:27.042832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:27.042843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:27.042852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:27.042897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:27.042921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:27.042943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:27.042963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592925537612275:4058]
2025-10-10T14:01:27.043082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:27.043108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:27.043125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.043135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:27.043137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.043147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.043157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:27.043191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:27.043216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.043227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:27.044370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:27.073260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId: src_id|dda995b5-8c169703-e14654bf-bf421c89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:27.103086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:27.194043Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:27.220330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:27.220391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:27.221047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:27.221289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:27.221323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:27.222585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:27.222891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592927115528642:3447]
2025-10-10T14:01:27.248962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda995b5-8c169703-e14654bf-bf421c89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:27.249003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda995b5-8c169703-e14654bf-bf421c89_0] Write session will restart in 0.006621s
2025-10-10T14:01:27.247028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 193 reason: error at write: Disconnected sessionId: src_id|dda995b5-8c169703-e14654bf-bf421c89_0
2025-10-10T14:01:27.247347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 193 sessionId: src_id|dda995b5-8c169703-e14654bf-bf421c89_0 is DEAD
2025-10-10T14:01:27.249104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda995b5-8c169703-e14654bf-bf421c89_0] Write session: Do CDS request
2025-10-10T14:01:27.249171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda995b5-8c169703-e14654bf-bf421c89_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:27.263172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dda995b5-8c169703-e14654bf-bf421c89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:27.267594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:27.267671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 194
2025-10-10T14:01:27.271921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:27.272159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:27.272187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:27.272204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:27.275200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 194 sessionId:  describe result for acl check
2025-10-10T14:01:27.275295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:27.275302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:27.275308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:27.275319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592931410496091:4368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:27.277429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592931410496091:4368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:27.289861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592931410496091:4368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:27.301842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592931410496091:4368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:27.301876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592931410496091:4368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:27.301888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592931410496091:4368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:27.301911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:27.321444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:27.322621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592931410496295:3447]
2025-10-10T14:01:27.325034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:27.325920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:27.325954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:27.325997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:27.326252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:27.326439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592929832579851:4067]
2025-10-10T14:01:27.328783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:27.329751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:27.329986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:27.331317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:27.331669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:27.331688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:27.331697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:27.331706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:27.331714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:27.331721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:27.331728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:27.331737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:27.331746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.331753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.331762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.331768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.331820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:27.331938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:27.331999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:27.332056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:27.332117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:27.332169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:27.332224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:27.332277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:27.332330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.332386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.332450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.332508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.332556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:27.332632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:27.332703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:27.332768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:27.332824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:27.332890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:27.332944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:27.333007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:27.333067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:27.333158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:27.333218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:27.333277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:27.333335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:27.333402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:27.333453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:27.333518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:27.333576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.333643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.333697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.333758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.333812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.333874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.333930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.333994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.334471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:27.385017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:27.402232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:27.402297Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:27.402317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:27.402337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:27.402363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 193 [2:7559592929832579851:4067]
2025-10-10T14:01:27.402428Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:27.402492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:27.402508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.402522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.402535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.402585Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:27.402608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:27.402631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:27.404109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.404127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.404141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.404159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.404171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:27.404475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:27.404493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.404661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.404875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.406609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.406795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:27.406885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.406907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.406923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.406938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.406970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:27.407010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:27.407040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:27.407055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:27.407060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:27.407067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:27.407292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:27.407322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:27.407300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 193
2025-10-10T14:01:27.407375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592931410496057:2442], now have 1 active actors on pipe
2025-10-10T14:01:27.407409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592931410496250:4368], now have 1 active actors on pipe
2025-10-10T14:01:27.407436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592931410496295:3447], now have 1 active actors on pipe
2025-10-10T14:01:27.407420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 193
2025-10-10T14:01:27.407491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 193, pipe: [1:7559592931410496295:3447]
2025-10-10T14:01:27.407558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.407593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:27.407635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:27.407940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:27.407973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:27.408043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:27.408081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.408099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.408110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:27.408143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.408184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:27.408228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:27.410655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:27.410704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:27.410801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:27.411178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 194 partition: 0 MaxSeqNo: 36 sessionId: src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0
2025-10-10T14:01:27.413005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dda995b5-8c169703-e14654bf-bf421c89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:27.447292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0] Write session: try to update token
2025-10-10T14:01:27.447351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:27.564236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:27.564282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:27.564294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:27.564304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:27.564315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:27.564350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.564376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.564397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.564418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.564669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.564680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.564692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.564739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:27.564766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.564776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:27.565812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:27.565826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:27.565856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:27.565902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:27.565935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:27.580320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId: src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:27.606178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:27.726735Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:27.736074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:27.736129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:27.736189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:27.736199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:27.736230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592929832579845:4067]
2025-10-10T14:01:27.736604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:27.736729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:27.736756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592931410496295:3447]
2025-10-10T14:01:27.736758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:27.736859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:27.737522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:27.767085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 194 reason: error at write: Disconnected sessionId: src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0
2025-10-10T14:01:27.767330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 194 sessionId: src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0 is DEAD
2025-10-10T14:01:27.769428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:27.769455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0] Write session will restart in 0.009366s
2025-10-10T14:01:27.769563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0] Write session: Do CDS request
2025-10-10T14:01:27.769594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:27.784005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:27.783204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:27.783239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 195
2025-10-10T14:01:27.787868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:27.787999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:27.788014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:27.788024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:27.789296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 195 sessionId:  describe result for acl check
2025-10-10T14:01:27.789405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:27.789418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:27.789426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:27.789443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592931410496337:4373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:27.791910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592931410496337:4373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:27.802109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592931410496337:4373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:27.822911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592931410496337:4373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:27.822961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592931410496337:4373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:27.822979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592931410496337:4373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:27.823010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:27.837090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592931410496509:3447]
2025-10-10T14:01:27.860304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:27.868093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:27.868862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:27.868889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:27.868920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:27.869116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:27.869277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592929832580112:4070]
2025-10-10T14:01:27.870965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:27.872214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:27.872401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:27.873457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:27.873721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:27.873740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:27.873747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:27.873755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:27.873764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:27.873769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:27.873774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:27.873780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:27.873785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.873789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.873795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.873800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.873836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:27.873942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:27.874003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:27.874040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:27.874074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:27.874112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:27.874151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:27.874193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:27.874245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.874301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.874347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.874397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.874437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:27.874497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:27.874544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:27.874597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:27.874647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:27.874699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:27.874747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:27.874808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:27.874850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:27.874900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:27.874954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:27.874998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:27.875054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:27.875115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:27.875149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:27.875194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:27.875251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.875319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.875377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.875440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.875493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.875559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.875614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.875682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.876173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:27.917045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:27.935645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:27.935695Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:27.935703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:27.935719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:27.935736Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 194 [2:7559592929832580112:4070]
2025-10-10T14:01:27.935782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:27.935828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:27.935839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.935847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.935855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.935890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:27.935905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:27.935923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:27.990351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.990392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.990403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.990414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.990423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:27.990699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:27.990714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:27.990843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:27.990997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:27.991201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:27.991619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:27.991702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:27.991716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:27.991730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:27.991742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:27.991772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:27.991852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:27.991868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:27.991880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:27.991890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:27.991899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:27.992012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:27.992029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:27.992170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592931410496308:2442], now have 1 active actors on pipe
2025-10-10T14:01:27.992192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592931410496509:3447], now have 1 active actors on pipe
2025-10-10T14:01:27.992212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592931410496462:4373], now have 1 active actors on pipe
2025-10-10T14:01:27.992230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:27.992262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:27.992754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:27.993168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:27.993193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:27.993267Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:27.993301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.993317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.993327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:27.993363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.993405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:27.993449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:27.994955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:27.994991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:27.995058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:27.992281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 194
2025-10-10T14:01:27.992371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 194, pipe: [1:7559592931410496509:3447]
2025-10-10T14:01:27.992427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 194
2025-10-10T14:01:27.999287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 195 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0
2025-10-10T14:01:28.005682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfe51ff-df22d5e6-2fb5fa3f-a6fc8dd2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:28.050660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.050706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.050717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.050776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:28.050789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:28.050827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:28.050955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:28.051164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:28.059224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:28.061298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:28.071204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:28.076428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0] Write session: try to update token
2025-10-10T14:01:28.076492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:28.078434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:28.080355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:28.080825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:28.158779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:28.158829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:28.158842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:28.158852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:28.158861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:28.158901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:28.158927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:28.158949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:28.158970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592929832580106:4070]
2025-10-10T14:01:28.159133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.159144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.159154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.159199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:28.159223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:28.159233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:28.160696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:28.161614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:28.161656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:28.161680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:28.161707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:28.257231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId: src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:28.319106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:28.330541Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:28.335429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:28.335482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:28.338096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:28.338245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592931410496509:3447]
2025-10-10T14:01:28.338319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:28.338329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:28.339476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:28.374177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 195 reason: error at write: Disconnected sessionId: src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0
2025-10-10T14:01:28.374550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 195 sessionId: src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0 is DEAD
2025-10-10T14:01:28.381362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:28.381410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0] Write session will restart in 0.008740s
2025-10-10T14:01:28.381528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0] Write session: Do CDS request
2025-10-10T14:01:28.381561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:28.398307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:28.401396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:28.401427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 196
2025-10-10T14:01:28.405383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:28.405532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:28.405547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:28.405555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:28.411977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 196 sessionId:  describe result for acl check
2025-10-10T14:01:28.412107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:28.412121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:28.412130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:28.412145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592935705463946:4388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:28.414723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592935705463946:4388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:28.424611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592935705463946:4388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:28.439462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592935705464025:3447]
2025-10-10T14:01:28.449867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592935705463946:4388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:28.449912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592935705463946:4388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:28.449930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592935705463946:4388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:28.449964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:28.504714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:28.512837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:28.513964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:28.513986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:28.514037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:28.514355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:28.514574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592934127547698:4082]
2025-10-10T14:01:28.517019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:28.518666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:28.518925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:28.520505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:28.520863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:28.520871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:28.520877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:28.520883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:28.520889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:28.520896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:28.520903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:28.520909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:28.520915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:28.520921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:28.520928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:28.520934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:28.521001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:28.521106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:28.521174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:28.521219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:28.521272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:28.521318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:28.521360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:28.521403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:28.521451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:28.521496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:28.521540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:28.521584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:28.521628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:28.522429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:28.522508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:28.522568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:28.522617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:28.522693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:28.522740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:28.522794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:28.522839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:28.522892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:28.522950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:28.523002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:28.523066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:28.523122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:28.523168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:28.523225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:28.523271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:28.523321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:28.523379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:28.523434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:28.523480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:28.523529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:28.523571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:28.523623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:28.524088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:28.570005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:28.593168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:28.593228Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:28.593245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:28.593265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:28.593312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 195 [2:7559592934127547698:4082]
2025-10-10T14:01:28.593368Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:28.593432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:28.593447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.593459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.593471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.593560Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:28.593595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:28.593617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:28.595934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:28.595967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:28.595980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:28.595992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:28.596003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:28.596269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:28.596313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:28.596462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:28.596632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:28.596849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:28.596971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:28.597049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592934127547692:4082]
2025-10-10T14:01:28.597070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592934127547692:4082]
2025-10-10T14:01:28.597084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592934127547692:4082]
2025-10-10T14:01:28.597096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592934127547692:4082]
2025-10-10T14:01:28.597152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:28.597241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:28.597311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:28.597362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:28.597376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:28.597389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:28.597610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:28.597644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:28.597804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592935705464048:4388], now have 1 active actors on pipe
2025-10-10T14:01:28.597871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592935705463910:2442], now have 1 active actors on pipe
2025-10-10T14:01:28.597897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592935705464025:3447], now have 1 active actors on pipe
2025-10-10T14:01:28.597916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592934127547692:4082]
2025-10-10T14:01:28.597947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:28.598091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 195
2025-10-10T14:01:28.598209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 195
2025-10-10T14:01:28.598289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 195, pipe: [1:7559592935705464025:3447]
2025-10-10T14:01:28.597984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:28.598835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:28.598863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:28.598953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|759fefeb-16b5ec12-960cbffe-973804c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:28.598985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.599003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.599014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:28.599050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.599092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:28.599141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:28.600245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:28.600279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:28.600342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:28.600743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 196 partition: 0 MaxSeqNo: 36 sessionId: src_id|759fefeb-16b5ec12-960cbffe-973804c7_0
2025-10-10T14:01:28.605409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd88af38-9c3bbfea-e2a11a96-6dca5e73_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|759fefeb-16b5ec12-960cbffe-973804c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:28.634317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|759fefeb-16b5ec12-960cbffe-973804c7_0] Write session: try to update token
2025-10-10T14:01:28.634361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|759fefeb-16b5ec12-960cbffe-973804c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:28.722595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.722642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.722655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.722719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:28.722734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:28.722748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:28.722760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:28.722774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:28.722811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592934127547692:4082]
2025-10-10T14:01:28.722839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592934127547692:4082]
2025-10-10T14:01:28.722866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592934127547692:4082]
2025-10-10T14:01:28.722888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592934127547692:4082]
2025-10-10T14:01:28.723034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:28.723071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:28.723088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:28.724838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:28.724899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:28.724945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:28.724975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:28.731318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:28.789256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId: src_id|759fefeb-16b5ec12-960cbffe-973804c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:28.812577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:28.882749Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:28.884640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:28.884669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:28.889368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:28.889389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:28.889404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:28.889566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592935705464025:3447]
2025-10-10T14:01:28.890266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:28.974769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 196 reason: error at write: Disconnected sessionId: src_id|759fefeb-16b5ec12-960cbffe-973804c7_0
2025-10-10T14:01:28.975119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 196 sessionId: src_id|759fefeb-16b5ec12-960cbffe-973804c7_0 is DEAD
2025-10-10T14:01:28.976659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759fefeb-16b5ec12-960cbffe-973804c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:28.976742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759fefeb-16b5ec12-960cbffe-973804c7_0] Write session will restart in 0.008160s
2025-10-10T14:01:28.976970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759fefeb-16b5ec12-960cbffe-973804c7_0] Write session: Do CDS request
2025-10-10T14:01:28.977033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759fefeb-16b5ec12-960cbffe-973804c7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:28.989710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592935705464215:3447]
2025-10-10T14:01:28.994814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|759fefeb-16b5ec12-960cbffe-973804c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:28.999340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:28.999377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 197
2025-10-10T14:01:28.999846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:28.999983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:29.000001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:29.000012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:29.001980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 197 sessionId:  describe result for acl check
2025-10-10T14:01:29.002120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:29.002131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:29.002893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:29.002919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592940000431523:4394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:29.005182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592940000431523:4394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:29.014437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592940000431523:4394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:29.040823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592940000431523:4394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:29.040855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592940000431523:4394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:29.040866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592940000431523:4394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:29.040899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:29.090175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:29.098329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:29.099348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:29.099368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:29.099414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:29.099723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:29.099922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592938422515257:4090]
2025-10-10T14:01:29.102579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:29.103812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:29.103982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:29.105182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:29.105498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:29.105534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:29.105542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:29.105550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:29.105557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:29.105569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:29.105575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:29.105580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:29.105585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.105589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.105595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.105600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.105636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:29.105724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:29.105761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:29.105796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:29.105831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:29.105868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:29.105903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:29.105937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:29.105972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.106007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.106040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.106072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.106099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:29.106147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:29.106190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:29.106229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:29.106264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:29.106303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:29.106335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:29.106374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:29.106407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:29.106447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:29.106479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:29.106519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:29.106551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:29.106589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:29.106619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:29.106655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:29.106691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.106729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.106761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.106799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.106835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.106870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.106901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.106936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.107246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:29.132375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:29.145952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:29.146010Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:29.146026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:29.146045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:29.146069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 196 [2:7559592938422515257:4090]
2025-10-10T14:01:29.146123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:29.146181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:29.146197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.146212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.146224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.146269Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:29.146292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:29.146315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:29.148797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 196, pipe: [1:7559592935705464215:3447]
2025-10-10T14:01:29.148852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 196
2025-10-10T14:01:29.148903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 196
2025-10-10T14:01:29.148074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.148106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.148119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.148132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.148144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:29.148470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:29.148486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.148638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.148833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.149058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.149176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:29.149258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592935705464215:3447], now have 1 active actors on pipe
2025-10-10T14:01:29.149281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592935705464183:2442], now have 1 active actors on pipe
2025-10-10T14:01:29.149301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592940000431599:4394], now have 1 active actors on pipe
2025-10-10T14:01:29.149360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:29.149379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:29.149417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592938422515252:4090]
2025-10-10T14:01:29.149432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592938422515252:4090]
2025-10-10T14:01:29.149445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592938422515252:4090]
2025-10-10T14:01:29.149457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592938422515252:4090]
2025-10-10T14:01:29.149496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:29.149575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:29.149733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:29.149751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:29.149851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:29.149881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.149899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.149909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:29.149945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.149988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:29.150116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592938422515252:4090]
2025-10-10T14:01:29.150136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:29.150182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:29.150408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:29.150419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:29.150429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:29.150439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:29.150462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:29.151352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:29.151373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:29.151437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:29.151677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 197 partition: 0 MaxSeqNo: 36 sessionId: src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0
2025-10-10T14:01:29.153329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|759fefeb-16b5ec12-960cbffe-973804c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:29.200957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0] Write session: try to update token
2025-10-10T14:01:29.201020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:29.246144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.246187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.246198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.320287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:29.320334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:29.320348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:29.320358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:29.320368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:29.320404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592938422515252:4090]
2025-10-10T14:01:29.320431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592938422515252:4090]
2025-10-10T14:01:29.320454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592938422515252:4090]
2025-10-10T14:01:29.320485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592938422515252:4090]
2025-10-10T14:01:29.320631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:29.320659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.320670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:29.320887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:29.320919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:29.320947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:29.320977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:29.322919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:29.362683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId: src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:29.387567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:29.474264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:29.483487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:29.483562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:29.486475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592935705464215:3447]
2025-10-10T14:01:29.486558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:29.486683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:29.486704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:29.496619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 197 reason: error at write: Disconnected sessionId: src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0
2025-10-10T14:01:29.496978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 197 sessionId: src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0 is DEAD
2025-10-10T14:01:29.499059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:29.499102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0] Write session will restart in 0.005680s
2025-10-10T14:01:29.499257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0] Write session: Do CDS request
2025-10-10T14:01:29.499303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:29.514401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:29.520406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:29.520443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 198
2025-10-10T14:01:29.520849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:29.520971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:29.520991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:29.521002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:29.522227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 198 sessionId:  describe result for acl check
2025-10-10T14:01:29.522341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:29.522350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:29.522358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:29.522374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592940000431767:4405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:29.524868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592940000431767:4405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:29.523325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:29.533471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592940000431767:4405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:29.562645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592940000431767:4405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:29.562682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592940000431767:4405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:29.562693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592940000431767:4405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:29.562715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:29.587681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592940000431887:3447]
2025-10-10T14:01:29.634492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:29.636844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:29.637718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:29.637754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:29.637801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:29.638045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:29.638233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592938422515523:4099]
2025-10-10T14:01:29.640180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:29.641192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:29.641441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:29.642620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:29.643006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:29.643026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:29.643034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:29.643042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:29.643049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:29.643054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:29.643061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:29.643067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:29.643073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.643079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.643086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.643093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.643138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:29.643235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:29.643281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:29.643322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:29.643378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:29.643422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:29.643472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:29.643520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:29.643566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.643614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.643658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.643707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.643753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:29.643818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:29.643880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:29.643934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:29.643987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:29.644042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:29.644088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:29.644144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:29.644193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:29.644246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:29.644292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:29.644347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:29.644394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:29.644448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:29.644512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:29.644565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:29.644616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.644673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.644723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.644774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.644817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.644864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.644904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.644949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.645364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:29.683794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:29.698085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:29.698139Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:29.698152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:29.698168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:29.698189Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 197 [2:7559592938422515523:4099]
2025-10-10T14:01:29.698236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:29.698287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:29.698301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.698312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.698322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.698367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:29.698389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:29.698409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:29.701108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.701496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.701528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.701540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.701550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:29.701819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:29.701833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.701954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:29.702111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:29.702306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:29.702404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:29.702470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592938422515518:4099]
2025-10-10T14:01:29.702483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592938422515518:4099]
2025-10-10T14:01:29.702495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592938422515518:4099]
2025-10-10T14:01:29.702505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592938422515518:4099]
2025-10-10T14:01:29.702551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:29.702624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:29.702779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:29.702812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:29.702936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592938422515518:4099]
2025-10-10T14:01:29.702954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:29.703321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:29.703356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:29.703366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:29.703377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:29.703403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:29.703709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592940000431811:4405], now have 1 active actors on pipe
2025-10-10T14:01:29.703746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592940000431887:3447], now have 1 active actors on pipe
2025-10-10T14:01:29.703765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592940000431755:2442], now have 1 active actors on pipe
2025-10-10T14:01:29.704052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 197
2025-10-10T14:01:29.704123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 197, pipe: [1:7559592940000431887:3447]
2025-10-10T14:01:29.704185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 197
2025-10-10T14:01:29.704356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:29.704387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:29.704482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae868016-52656c73-2ff48bf8-884775e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:29.704523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.704541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.704552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:29.704591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.704640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:29.704699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:29.705343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:29.705379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:29.705439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:29.705714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 198 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae868016-52656c73-2ff48bf8-884775e1_0
2025-10-10T14:01:29.709687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db12cfd-74d103f7-8b3e68e0-bf2e67_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae868016-52656c73-2ff48bf8-884775e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:29.748515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae868016-52656c73-2ff48bf8-884775e1_0] Write session: try to update token
2025-10-10T14:01:29.748569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae868016-52656c73-2ff48bf8-884775e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:29.798915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:29.798960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:29.798972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:29.798983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:29.798993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:29.799028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592938422515518:4099]
2025-10-10T14:01:29.799053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592938422515518:4099]
2025-10-10T14:01:29.799074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592938422515518:4099]
2025-10-10T14:01:29.799093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592938422515518:4099]
2025-10-10T14:01:29.799251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.799273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.799284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.799326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:29.799348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:29.799358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:29.799539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:29.799567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:29.799615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:29.799638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:29.800649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:29.887930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId: src_id|ae868016-52656c73-2ff48bf8-884775e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:29.916075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:29.953720Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:29.955449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:29.955499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:29.956154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:29.956203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:29.957419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592940000431887:3447]
2025-10-10T14:01:29.957553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:29.964176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 198 reason: error at write: Disconnected sessionId: src_id|ae868016-52656c73-2ff48bf8-884775e1_0
2025-10-10T14:01:29.964583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 198 sessionId: src_id|ae868016-52656c73-2ff48bf8-884775e1_0 is DEAD
2025-10-10T14:01:29.965621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae868016-52656c73-2ff48bf8-884775e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:29.965669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae868016-52656c73-2ff48bf8-884775e1_0] Write session will restart in 0.007563s
2025-10-10T14:01:29.965837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae868016-52656c73-2ff48bf8-884775e1_0] Write session: Do CDS request
2025-10-10T14:01:29.965884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae868016-52656c73-2ff48bf8-884775e1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:29.981772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae868016-52656c73-2ff48bf8-884775e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:29.985261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:29.985294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 199
2025-10-10T14:01:29.985674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:29.985788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:29.985803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:29.985812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:29.989592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 199 sessionId:  describe result for acl check
2025-10-10T14:01:29.989716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:29.989734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:29.989745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:29.989760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592940000432062:4414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:29.991774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:29.992440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592940000432062:4414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:29.997874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592940000432062:4414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:30.006500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592940000432062:4414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:30.006543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592940000432062:4414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:30.006560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592940000432062:4414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:30.006589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:30.057623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592944295399584:3447]
2025-10-10T14:01:30.058981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:30.062373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:30.063159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:30.063193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:30.063237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:30.063482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:30.063692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592942717483108:4109]
2025-10-10T14:01:30.065800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:30.066714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:30.066867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:30.067822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:30.068054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:30.068065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:30.068069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:30.068074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:30.068078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:30.068083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:30.068086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:30.068091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:30.068095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.068099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.068103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.068107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.068145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:30.068228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:30.068260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:30.068302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:30.068345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:30.068381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:30.068417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:30.068453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:30.068505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.068542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.068576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.068610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.068638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:30.068693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:30.068737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:30.068777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:30.068814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:30.068852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:30.068884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:30.068922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:30.068959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:30.069004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:30.069038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:30.069072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:30.069102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:30.069171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:30.069206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:30.069243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:30.069278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.069310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.069344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.069399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.069446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.069499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.069538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.069575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.069932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:30.090457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:30.105724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:30.105790Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:30.105809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:30.105828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:30.105857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 198 [2:7559592942717483108:4109]
2025-10-10T14:01:30.105917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:30.105983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:30.106001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.106012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.106023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.106073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:30.106107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:30.106132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:30.107281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.107304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.107313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.107321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.107332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:30.107604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:30.107633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.107771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.107926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 198, pipe: [1:7559592944295399584:3447]
2025-10-10T14:01:30.107950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 198
2025-10-10T14:01:30.108032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 198
2025-10-10T14:01:30.107950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.108170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.108270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:30.108340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592944295399584:3447], now have 1 active actors on pipe
2025-10-10T14:01:30.108356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592944295399384:4414], now have 1 active actors on pipe
2025-10-10T14:01:30.108371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592940000432047:2442], now have 1 active actors on pipe
2025-10-10T14:01:30.108402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:30.108417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:30.108452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592942717483103:4109]
2025-10-10T14:01:30.108472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592942717483103:4109]
2025-10-10T14:01:30.108495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592942717483103:4109]
2025-10-10T14:01:30.108504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592942717483103:4109]
2025-10-10T14:01:30.108535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:30.108573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:30.108595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:30.108606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:30.108610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:30.108616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:30.108743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:30.108761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:30.108820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c04cdba-68ccede2-b335633e-59066548_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:30.108857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.108873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.108882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:30.108918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.108961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:30.109096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592942717483103:4109]
2025-10-10T14:01:30.109160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:30.109194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:30.109239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:30.109838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:30.109863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:30.109908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:30.110174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 199 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c04cdba-68ccede2-b335633e-59066548_0
2025-10-10T14:01:30.110977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae868016-52656c73-2ff48bf8-884775e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c04cdba-68ccede2-b335633e-59066548_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:30.132765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c04cdba-68ccede2-b335633e-59066548_0] Write session: try to update token
2025-10-10T14:01:30.132815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c04cdba-68ccede2-b335633e-59066548_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:30.179273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:30.179315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:30.179327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:30.179336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:30.179343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:30.179380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592942717483103:4109]
2025-10-10T14:01:30.179406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592942717483103:4109]
2025-10-10T14:01:30.179428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592942717483103:4109]
2025-10-10T14:01:30.179448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592942717483103:4109]
2025-10-10T14:01:30.179593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:30.179590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:30.179621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:30.179628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.179638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:30.179646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:30.179670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:30.180716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:30.265478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId: src_id|1c04cdba-68ccede2-b335633e-59066548_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:30.287249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:30.342256Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:30.344110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:30.344159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:30.348076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:30.345650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592944295399584:3447]
2025-10-10T14:01:30.345782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:30.345804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:30.345812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:30.386606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 199 reason: error at write: Disconnected sessionId: src_id|1c04cdba-68ccede2-b335633e-59066548_0
2025-10-10T14:01:30.387003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 199 sessionId: src_id|1c04cdba-68ccede2-b335633e-59066548_0 is DEAD
2025-10-10T14:01:30.389674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c04cdba-68ccede2-b335633e-59066548_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:30.389708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c04cdba-68ccede2-b335633e-59066548_0] Write session will restart in 0.007495s
2025-10-10T14:01:30.389806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c04cdba-68ccede2-b335633e-59066548_0] Write session: Do CDS request
2025-10-10T14:01:30.389839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c04cdba-68ccede2-b335633e-59066548_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:30.404445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c04cdba-68ccede2-b335633e-59066548_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:30.404315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:30.404349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 200
2025-10-10T14:01:30.404960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:30.405093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:30.405116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:30.405141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:30.406425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 200 sessionId:  describe result for acl check
2025-10-10T14:01:30.406532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:30.406541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:30.406549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:30.406566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592944295399658:4419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:30.408971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592944295399658:4419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:30.419594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592944295399658:4419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:30.428951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592944295399658:4419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:30.428997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592944295399658:4419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:30.429014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592944295399658:4419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:30.429044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:30.448811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592944295399850:3447]
2025-10-10T14:01:30.451379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:30.456183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:30.457052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:30.457085Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:30.457154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:30.457451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:30.457661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592942717483365:4111]
2025-10-10T14:01:30.459787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:30.463388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:30.463636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:30.464922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:30.465267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:30.465275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:30.465281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:30.465288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:30.465295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:30.465301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:30.465308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:30.465315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:30.465321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.465328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.465335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.465341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.465387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:30.465494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:30.465541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:30.465586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:30.465650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:30.465704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:30.465755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:30.465803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:30.465848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.465895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.465944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.465992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.466039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:30.466110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:30.466174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:30.466229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:30.466282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:30.466337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:30.466388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:30.466448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:30.466499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:30.466555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:30.466606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:30.466664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:30.466713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:30.466767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:30.466815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:30.466869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:30.466921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.466976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.467024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.467076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.467128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.467185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.468025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.468113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.468580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:30.504066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:30.519127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:30.519195Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:30.519214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:30.519235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:30.519260Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 199 [2:7559592942717483365:4111]
2025-10-10T14:01:30.519316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:30.519387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:30.519412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.519424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.519436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.519486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:30.519509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:30.519537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:30.520976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.521010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.521024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.521038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.521050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:30.521903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 199
2025-10-10T14:01:30.522014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 199
2025-10-10T14:01:30.522090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 199, pipe: [1:7559592944295399850:3447]
2025-10-10T14:01:30.522395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:30.522436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.522574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:30.522754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:30.522959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:30.523073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:30.523122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592944295399813:4419], now have 1 active actors on pipe
2025-10-10T14:01:30.523146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592944295399601:2442], now have 1 active actors on pipe
2025-10-10T14:01:30.523166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592944295399850:3447], now have 1 active actors on pipe
2025-10-10T14:01:30.523233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592942717483360:4111]
2025-10-10T14:01:30.523254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592942717483360:4111]
2025-10-10T14:01:30.523266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592942717483360:4111]
2025-10-10T14:01:30.523279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592942717483360:4111]
2025-10-10T14:01:30.523309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:30.523392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:30.523567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:30.523592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:30.523719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592942717483360:4111]
2025-10-10T14:01:30.523747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:30.524006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:30.524029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:30.524041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:30.524052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:30.524076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:30.524318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:30.524376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:30.524462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:30.524526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.524549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.524560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:30.524600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.524649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:30.524719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:30.525512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:30.525546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:30.525612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:30.526091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 200 partition: 0 MaxSeqNo: 36 sessionId: src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0
2025-10-10T14:01:30.529698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c04cdba-68ccede2-b335633e-59066548_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
E1010 14:01:30.531361052  162940 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:01:30.535170Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:01:30.571552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0] Write session: try to update token
2025-10-10T14:01:30.571614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:30.629477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.629522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.629535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.629598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:30.629613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:30.629629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:30.629640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:30.629652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:30.629688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592942717483360:4111]
2025-10-10T14:01:30.629716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592942717483360:4111]
2025-10-10T14:01:30.629739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592942717483360:4111]
2025-10-10T14:01:30.629760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592942717483360:4111]
2025-10-10T14:01:30.629909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:30.629942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:30.629953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:30.630118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:30.630154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:30.630183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:30.630209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:30.631285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:30.758397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId: src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:30.780927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:30.814538Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:30.817096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:30.817375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:30.820983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:30.821014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:30.821158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:30.821355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592944295399850:3447]
2025-10-10T14:01:30.834043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 200 reason: error at write: Disconnected sessionId: src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0
2025-10-10T14:01:30.834247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 200 sessionId: src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0 is DEAD
2025-10-10T14:01:30.841606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:30.841648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0] Write session will restart in 0.009773s
2025-10-10T14:01:30.841753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0] Write session: Do CDS request
2025-10-10T14:01:30.841780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:30.852747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:30.861726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:30.861766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 201
2025-10-10T14:01:30.863007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:30.865819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:30.865967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:30.865981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:30.865990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:30.867468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 201 sessionId:  describe result for acl check
2025-10-10T14:01:30.867584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:30.867592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:30.867601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:30.867616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592944295399899:4429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:30.870068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592944295399899:4429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:30.899566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592944295399899:4429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:30.918890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592944295399899:4429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:30.918931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592944295399899:4429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:30.918948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592944295399899:4429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:30.918979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:30.921733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592944295399966:3447]
2025-10-10T14:01:31.026424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:31.034807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:31.035808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:31.035827Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:31.035876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:31.036164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:31.036370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592947012450940:4114]
2025-10-10T14:01:31.039890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:31.041822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:31.042060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:31.043398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:31.043723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:31.043742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:31.043749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:31.043755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:31.043761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:31.043766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:31.043772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:31.043779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:31.043786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.043792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.043799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.043806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.043849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:31.043942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:31.043987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:31.044027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:31.044075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:31.044123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:31.044168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:31.044216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:31.044269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.044318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.044365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.044411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.044453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:31.044531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:31.044599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:31.044655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:31.044701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:31.044756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:31.044806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:31.044858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:31.044903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:31.044957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:31.045003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:31.045055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:31.045101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:31.050420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:31.050512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:31.050568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:31.050618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.050669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.050715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.050768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.050815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.050865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.050911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.050962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.051390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:31.085950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:31.129622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:31.129675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:31.129689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:31.129707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:31.129729Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 200 [2:7559592947012450940:4114]
2025-10-10T14:01:31.129782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:31.129837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:31.129851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.129863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.129873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.129920Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:31.129943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:31.129964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:31.132811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.132829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.132842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.132856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.132866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:31.134659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 200, pipe: [1:7559592944295399966:3447]
2025-10-10T14:01:31.134770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 200
2025-10-10T14:01:31.134849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 200
2025-10-10T14:01:31.137629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:31.137674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.137805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.137968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.138167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.138274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:31.138316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592944295399966:3447], now have 1 active actors on pipe
2025-10-10T14:01:31.138359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592944295399964:4429], now have 1 active actors on pipe
2025-10-10T14:01:31.138378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592944295399872:2442], now have 1 active actors on pipe
2025-10-10T14:01:31.138429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:31.138450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:31.138551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.138565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.138577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.138588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.138627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:31.138725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:31.138756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.138775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.138785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:31.138820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.138864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:31.138918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:31.139078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:31.139094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:31.139221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:31.139268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.139298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:31.140088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:31.140116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:31.140127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:31.140137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:31.140160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:31.145271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:31.145320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:31.145406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:31.147233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 201 partition: 0 MaxSeqNo: 36 sessionId: src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0
2025-10-10T14:01:31.149334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1095ea06-8eb5acda-4545efb4-8a4f1c56_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:31.200598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0] Write session: try to update token
2025-10-10T14:01:31.200650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:31.304206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.304266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.304292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.304364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:31.304378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:31.304390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:31.304400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:31.304410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:31.304467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.304531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.304571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.304615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.304784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:31.304833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:31.304878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:31.304910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:31.304923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:31.304955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.304975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:31.319311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:31.375680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId: src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:31.406393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:31.470158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:31.479708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:31.479771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:31.479835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:31.479849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:31.479890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592947012450934:4114]
2025-10-10T14:01:31.480326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:31.481326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:31.480864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:31.480881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592944295399966:3447]
2025-10-10T14:01:31.480898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:31.480960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:31.481099Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:01:31.482464Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_667288218893573319_v1 is DEAD
2025-10-10T14:01:31.482867Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592665122501974:3444] disconnected; active server actors: 1
2025-10-10T14:01:31.482894Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592665122501974:3444] client user disconnected session shared/user_1_2_667288218893573319_v1
2025-10-10T14:01:31.483549Z :ERROR: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:01:31.484204Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:01:31.484231Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:01:31.484264Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Reconnecting session to cluster  in 0.008191s
2025-10-10T14:01:31.496573Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Successfully connected. Initializing session
2025-10-10T14:01:31.498103Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:01:31.498146Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-10T14:01:31.499033Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:01:31.499333Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 read init: from# ipv6:[::1]:40068, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:01:31.499907Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 auth for : user
2025-10-10T14:01:31.500546Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 Handle describe topics response
2025-10-10T14:01:31.500701Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 auth is DEAD
2025-10-10T14:01:31.500793Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:01:31.503104Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got InitResponse. ReadSessionId: shared/user_1_3_5983115989678144199_v1
2025-10-10T14:01:31.502613Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:01:31.503958Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592948590367493:4444] connected; active server actors: 1
2025-10-10T14:01:31.504002Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559592948590367493:4444] session shared/user_1_3_5983115989678144199_v1
2025-10-10T14:01:31.504042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:01:31.504091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:01:31.504124Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_3_5983115989678144199_v1" (Sender=[1:7559592948590367489:4444], Pipe=[1:7559592948590367493:4444], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:01:31.504152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:01:31.504217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:01:31.504278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_5983115989678144199_v1" (Sender=[1:7559592948590367489:4444], Pipe=[1:7559592948590367493:4444], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:01:31.504343Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_3_5983115989678144199_v1" sender [1:7559592948590367489:4444] lock partition 0 for ReadingSession "shared/user_1_3_5983115989678144199_v1" (Sender=[1:7559592948590367489:4444], Pipe=[1:7559592948590367493:4444], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-10-10T14:01:31.504392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:01:31.504437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000185s
2025-10-10T14:01:31.505202Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_3_5983115989678144199_v1" ClientId: "user" PipeClient { RawX1: 7559592948590367493 RawX2: 4503603922342236 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:01:31.505288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:01:31.511802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 201 reason: error at write: Disconnected sessionId: src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0
2025-10-10T14:01:31.512143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 201 sessionId: src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0 is DEAD
2025-10-10T14:01:31.513667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:31.513699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0] Write session will restart in 0.007018s
2025-10-10T14:01:31.513796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0] Write session: Do CDS request
2025-10-10T14:01:31.513825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:31.527817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:31.527856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 202
2025-10-10T14:01:31.529850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:31.530514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:31.530652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:31.530667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:31.530677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:31.532928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 202 sessionId:  describe result for acl check
2025-10-10T14:01:31.533047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:31.533063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:31.533072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:31.533089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592948590367506:4448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:31.535837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592948590367506:4448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:31.544740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592948590367506:4448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:31.568695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592948590367506:4448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:31.568739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592948590367506:4448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:31.568756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592948590367506:4448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:31.568789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:31.625090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:31.627647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:31.628295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:31.628305Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:31.628333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:31.628525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:31.628705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592947012451224:4131]
2025-10-10T14:01:31.630584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:31.637757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:31.637974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:31.638886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:31.639096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:31.639101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:31.639105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:31.639109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:31.639114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:31.639118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:31.639122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:31.639127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:31.639132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.639135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.639139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.639144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.639172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:31.639235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:31.639262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:31.639286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:31.639311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:31.639342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:31.639364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:31.639388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:31.639434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.639460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.639482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.639502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.639526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:31.639570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:31.639602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:31.639625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:31.639644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:31.639678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:31.639708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:31.639758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:31.639783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:31.639820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:31.639841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:31.639876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:31.639900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:31.639935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:31.639966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:31.640005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:31.640034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.640059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.640080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.640103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.640124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.640159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.640180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.640203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.640413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:31.721989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:31.738212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:31.738271Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:31.738289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:31.738309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:31.738331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 201 [2:7559592947012451224:4131]
2025-10-10T14:01:31.738384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:31.738448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:31.738476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.738488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.738500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.738551Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:31.738574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:31.738598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:31.740085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.740103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.740118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.740132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.740144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:31.741671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 201
2025-10-10T14:01:31.741676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 201
2025-10-10T14:01:31.741774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 201, pipe: [1:7559592948590367497:4447]
2025-10-10T14:01:31.742364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:31.742407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.742573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:31.742749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:31.742972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:31.743079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:31.743176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592948590367478:2442], now have 1 active actors on pipe
2025-10-10T14:01:31.743198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592948590367588:4448], now have 1 active actors on pipe
2025-10-10T14:01:31.743218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592948590367497:4447], now have 1 active actors on pipe
2025-10-10T14:01:31.743289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:31.743311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:31.743362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:31.743374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:31.743408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_3_5983115989678144199_v1 on pipe: [1:7559592948590367497:4447]
2025-10-10T14:01:31.743466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:31.743480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:31.743492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:31.743493Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_5983115989678144199_v1:1 with generation 201
2025-10-10T14:01:31.743504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:31.743543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:31.743626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:31.743791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:31.743807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:31.743874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:31.743907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.743926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.743936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:31.743973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.744016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:31.744063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.744083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.744091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:31.744158Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_3_5983115989678144199_v1
2025-10-10T14:01:31.744189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.744389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:31.744410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:31.744453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:31.744493Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:01:31.744820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:31.744867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:31.744879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:31.744890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:31.744916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:31.747215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:31.747252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:31.747320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:31.747742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 202 partition: 0 MaxSeqNo: 36 sessionId: src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0
2025-10-10T14:01:31.748526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdfb194c-16f5dde1-ed2803d-96ffb999_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:31.749069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:01:31.749163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:01:31.749193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.749204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.749215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.749248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:01:31.749281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:01:31.749745Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1760104766000 SizeLag: 18742722 WriteTimestampEstimateMS: 1760104891743 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:01:31.749800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-10T14:01:31.749886Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 sending to client partition status
2025-10-10T14:01:31.773613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0] Write session: try to update token
2025-10-10T14:01:31.773673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:31.894273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:31.894321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:31.894333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:31.894343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:31.894354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:31.894406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:31.894436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:31.894460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:31.894480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:31.894662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:31.894668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.894680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.894691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.894729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:31.894777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:31.894817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:31.894831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:31.894843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:31.894854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:31.895872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:31.906374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId: src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:31.927117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:32.082328Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:32.114585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:32.114646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:32.114716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:32.114727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:32.114759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592947012451219:4131]
2025-10-10T14:01:32.115193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:32.115576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_5983115989678144199_v1
2025-10-10T14:01:32.115620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:32.116653Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_5983115989678144199_v1
2025-10-10T14:01:32.116284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:32.116414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:32.117380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592948590367497:4447]
2025-10-10T14:01:32.124029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 202 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0
2025-10-10T14:01:32.124397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 202 sessionId: src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0 is DEAD
2025-10-10T14:01:32.124799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:32.124855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0] Write session will restart in 0.005861s
2025-10-10T14:01:32.125042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0] Write session: Do CDS request
2025-10-10T14:01:32.125086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:32.142278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:32.142223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:32.142259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 203
2025-10-10T14:01:32.149457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:32.149609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:32.149629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:32.149639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:32.151161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 203 sessionId:  describe result for acl check
2025-10-10T14:01:32.151275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:32.151290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:32.151298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:32.151315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592952885335085:4454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:32.154590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592952885335085:4454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:32.168906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592952885335085:4454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:32.207275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592952885335085:4454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:32.207329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592952885335085:4454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:32.207345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592952885335085:4454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:32.207374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:32.217452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592952885335144:4447]
2025-10-10T14:01:32.295511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:32.304255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:32.305106Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:32.305142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:32.305186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:32.305449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:32.305627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592951307418793:4134]
2025-10-10T14:01:32.308405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:32.309789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:32.310003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:32.311232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:32.311515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:32.311522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:32.311528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:32.311535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:32.311543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:32.311550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:32.311556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:32.311562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:32.311568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.311574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.311581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.311587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.311634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:32.311739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:32.311787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:32.311836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:32.311880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:32.311924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:32.311969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:32.312015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:32.312057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.312104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.312147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.312190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.312229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:32.312300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:32.312357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:32.312410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:32.312456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:32.312507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:32.312566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:32.312618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:32.312665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:32.312716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:32.312759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:32.312809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:32.312853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:32.312904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:32.312941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:32.312993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:32.313040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.313093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.314072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.314152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.314202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.314263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.314305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.314359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.314794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:32.345889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:32.360544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:32.360601Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:32.360618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:32.360637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:32.360660Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 202 [2:7559592951307418793:4134]
2025-10-10T14:01:32.360716Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:32.360775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:32.360789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.360801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.360813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.360860Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:32.360880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:32.360900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:32.387060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.387100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.387110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.387122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.387132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:32.387426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:32.387458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.387583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.387728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.387922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.388032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:32.388128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592952885335144:4447], now have 1 active actors on pipe
2025-10-10T14:01:32.388157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592952885335127:4454], now have 1 active actors on pipe
2025-10-10T14:01:32.388176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592952885335071:2442], now have 1 active actors on pipe
2025-10-10T14:01:32.388202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.388226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.388248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.388260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.388298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:32.388341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:32.388355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:32.388368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:32.388375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:32.388378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:32.388561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:32.388579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:32.388711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.388742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:32.389193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:32.389909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 202, pipe: [1:7559592952885335144:4447]
2025-10-10T14:01:32.390020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 202
2025-10-10T14:01:32.390103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 202
2025-10-10T14:01:32.390485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:32.390518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:32.390602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:32.390634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.390652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.390661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:32.390696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.390737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:32.390781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:32.391580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:32.391604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:32.391661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:32.391979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 203 partition: 0 MaxSeqNo: 36 sessionId: src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0
2025-10-10T14:01:32.393681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db7e0650-60a77fa3-38a2ccbd-95a25675_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:32.443702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:32.443753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:32.443793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.443928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:32.443971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:32.447669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0] Write session: try to update token
2025-10-10T14:01:32.447769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:32.447450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:32.450752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:32.455592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:32.457120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:32.460336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:32.460920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:32.461058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.461147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.461164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.536507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:32.536576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:32.536588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:32.536599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:32.536609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:32.536652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.536675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.536694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.536712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592951307418787:4134]
2025-10-10T14:01:32.536871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:32.536898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.536908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:32.536956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:32.536983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:32.537002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:32.537018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:32.546377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:32.630479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId: src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:32.655812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:32.728285Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:32.733497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:32.733562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:32.734928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:32.735303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592952885335144:4447]
2025-10-10T14:01:32.735419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:32.735432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:32.752231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:32.752267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0] Write session will restart in 0.005008s
2025-10-10T14:01:32.752378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0] Write session: Do CDS request
2025-10-10T14:01:32.752405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:32.751413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:32.751575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 203 reason: error at write: Disconnected sessionId: src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0
2025-10-10T14:01:32.751873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 203 sessionId: src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0 is DEAD
2025-10-10T14:01:32.781557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:32.799650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:32.799686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 204
2025-10-10T14:01:32.800392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:32.800521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:32.800551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:32.800561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:32.802047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 204 sessionId:  describe result for acl check
2025-10-10T14:01:32.802143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:32.802170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:32.802178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:32.802196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592952885335368:4465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:32.804804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592952885335368:4465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:32.813543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592952885335368:4465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:32.830329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592952885335368:4465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:32.830377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592952885335368:4465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:32.830392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592952885335368:4465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:32.830422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:32.834667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592952885335454:4447]
2025-10-10T14:01:32.906390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:32.914578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:32.915268Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:32.915298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:32.915335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:32.915535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:32.915693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592951307419068:4143]
2025-10-10T14:01:32.917293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:32.918433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:32.918659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:32.919987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:32.920335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:32.920343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:32.920351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:32.920358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:32.920366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:32.920374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:32.920381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:32.920388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:32.920395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.920402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.920409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.920418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.920469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:32.920599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:32.920650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:32.920701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:32.920752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:32.920802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:32.920847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:32.920893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:32.920940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.920990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.921038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.921093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.921178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:32.921250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:32.921343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:32.921408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:32.921460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:32.921525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:32.921576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:32.921641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:32.921702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:32.921757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:32.921814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:32.921877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:32.921934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:32.921995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:32.922053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:32.922117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:32.922206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.922276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.922332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.922396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.922455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.922513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.922570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.922635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.923138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:32.962817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:32.977110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:32.977185Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:32.977203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:32.977222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:32.977249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 203 [2:7559592951307419068:4143]
2025-10-10T14:01:32.977332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:32.977390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:32.977416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.977429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.977441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.977488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:32.977516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:32.977542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:32.980116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.980151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.980168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.980181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.980193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:32.980404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:32.980427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:32.980575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:32.980778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:32.981035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:32.981179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:32.981255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592951307419062:4143]
2025-10-10T14:01:32.981276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592951307419062:4143]
2025-10-10T14:01:32.981290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592951307419062:4143]
2025-10-10T14:01:32.981306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592951307419062:4143]
2025-10-10T14:01:32.981337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:32.981421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:32.981435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:32.981451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:32.981462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:32.981486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:32.981615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:32.981638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:32.981782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592952885335361:2442], now have 1 active actors on pipe
2025-10-10T14:01:32.981814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592952885335434:4465], now have 1 active actors on pipe
2025-10-10T14:01:32.981837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592952885335454:4447], now have 1 active actors on pipe
2025-10-10T14:01:32.981860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592951307419062:4143]
2025-10-10T14:01:32.981892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:32.982123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:32.985320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 203
2025-10-10T14:01:32.985447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 203
2025-10-10T14:01:32.985521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 203, pipe: [1:7559592952885335454:4447]
2025-10-10T14:01:32.985685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:32.985752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:32.985838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:32.985871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.985892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.985902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:32.985937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.985978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:32.986026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:32.988259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:32.988313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:32.988388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:32.991183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 204 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0
2025-10-10T14:01:32.992351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|775d9dfa-2735ceb8-7935df80-d127eab9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:33.024999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0] Write session: try to update token
2025-10-10T14:01:33.025040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:33.077930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.077985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.077996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.145399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:33.145450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:33.145465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:33.145477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:33.145490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:33.145528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592951307419062:4143]
2025-10-10T14:01:33.145555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592951307419062:4143]
2025-10-10T14:01:33.145577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592951307419062:4143]
2025-10-10T14:01:33.145600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592951307419062:4143]
2025-10-10T14:01:33.145758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:33.145799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.145813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:33.146990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:33.148603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:33.148644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:33.148682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:33.148712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:33.193260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId: src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:33.219542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:33.318626Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:33.320673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:33.320703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:33.323818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:33.324037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:33.324064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:33.325297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:33.325531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592952885335454:4447]
2025-10-10T14:01:33.333549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 204 reason: error at write: Disconnected sessionId: src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0
2025-10-10T14:01:33.333938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 204 sessionId: src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0 is DEAD
2025-10-10T14:01:33.334404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:33.334454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0] Write session will restart in 0.008634s
2025-10-10T14:01:33.334640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0] Write session: Do CDS request
2025-10-10T14:01:33.334704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:33.348451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:33.349264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:33.349300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 205
2025-10-10T14:01:33.353376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:33.353521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:33.353537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:33.353546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:33.355195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 205 sessionId:  describe result for acl check
2025-10-10T14:01:33.355282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:33.355292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:33.355301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:33.355317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592957180302962:4475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:33.357492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592957180302962:4475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:33.366411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592957180302962:4475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:33.378997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592957180302962:4475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:33.379034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592957180302962:4475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:33.379047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592957180302962:4475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:33.379067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:33.426083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592957180303180:4447]
2025-10-10T14:01:33.446437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:33.451555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:33.452398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:33.452438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:33.452483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:33.452753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:33.452951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592955602386662:4153]
2025-10-10T14:01:33.455176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:33.456502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:33.456730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:33.457975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:33.458293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:33.458311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:33.458318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:33.458325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:33.458331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:33.458338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:33.458344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:33.458351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:33.458358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.458364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.458370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.458376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.458419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:33.458524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:33.458571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:33.458619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:33.458666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:33.458711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:33.458755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:33.458797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:33.458838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.458882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.458923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.458964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.459000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:33.459064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:33.459120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:33.459174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:33.459221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:33.459275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:33.459316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:33.459367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:33.459412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:33.459459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:33.459499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:33.459547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:33.459587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:33.459636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:33.459674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:33.459721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:33.459766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.459834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.459875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.459922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.459965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.460010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.460050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.460097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.460493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:33.485574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:33.501090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:33.501269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:33.501298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:33.501318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:33.501340Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 204 [2:7559592955602386662:4153]
2025-10-10T14:01:33.501396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:33.501464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:33.501486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.501499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.501510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.501560Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:33.501583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:33.501606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:33.502758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.502778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.502785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.502794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.502801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:33.502993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:33.503012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.503122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.503247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.503432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 204
2025-10-10T14:01:33.503544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 204
2025-10-10T14:01:33.503546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 204, pipe: [1:7559592957180303180:4447]
2025-10-10T14:01:33.503453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.503569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:33.503649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592957180303180:4447], now have 1 active actors on pipe
2025-10-10T14:01:33.503671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592957180302998:4475], now have 1 active actors on pipe
2025-10-10T14:01:33.503690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592957180302949:2442], now have 1 active actors on pipe
2025-10-10T14:01:33.503724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.503733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.503741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.503748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.503779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:33.503838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:33.503847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:33.503852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:33.503863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:33.503875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:33.503965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:33.503975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:33.504010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:33.504023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:33.504125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.504144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:33.504172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:33.504188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|818b2023-27c09672-7be74e3a-eec6b396_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:33.504207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.504224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.504234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:33.504270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.504309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:33.504416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:33.507185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:33.507222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:33.507308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:33.507620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 205 partition: 0 MaxSeqNo: 36 sessionId: src_id|818b2023-27c09672-7be74e3a-eec6b396_0
2025-10-10T14:01:33.508401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed04f85-e13608e-2b4bb13b-79f161cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|818b2023-27c09672-7be74e3a-eec6b396_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:33.545400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|818b2023-27c09672-7be74e3a-eec6b396_0] Write session: try to update token
2025-10-10T14:01:33.545468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|818b2023-27c09672-7be74e3a-eec6b396_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:33.586565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:33.586607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:33.586639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.586737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:33.586784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:33.594759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:33.602452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:33.604100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:33.605610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:33.608429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:33.609093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.609133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.609148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.609228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:33.662079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:33.662114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:33.662123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:33.662129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:33.662136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:33.662162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.662176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.662188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.662201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592955602386656:4153]
2025-10-10T14:01:33.662311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:33.662329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.662336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:33.663154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:33.663719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:33.663762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:33.663788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:33.663814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:33.710026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId: src_id|818b2023-27c09672-7be74e3a-eec6b396_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:33.752123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:33.822542Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:33.824173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:33.824219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:33.824923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:33.827877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592957180303180:4447]
2025-10-10T14:01:33.828031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:33.829300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:33.853201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 205 reason: status is not ok: tablet will be restarted right now sessionId: src_id|818b2023-27c09672-7be74e3a-eec6b396_0
2025-10-10T14:01:33.853574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 205 sessionId: src_id|818b2023-27c09672-7be74e3a-eec6b396_0 is DEAD
2025-10-10T14:01:33.856394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818b2023-27c09672-7be74e3a-eec6b396_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:33.856466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818b2023-27c09672-7be74e3a-eec6b396_0] Write session will restart in 0.009845s
2025-10-10T14:01:33.856676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818b2023-27c09672-7be74e3a-eec6b396_0] Write session: Do CDS request
2025-10-10T14:01:33.856731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818b2023-27c09672-7be74e3a-eec6b396_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:33.871974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:33.872010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 206
2025-10-10T14:01:33.877927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|818b2023-27c09672-7be74e3a-eec6b396_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:33.882264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:33.882450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:33.882473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:33.882496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:33.883933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 206 sessionId:  describe result for acl check
2025-10-10T14:01:33.884053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:33.884068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:33.884078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:33.884094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592957180303263:4479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:33.886648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592957180303263:4479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:33.894533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592957180303263:4479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:33.911386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592957180303263:4479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:33.911433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592957180303263:4479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:33.911449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592957180303263:4479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:33.911478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:33.928806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592957180303480:4447]
2025-10-10T14:01:33.935004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:33.944123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:33.944950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:33.944983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:33.945027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:33.945268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:33.945461Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592955602386920:4156]
2025-10-10T14:01:33.947472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:33.948356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:33.948594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:33.949731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:33.950037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:33.950056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:33.950063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:33.950069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:33.950075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:33.950081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:33.950087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:33.950093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:33.950100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.950106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.950113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.950119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.950160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:33.950254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:33.950299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:33.950343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:33.950383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:33.950455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:33.950508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:33.950555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:33.950594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.950636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.950691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.950748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.950789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:33.950857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:33.950909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:33.950967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:33.951024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:33.951078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:33.951121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:33.951206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:33.951256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:33.951302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:33.951353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:33.951404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:33.951451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:33.951506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:33.951553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:33.951605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:33.951656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.951710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.951754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.951809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.951851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.951895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.951940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.951987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.952429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:33.980313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:33.995458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:33.995509Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:33.995525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:33.995541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:33.995563Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 205 [2:7559592955602386920:4156]
2025-10-10T14:01:33.995615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:33.995673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:33.995685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.995696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.995708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.995752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:33.995771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:33.995792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:33.997681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.997710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.997721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.997735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.997744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:33.998008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:33.998034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:33.998262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 205, pipe: [1:7559592957180303480:4447]
2025-10-10T14:01:33.998280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 205
2025-10-10T14:01:33.998364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 205
2025-10-10T14:01:33.998160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:33.998336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:33.998543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:33.998642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:33.998738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592957180303480:4447], now have 1 active actors on pipe
2025-10-10T14:01:33.998766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592957180303418:4479], now have 1 active actors on pipe
2025-10-10T14:01:33.998785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592957180303218:2442], now have 1 active actors on pipe
2025-10-10T14:01:33.998829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:33.998856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:33.998893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:33.998915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:33.998926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:33.998938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:33.998974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:33.999011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:33.999036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:33.999047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:33.999051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:33.999058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:33.999204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:33.999232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:33.999306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a776861-af86231c-efa0468c-154c3f8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:33.999350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.999369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.999377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:33.999413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.999456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:33.999584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:33.999617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:33.999647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:33.999664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:34.000129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:34.000157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:34.000212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:34.000464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 206 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a776861-af86231c-efa0468c-154c3f8a_0
2025-10-10T14:01:34.001321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|818b2023-27c09672-7be74e3a-eec6b396_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a776861-af86231c-efa0468c-154c3f8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:34.029453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a776861-af86231c-efa0468c-154c3f8a_0] Write session: try to update token
2025-10-10T14:01:34.029507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a776861-af86231c-efa0468c-154c3f8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:34.150467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.150513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.150525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.150635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:34.150648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:34.150658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:34.150669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:34.150680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:34.150711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:34.150734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:34.150753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:34.150771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:34.153252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:34.153286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:34.153311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:34.153334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:34.178195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId: src_id|6a776861-af86231c-efa0468c-154c3f8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:34.194592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:34.196772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:34.196829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:34.203602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:34.224131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:34.379877Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:34.387768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:34.387817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:34.387862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592955602386915:4156]
2025-10-10T14:01:34.387990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:34.388015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:34.388041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:34.391162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592957180303480:4447]
2025-10-10T14:01:34.391328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:34.391363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:34.389465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:34.429250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 206 reason: error at write: Disconnected sessionId: src_id|6a776861-af86231c-efa0468c-154c3f8a_0
2025-10-10T14:01:34.429604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 206 sessionId: src_id|6a776861-af86231c-efa0468c-154c3f8a_0 is DEAD
2025-10-10T14:01:34.440211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a776861-af86231c-efa0468c-154c3f8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:34.440289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a776861-af86231c-efa0468c-154c3f8a_0] Write session will restart in 0.009113s
2025-10-10T14:01:34.440428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a776861-af86231c-efa0468c-154c3f8a_0] Write session: Do CDS request
2025-10-10T14:01:34.440475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a776861-af86231c-efa0468c-154c3f8a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:34.450115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:34.458084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:34.458116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 207
2025-10-10T14:01:34.460541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a776861-af86231c-efa0468c-154c3f8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:34.461997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:34.462125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:34.462140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:34.462148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:34.466832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 207 sessionId:  describe result for acl check
2025-10-10T14:01:34.466949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:34.466958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:34.466967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:34.466984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592961475270841:4492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:34.470033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592961475270841:4492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:34.492235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592961475270893:4447]
2025-10-10T14:01:34.494689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592961475270841:4492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:34.523207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592961475270841:4492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:34.523249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592961475270841:4492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:34.523265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592961475270841:4492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:34.523298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:34.563448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:34.568699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:34.569610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:34.569629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:34.569679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:34.569951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:34.570144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592959897354530:4165]
2025-10-10T14:01:34.572205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:34.573882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:34.574120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:34.575313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:34.575611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:34.575617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:34.575624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:34.575631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:34.575636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:34.575642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:34.575648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:34.575655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:34.575661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:34.575667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:34.575676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:34.575682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:34.575727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:34.575831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:34.575877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:34.575922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:34.575970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:34.576026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:34.576073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:34.576114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:34.576157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:34.576203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:34.576246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:34.576288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:34.576329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:34.576391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:34.576448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:34.576498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:34.576543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:34.576612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:34.576657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:34.576708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:34.576755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:34.576809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:34.576853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:34.576901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:34.576945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:34.576995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:34.577037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:34.577090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:34.578026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:34.578112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:34.578159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:34.578210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:34.578254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:34.578305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:34.578346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:34.578398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:34.578857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:34.650785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:34.667808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:34.667869Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:34.667886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:34.667904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:34.667929Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 206 [2:7559592959897354530:4165]
2025-10-10T14:01:34.667984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:34.668046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:34.668062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.668074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.668085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.668131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:34.668153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:34.668174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:34.669498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:34.669513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:34.669528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:34.669541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:34.669553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:34.669820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:34.669836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:34.669974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:34.670141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:34.670349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:34.670458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:34.670525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592959897354524:4165]
2025-10-10T14:01:34.670539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592959897354524:4165]
2025-10-10T14:01:34.670552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592959897354524:4165]
2025-10-10T14:01:34.670563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592959897354524:4165]
2025-10-10T14:01:34.670594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:34.670663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:34.670825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:34.670841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:34.670954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592959897354524:4165]
2025-10-10T14:01:34.670973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:34.673237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:34.673253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:34.673265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:34.673277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:34.673303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:34.674112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592961475270977:4492], now have 1 active actors on pipe
2025-10-10T14:01:34.674154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592961475270893:4447], now have 1 active actors on pipe
2025-10-10T14:01:34.674173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592961475270819:2442], now have 1 active actors on pipe
2025-10-10T14:01:34.677499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 206
2025-10-10T14:01:34.677597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 206, pipe: [1:7559592961475270893:4447]
2025-10-10T14:01:34.677691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 206
2025-10-10T14:01:34.678821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:34.678885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:34.678986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:34.679020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.679039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.679048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:34.679087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.679134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:34.679183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:34.679651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:34.679680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:34.679737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:34.680474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 207 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0
2025-10-10T14:01:34.681402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a776861-af86231c-efa0468c-154c3f8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:34.720265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0] Write session: try to update token
2025-10-10T14:01:34.720322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:34.788557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.788748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.788770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.788827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:34.788839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:34.788851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:34.788861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:34.788870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:34.788905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592959897354524:4165]
2025-10-10T14:01:34.788928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592959897354524:4165]
2025-10-10T14:01:34.788948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592959897354524:4165]
2025-10-10T14:01:34.788967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592959897354524:4165]
2025-10-10T14:01:34.789103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:34.789104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:34.789145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:34.789155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:34.789155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:34.789182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:34.789213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:34.790349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:34.855408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId: src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:34.890719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:34.944621Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:34.967125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:34.967181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:34.969481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:34.971063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592961475270893:4447]
2025-10-10T14:01:34.971219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:34.971434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:34.979051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 207 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0
2025-10-10T14:01:34.979398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 207 sessionId: src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0 is DEAD
2025-10-10T14:01:34.981870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:34.981932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0] Write session will restart in 0.006436s
2025-10-10T14:01:34.982081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0] Write session: Do CDS request
2025-10-10T14:01:34.982125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:34.994913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:34.999097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:34.999136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 208
2025-10-10T14:01:34.999456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:34.999567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:34.999588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:34.999599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:35.000717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 208 sessionId:  describe result for acl check
2025-10-10T14:01:35.000826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:35.000835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:35.000844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:35.000859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592961475271126:4501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:35.003077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592961475271126:4501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:35.012206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592961475271126:4501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:35.026278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592961475271126:4501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:35.026325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592961475271126:4501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:35.026342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592961475271126:4501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:35.026374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:35.076835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592965770238583:4447]
2025-10-10T14:01:35.132672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:35.136880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:35.137763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:35.137795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:35.137841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:35.138091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:35.138267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592964192322100:4176]
2025-10-10T14:01:35.140225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:35.141757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:35.142006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:35.143447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:35.143780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:35.143788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:35.143795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:35.143802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:35.143809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:35.143817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:35.143823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:35.143829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:35.143836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.143843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.143850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.143857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.143903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:35.144003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:35.144048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:35.144091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:35.144134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:35.144176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:35.144217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:35.144257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:35.144297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.144339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.144377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.144418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.144458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:35.144520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:35.144571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:35.144639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:35.144687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:35.145322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:35.145392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:35.145445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:35.145500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:35.145564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:35.145600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:35.145633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:35.145663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:35.145698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:35.145725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:35.145759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:35.145788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.145821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.145852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.145900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.145928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.145960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.145986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.146017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.146307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:35.194684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:35.220417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 207, pipe: [1:7559592965770238583:4447]
2025-10-10T14:01:35.220481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 207
2025-10-10T14:01:35.220520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 207
2025-10-10T14:01:35.217583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:35.217638Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:35.217656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:35.217677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:35.217701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 207 [2:7559592964192322100:4176]
2025-10-10T14:01:35.217761Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:35.217823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:35.217839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.217852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.217863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.217909Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:35.217931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:35.217954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:35.219274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.219289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.219304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.219319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.219330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:35.219603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:35.219619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.219766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.219951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.220175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.220280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:35.220362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592965770238583:4447], now have 1 active actors on pipe
2025-10-10T14:01:35.220384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592965770238451:4501], now have 1 active actors on pipe
2025-10-10T14:01:35.220404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592961475271113:2442], now have 1 active actors on pipe
2025-10-10T14:01:35.220429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.220444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.220457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.220469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.220511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:35.220602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:35.220774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:35.220790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:35.220915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.220933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:35.221394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:35.221407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:35.221418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:35.221428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:35.221453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:35.222147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:35.222195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:35.222288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:35.222320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.222338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.222347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:35.222387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.222430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:35.222476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:35.225241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:35.225295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:35.225375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:35.227186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5ea534a-a93a96a0-676b6880-1bc6674b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:35.226413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 208 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0
2025-10-10T14:01:35.277093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:35.277154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:35.277196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.277329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:35.278413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:35.279228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:35.301264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0] Write session: try to update token
2025-10-10T14:01:35.301323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:35.315388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:35.322861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:35.324352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:35.326338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:35.326640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.326653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.326662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.326709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:35.403110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:35.403158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:35.403173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:35.403184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:35.403194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:35.403235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.403261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.403283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.403305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592964192322095:4176]
2025-10-10T14:01:35.403456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:35.403485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.403496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:35.404385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:35.404432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:35.404458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:35.404481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:35.404730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:35.420539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId: src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:35.440809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:35.551294Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:35.554549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:35.554603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:35.559257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:35.560271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:35.560301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:35.582625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:35.582693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0] Write session will restart in 0.007134s
2025-10-10T14:01:35.582843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0] Write session: Do CDS request
2025-10-10T14:01:35.582885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:35.581834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:35.581942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592965770238583:4447]
2025-10-10T14:01:35.581993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 208 reason: error at write: Disconnected sessionId: src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0
2025-10-10T14:01:35.582252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 208 sessionId: src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0 is DEAD
2025-10-10T14:01:35.600491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:35.600522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 209
2025-10-10T14:01:35.601399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:35.602025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:35.602162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:35.602184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:35.602194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:35.604144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 209 sessionId:  describe result for acl check
2025-10-10T14:01:35.604264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:35.604273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:35.604281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:35.604297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592965770238709:4512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:35.606593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592965770238709:4512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:35.618652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592965770238709:4512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:35.631996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592965770238709:4512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:35.632043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592965770238709:4512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:35.632061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592965770238709:4512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:35.632094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:35.683184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592965770238933:4447]
2025-10-10T14:01:35.692885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:35.696829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:35.697740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:35.697782Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:35.697831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:35.698122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:35.698314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592964192322378:4185]
2025-10-10T14:01:35.700445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:35.701632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:35.701879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:35.703066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:35.703383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:35.703392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:35.703398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:35.703404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:35.703411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:35.703417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:35.703422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:35.703429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:35.703435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.703441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.703448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.703454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.703500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:35.703601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:35.703644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:35.703690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:35.703733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:35.703776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:35.703820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:35.703865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:35.703905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.703950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.703994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.704037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.704077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:35.704137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:35.704192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:35.704244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:35.704289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:35.704343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:35.704387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:35.704440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:35.704483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:35.704534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:35.704577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:35.704644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:35.704690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:35.704740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:35.704781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:35.704832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:35.704875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.704923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.704963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.705011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.705054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.705103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.705548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.705611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.706055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:35.753851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:35.775172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:35.775232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:35.775248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:35.775266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:35.775288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 208 [2:7559592964192322378:4185]
2025-10-10T14:01:35.775337Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:35.775396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:35.775410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.775420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.775431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.775478Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:35.775499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:35.775520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:35.793163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.793203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.793214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.793225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.793234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:35.793509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:35.793525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.793662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:35.793828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:35.794042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:35.794150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:35.794225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:35.794237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:35.794249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:35.794261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:35.794301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:35.794375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:35.794532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:35.794550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:35.794677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:35.794696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:35.797623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 208
2025-10-10T14:01:35.797723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 208, pipe: [1:7559592965770238933:4447]
2025-10-10T14:01:35.797814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 208
2025-10-10T14:01:35.795522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:35.795549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:35.795560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:35.795570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:35.795593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:35.799114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592965770238778:4512], now have 1 active actors on pipe
2025-10-10T14:01:35.799154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592965770238933:4447], now have 1 active actors on pipe
2025-10-10T14:01:35.799174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592965770238695:2442], now have 1 active actors on pipe
2025-10-10T14:01:35.799216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:35.799237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:35.799329Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:35.799365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.799383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.799394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:35.799433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.799476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:35.799526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:35.802398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:35.802443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:35.802514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:35.802921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 209 partition: 0 MaxSeqNo: 36 sessionId: src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0
2025-10-10T14:01:35.803706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c4acf42-e166960d-ef54d02f-ba7d1177_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:35.845411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0] Write session: try to update token
2025-10-10T14:01:35.845466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:35.912810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.912859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.912871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.912968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:35.912988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:35.913003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:35.913013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:35.913024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:35.913077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:35.913108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:35.913156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:35.913185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:35.913296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:35.913335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:35.913361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:35.913401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:35.913418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:35.913446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:35.913465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:35.914604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:36.008261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId: src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:36.032996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:36.079795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:36.099738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:36.099763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:36.098940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:36.098998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:36.099064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:36.099076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:36.099118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592964192322372:4185]
2025-10-10T14:01:36.099318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:36.099653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:36.101343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592965770238933:4447]
2025-10-10T14:01:36.101480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:36.117692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 209 reason: error at write: Disconnected sessionId: src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0
2025-10-10T14:01:36.118006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 209 sessionId: src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0 is DEAD
2025-10-10T14:01:36.118367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:36.118444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0] Write session will restart in 0.009087s
2025-10-10T14:01:36.118673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0] Write session: Do CDS request
2025-10-10T14:01:36.118742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:36.136035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:36.136073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 210
2025-10-10T14:01:36.141972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:36.145270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:36.145427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:36.145445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:36.145456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:36.150323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 210 sessionId:  describe result for acl check
2025-10-10T14:01:36.150455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:36.150466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:36.150476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:36.150492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592970065206309:4523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:36.153271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592970065206309:4523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:36.163967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592970065206309:4523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:36.183142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592970065206309:4523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:36.183190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592970065206309:4523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:36.183208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592970065206309:4523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:36.183240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:36.201644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592970065206506:4447]
2025-10-10T14:01:36.222023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:36.230747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:36.231667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:36.231707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:36.231753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:36.232038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:36.232245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592968487289975:4195]
2025-10-10T14:01:36.234881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:36.236093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:36.236392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:36.237892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:36.238263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:36.238284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:36.238292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:36.238300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:36.238308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:36.238317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:36.238326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:36.238335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:36.238344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.238351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.238359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.238368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.238423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:36.238547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:36.238610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:36.238670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:36.238732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:36.238792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:36.238856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:36.238914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:36.238974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.239036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.239095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.239154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.239203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:36.239285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:36.239358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:36.239421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:36.239482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:36.239551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:36.239607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:36.239674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:36.239735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:36.239802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:36.239860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:36.239931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:36.240005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:36.240074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:36.240135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:36.240213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:36.240273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.240341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.240395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.240460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.240524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.240593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.240665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.240730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.241257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:36.285470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:36.309050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 209
2025-10-10T14:01:36.309163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 209, pipe: [1:7559592970065206506:4447]
2025-10-10T14:01:36.305831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:36.309261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 209
2025-10-10T14:01:36.305882Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:36.305897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:36.305915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:36.305936Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 209 [2:7559592968487289975:4195]
2025-10-10T14:01:36.305986Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:36.306057Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:36.306072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.306083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.306093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.306139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:36.306160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:36.306180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:36.308236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.308247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.308258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.308269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.308279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:36.308535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:36.308550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.308687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.308841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.309003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.309092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:36.309872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592970065206424:4523], now have 1 active actors on pipe
2025-10-10T14:01:36.309911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592970065206506:4447], now have 1 active actors on pipe
2025-10-10T14:01:36.309930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592970065206286:2442], now have 1 active actors on pipe
2025-10-10T14:01:36.309956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592968487289969:4195]
2025-10-10T14:01:36.309970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592968487289969:4195]
2025-10-10T14:01:36.309982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592968487289969:4195]
2025-10-10T14:01:36.309992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592968487289969:4195]
2025-10-10T14:01:36.310032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:36.310080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:36.310094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:36.310103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:36.310113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:36.310128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:36.310145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:36.310200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:36.310377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:36.310392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:36.310552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:36.310585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.310603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.310613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:36.310646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.310688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:36.310728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592968487289969:4195]
2025-10-10T14:01:36.310752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:36.310780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:36.310849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:36.317180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:36.317247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:36.317344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:36.319144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 210 partition: 0 MaxSeqNo: 36 sessionId: src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0
2025-10-10T14:01:36.320077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7529740-49f34bb9-7744cddb-f0e8214d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:36.346251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0] Write session: try to update token
2025-10-10T14:01:36.346316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:36.408443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.408487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.408501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.451641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:36.451679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:36.451688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:36.451695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:36.451702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:36.451729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592968487289969:4195]
2025-10-10T14:01:36.451748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592968487289969:4195]
2025-10-10T14:01:36.451761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592968487289969:4195]
2025-10-10T14:01:36.451775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592968487289969:4195]
2025-10-10T14:01:36.451893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:36.451900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:36.451915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.451921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:36.451934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:36.451970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:36.451999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:36.460250Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:36.490927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId: src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:36.520940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:36.621651Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:36.623569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:36.623601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:36.626968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:36.625640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:36.625895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:36.625919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:36.626674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592970065206506:4447]
2025-10-10T14:01:36.668926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:36.668996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0] Write session will restart in 0.005703s
2025-10-10T14:01:36.669171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0] Write session: Do CDS request
2025-10-10T14:01:36.669201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:36.666168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 210 reason: error at write: Disconnected sessionId: src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0
2025-10-10T14:01:36.666457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 210 sessionId: src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0 is DEAD
2025-10-10T14:01:36.679593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:36.683856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:36.683889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 211
2025-10-10T14:01:36.684284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:36.684453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:36.684475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:36.684494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:36.686214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 211 sessionId:  describe result for acl check
2025-10-10T14:01:36.686330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:36.686346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:36.686355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:36.686372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592970065206609:4528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:36.688862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592970065206609:4528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:36.697381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592970065206609:4528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:36.714242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592970065206609:4528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:36.714289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592970065206609:4528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:36.714306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592970065206609:4528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:36.714340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:36.727086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592970065206812:4447]
2025-10-10T14:01:36.737657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:36.744282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:36.745196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:36.745222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:36.745255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:36.745448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:36.745634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592968487290240:4198]
2025-10-10T14:01:36.747147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:36.749420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:36.749581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:36.750606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:36.750843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:36.750848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:36.750852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:36.750856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:36.750860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:36.750865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:36.750869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:36.750873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:36.750877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.750882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.750886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.750890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.750921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:36.750995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:36.751026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:36.751065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:36.751101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:36.751133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:36.751169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:36.751211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:36.751242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.751273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.751304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.751335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.751359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:36.751404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:36.751443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:36.751478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:36.751509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:36.751543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:36.751616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:36.751659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:36.751702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:36.751746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:36.751776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:36.751809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:36.751837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:36.751872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:36.751900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:36.751934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:36.751969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.752017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.752059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.752105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.752150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.752197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.752237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.752271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.752560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:36.772814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:36.793096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:36.793164Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:36.793179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:36.793198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:36.793221Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 210 [2:7559592968487290240:4198]
2025-10-10T14:01:36.793273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:36.793334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:36.793348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.793358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.793368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.793416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:36.793440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:36.793461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:36.794736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.794768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.794780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.794794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.794804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:36.795076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:36.795093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.795448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:36.795630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:36.795843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:36.795951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:36.796040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592970065206812:4447], now have 1 active actors on pipe
2025-10-10T14:01:36.796062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592970065206757:4528], now have 1 active actors on pipe
2025-10-10T14:01:36.796082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592970065206558:2442], now have 1 active actors on pipe
2025-10-10T14:01:36.796102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:36.796111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:36.796120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:36.796129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:36.796158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:36.796214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:36.796224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:36.796239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:36.796250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:36.796263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:36.796353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:36.796371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:36.796468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:36.796479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:36.796641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:36.797780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 210, pipe: [1:7559592970065206812:4447]
2025-10-10T14:01:36.797811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 210
2025-10-10T14:01:36.797886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 210
2025-10-10T14:01:36.798156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:36.798213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:36.798309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:36.798350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.798373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.798384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:36.798424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.798475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:36.798520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:36.799999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:36.800034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:36.800108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:36.800541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 211 partition: 0 MaxSeqNo: 36 sessionId: src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0
2025-10-10T14:01:36.805432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc1ad93-655a2504-2c136976-f935a7b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:36.857361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0] Write session: try to update token
2025-10-10T14:01:36.857417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:36.912145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:36.917999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:36.918052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:36.918064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:36.918074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:36.918113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:36.918140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:36.918164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:36.918184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:36.918326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:36.918374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:36.918404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:36.918417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.918431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.918438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:36.918443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.918491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:36.918517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:36.918529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:36.919585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:36.989221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId: src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:37.013897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:37.110065Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:37.131242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:37.131310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:37.131379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:37.131393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:37.131433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592968487290235:4198]
2025-10-10T14:01:37.131950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:37.133818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:37.136006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592970065206812:4447]
2025-10-10T14:01:37.136164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:37.145794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 211 reason: status is not ok: tablet will be restarted right now sessionId: src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0
2025-10-10T14:01:37.146141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 211 sessionId: src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0 is DEAD
2025-10-10T14:01:37.149789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:37.149864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0] Write session will restart in 0.009858s
2025-10-10T14:01:37.150097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0] Write session: Do CDS request
2025-10-10T14:01:37.150193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:37.155482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:37.180325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:37.180357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 212
2025-10-10T14:01:37.181803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:37.185415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:37.185561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:37.185576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:37.185585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:37.186922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 212 sessionId:  describe result for acl check
2025-10-10T14:01:37.187031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:37.187048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:37.187057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:37.187073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592974360174173:4541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:37.190149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592974360174173:4541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:37.199516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592974360174173:4541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:37.207009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592974360174173:4541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:37.207050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592974360174173:4541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:37.207065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592974360174173:4541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:37.207093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:37.235619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592974360174211:4447]
2025-10-10T14:01:37.351585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:37.362215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:37.363039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:37.363055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:37.363100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:37.363434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:37.363611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592972782257826:4207]
2025-10-10T14:01:37.365931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:37.369807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:37.370095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:37.371388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:37.371778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:37.371785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:37.371792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:37.371799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:37.371806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:37.371812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:37.371819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:37.371826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:37.371832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:37.371839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:37.371846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:37.371853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:37.371899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:37.371996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:37.372042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:37.372085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:37.372127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:37.372173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:37.372216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:37.372256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:37.372299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:37.372343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:37.372386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:37.372428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:37.372465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:37.372527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:37.372583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:37.372653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:37.372698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:37.372751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:37.372794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:37.372845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:37.372889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:37.372941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:37.372983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:37.373034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:37.373077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:37.373160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:37.373206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:37.373256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:37.373302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:37.373350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:37.373395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:37.373443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:37.373489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:37.373540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:37.373580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:37.373633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:37.374090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:37.409315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:37.424742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:37.424793Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:37.424806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:37.424822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:37.424845Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 211 [2:7559592972782257826:4207]
2025-10-10T14:01:37.424892Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:37.424950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:37.424962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.424973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.424984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.425029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:37.425049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:37.425068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:37.432222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 211
2025-10-10T14:01:37.432333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 211
2025-10-10T14:01:37.432396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 211, pipe: [1:7559592974360174211:4447]
2025-10-10T14:01:37.430817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:37.430850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:37.430862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:37.430872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:37.430883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:37.431124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:37.431139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:37.431258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:37.431402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:37.431601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:37.431701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:37.431777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592974360174202:4541], now have 1 active actors on pipe
2025-10-10T14:01:37.431798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592974360174161:2442], now have 1 active actors on pipe
2025-10-10T14:01:37.431819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592974360174211:4447], now have 1 active actors on pipe
2025-10-10T14:01:37.431842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.431856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.431868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.431881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.431921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:37.431969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:37.431986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:37.431995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:37.431997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:37.432007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:37.432146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:37.432161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:37.432274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.432291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:37.432308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:37.434722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:37.434749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:37.434843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:37.434880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.434898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.434908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:37.434943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.434990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:37.435038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:37.440129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:37.440184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:37.440267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:37.442298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 212 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0
2025-10-10T14:01:37.443985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adf514db-7af759fd-c79cb9f3-2a3f28af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:37.504923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:37.504971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:37.505008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.505147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:37.505162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:37.519053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0] Write session: try to update token
2025-10-10T14:01:37.519113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:37.526757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:37.527785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:37.533953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:37.535258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:37.543216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:37.543697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.543712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.543723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.543785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:37.643382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.643420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.643440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.702798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId: src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:37.768084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:37.787041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.787087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.787098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.787154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:37.787169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:37.787181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:37.787192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:37.787203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:37.787242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.787265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.787286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.787305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592972782257820:4207]
2025-10-10T14:01:37.787489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:37.787526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:37.787561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:37.787596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:37.787611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:37.788685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:37.789353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:37.789402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:37.789433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:37.789460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:37.960715Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:37.963460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:37.964895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:37.964942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:37.965378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:37.965564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592974360174211:4447]
2025-10-10T14:01:37.993600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 212 reason: error at write: Disconnected sessionId: src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0
2025-10-10T14:01:37.993921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 212 sessionId: src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0 is DEAD
2025-10-10T14:01:37.997548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:37.997582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0] Write session will restart in 0.006652s
2025-10-10T14:01:37.997672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0] Write session: Do CDS request
2025-10-10T14:01:37.997699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:38.008338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:38.009036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:38.009061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 213
2025-10-10T14:01:38.009558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:38.009639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:38.009648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:38.009655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:38.014274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 213 sessionId:  describe result for acl check
2025-10-10T14:01:38.014394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:38.014406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:38.014414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:38.014430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592978655141771:4549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:38.016910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592978655141771:4549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:38.042601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592978655141771:4549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:38.065096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592978655141771:4549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:38.065161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592978655141771:4549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:38.065177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592978655141771:4549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:38.065211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:38.065830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592978655141883:4447]
2025-10-10T14:01:38.144347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:38.154181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:38.155075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:38.155115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:38.155160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:38.155435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:38.155637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592977077225431:4217]
2025-10-10T14:01:38.158102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:38.159212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:38.159448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:38.160777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:38.161111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:38.161143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:38.161153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:38.161161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:38.161170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:38.161183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:38.161190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:38.161198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:38.161207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.161215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.161223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.161231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.161283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:38.161406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:38.161471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:38.161532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:38.161596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:38.161657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:38.162038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:38.162103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:38.162170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.162231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.162296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.162351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.162408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:38.162482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:38.162546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:38.162618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:38.162681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:38.162748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:38.162805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:38.162871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:38.162941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:38.162999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:38.163050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:38.163111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:38.163164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:38.163225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:38.163278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:38.163335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:38.163387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.163445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.163497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.163556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.163605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.163662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.163711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.163768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.164251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:38.198223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:38.221502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:38.221566Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:38.221586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:38.221609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:38.221637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 212 [2:7559592977077225431:4217]
2025-10-10T14:01:38.221698Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:38.221759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:38.221776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.221788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.221801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.221852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:38.221875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:38.221901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:38.263512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.263559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.263571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.263583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.263595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:38.263879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:38.263896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.264044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.264231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.264450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.264567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:38.264631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592977077225425:4217]
2025-10-10T14:01:38.264646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592977077225425:4217]
2025-10-10T14:01:38.264674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592977077225425:4217]
2025-10-10T14:01:38.264688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592977077225425:4217]
2025-10-10T14:01:38.264730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:38.264809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:38.264902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:38.264918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:38.264929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:38.264940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:38.264998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:38.265016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:38.265993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592977077225425:4217]
2025-10-10T14:01:38.266055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:38.266167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592978655141882:4549], now have 1 active actors on pipe
2025-10-10T14:01:38.266182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:38.266193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592978655141883:4447], now have 1 active actors on pipe
2025-10-10T14:01:38.266218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592974360174458:2442], now have 1 active actors on pipe
2025-10-10T14:01:38.268025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 212
2025-10-10T14:01:38.268120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 212, pipe: [1:7559592978655141883:4447]
2025-10-10T14:01:38.268191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 212
2025-10-10T14:01:38.272011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:38.272064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:38.272147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:38.272182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.272200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.272210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:38.272250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.272294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:38.272335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:38.274512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:38.274575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:38.274665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:38.275460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 213 partition: 0 MaxSeqNo: 36 sessionId: src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0
2025-10-10T14:01:38.276289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9834da-f59b9295-2f5f445c-bfc5b82e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:38.323518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.323575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.323587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.333518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0] Write session: try to update token
2025-10-10T14:01:38.333573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:38.381418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:38.381464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:38.381478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:38.381488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:38.381499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:38.381537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592977077225425:4217]
2025-10-10T14:01:38.381563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592977077225425:4217]
2025-10-10T14:01:38.381587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592977077225425:4217]
2025-10-10T14:01:38.381608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592977077225425:4217]
2025-10-10T14:01:38.381759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:38.381787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.381799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:38.382206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:38.382248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:38.382275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:38.382299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:38.383487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:38.512450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId: src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:38.541713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:38.590171Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:38.592185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:38.592230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:38.598318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:38.598350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:38.598641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:38.598879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592978655141883:4447]
2025-10-10T14:01:38.606798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:38.608932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:38.608992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0] Write session will restart in 0.006080s
2025-10-10T14:01:38.608096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 213 reason: error at write: Disconnected sessionId: src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0
2025-10-10T14:01:38.609216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0] Write session: Do CDS request
2025-10-10T14:01:38.608441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 213 sessionId: src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0 is DEAD
2025-10-10T14:01:38.609277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:38.624025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:38.624059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 214
2025-10-10T14:01:38.626236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:38.629289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:38.629436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:38.629459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:38.629469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:38.631745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 214 sessionId:  describe result for acl check
2025-10-10T14:01:38.631867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:38.631883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:38.631891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:38.631908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592978655142053:4555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:38.634824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592978655142053:4555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:38.641779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592978655142053:4555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:38.651247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592978655142053:4555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:38.651288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592978655142053:4555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:38.651304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592978655142053:4555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:38.651333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:38.699677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592978655142229:4447]
2025-10-10T14:01:38.728517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:38.740076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:38.740959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:38.740977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:38.741022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:38.741290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:38.741469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592977077225699:4221]
2025-10-10T14:01:38.743644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:38.748726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:38.748973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:38.750335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:38.750662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:38.750670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:38.750675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:38.750680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:38.750692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:38.750697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:38.750703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:38.750708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:38.750714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.750719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.750724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.750729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.750774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:38.750872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:38.750916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:38.750958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:38.751001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:38.751044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:38.751085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:38.751125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:38.751166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.751213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.751257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.751297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.751332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:38.751391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:38.751446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:38.751497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:38.751543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:38.751591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:38.751633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:38.751680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:38.751744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:38.751793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:38.751831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:38.751876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:38.751919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:38.751963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:38.752010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:38.752059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:38.752103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.752150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.752190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.752237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.752280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.752327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.752367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.752411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.752830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:38.796907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:38.812525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:38.812580Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:38.812592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:38.812608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:38.812630Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 213 [2:7559592977077225699:4221]
2025-10-10T14:01:38.812688Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:38.812744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:38.812757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.812768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.812777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.812825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:38.812844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:38.812865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:38.815907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.815943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.815956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.815968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.815978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:38.816241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:38.816257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:38.816378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:38.816531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:38.816741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:38.816839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:38.816906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:38.816921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:38.816933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:38.816945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:38.816975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:38.817054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:38.817498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:38.817521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:38.817534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:38.817544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:38.817900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 213, pipe: [1:7559592978655142229:4447]
2025-10-10T14:01:38.817748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:38.817993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 213
2025-10-10T14:01:38.817772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:38.818073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 213
2025-10-10T14:01:38.817920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592978655142086:4555], now have 1 active actors on pipe
2025-10-10T14:01:38.817940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592978655142229:4447], now have 1 active actors on pipe
2025-10-10T14:01:38.817957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592978655142041:2442], now have 1 active actors on pipe
2025-10-10T14:01:38.817976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:38.818002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:38.818315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:38.819106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:38.819135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:38.819204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:38.819233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.819250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.819393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:38.819435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.819478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:38.819520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:38.825232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:38.825279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:38.825366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:38.825837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 214 partition: 0 MaxSeqNo: 36 sessionId: src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0
2025-10-10T14:01:38.829646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3daf134f-a280ca4c-da15f08a-4090ce7f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:38.922342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0] Write session: try to update token
2025-10-10T14:01:38.922396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:39.052864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:39.052906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:39.052919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:39.052929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:39.052939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:39.052972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:39.052994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:39.053015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:39.053034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:39.053161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:39.053191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:39.053207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.053216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:39.053218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.053228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.053240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:39.053322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:39.053346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:39.053357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:39.054317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:39.103016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId: src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:39.133486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:39.272516Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:39.286654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:39.286709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:39.286773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:39.286787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:39.286826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592977077225693:4221]
2025-10-10T14:01:39.290502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:39.290531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:39.289251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:39.291116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592978655142229:4447]
2025-10-10T14:01:39.291309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:39.291205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:39.334957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 214 reason: error at write: Disconnected sessionId: src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0
2025-10-10T14:01:39.345548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:39.345590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0] Write session will restart in 0.005093s
2025-10-10T14:01:39.341431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 214 sessionId: src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0 is DEAD
2025-10-10T14:01:39.345681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0] Write session: Do CDS request
2025-10-10T14:01:39.345708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:39.358377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:39.357404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:39.357436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 215
2025-10-10T14:01:39.358925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:39.359040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:39.359054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:39.359064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:39.360365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 215 sessionId:  describe result for acl check
2025-10-10T14:01:39.360471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:39.360481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:39.360488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:39.360503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592982950109680:4571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:39.363082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592982950109680:4571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:39.392421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592982950109716:4447]
2025-10-10T14:01:39.395978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592982950109680:4571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:39.410843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592982950109680:4571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:39.410887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592982950109680:4571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:39.410902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592982950109680:4571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:39.410936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:39.460794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:39.467329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:39.468206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:39.468236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:39.468281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:39.468525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:39.468720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592981372193318:4232]
2025-10-10T14:01:39.470829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:39.471943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:39.472151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:39.473401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:39.473674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:39.473681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:39.473687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:39.473693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:39.473699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:39.473705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:39.473711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:39.473718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:39.473722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:39.473728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:39.473733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:39.473738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:39.473780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:39.473878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:39.473922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:39.473971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:39.474012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:39.474053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:39.474095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:39.474136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:39.474175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:39.474215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:39.474253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:39.474293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:39.474329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:39.474409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:39.474462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:39.474508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:39.474552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:39.474599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:39.474637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:39.474680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:39.474751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:39.474802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:39.474843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:39.474889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:39.474928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:39.474975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:39.475011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:39.475058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:39.475100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:39.475146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:39.475182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:39.475229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:39.475271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:39.475316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:39.475381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:39.475431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:39.475844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:39.500241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:39.557937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:39.557992Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:39.558008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:39.558029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:39.558056Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 214 [2:7559592981372193318:4232]
2025-10-10T14:01:39.558112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:39.558169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:39.558186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.558198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.558208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.558255Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:39.558277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:39.558300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:39.559743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:39.559769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:39.559782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:39.559796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:39.559807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:39.560066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:39.560081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:39.560213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:39.560386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:39.560599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:39.560723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:39.560793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.560806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.560818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.560830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.560871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:39.560940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:39.561097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:39.561111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:39.561254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:39.561266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:39.561278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:39.561287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:39.561694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.561718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:39.561767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592982950109664:2442], now have 1 active actors on pipe
2025-10-10T14:01:39.561789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592982950109767:4571], now have 1 active actors on pipe
2025-10-10T14:01:39.561808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592982950109716:4447], now have 1 active actors on pipe
2025-10-10T14:01:39.561931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:39.563559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:39.563593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:39.563675Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:39.563707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.563724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.563734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:39.563766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.563808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:39.563853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:39.563078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 214
2025-10-10T14:01:39.563187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 214
2025-10-10T14:01:39.563244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 214, pipe: [1:7559592982950109716:4447]
2025-10-10T14:01:39.573256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:39.573312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:39.573404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:39.576631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 215 partition: 0 MaxSeqNo: 36 sessionId: src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0
2025-10-10T14:01:39.578866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f2ca67-2bd7e33-8606300f-ba9b37ea_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:39.611352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0] Write session: try to update token
2025-10-10T14:01:39.611399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:39.732900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:39.733318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:39.733338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:39.733347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:39.733356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:39.733391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.733417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.733436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.733456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.733621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.733633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.733643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.733866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:39.733894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:39.733918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:39.733943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:39.766056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId: src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:39.767783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:39.767853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:39.767864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:39.768967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:39.799891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:39.915501Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:39.942002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:39.942047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:39.942087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592981372193313:4232]
2025-10-10T14:01:39.942233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:39.942265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:39.942280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:39.942622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:39.942687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592982950109716:4447]
2025-10-10T14:01:39.942752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:39.942762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:39.943178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:39.972662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 215 reason: error at write: Disconnected sessionId: src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0
2025-10-10T14:01:39.973022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 215 sessionId: src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0 is DEAD
2025-10-10T14:01:39.977337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:39.977375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0] Write session will restart in 0.008955s
2025-10-10T14:01:39.977480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0] Write session: Do CDS request
2025-10-10T14:01:39.977508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:39.997278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:39.997314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 216
2025-10-10T14:01:39.997900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:40.001571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:40.001726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:40.001742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:40.001754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:40.003443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 216 sessionId:  describe result for acl check
2025-10-10T14:01:40.003571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:40.003581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:40.003590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:40.003606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592987245077263:4576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:40.006201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592987245077263:4576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:40.011375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592987245077263:4576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:40.023265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592987245077263:4576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:40.023317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592987245077263:4576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:40.023334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592987245077263:4576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:40.023371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:40.045141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592987245077354:4447]
2025-10-10T14:01:40.126035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:40.130549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:40.131450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:40.131477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:40.131522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:40.131784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:40.131975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592985667160884:4240]
2025-10-10T14:01:40.137726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:40.138819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:40.139054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:40.140221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:40.140515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:40.140523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:40.140530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:40.140537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:40.140542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:40.140548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:40.140555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:40.140561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:40.140567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.140574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.140580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.140588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.140633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:40.140755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:40.140803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:40.140847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:40.140891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:40.140935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:40.140980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:40.141023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:40.141066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.141112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.141174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.141220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.141260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:40.141320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:40.141375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:40.141427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:40.141472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:40.141523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:40.141568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:40.141621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:40.141668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:40.141718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:40.141761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:40.141810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:40.141853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:40.141905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:40.141948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:40.142006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:40.142053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.142104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.142146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.142200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.142246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.142296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.142340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.143845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.144294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:40.167784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:40.186017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:40.186069Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:40.186086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:40.186106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:40.186135Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 215 [2:7559592985667160884:4240]
2025-10-10T14:01:40.186196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:40.186264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:40.186280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.186294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.186304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.186367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:40.186392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:40.186415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:40.187926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.187943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.187956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.187970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.187981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:40.188624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 215, pipe: [1:7559592987245077354:4447]
2025-10-10T14:01:40.188728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 215
2025-10-10T14:01:40.188778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 215
2025-10-10T14:01:40.188886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:40.188921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.189057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.189264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.189496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.189603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:40.189685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592987245077354:4447], now have 1 active actors on pipe
2025-10-10T14:01:40.189708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592987245077311:4576], now have 1 active actors on pipe
2025-10-10T14:01:40.189730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592982950109946:2442], now have 1 active actors on pipe
2025-10-10T14:01:40.190075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:40.190115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:40.190174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592985667160878:4240]
2025-10-10T14:01:40.190195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592985667160878:4240]
2025-10-10T14:01:40.190207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592985667160878:4240]
2025-10-10T14:01:40.190219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592985667160878:4240]
2025-10-10T14:01:40.190258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:40.190351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:40.190369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:40.190382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:40.190392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:40.191425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:40.191616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:40.191634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:40.191697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de569a73-157508fd-bf6527dd-c6273b66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:40.191739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.191761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.191771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:40.191808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.191857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:40.192019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592985667160878:4240]
2025-10-10T14:01:40.192070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:40.192115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:40.192191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:40.194860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 216 partition: 0 MaxSeqNo: 36 sessionId: src_id|de569a73-157508fd-bf6527dd-c6273b66_0
2025-10-10T14:01:40.194292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:40.194328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:40.194396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:40.196919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50d4dbca-2407b693-49cc54e0-ab1b86aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de569a73-157508fd-bf6527dd-c6273b66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:40.248009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de569a73-157508fd-bf6527dd-c6273b66_0] Write session: try to update token
2025-10-10T14:01:40.248070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de569a73-157508fd-bf6527dd-c6273b66_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:40.351745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.351786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.351797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.351851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:40.351864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:40.351878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:40.351889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:40.351899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:40.351933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592985667160878:4240]
2025-10-10T14:01:40.351957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592985667160878:4240]
2025-10-10T14:01:40.351980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592985667160878:4240]
2025-10-10T14:01:40.351999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592985667160878:4240]
2025-10-10T14:01:40.352134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:40.352160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.352171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:40.353241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:40.353275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:40.353302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:40.353327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:40.359741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:40.475675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId: src_id|de569a73-157508fd-bf6527dd-c6273b66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:40.520150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:40.565900Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:40.568672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:40.568714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:40.573407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592987245077354:4447]
2025-10-10T14:01:40.573509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:40.573520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:40.583163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:40.603297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 216 reason: error at write: Disconnected sessionId: src_id|de569a73-157508fd-bf6527dd-c6273b66_0
2025-10-10T14:01:40.603683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 216 sessionId: src_id|de569a73-157508fd-bf6527dd-c6273b66_0 is DEAD
2025-10-10T14:01:40.606930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de569a73-157508fd-bf6527dd-c6273b66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:40.606959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de569a73-157508fd-bf6527dd-c6273b66_0] Write session will restart in 0.009375s
2025-10-10T14:01:40.607048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de569a73-157508fd-bf6527dd-c6273b66_0] Write session: Do CDS request
2025-10-10T14:01:40.607075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de569a73-157508fd-bf6527dd-c6273b66_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:40.619080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:40.626208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:40.626238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 217
2025-10-10T14:01:40.629031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de569a73-157508fd-bf6527dd-c6273b66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:40.631552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:40.631687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:40.631702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:40.631712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:40.633193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 217 sessionId:  describe result for acl check
2025-10-10T14:01:40.633304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:40.633314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:40.633322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:40.633338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592987245077565:4588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:40.635690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592987245077565:4588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:40.676499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592987245077622:4447]
2025-10-10T14:01:40.678329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592987245077565:4588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:40.701170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592987245077565:4588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:40.701218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592987245077565:4588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:40.701235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592987245077565:4588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:40.701268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:40.758568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:40.764612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:40.765755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:40.765792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:40.765838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:40.766118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:40.766361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592985667161181:4250]
2025-10-10T14:01:40.768682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:40.774572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:40.774867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:40.776235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:40.776576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:40.776584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:40.776592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:40.776600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:40.776607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:40.776614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:40.776622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:40.776629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:40.776636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.776643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.776650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.776657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.776726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:40.776843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:40.776895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:40.776946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:40.776994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:40.777043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:40.777091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:40.777165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:40.777216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.777271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.777318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.777366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.777411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:40.777481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:40.777541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:40.777603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:40.777658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:40.777716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:40.777764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:40.777822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:40.777877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:40.777935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:40.777986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:40.778043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:40.778091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:40.778147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:40.778196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:40.778257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:40.778307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.778366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.778413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.778470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.778519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.778574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.778620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.778675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.779140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:40.826532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:40.866869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:40.866928Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:40.866946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:40.866965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:40.866987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 216 [2:7559592985667161181:4250]
2025-10-10T14:01:40.867042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:40.867098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:40.867113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.867125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.867137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.867182Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:40.867203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:40.867225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:40.870002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.870041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.870057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.870070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.870082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:40.870377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:40.870395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:40.870539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:40.870751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:40.871025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:40.871165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:40.871241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:40.871258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:40.871272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:40.871286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:40.871332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:40.871413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:40.871454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:40.871468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:40.871480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:40.871492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:40.871602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:40.871617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:40.871741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:40.871762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:40.871797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:40.871861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592987245077712:4588], now have 1 active actors on pipe
2025-10-10T14:01:40.871898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592987245077622:4447], now have 1 active actors on pipe
2025-10-10T14:01:40.871923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592987245077558:2442], now have 1 active actors on pipe
2025-10-10T14:01:40.872908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 216
2025-10-10T14:01:40.872983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 216, pipe: [1:7559592987245077622:4447]
2025-10-10T14:01:40.873049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 216
2025-10-10T14:01:40.877521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:40.877577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:40.877677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c9781b5-acc33620-708b1961-bfc3078e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:40.877711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.877729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.877740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:40.877777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.877819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:40.877872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:40.880280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:40.880331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:40.880407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:40.880769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 217 partition: 0 MaxSeqNo: 36 sessionId: src_id|2c9781b5-acc33620-708b1961-bfc3078e_0
2025-10-10T14:01:40.882873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de569a73-157508fd-bf6527dd-c6273b66_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2c9781b5-acc33620-708b1961-bfc3078e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:40.916211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c9781b5-acc33620-708b1961-bfc3078e_0] Write session: try to update token
2025-10-10T14:01:40.916271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c9781b5-acc33620-708b1961-bfc3078e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:41.022538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:41.022587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:41.022601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:41.022615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:41.022628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:41.022666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:41.022694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:41.022720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:41.022746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:41.022931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.022956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.022968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.023067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:41.023101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:41.023113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:41.023520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:41.023563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:41.023593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:41.023624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:41.026046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:41.044699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId: src_id|2c9781b5-acc33620-708b1961-bfc3078e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:41.069978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:41.173585Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:41.198040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:41.198094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:41.198160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:41.198173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:41.198208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592985667161175:4250]
2025-10-10T14:01:41.198546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:41.198863Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:41.199872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:41.199908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:41.201113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592987245077622:4447]
2025-10-10T14:01:41.201252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:41.212842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 217 reason: error at write: Disconnected sessionId: src_id|2c9781b5-acc33620-708b1961-bfc3078e_0
2025-10-10T14:01:41.213220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 217 sessionId: src_id|2c9781b5-acc33620-708b1961-bfc3078e_0 is DEAD
2025-10-10T14:01:41.214630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c9781b5-acc33620-708b1961-bfc3078e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:41.214680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c9781b5-acc33620-708b1961-bfc3078e_0] Write session will restart in 0.006850s
2025-10-10T14:01:41.214825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c9781b5-acc33620-708b1961-bfc3078e_0] Write session: Do CDS request
2025-10-10T14:01:41.214869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c9781b5-acc33620-708b1961-bfc3078e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:41.233658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c9781b5-acc33620-708b1961-bfc3078e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:41.233953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:41.233991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 218
2025-10-10T14:01:41.237871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:41.238027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:41.238043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:41.238053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:41.242201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 218 sessionId:  describe result for acl check
2025-10-10T14:01:41.242336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:41.242347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:41.242357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:41.242373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592991540045171:4599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:41.244978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592991540045171:4599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:41.259408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592991540045171:4599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:41.270488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592991540045171:4599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:41.270534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592991540045171:4599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:41.270551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592991540045171:4599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:41.270582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:41.300127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592991540045297:4447]
2025-10-10T14:01:41.326620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:41.335877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:41.337108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:41.337151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:41.337209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:41.337490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:41.337669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592989962128780:4259]
2025-10-10T14:01:41.339810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:41.341110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:41.341353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:41.342545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:41.342836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:41.342843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:41.342849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:41.342856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:41.342863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:41.342870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:41.342877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:41.342884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:41.342889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:41.342895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:41.342903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:41.342910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:41.342954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:41.343059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:41.343106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:41.343150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:41.343196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:41.343241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:41.343285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:41.343326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:41.343371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:41.343417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:41.343460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:41.343504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:41.343542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:41.343602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:41.343658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:41.343714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:41.343801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:41.343856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:41.343901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:41.343953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:41.344002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:41.344055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:41.344099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:41.344152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:41.344198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:41.344248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:41.344294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:41.344345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:41.344391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:41.344442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:41.344503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:41.344558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:41.344604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:41.344656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:41.344699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:41.344768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:41.348940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:41.413105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:41.430740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:41.430798Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:41.430815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:41.430834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:41.430856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 217 [2:7559592989962128780:4259]
2025-10-10T14:01:41.430912Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:41.430975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:41.430989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.431002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.431014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.431061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:41.431080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:41.431103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:41.432430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:41.432445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:41.432458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:41.432470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:41.432480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:41.432768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:41.432785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:41.432918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:41.433093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:41.433776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 217
2025-10-10T14:01:41.433879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 217
2025-10-10T14:01:41.433962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 217, pipe: [1:7559592991540045297:4447]
2025-10-10T14:01:41.434249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:41.434392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:41.434482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592991540045297:4447], now have 1 active actors on pipe
2025-10-10T14:01:41.434507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592991540045211:4599], now have 1 active actors on pipe
2025-10-10T14:01:41.434528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592991540045159:2442], now have 1 active actors on pipe
2025-10-10T14:01:41.434552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.434568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.434582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.437272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 218 partition: 0 MaxSeqNo: 36 sessionId: src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0
2025-10-10T14:01:41.437999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c9781b5-acc33620-708b1961-bfc3078e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:41.434595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.434640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:41.434723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:41.434917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:41.434936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:41.435071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.435091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:41.435121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:41.435149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:41.435161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:41.435173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:41.435199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:41.435575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:41.435596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:41.435677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:41.435708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.435725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.435735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:41.435770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.435810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:41.435852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:41.436564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:41.436594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:41.436654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:41.472583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0] Write session: try to update token
2025-10-10T14:01:41.472660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:41.492070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:41.492114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:41.492159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.492289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:41.492445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:41.496157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:41.503250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:41.513592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:41.522097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:41.529699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:41.595174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.595206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.595213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.595307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:41.647123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:41.647169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:41.647184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:41.647196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:41.647208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:41.647252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.647279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.647301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.647322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592989962128769:4259]
2025-10-10T14:01:41.647471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:41.647486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:41.647504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:41.647515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:41.647527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:41.647542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:41.647578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:41.648655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:41.679962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId: src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0 grpc read done: success: 1 data:  write_request[data omitted]
E1010 14:01:41.686804932  112399 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:01:41.712248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:41.832416Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:41.834745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:41.834792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:41.841991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:41.842928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:41.843100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592991540045297:4447]
2025-10-10T14:01:41.843181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:41.843199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:41.851720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 218 reason: error at write: Disconnected sessionId: src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0
2025-10-10T14:01:41.853024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:41.852150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 218 sessionId: src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0 is DEAD
2025-10-10T14:01:41.854612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0] Write session will restart in 0.005971s
2025-10-10T14:01:41.854731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0] Write session: Do CDS request
2025-10-10T14:01:41.854764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:41.878477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:41.878219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:41.878273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 219
2025-10-10T14:01:41.881892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:41.882050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:41.882066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:41.882076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:41.885314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 219 sessionId:  describe result for acl check
2025-10-10T14:01:41.885445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:41.885456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:41.885470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:41.885492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592991540045467:4604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:41.887944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592991540045467:4604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:41.910396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592991540045467:4604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:41.925515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592991540045467:4604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:41.925562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592991540045467:4604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:41.925580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592991540045467:4604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:41.925612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:41.943198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592991540045563:4447]
2025-10-10T14:01:42.024819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:42.027194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:42.027980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:42.028019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:42.028062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:42.028302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:42.028473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592994257096357:4263]
2025-10-10T14:01:42.030540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:42.031629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:42.031830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:42.032961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:42.033276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:42.033284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:42.033290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:42.033297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:42.033303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:42.033309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:42.033316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:42.033321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:42.033327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.033333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.033339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.033344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.033388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:42.033478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:42.033522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:42.033563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:42.033602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:42.033641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:42.033679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:42.033720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:42.033762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.033805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.033844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.033882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.033918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:42.033976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:42.034027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:42.034072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:42.034114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:42.034160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:42.035675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:42.035754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:42.035911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:42.035966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:42.036008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:42.036055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:42.036102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:42.036147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:42.036188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:42.036238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:42.036284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.036329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.036371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.036420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.036463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.036514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.036554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.036601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.037011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:42.079741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:42.100418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:42.100473Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:42.100486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:42.100502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:42.100523Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 218 [2:7559592994257096357:4263]
2025-10-10T14:01:42.100568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:42.100619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:42.100631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.100642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.100652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.100698Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:42.100719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:42.100773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:42.103763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.103777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.103788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.103799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.103808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:42.105355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 218
2025-10-10T14:01:42.105493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 218
2025-10-10T14:01:42.105564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 218, pipe: [1:7559592991540045563:4447]
2025-10-10T14:01:42.104861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:42.104898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.105013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.105159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.105316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.105400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:42.105441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592991540045451:2442], now have 1 active actors on pipe
2025-10-10T14:01:42.105464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592991540045518:4604], now have 1 active actors on pipe
2025-10-10T14:01:42.105480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592991540045563:4447], now have 1 active actors on pipe
2025-10-10T14:01:42.105543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.105555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.105566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.105577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.105604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:42.105667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:42.105718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:42.105733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:42.105743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:42.105753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:42.105804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:42.105817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:42.105974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:42.105990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:42.106024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.106053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:42.106201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:42.106232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.106247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.106256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:42.106288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.106329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:42.106401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:42.106543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:42.107695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:42.107724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:42.107782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:42.108130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 219 partition: 0 MaxSeqNo: 36 sessionId: src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0
2025-10-10T14:01:42.109108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ed5b1a9-2e3da8dd-7bb0d911-9602d645_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:42.144201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0] Write session: try to update token
2025-10-10T14:01:42.144257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:42.332231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.332268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.332277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.332322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:42.332336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:42.332349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:42.332358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:42.332367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:42.332400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.332423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.332443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.332461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.332605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:42.332635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:42.332657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:42.332663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:42.332679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.332688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:42.332690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:42.334213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:42.352093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId: src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:42.385889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:42.485880Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:42.508371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:42.506194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:42.506234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:42.506284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:42.506299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:42.506331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592994257096352:4263]
2025-10-10T14:01:42.506729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:42.506737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:42.509845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592991540045563:4447]
2025-10-10T14:01:42.510026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:42.517394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:42.517476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0] Write session will restart in 0.008080s
2025-10-10T14:01:42.517597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0] Write session: Do CDS request
2025-10-10T14:01:42.517633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:42.516722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 219 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0
2025-10-10T14:01:42.517067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 219 sessionId: src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0 is DEAD
2025-10-10T14:01:42.538357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:42.538715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:42.538742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 220
2025-10-10T14:01:42.539038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:42.539123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:42.539133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:42.539141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:42.540168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 220 sessionId:  describe result for acl check
2025-10-10T14:01:42.540286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:42.540303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:42.540311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:42.540327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592995835013084:4620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:42.542565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592995835013084:4620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:42.564322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592995835013084:4620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:42.576970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592995835013084:4620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:42.577016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592995835013084:4620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:42.577033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592995835013084:4620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:42.577063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:42.609157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559592995835013117:4447]
2025-10-10T14:01:42.699849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:42.705010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:42.705689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:42.705719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:42.705748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:42.705919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:42.706045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592994257096683:4275]
2025-10-10T14:01:42.710347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:42.714279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:42.714640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:42.715879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:42.716201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:42.716223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:42.716230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:42.716236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:42.716266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:42.716279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:42.716284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:42.716290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:42.716296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.716301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.716307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.716312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.716355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:42.716458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:42.716495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:42.716531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:42.716563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:42.716597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:42.716644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:42.716677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:42.716745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.716798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.716830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.716862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.716903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:42.716987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:42.717051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:42.717106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:42.717161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:42.717201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:42.717246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:42.717290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:42.717323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:42.717361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:42.717391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:42.717425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:42.717464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:42.717502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:42.717531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:42.717566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:42.717599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.717636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.717667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.717705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.717736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.717796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.717833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.717889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.718311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:42.751967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:42.766055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:42.766116Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:42.766133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:42.766149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:42.766171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 219 [2:7559592994257096683:4275]
2025-10-10T14:01:42.766218Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:42.766275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:42.766289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.766300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.766312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.766359Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:42.766379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:42.766398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:42.768745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.768771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.768783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.768794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.768805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:42.769087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:42.769103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.771397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:42.771614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:42.771830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:42.771939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:42.772062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592995835013113:4620], now have 1 active actors on pipe
2025-10-10T14:01:42.772085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592995835013071:2442], now have 1 active actors on pipe
2025-10-10T14:01:42.772105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592995835013117:4447], now have 1 active actors on pipe
2025-10-10T14:01:42.772152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:42.772183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:42.772237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592994257096678:4275]
2025-10-10T14:01:42.772256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592994257096678:4275]
2025-10-10T14:01:42.772267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592994257096678:4275]
2025-10-10T14:01:42.772279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592994257096678:4275]
2025-10-10T14:01:42.772314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:42.772360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:42.772373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:42.772384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:42.772393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:42.772395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:42.772566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:42.772581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:42.772640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:42.772665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.772680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.772690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:42.772721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.772774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:42.772916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592994257096678:4275]
2025-10-10T14:01:42.772948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:42.772989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:42.773167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:42.770432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 219
2025-10-10T14:01:42.770541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 219
2025-10-10T14:01:42.770609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 219, pipe: [1:7559592995835013117:4447]
2025-10-10T14:01:42.775127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3136f5c-ccdafb07-9d782f25-c88cabc2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:42.773894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:42.773924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:42.773983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:42.774386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 220 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0
2025-10-10T14:01:42.831604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0] Write session: try to update token
2025-10-10T14:01:42.831673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:42.887965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.888004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.888011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.888059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:42.888073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:42.888083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:42.888091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:42.888097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:42.888123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592994257096678:4275]
2025-10-10T14:01:42.888155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592994257096678:4275]
2025-10-10T14:01:42.888171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592994257096678:4275]
2025-10-10T14:01:42.888195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592994257096678:4275]
2025-10-10T14:01:42.888303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:42.888319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:42.888326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:42.888936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:42.888964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:42.888988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:42.889004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:42.891123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:42.986522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId: src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:43.011940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:43.066410Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:43.075355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:43.075418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:43.076803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:43.076860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:43.079282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:43.077915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:43.078144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559592995835013117:4447]
2025-10-10T14:01:43.086310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 220 reason: error at write: Disconnected sessionId: src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0
2025-10-10T14:01:43.086665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 220 sessionId: src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0 is DEAD
2025-10-10T14:01:43.087704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:43.087760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0] Write session will restart in 0.007127s
2025-10-10T14:01:43.087867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0] Write session: Do CDS request
2025-10-10T14:01:43.087898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:43.099126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:43.099170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 221
2025-10-10T14:01:43.099616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:43.100053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:43.100172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:43.100200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:43.100211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:43.101531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 221 sessionId:  describe result for acl check
2025-10-10T14:01:43.101656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:43.101666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:43.101676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:43.101693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593000129980668:4625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:43.104136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593000129980668:4625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:43.114203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593000129980668:4625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:43.133664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593000129980668:4625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:43.133710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593000129980668:4625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:43.133726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593000129980668:4625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:43.133758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:43.179531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593000129980806:4447]
2025-10-10T14:01:43.220023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:43.224414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:43.225326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:43.225358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:43.225404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:43.225692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:43.225907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592998552064254:4282]
2025-10-10T14:01:43.228252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:43.229195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:43.229429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:43.230759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:43.231074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:43.231084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:43.231091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:43.231099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:43.231106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:43.231114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:43.231122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:43.231130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:43.231137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.231145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.231153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.231160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.231215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:43.231338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:43.231392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:43.231443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:43.231498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:43.231572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:43.231635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:43.231689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:43.231743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.231797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.231847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.231898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.231941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:43.232013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:43.232076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:43.232136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:43.232190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:43.232251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:43.232302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:43.232359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:43.232411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:43.232468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:43.232521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:43.232580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:43.232633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:43.232694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:43.232742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:43.232816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:43.232869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.232926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.232978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.233036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.233085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.233247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.233334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.233409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.233943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:43.262481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:43.287771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:43.287835Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:43.287851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:43.287872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:43.287894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 220 [2:7559592998552064254:4282]
2025-10-10T14:01:43.287945Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:43.288002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:43.288017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.288029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.288041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.288088Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:43.288110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:43.288133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:43.289334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.289366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.289382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.289395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.289409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:43.289690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:43.289724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.289874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.290080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.290331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.290472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:43.290555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.290578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.290593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.290606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.290651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:43.290737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:43.290937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:43.290964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:43.291092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.291121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:43.292741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:43.292783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:43.292796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:43.292809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:43.292836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:43.293731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593000129980658:2442], now have 1 active actors on pipe
2025-10-10T14:01:43.293773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593000129980806:4447], now have 1 active actors on pipe
2025-10-10T14:01:43.293800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593000129980701:4625], now have 1 active actors on pipe
2025-10-10T14:01:43.294571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:43.294618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:43.294699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:43.294742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.294765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.294777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:43.294822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.294863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:43.294931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:43.294086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 220
2025-10-10T14:01:43.294183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 220, pipe: [1:7559593000129980806:4447]
2025-10-10T14:01:43.294259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 220
2025-10-10T14:01:43.298189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:43.298242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:43.298318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:43.298637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 221 partition: 0 MaxSeqNo: 36 sessionId: src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0
2025-10-10T14:01:43.304197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9f5649-b6fe8864-b5f7c0db-e46cc024_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:43.367768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0] Write session: try to update token
2025-10-10T14:01:43.367832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:43.451251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.451303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.451313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.451365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:43.451378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:43.451387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:43.451394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:43.451403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:43.451434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.451455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.451474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.451492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.451696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:43.451736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.451746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:43.452753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:43.453236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:43.453286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:43.453316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:43.453339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:43.536979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId: src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:43.578031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:43.603206Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:43.615446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:43.615508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:43.615572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:43.615587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:43.615626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592998552064248:4282]
2025-10-10T14:01:43.616057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:43.617299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:43.617439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593000129980806:4447]
2025-10-10T14:01:43.617514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:43.617526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:43.616533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:43.661628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 221 reason: error at write: Disconnected sessionId: src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0
2025-10-10T14:01:43.661970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 221 sessionId: src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0 is DEAD
2025-10-10T14:01:43.665713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:43.665749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0] Write session will restart in 0.005303s
2025-10-10T14:01:43.665843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0] Write session: Do CDS request
2025-10-10T14:01:43.665871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:43.676337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:43.683630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:43.683667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 222
2025-10-10T14:01:43.686653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:43.686795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:43.686817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:43.686828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:43.688057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 222 sessionId:  describe result for acl check
2025-10-10T14:01:43.688165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:43.688175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:43.688183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:43.688201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593000129980992:4637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:43.690629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593000129980992:4637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:43.712519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593000129980992:4637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:43.718085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593000129981108:4447]
2025-10-10T14:01:43.734227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593000129980992:4637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:43.734278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593000129980992:4637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:43.734296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593000129980992:4637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:43.734327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:43.773869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:43.778901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:43.779787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:43.779805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:43.779852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:43.780118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:43.780297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592998552064558:4288]
2025-10-10T14:01:43.782413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:43.783977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:43.784211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:43.785470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:43.785781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:43.785788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:43.785795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:43.785802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:43.785809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:43.785815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:43.785821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:43.785827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:43.785833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.785839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.785845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.785852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.785896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:43.785996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:43.786039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:43.786085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:43.786127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:43.786169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:43.786208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:43.786251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:43.786292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.786334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.786396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.786436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.786475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:43.786533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:43.786596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:43.786649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:43.786696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:43.786745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:43.786786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:43.786833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:43.786877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:43.786926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:43.786968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:43.787016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:43.787057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:43.787106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:43.787149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:43.787195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:43.787237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.787281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.787320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.787369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.787412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.787458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.787495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.787540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.787919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:43.818657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:43.842131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:43.842186Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:43.842201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:43.842229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:43.842251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 221 [2:7559592998552064558:4288]
2025-10-10T14:01:43.842299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:43.842355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:43.842369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.842380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.842389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.842436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:43.842456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:43.842478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:43.845674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.845710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.845723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.845737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.845747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:43.846014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:43.846030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.846166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:43.846331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:43.846535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:43.846640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:43.846710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:43.846725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:43.846737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:43.846748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:43.846792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:43.846867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:43.847031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:43.847047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:43.847167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:43.847185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:43.847486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:43.847497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:43.847508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:43.847517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:43.847540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:43.848471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593000129981149:4637], now have 1 active actors on pipe
2025-10-10T14:01:43.848514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593000129981108:4447], now have 1 active actors on pipe
2025-10-10T14:01:43.848534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593000129980958:2442], now have 1 active actors on pipe
2025-10-10T14:01:43.849851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 221
2025-10-10T14:01:43.849952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 221, pipe: [1:7559593000129981108:4447]
2025-10-10T14:01:43.850042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 221
2025-10-10T14:01:43.850624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:43.850666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:43.850762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:43.850796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.850814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.850824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:43.850858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.850902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:43.850948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:43.851647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:43.851676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:43.851731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:43.852057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 222 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0
2025-10-10T14:01:43.853617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b66cd8eb-f8d427c5-c6f1604b-cce0f267_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:43.902490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0] Write session: try to update token
2025-10-10T14:01:43.902549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:43.982228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.982272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.982283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.982337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:43.982350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:43.982363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:43.982375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:43.982386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:43.982419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:43.982446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:43.982469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:43.982490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:43.982668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:43.982704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:43.982714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:43.982904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:43.982943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:43.982971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:43.982998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:43.983950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:44.057229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId: src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:44.084605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:44.140033Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:44.160410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:44.160476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:44.160540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:44.160555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:44.160593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559592998552064552:4288]
2025-10-10T14:01:44.160735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:44.161930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:44.161286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:44.161317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:44.161420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593000129981108:4447]
2025-10-10T14:01:44.161542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:44.196655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:44.196713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0] Write session will restart in 0.007691s
2025-10-10T14:01:44.196859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0] Write session: Do CDS request
2025-10-10T14:01:44.196893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:44.195225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 222 reason: error at write: Disconnected sessionId: src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0
2025-10-10T14:01:44.195530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 222 sessionId: src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0 is DEAD
2025-10-10T14:01:44.210764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:44.210796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 223
2025-10-10T14:01:44.211101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:44.211679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:44.211770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:44.211780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:44.211787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:44.213089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 223 sessionId:  describe result for acl check
2025-10-10T14:01:44.213229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:44.213238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:44.213246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:44.213263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593004424948594:4646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:44.215155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593004424948594:4646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:44.222908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593004424948594:4646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:44.236610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593004424948594:4646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:44.236656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593004424948594:4646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:44.236673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593004424948594:4646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:44.236705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:44.261984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593004424948684:4447]
2025-10-10T14:01:44.323375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:44.325953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:44.326596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:44.326623Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:44.326655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:44.326823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:44.326947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593002847032156:4301]
2025-10-10T14:01:44.328232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:44.329032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:44.329263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:44.330460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:44.330787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:44.330811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:44.330818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:44.330825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:44.330832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:44.330839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:44.330847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:44.330854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:44.330860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.330867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.330873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.330879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.330922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:44.331022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:44.331068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:44.331111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:44.331151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:44.331198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:44.331253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:44.331301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:44.331356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.331402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.331443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.331485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.331527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:44.331589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:44.331643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:44.331695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:44.331741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:44.331791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:44.331833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:44.331900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:44.331953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:44.332006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:44.332048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:44.332096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:44.332139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:44.332187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:44.332230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:44.332281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:44.332326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.332375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.332416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.332464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.332507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.332552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.332594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.332644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.333072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:44.358069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:44.371919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:44.371980Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:44.371997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:44.372015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:44.372041Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 222 [2:7559593002847032156:4301]
2025-10-10T14:01:44.372093Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:44.372163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:44.372180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.372191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.372203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.372254Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:44.372277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:44.372300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:44.423137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.423179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.423193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.423207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.423218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:44.423495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:44.423512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.423658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.423841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.424058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.424181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:44.424253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593002847032151:4301]
2025-10-10T14:01:44.424268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593002847032151:4301]
2025-10-10T14:01:44.424280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593002847032151:4301]
2025-10-10T14:01:44.424291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593002847032151:4301]
2025-10-10T14:01:44.424335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:44.424416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:44.424497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:44.424525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:44.424540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:44.424553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:44.424584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:44.424602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:44.424728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593002847032151:4301]
2025-10-10T14:01:44.424747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:44.424814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:44.424914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593004424948684:4447], now have 1 active actors on pipe
2025-10-10T14:01:44.424937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593004424948569:2442], now have 1 active actors on pipe
2025-10-10T14:01:44.424956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593004424948646:4646], now have 1 active actors on pipe
2025-10-10T14:01:44.426084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 222, pipe: [1:7559593004424948684:4447]
2025-10-10T14:01:44.426192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 222
2025-10-10T14:01:44.426208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 222
2025-10-10T14:01:44.428881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:44.428929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:44.428990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:44.429015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.429028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.429046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:44.429074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.429145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:44.429209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:44.431854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:44.431913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:44.431989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:44.432553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 223 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0
2025-10-10T14:01:44.434156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9355c86-d3ec2a6-78b51b15-71ea5808_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:44.472505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.472559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.472572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.474834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0] Write session: try to update token
2025-10-10T14:01:44.474892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:44.498847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:44.498894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:44.498909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:44.498920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:44.498931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:44.498969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593002847032151:4301]
2025-10-10T14:01:44.498996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593002847032151:4301]
2025-10-10T14:01:44.499019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593002847032151:4301]
2025-10-10T14:01:44.499040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593002847032151:4301]
2025-10-10T14:01:44.499183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:44.499219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.499238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:44.499694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:44.499736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:44.499771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:44.499805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:44.500504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:44.662094Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:44.662484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId: src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:44.670609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593004424948684:4447]
2025-10-10T14:01:44.670710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:44.687152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:44.687180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:44.700250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:01:44.700315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0] Write session will restart in 0.009840s
2025-10-10T14:01:44.700519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0] Write session: Do CDS request
2025-10-10T14:01:44.700572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:44.699380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 223 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0
2025-10-10T14:01:44.699732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 223 sessionId: src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0 is DEAD
2025-10-10T14:01:44.721154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:44.729301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:44.729336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 224
2025-10-10T14:01:44.729735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:44.729851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:44.729867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:44.729878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:44.731235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 224 sessionId:  describe result for acl check
2025-10-10T14:01:44.731352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:44.731362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:44.731370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:44.731386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593004424948896:4651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:44.737730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593004424948896:4651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:44.754747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593004424948896:4651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:44.770993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593004424949010:4447]
2025-10-10T14:01:44.778780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593004424948896:4651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:44.778822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593004424948896:4651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:44.778838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593004424948896:4651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:44.778867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:44.826201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:44.832921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:44.833892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:44.833915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:44.833961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:44.834251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:44.834444Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593002847032448:4305]
2025-10-10T14:01:44.836521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:44.838747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:44.838968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:44.840230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:44.840532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:44.840541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:44.840547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:44.840554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:44.840560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:44.840567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:44.840573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:44.840579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:44.840585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.840591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.840599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.840606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.840653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:44.842720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:44.842798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:44.842850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:44.842902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:44.842951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:44.842999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:44.843047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:44.843093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.843145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.843191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.843238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.843293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:44.843366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:44.843432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:44.843486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:44.843542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:44.843597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:44.843643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:44.843711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:44.843760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:44.843817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:44.843862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:44.843916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:44.843963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:44.844019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:44.844065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:44.844128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:44.844174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.844228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.844272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.844325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.844372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.844422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.844468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.844519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.844974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:44.885879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:44.914218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:44.914277Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:44.914293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:44.914310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:44.914332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 223 [2:7559593002847032448:4305]
2025-10-10T14:01:44.914384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:44.914437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:44.914450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.914461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.914472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.914518Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:44.914537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:44.914559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:44.916277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.916309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.916320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.916334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.916345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:44.916615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:44.916641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:44.916808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:44.916993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:44.917281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:44.917406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:44.917484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593004424949041:4651], now have 1 active actors on pipe
2025-10-10T14:01:44.917508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593004424948864:2442], now have 1 active actors on pipe
2025-10-10T14:01:44.917530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593004424949010:4447], now have 1 active actors on pipe
2025-10-10T14:01:44.917552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593002847032442:4305]
2025-10-10T14:01:44.917566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593002847032442:4305]
2025-10-10T14:01:44.917578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593002847032442:4305]
2025-10-10T14:01:44.917592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593002847032442:4305]
2025-10-10T14:01:44.917622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:44.917662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:44.917689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:44.917697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:44.917701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:44.917713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:44.917876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:44.917894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:44.917951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:44.917971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:44.918109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593002847032442:4305]
2025-10-10T14:01:44.918141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:44.918210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61c613f5-aa74720b-46d01bb7-7222a008_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:44.918238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.918257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.918269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:44.918299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.918334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:44.918455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:44.918678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:44.919492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:44.919512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:44.919573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:44.921018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4086dd6-c536d284-ee1247f4-ce15be09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61c613f5-aa74720b-46d01bb7-7222a008_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:44.917152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 223
2025-10-10T14:01:44.917252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 223
2025-10-10T14:01:44.917323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 223, pipe: [1:7559593004424949010:4447]
2025-10-10T14:01:44.919862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 224 partition: 0 MaxSeqNo: 36 sessionId: src_id|61c613f5-aa74720b-46d01bb7-7222a008_0
2025-10-10T14:01:44.977049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c613f5-aa74720b-46d01bb7-7222a008_0] Write session: try to update token
2025-10-10T14:01:44.977113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c613f5-aa74720b-46d01bb7-7222a008_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:45.053740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:45.053787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:45.053799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.053857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:45.053870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:45.053884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:45.053895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:45.053906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:45.053943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593002847032442:4305]
2025-10-10T14:01:45.053966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593002847032442:4305]
2025-10-10T14:01:45.053987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593002847032442:4305]
2025-10-10T14:01:45.054005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593002847032442:4305]
2025-10-10T14:01:45.054147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:45.054176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:45.054196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:45.055131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:45.055186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:45.055215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:45.055242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:45.058010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:45.137607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId: src_id|61c613f5-aa74720b-46d01bb7-7222a008_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:45.163690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:45.251590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:45.257183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:45.257236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:45.262160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593004424949010:4447]
2025-10-10T14:01:45.262265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:45.262283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:45.274259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 224 reason: error at write: Disconnected sessionId: src_id|61c613f5-aa74720b-46d01bb7-7222a008_0
2025-10-10T14:01:45.274592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 224 sessionId: src_id|61c613f5-aa74720b-46d01bb7-7222a008_0 is DEAD
2025-10-10T14:01:45.277672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c613f5-aa74720b-46d01bb7-7222a008_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:45.277704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c613f5-aa74720b-46d01bb7-7222a008_0] Write session will restart in 0.009140s
2025-10-10T14:01:45.277800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c613f5-aa74720b-46d01bb7-7222a008_0] Write session: Do CDS request
2025-10-10T14:01:45.277826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c613f5-aa74720b-46d01bb7-7222a008_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:45.283474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:45.300380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:45.303499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61c613f5-aa74720b-46d01bb7-7222a008_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:45.313411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:45.313442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 225
2025-10-10T14:01:45.317502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:45.317651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:45.317667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:45.317677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:45.319107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 225 sessionId:  describe result for acl check
2025-10-10T14:01:45.319226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:45.319236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:45.319245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:45.319263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593008719916484:4663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:45.322354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593008719916484:4663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:45.331384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593008719916484:4663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:45.358355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593008719916484:4663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:45.358424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593008719916484:4663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:45.358444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593008719916484:4663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:45.358480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:45.365261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593008719916597:4447]
2025-10-10T14:01:45.415887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:45.428603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:45.429314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:45.429328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:45.429359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:45.429544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:45.429678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593007142000034:4313]
2025-10-10T14:01:45.431127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:45.432034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:45.432246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:45.433536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:45.433899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:45.433909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:45.433917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:45.433925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:45.433933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:45.433939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:45.433948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:45.433955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:45.433963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:45.433969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:45.433977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:45.433985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:45.434036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:45.434146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:45.434193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:45.434244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:45.434294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:45.434346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:45.434393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:45.434440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:45.434491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:45.434543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:45.434591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:45.434641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:45.434683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:45.434753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:45.434813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:45.434869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:45.434920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:45.434978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:45.435022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:45.435079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:45.435127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:45.435183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:45.435232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:45.435289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:45.435337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:45.435390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:45.435437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:45.435495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:45.435546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:45.435603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:45.435651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:45.435707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:45.435757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:45.435810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:45.435858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:45.435913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:45.436370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:45.493414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:45.519884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:45.519945Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:45.519963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:45.519982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:45.520007Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 224 [2:7559593007142000034:4313]
2025-10-10T14:01:45.520064Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:45.520123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:45.520138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:45.520150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:45.520163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.520212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:45.520234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:45.520256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:45.525250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:45.525301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:45.525315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:45.525328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:45.525339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:45.525623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:45.525641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:45.525793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:45.525991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:45.526241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:45.526365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:45.526430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.526446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.526460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.526475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.526513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:45.526595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:45.526780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:45.526797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:45.526936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.526958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:45.527905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:45.527920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:45.527932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:45.527943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:45.527967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:45.529183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593008719916479:2442], now have 1 active actors on pipe
2025-10-10T14:01:45.529215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593008719916597:4447], now have 1 active actors on pipe
2025-10-10T14:01:45.529237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593008719916574:4663], now have 1 active actors on pipe
2025-10-10T14:01:45.529909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 224
2025-10-10T14:01:45.530012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 224, pipe: [1:7559593008719916597:4447]
2025-10-10T14:01:45.530101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 224
2025-10-10T14:01:45.530382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:45.530434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:45.530501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:45.530531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:45.530551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:45.530562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:45.530605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.530655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:45.530705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:45.531246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:45.531264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:45.531322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:45.531612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 225 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0
2025-10-10T14:01:45.539121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61c613f5-aa74720b-46d01bb7-7222a008_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:45.621694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:45.621747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:45.621758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.634896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0] Write session: try to update token
2025-10-10T14:01:45.634947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:45.693306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:45.693353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:45.693366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:45.693378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:45.693390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:45.693423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.693450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.693474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.693497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.695265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:45.695301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:45.695335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:45.695365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:45.716790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:45.716869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:45.716882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:45.720052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:45.782813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId: src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:45.805616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:45.867398Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:45.869482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:45.869521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:45.869561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593007142000029:4313]
2025-10-10T14:01:45.869703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:45.869729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:45.869861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:45.870658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:45.871276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:45.871426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593008719916597:4447]
2025-10-10T14:01:45.871503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:45.871515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:45.890513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 225 reason: error at write: Disconnected sessionId: src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0
2025-10-10T14:01:45.890849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 225 sessionId: src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0 is DEAD
2025-10-10T14:01:45.895867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:45.895902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0] Write session will restart in 0.008953s
2025-10-10T14:01:45.896026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0] Write session: Do CDS request
2025-10-10T14:01:45.896055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:45.911823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:45.911857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 226
2025-10-10T14:01:45.924938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:45.925680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:45.925851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:45.925868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:45.925879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:45.927481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 226 sessionId:  describe result for acl check
2025-10-10T14:01:45.927617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:45.927632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:45.927645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:45.927662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593008719916804:4673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:45.933279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593008719916804:4673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:45.943298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593008719916804:4673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:45.966039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593008719916804:4673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:45.966085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593008719916804:4673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:45.966120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593008719916804:4673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:45.966196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:45.971698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593008719916837:4447]
2025-10-10T14:01:46.066928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:46.071393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:46.072031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:46.072044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:46.072074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:46.072245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:46.072359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593011436967649:4324]
2025-10-10T14:01:46.073991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:46.074747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:46.074919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:46.075767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:46.076025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:46.076037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:46.076042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:46.076046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:46.076050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:46.076054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:46.076059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:46.076062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:46.076066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.076070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.076076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.076084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.076130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:46.076211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:46.076246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:46.076280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:46.076313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:46.076343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:46.076373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:46.076403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:46.076442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.076477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.076512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.076546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.076574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:46.076631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:46.076693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:46.076750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:46.076799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:46.076858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:46.076892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:46.076941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:46.076978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:46.077016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:46.077051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:46.077091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:46.077158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:46.077203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:46.077238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:46.077276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:46.077311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.077361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.077396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.077440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.077473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.077514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.077545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.077583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.077891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:46.143032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:46.156962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:46.157020Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:46.157037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:46.157058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:46.157082Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 225 [2:7559593011436967649:4324]
2025-10-10T14:01:46.157508Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:46.157577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:46.157591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:46.157603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:46.157614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:46.157660Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:46.157681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:46.157703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:46.159005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.159019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.159033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.159047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.159057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:46.159332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:46.159349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.159478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.160579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 225
2025-10-10T14:01:46.160696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 225
2025-10-10T14:01:46.160769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 225, pipe: [1:7559593008719916837:4447]
2025-10-10T14:01:46.159649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.161280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.161416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:46.161509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593008719916788:2442], now have 1 active actors on pipe
2025-10-10T14:01:46.161536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593008719916835:4673], now have 1 active actors on pipe
2025-10-10T14:01:46.161555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593008719916837:4447], now have 1 active actors on pipe
2025-10-10T14:01:46.161610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:46.161635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:46.161667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.161685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.161697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.161708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.161744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:46.161822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:46.161987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:46.162008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:46.162072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:46.162108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:46.162126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:46.162143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:46.162178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:46.162219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:46.162347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.162365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:46.162407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:46.162583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:46.162594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:46.162603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:46.162614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:46.162634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:46.164771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:46.164808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:46.164886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:46.165178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 226 partition: 0 MaxSeqNo: 36 sessionId: src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0
2025-10-10T14:01:46.166054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ad10b8-4f4872df-754d46a4-1481d691_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:46.191278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0] Write session: try to update token
2025-10-10T14:01:46.191334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:46.330636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:46.330677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:46.330689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:46.330697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:46.330706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:46.330748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.330775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.330796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.330815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.330993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:46.331004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:46.331015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:46.331032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:46.331074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:46.331101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:46.331123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:46.331130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:46.331152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.331165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:46.334888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:46.338926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId: src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:46.360747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:46.497191Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:46.517243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:46.517308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:46.517372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:46.517382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:46.517415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593011436967643:4324]
2025-10-10T14:01:46.517902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:46.519306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593008719916837:4447]
2025-10-10T14:01:46.519397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:46.519535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:46.518466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:46.536214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 226 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0
2025-10-10T14:01:46.537235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:46.537317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0] Write session will restart in 0.007578s
2025-10-10T14:01:46.537539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0] Write session: Do CDS request
2025-10-10T14:01:46.537593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:46.536573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 226 sessionId: src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0 is DEAD
2025-10-10T14:01:46.550694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:46.553462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:46.553509Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 227
2025-10-10T14:01:46.557358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:46.557509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:46.557532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:46.557542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:46.564107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 227 sessionId:  describe result for acl check
2025-10-10T14:01:46.564239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:46.564256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:46.564266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:46.564284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593013014884403:4680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:46.567221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593013014884403:4680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:46.585012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593013014884403:4680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:46.594936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593013014884403:4680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:46.594988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593013014884403:4680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:46.595005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593013014884403:4680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:46.595039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:46.618786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593013014884545:4447]
2025-10-10T14:01:46.652251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:46.661149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:46.662142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:46.662175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:46.662223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:46.662484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:46.662687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593011436967945:4326]
2025-10-10T14:01:46.664714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:46.665712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:46.665924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:46.667122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:46.667425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:46.667444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:46.667452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:46.667458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:46.667463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:46.667470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:46.667477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:46.667484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:46.667490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.667497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.667503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.667511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.667560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:46.667669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:46.667714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:46.667764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:46.667821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:46.667867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:46.667912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:46.667964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:46.668015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.668066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.668112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.668157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.668198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:46.668266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:46.668337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:46.668399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:46.668455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:46.668516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:46.668564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:46.668621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:46.668671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:46.668728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:46.668776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:46.668848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:46.668902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:46.668961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:46.669010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:46.669069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:46.669148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.669203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.669250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.669307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.669356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.669421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.669478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.669543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.670018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:46.704643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:46.719579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:46.719631Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:46.719646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:46.719664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:46.719688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 226 [2:7559593011436967945:4326]
2025-10-10T14:01:46.719744Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:46.719802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:46.719822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:46.719835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:46.719847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:46.719895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:46.719921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:46.719942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:46.722123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.722158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.722171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.722183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.722194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:46.723419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 226
2025-10-10T14:01:46.723531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 226, pipe: [1:7559593013014884545:4447]
2025-10-10T14:01:46.723606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 226
2025-10-10T14:01:46.724035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:46.724062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.724152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:46.724330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:46.724505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:46.724589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:46.724623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593013014884376:2442], now have 1 active actors on pipe
2025-10-10T14:01:46.724643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593013014884545:4447], now have 1 active actors on pipe
2025-10-10T14:01:46.724658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593013014884461:4680], now have 1 active actors on pipe
2025-10-10T14:01:46.724757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:46.724783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:46.724822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:46.724852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:46.724864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:46.724876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:46.724914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:46.724967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:46.725145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:46.725169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:46.725237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:46.725279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:46.725304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:46.725314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:46.725350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:46.725395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:46.725534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:46.725562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:46.725602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:46.725841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:46.725863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:46.725873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:46.725884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:46.725909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:46.726475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:46.726506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:46.726585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:46.727010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 227 partition: 0 MaxSeqNo: 36 sessionId: src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0
2025-10-10T14:01:46.727815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba05be-2f496e16-8739e3b1-4711fa52_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:46.791058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0] Write session: try to update token
2025-10-10T14:01:46.791114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:46.877253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:46.877306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:46.877319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:46.877372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:46.877387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:46.877400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:46.877413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:46.877425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:46.877468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:46.877497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:46.877523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:46.877545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:46.877698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:46.877744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:46.877756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:46.877769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:46.877782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:46.877786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:46.877814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:46.889299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:46.957809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId: src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:46.989036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:47.083044Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:47.097210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:47.097274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:47.097355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:47.097370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:47.097425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593011436967940:4326]
2025-10-10T14:01:47.097637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:47.098122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:47.101360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593013014884545:4447]
2025-10-10T14:01:47.101533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:47.118968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:47.119140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 227 reason: status is not ok: tablet will be restarted right now sessionId: src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0
2025-10-10T14:01:47.119503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 227 sessionId: src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0 is DEAD
2025-10-10T14:01:47.120744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:47.120818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0] Write session will restart in 0.006565s
2025-10-10T14:01:47.120974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0] Write session: Do CDS request
2025-10-10T14:01:47.121013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:47.144155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:47.150863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:47.150897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 228
2025-10-10T14:01:47.154030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:47.154173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:47.154190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:47.154199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:47.156203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 228 sessionId:  describe result for acl check
2025-10-10T14:01:47.156322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:47.156332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:47.156340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:47.156358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593017309852011:4691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:47.158803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593017309852011:4691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:47.169011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593017309852011:4691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:47.185266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593017309852011:4691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:47.185310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593017309852011:4691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:47.185327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593017309852011:4691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:47.185358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:47.203264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593017309852169:4447]
2025-10-10T14:01:47.238928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:47.248235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:47.249289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:47.249309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:47.249359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:47.249634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:47.249824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593015731935563:4336]
2025-10-10T14:01:47.252206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:47.253211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:47.253428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:47.254681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:47.255006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:47.255014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:47.255021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:47.255029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:47.255036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:47.255043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:47.255049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:47.255056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:47.255062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.255068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.255074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.255079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.255126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:47.255231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:47.255296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:47.255344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:47.255388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:47.255431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:47.255475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:47.255520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:47.255564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.255610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.255661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.255708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.255750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:47.255813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:47.255871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:47.255925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:47.255974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:47.256023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:47.256064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:47.256112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:47.256156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:47.256203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:47.256248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:47.256296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:47.256339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:47.256388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:47.256428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:47.256477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:47.256518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.256562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.257825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.257912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.257958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.258010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.258050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.258096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.258475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:47.299436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:47.312549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:47.312607Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:47.312625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:47.312644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:47.312670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 227 [2:7559593015731935563:4336]
2025-10-10T14:01:47.312723Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:47.312785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:47.312799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:47.312811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:47.312824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:47.312885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:47.312911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:47.312933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:47.314267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.314297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.314322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.314336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.314346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:47.314606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:47.314632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.314763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.314931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.315158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.315267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:47.315338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593015731935558:4336]
2025-10-10T14:01:47.315353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593015731935558:4336]
2025-10-10T14:01:47.315366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593015731935558:4336]
2025-10-10T14:01:47.315379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593015731935558:4336]
2025-10-10T14:01:47.315412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:47.315489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:47.315502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:47.315510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:47.315517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:47.315525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:47.315908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 227
2025-10-10T14:01:47.315921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 227
2025-10-10T14:01:47.315989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 227, pipe: [1:7559593017309852169:4447]
2025-10-10T14:01:47.315655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:47.315689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:47.315842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593017309852094:4691], now have 1 active actors on pipe
2025-10-10T14:01:47.315865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593017309852000:2442], now have 1 active actors on pipe
2025-10-10T14:01:47.315886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593017309852169:4447], now have 1 active actors on pipe
2025-10-10T14:01:47.315903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593015731935558:4336]
2025-10-10T14:01:47.315935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:47.315986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:47.316683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:47.316714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:47.316781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9160c7db-5f147e83-257dbb28-b6d939af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:47.316813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:47.316829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:47.316840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:47.316887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:47.316927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:47.316968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:47.317411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:47.317437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:47.317503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:47.318060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 228 partition: 0 MaxSeqNo: 36 sessionId: src_id|9160c7db-5f147e83-257dbb28-b6d939af_0
2025-10-10T14:01:47.320066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|124b2eee-af9648b8-611d8bdd-fb9b4710_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9160c7db-5f147e83-257dbb28-b6d939af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:47.350036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9160c7db-5f147e83-257dbb28-b6d939af_0] Write session: try to update token
2025-10-10T14:01:47.350098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9160c7db-5f147e83-257dbb28-b6d939af_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:47.389058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:47.389114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:47.389222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:47.389247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:47.389266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:47.389344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593015731935558:4336]
2025-10-10T14:01:47.389409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593015731935558:4336]
2025-10-10T14:01:47.389464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593015731935558:4336]
2025-10-10T14:01:47.389519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593015731935558:4336]
2025-10-10T14:01:47.389703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:47.389730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:47.389739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:47.389759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.389767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:47.389770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:47.389794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:47.394235Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:47.457780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId: src_id|9160c7db-5f147e83-257dbb28-b6d939af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:47.477504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:47.558442Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:47.561035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:47.561066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:47.562108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:47.562156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:47.564883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:47.565219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593017309852169:4447]
2025-10-10T14:01:47.577564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:47.634121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 228 reason: error at write: Disconnected sessionId: src_id|9160c7db-5f147e83-257dbb28-b6d939af_0
2025-10-10T14:01:47.634463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 228 sessionId: src_id|9160c7db-5f147e83-257dbb28-b6d939af_0 is DEAD
2025-10-10T14:01:47.635067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9160c7db-5f147e83-257dbb28-b6d939af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:47.635101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9160c7db-5f147e83-257dbb28-b6d939af_0] Write session will restart in 0.006586s
2025-10-10T14:01:47.635204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9160c7db-5f147e83-257dbb28-b6d939af_0] Write session: Do CDS request
2025-10-10T14:01:47.635259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9160c7db-5f147e83-257dbb28-b6d939af_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:47.646410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:47.646443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 229
2025-10-10T14:01:47.648218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9160c7db-5f147e83-257dbb28-b6d939af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:47.648940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:47.649118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:47.649155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:47.649166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:47.652048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 229 sessionId:  describe result for acl check
2025-10-10T14:01:47.652135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:47.652143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:47.652149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:47.652172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593017309852367:4700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:47.654223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593017309852367:4700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:47.664524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593017309852437:4447]
2025-10-10T14:01:47.666170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593017309852367:4700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:47.678506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593017309852367:4700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:47.678549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593017309852367:4700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:47.678564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593017309852367:4700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:47.678596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:47.701838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:47.705909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:47.706909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:47.706930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:47.706976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:47.707244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:47.707430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593015731935859:4345]
2025-10-10T14:01:47.709642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:47.710809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:47.711024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:47.712193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:47.712481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:47.712489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:47.712496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:47.712503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:47.712509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:47.712516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:47.712522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:47.712528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:47.712534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.712541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.712547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.712554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.712595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:47.712693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:47.712740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:47.712786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:47.712831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:47.712893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:47.712937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:47.714497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:47.714567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.714617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.714662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.714704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.714753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:47.714817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:47.714885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:47.714938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:47.714985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:47.715037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:47.715082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:47.715133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:47.715178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:47.715227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:47.715269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:47.715318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:47.715361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:47.715412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:47.715454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:47.715500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:47.715547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.715597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.715640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.715691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.715733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.715780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.715823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.715873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.716285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:47.751701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:47.795446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:47.795506Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:47.795521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:47.795540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:47.795564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 228 [2:7559593015731935859:4345]
2025-10-10T14:01:47.795618Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:47.795679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:47.795692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:47.795704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:47.795714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:47.795765Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:47.795801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:47.795823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:47.796850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.796888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.796898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.796908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.796915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:47.797533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 228
2025-10-10T14:01:47.797616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 228, pipe: [1:7559593017309852437:4447]
2025-10-10T14:01:47.797685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 228
2025-10-10T14:01:47.798260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:47.798292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.798422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:47.798530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:47.798693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:47.798804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:47.798892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593017309852521:4700], now have 1 active actors on pipe
2025-10-10T14:01:47.798914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593017309852437:4447], now have 1 active actors on pipe
2025-10-10T14:01:47.798930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593017309852310:2442], now have 1 active actors on pipe
2025-10-10T14:01:47.798976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:47.798995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:47.799042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:47.799051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:47.799059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:47.799068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:47.799100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:47.799134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:47.799147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:47.799157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:47.799167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:47.799177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:47.799316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:47.799327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:47.799374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:47.799396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:47.799408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:47.799415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:47.799440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:47.799473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:47.799571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:47.799593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:47.799622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:47.799634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:47.800483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:47.800513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:47.800580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:47.801891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9160c7db-5f147e83-257dbb28-b6d939af_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:47.800904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 229 partition: 0 MaxSeqNo: 36 sessionId: src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0
2025-10-10T14:01:47.833344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0] Write session: try to update token
2025-10-10T14:01:47.833401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:47.955425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:47.955460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:47.955468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:47.955552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:47.955561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:47.955570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:47.955577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:47.955585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:47.955608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:47.955626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:47.955640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:47.955653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:47.955780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:47.955813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:47.955849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:47.955892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:47.963737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId: src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:47.966421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:47.966476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:47.966489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:47.967838Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:47.993791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:48.126875Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:48.128855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:48.128918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:48.128966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593015731935854:4345]
2025-10-10T14:01:48.129140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:48.129169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:48.129704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:48.130402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:48.130432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:48.131440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593017309852437:4447]
2025-10-10T14:01:48.131528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:48.131713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:48.161164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:48.161222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0] Write session will restart in 0.005968s
2025-10-10T14:01:48.161396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0] Write session: Do CDS request
2025-10-10T14:01:48.161448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:48.160446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 229 reason: error at write: Disconnected sessionId: src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0
2025-10-10T14:01:48.160738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 229 sessionId: src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0 is DEAD
2025-10-10T14:01:48.181340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:48.179858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:48.179896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 230
2025-10-10T14:01:48.185590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:48.185737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:48.185759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:48.185770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:48.187748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 230 sessionId:  describe result for acl check
2025-10-10T14:01:48.187878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:48.187894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:48.187902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:48.187919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593021604819920:4705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:48.190455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593021604819920:4705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:48.197267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593021604819920:4705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:48.206189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593021604819920:4705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:48.206235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593021604819920:4705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:48.206253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593021604819920:4705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:48.206285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:48.233263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593021604820107:4447]
2025-10-10T14:01:48.260544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:48.264661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:48.265469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:48.265485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:48.265528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:48.265760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:48.265927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593020026903454:4349]
2025-10-10T14:01:48.268105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:48.269158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:48.269366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:48.270567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:48.270870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:48.270889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:48.270895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:48.270901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:48.270907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:48.270913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:48.270919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:48.270926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:48.270931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.270937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.270944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.270951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.270993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:48.271089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:48.271133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:48.271186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:48.271229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:48.271281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:48.271326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:48.271375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:48.271422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.271465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.271515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.271563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.271604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:48.271666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:48.271726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:48.271781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:48.271832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:48.271884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:48.271928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:48.271978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:48.272022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:48.272071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:48.272120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:48.272173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:48.272215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:48.272263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:48.272303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:48.272349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:48.272395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.272441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.272482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.272530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.272572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.272622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.272664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.272712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.273161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:48.337450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:48.358095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:48.358152Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:48.358167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:48.358183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:48.358206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 229 [2:7559593020026903454:4349]
2025-10-10T14:01:48.358255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:48.358314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:48.358328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:48.358340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:48.358352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:48.358400Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:48.358422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:48.358444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:48.361093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.361292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.361321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.361336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.361347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:48.361640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:48.361667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.361792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.361963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.362160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.362265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:48.362339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.362353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.362366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.362379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.362422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:48.362501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:48.362665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:48.362681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:48.362807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.362826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:48.363248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:48.363259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:48.363270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:48.363280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:48.363303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:48.364564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593021604819975:4705], now have 1 active actors on pipe
2025-10-10T14:01:48.364605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593021604820107:4447], now have 1 active actors on pipe
2025-10-10T14:01:48.364626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593021604819904:2442], now have 1 active actors on pipe
2025-10-10T14:01:48.369320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 229
2025-10-10T14:01:48.369407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 229, pipe: [1:7559593021604820107:4447]
2025-10-10T14:01:48.369478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 229
2025-10-10T14:01:48.374174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:48.374230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:48.374326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|210ca93c-1b3c5c59-40194e75-441d6302_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:48.374363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:48.374381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:48.374392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:48.374433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:48.374480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:48.374551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:48.382961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:48.383019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:48.383102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:48.388896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 230 partition: 0 MaxSeqNo: 36 sessionId: src_id|210ca93c-1b3c5c59-40194e75-441d6302_0
2025-10-10T14:01:48.389771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27047d5e-ce00c31a-18c9ffbd-7c77becf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|210ca93c-1b3c5c59-40194e75-441d6302_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:48.425539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|210ca93c-1b3c5c59-40194e75-441d6302_0] Write session: try to update token
2025-10-10T14:01:48.425598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|210ca93c-1b3c5c59-40194e75-441d6302_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:48.470382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:48.470426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:48.470438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:48.470446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:48.470455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:48.470486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.470510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.470532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.470548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.470757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:48.470781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:48.470792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:48.470836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:48.470861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.470877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:48.471866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:48.473237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:48.473291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:48.473317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:48.473342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:48.569114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId: src_id|210ca93c-1b3c5c59-40194e75-441d6302_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:48.650019Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:48.663442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:48.699638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593021604820107:4447]
2025-10-10T14:01:48.699702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:48.699807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:48.699816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:48.698091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:48.698130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:48.698160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593020026903449:4349]
2025-10-10T14:01:48.698678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:48.719408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 230 reason: error at write: Disconnected sessionId: src_id|210ca93c-1b3c5c59-40194e75-441d6302_0
2025-10-10T14:01:48.719735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 230 sessionId: src_id|210ca93c-1b3c5c59-40194e75-441d6302_0 is DEAD
2025-10-10T14:01:48.722270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210ca93c-1b3c5c59-40194e75-441d6302_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:48.722307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210ca93c-1b3c5c59-40194e75-441d6302_0] Write session will restart in 0.006002s
2025-10-10T14:01:48.722404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210ca93c-1b3c5c59-40194e75-441d6302_0] Write session: Do CDS request
2025-10-10T14:01:48.722432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210ca93c-1b3c5c59-40194e75-441d6302_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:48.741089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|210ca93c-1b3c5c59-40194e75-441d6302_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:48.745413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:48.745448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 231
2025-10-10T14:01:48.745903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:48.746025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:48.746041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:48.746051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:48.748103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 231 sessionId:  describe result for acl check
2025-10-10T14:01:48.748238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:48.748249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:48.748260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:48.748276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593021604820250:4720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:48.750938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593021604820250:4720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:48.764270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593021604820250:4720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:48.794773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593021604820250:4720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:48.794823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593021604820250:4720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:48.794842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593021604820250:4720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:48.794876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:48.798427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593021604820353:4447]
2025-10-10T14:01:48.865526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:48.873494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:48.874400Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:48.874434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:48.874481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:48.874752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:48.874944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593020026903778:4366]
2025-10-10T14:01:48.877031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:48.883484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:48.883756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:48.885224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:48.885585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:48.885594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:48.885600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:48.885608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:48.885615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:48.885622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:48.885630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:48.885639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:48.885646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.885652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.885659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.885666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.885711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:48.885820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:48.885869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:48.885915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:48.885962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:48.886012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:48.886056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:48.886100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:48.886150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.886194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.886235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.886279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.886319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:48.886384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:48.886440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:48.886494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:48.886540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:48.886593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:48.886637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:48.886688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:48.886734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:48.886783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:48.886827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:48.886876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:48.886920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:48.886971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:48.887014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:48.887058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:48.887102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.887150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.887196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.887244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.887286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.887330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.887371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.887415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.887774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:48.975323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:48.988942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:48.989007Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:48.989023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:48.989041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:48.989066Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 230 [2:7559593020026903778:4366]
2025-10-10T14:01:48.989118Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:48.992520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 230
2025-10-10T14:01:48.992625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 230
2025-10-10T14:01:48.989403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:48.989425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:48.989439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:48.989450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:48.989498Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:48.992672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 230, pipe: [1:7559593021604820353:4447]
2025-10-10T14:01:48.989519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:48.989539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:48.990859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.990873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.990887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.990900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.990910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:48.991181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:48.991198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:48.991333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:48.991507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:48.991722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:48.991828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:48.991912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593021604820351:4720], now have 1 active actors on pipe
2025-10-10T14:01:48.991937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593021604820234:2442], now have 1 active actors on pipe
2025-10-10T14:01:48.991958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593021604820353:4447], now have 1 active actors on pipe
2025-10-10T14:01:48.991984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:48.991998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:48.992009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:48.992022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:48.992066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:48.992139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:48.992324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:48.992340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:48.992466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:48.992487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:48.993241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:48.993258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:48.993270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:48.993282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:48.993311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:48.994238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:48.994293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:48.994387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:48.994417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:48.994435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:48.994444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:48.994479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:48.994522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:48.994568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:48.995786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:48.995824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:48.995888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:48.996248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 231 partition: 0 MaxSeqNo: 36 sessionId: src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0
2025-10-10T14:01:48.997070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|210ca93c-1b3c5c59-40194e75-441d6302_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:49.021488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0] Write session: try to update token
2025-10-10T14:01:49.021567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:49.038173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:49.038219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:49.038259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:49.038356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:49.038826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:49.039738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:49.040657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:49.050202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:49.051741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:49.053594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:49.054051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:49.107585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:49.107636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:49.107659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:49.146940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:49.146988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:49.147003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:49.147013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:49.147023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:49.147064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:49.147090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:49.147111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:49.147133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593020026903772:4366]
2025-10-10T14:01:49.147279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:49.147305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:49.147315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:49.148268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:49.148327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:49.148364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:49.148399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:49.160415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:49.184304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId: src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:49.235793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:49.322437Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:49.324356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:49.324406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:49.326433Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:49.328600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593021604820353:4447]
2025-10-10T14:01:49.328751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:49.330057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:49.386591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 231 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0
2025-10-10T14:01:49.386906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 231 sessionId: src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0 is DEAD
2025-10-10T14:01:49.389829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:49.389911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0] Write session will restart in 0.005886s
2025-10-10T14:01:49.390074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0] Write session: Do CDS request
2025-10-10T14:01:49.390125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:49.403045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:49.408194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:49.408236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 232
2025-10-10T14:01:49.408632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:49.408761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:49.408785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:49.408796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:49.412981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 232 sessionId:  describe result for acl check
2025-10-10T14:01:49.413106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:49.413139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:49.413149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:49.413167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593025899787882:4726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:49.415838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593025899787882:4726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:49.429199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593025899787951:4447]
2025-10-10T14:01:49.430317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593025899787882:4726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:49.448751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593025899787882:4726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:49.448800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593025899787882:4726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:49.448818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593025899787882:4726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:49.448854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:49.486176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:49.494035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:49.494994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:49.495030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:49.495073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:49.495381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:49.495558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593024321871369:4368]
2025-10-10T14:01:49.497729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:49.498767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:49.498995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:49.500111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:49.500425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:49.500433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:49.500441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:49.500449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:49.500456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:49.500462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:49.500468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:49.500473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:49.500479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:49.500484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:49.500490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:49.500495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:49.500532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:49.500618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:49.500655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:49.500724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:49.500773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:49.500818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:49.500853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:49.500920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:49.500971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:49.501025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:49.501066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:49.501102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:49.501166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:49.501223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:49.501280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:49.501336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:49.501374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:49.501435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:49.501484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:49.501542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:49.501596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:49.501658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:49.501707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:49.501765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:49.501815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:49.501889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:49.501949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:49.502006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:49.502059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:49.502113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:49.502168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:49.502214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:49.502263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:49.502318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:49.502375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:49.502439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:49.504178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:49.531571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:49.569348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:49.569403Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:49.569421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:49.569447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:49.569472Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 231 [2:7559593024321871369:4368]
2025-10-10T14:01:49.569533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:49.569799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:49.569819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:49.569832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:49.569844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:49.569893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:49.569914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:49.569936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:49.571159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:49.571176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:49.571191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:49.571206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:49.571219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:49.571487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:49.571505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:49.572675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 231
2025-10-10T14:01:49.572768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 231, pipe: [1:7559593025899787951:4447]
2025-10-10T14:01:49.572846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 231
2025-10-10T14:01:49.575205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:49.575470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:49.575716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:49.575847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:49.575969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593025899788017:4726], now have 1 active actors on pipe
2025-10-10T14:01:49.575993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593025899787951:4447], now have 1 active actors on pipe
2025-10-10T14:01:49.576029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593025899787834:2442], now have 1 active actors on pipe
2025-10-10T14:01:49.576091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:49.576115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:49.576170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.576185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.576198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.576212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.576251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:49.576336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:49.576530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:49.576548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:49.576613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:49.576641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:49.576660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:49.576671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:49.576708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:49.576751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:49.576889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.576929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:49.576978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:49.577302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:49.577333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:49.577344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:49.577356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:49.577380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:49.579922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:49.579963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:49.580035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:49.581683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf6ab615-b4fca551-a4d7d714-b291482d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:49.580859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 232 partition: 0 MaxSeqNo: 36 sessionId: src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0
2025-10-10T14:01:49.632202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0] Write session: try to update token
2025-10-10T14:01:49.632265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:49.726843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:49.726891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:49.726902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:49.726957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:49.726971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:49.726982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:49.726992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:49.727002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:49.727035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.727059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.727080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.727098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.727296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:49.727335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:49.727344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:49.727388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:49.727421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:49.727448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:49.727473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:49.728319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:49.839450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId: src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:49.860754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:49.931735Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:49.951276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:49.951339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:49.951400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:49.951411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:49.951448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593024321871355:4368]
2025-10-10T14:01:49.951682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:49.952081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:49.953473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:49.953514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:49.962355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 232 reason: error at write: Disconnected sessionId: src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0
2025-10-10T14:01:49.962694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 232 sessionId: src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0 is DEAD
2025-10-10T14:01:49.963005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:49.963037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0] Write session will restart in 0.005230s
2025-10-10T14:01:49.963123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0] Write session: Do CDS request
2025-10-10T14:01:49.963148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:49.977582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:50.002064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593025899787951:4447]
2025-10-10T14:01:50.002152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:50.002385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:50.002410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 233
2025-10-10T14:01:50.002921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:50.003064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:50.003084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:50.003094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:50.004321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 233 sessionId:  describe result for acl check
2025-10-10T14:01:50.004437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:50.004447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:50.004456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:50.004473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593030194755478:4738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:50.006949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593030194755478:4738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:50.012494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593030194755478:4738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:50.021909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:50.024771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:50.025563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593030194755478:4738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:50.025604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593030194755478:4738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:50.025621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593030194755478:4738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:50.025649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:50.025738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:50.025769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:50.025811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:50.026063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:50.026254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593028616838750:4378]
2025-10-10T14:01:50.028260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:50.029168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:50.030539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:50.031938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:50.032266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.032288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.032294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.032301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.032308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.032315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.032320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.032326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.032333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.032339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.032347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.032352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.032396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.032500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.032547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.032593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.032636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.032681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.032724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.032765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.032821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.032866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.032930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.032975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.033023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.033093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.033177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.033235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.033289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.033346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.033396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.033449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.033503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.033554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.033595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.033645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.033695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.033752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.033800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.033860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.033906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.033964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.034014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.034069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.034120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.034178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.034224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.034280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.034686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:50.058506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:50.072998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:50.073052Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:50.073066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:50.073083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:50.073108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 232 [2:7559593028616838750:4378]
2025-10-10T14:01:50.073175Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:50.073234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:50.073249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:50.073261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:50.073270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:50.073304Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:50.073318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:50.073339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:50.092783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.092834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.092844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.092854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.092863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:50.093173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:50.093187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.093307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.093455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.093653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.093754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:50.093829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.093842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.093854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.093866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.093908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:50.093983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:50.094140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:50.094160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:50.094291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.094309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:50.095427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 232
2025-10-10T14:01:50.095064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:50.095091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:50.095102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:50.095111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:50.095135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:50.096087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593030194755505:4738], now have 1 active actors on pipe
2025-10-10T14:01:50.096119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593030194755472:2442], now have 1 active actors on pipe
2025-10-10T14:01:50.096161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:50.096183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:50.096248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4617519-8a657b72-ed402b12-bd4823ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:50.096279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:50.096297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:50.096306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:50.096342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:50.096385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:50.096425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:50.097492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 232
2025-10-10T14:01:50.101397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:50.101439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:50.101514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:50.102504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593030194755515:4447]
2025-10-10T14:01:50.102638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 233 partition: 0 MaxSeqNo: 36 sessionId: src_id|c4617519-8a657b72-ed402b12-bd4823ac_0
2025-10-10T14:01:50.103284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0c37ee1-a1b5dc75-d6c4fa7e-1373e7e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c4617519-8a657b72-ed402b12-bd4823ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:50.105440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593030194755515:4447], now have 1 active actors on pipe
2025-10-10T14:01:50.105541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 232, pipe: [1:7559593030194755515:4447]
2025-10-10T14:01:50.148435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4617519-8a657b72-ed402b12-bd4823ac_0] Write session: try to update token
2025-10-10T14:01:50.148489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4617519-8a657b72-ed402b12-bd4823ac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:50.162788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:50.162827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:50.162859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.162969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:50.164707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:50.166279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:50.167474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:50.173265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:50.174599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:50.178367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:50.183087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:50.183128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:50.183139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:50.183192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:50.238498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:50.238555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:50.238570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:50.238590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:50.238612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:50.238677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.238728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.238784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.238832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593028616838745:4378]
2025-10-10T14:01:50.239122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:50.239196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.239220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:50.240035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:50.240093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:50.240123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:50.240153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:50.245023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:50.300478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId: src_id|c4617519-8a657b72-ed402b12-bd4823ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:50.321025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:50.397202Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:50.399018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:50.399052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:50.399800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:50.401645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593030194755515:4447]
2025-10-10T14:01:50.401844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:50.402123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:50.410945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 233 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4617519-8a657b72-ed402b12-bd4823ac_0
2025-10-10T14:01:50.411713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4617519-8a657b72-ed402b12-bd4823ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:50.411277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 233 sessionId: src_id|c4617519-8a657b72-ed402b12-bd4823ac_0 is DEAD
2025-10-10T14:01:50.411786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4617519-8a657b72-ed402b12-bd4823ac_0] Write session will restart in 0.005348s
2025-10-10T14:01:50.411928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4617519-8a657b72-ed402b12-bd4823ac_0] Write session: Do CDS request
2025-10-10T14:01:50.412033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4617519-8a657b72-ed402b12-bd4823ac_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:50.425357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:50.425397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 234
2025-10-10T14:01:50.428147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4617519-8a657b72-ed402b12-bd4823ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:50.429039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:50.429203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:50.429219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:50.429228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:50.430631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 234 sessionId:  describe result for acl check
2025-10-10T14:01:50.430749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:50.430759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:50.430767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:50.430783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593030194755548:4746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:50.434756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593030194755548:4746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:50.445996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593030194755548:4746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:50.451282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:50.460116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:50.461113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:50.461148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:50.461195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:50.461219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593030194755548:4746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:50.461268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593030194755548:4746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:50.461285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593030194755548:4746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:50.461317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:50.461472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:50.461671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593028616838833:4387]
2025-10-10T14:01:50.463730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:50.464779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:50.465018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:50.466237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:50.466554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.466563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.466570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.466576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.466582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.466588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.466595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.466603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.466609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.466615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.466621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.466628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.466673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.466775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.466818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.466863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.466907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.466950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.466991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.467030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.467072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.467113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.467152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.467195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.467233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.467297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.467341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.467379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.467409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.467444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.467470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.467505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.467534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.468215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.468275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.468327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.468374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.468423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.468467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.468521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.468565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.468615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.468658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.468708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.468753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.468802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.468842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.468889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.469270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:50.496281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:50.500886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593030194755590:4447]
2025-10-10T14:01:50.523879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 233
2025-10-10T14:01:50.523997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 233
2025-10-10T14:01:50.524108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 233, pipe: [1:7559593030194755590:4447]
2025-10-10T14:01:50.521095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:50.521172Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:50.521190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:50.521209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:50.521234Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 233 [2:7559593028616838833:4387]
2025-10-10T14:01:50.521288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:50.521351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:50.521367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:50.521378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:50.521390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:50.521437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:50.521459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:50.521479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:50.523059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.523074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.523087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.523099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.523109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:50.523387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:50.523402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.523533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.523704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.523917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.524024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:50.524133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593030194755585:4746], now have 1 active actors on pipe
2025-10-10T14:01:50.524157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593030194755536:2442], now have 1 active actors on pipe
2025-10-10T14:01:50.524178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593030194755590:4447], now have 1 active actors on pipe
2025-10-10T14:01:50.524228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:50.524250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:50.524289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.524304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.524317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.524330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.524375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:50.524408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:50.524426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:50.524439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:50.524452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:50.524454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:50.524623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:50.524639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:50.524723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:50.524756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:50.524774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:50.524784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:50.524820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:50.525910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:50.526091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.526135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:50.526197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:50.526386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:50.526850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:50.526887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:50.526954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:50.527383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 234 partition: 0 MaxSeqNo: 36 sessionId: src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0
2025-10-10T14:01:50.528121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4617519-8a657b72-ed402b12-bd4823ac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:50.550753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0] Write session: try to update token
2025-10-10T14:01:50.550813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:50.574853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:50.574891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:50.574918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.575031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:50.575036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:50.576577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:50.586783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:50.587790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:50.589000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:50.595204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:50.595754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:50.622511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:50.622564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:50.622582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:50.671264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId: src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:50.688904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:50.688960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:50.688976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:50.688986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:50.688999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:50.689045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.689074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.689095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.689119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593028616838827:4387]
2025-10-10T14:01:50.689292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:50.689322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.689335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:50.689528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:50.689560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:50.689588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:50.689615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:50.690641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:50.715041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:50.835099Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:50.839180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:50.839233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:50.839949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:50.840069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:50.840114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593030194755590:4447]
2025-10-10T14:01:50.840200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:50.840217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:50.860410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 234 reason: error at write: Disconnected sessionId: src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0
2025-10-10T14:01:50.860734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 234 sessionId: src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0 is DEAD
2025-10-10T14:01:50.866259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:50.866302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0] Write session will restart in 0.006027s
2025-10-10T14:01:50.866396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0] Write session: Do CDS request
2025-10-10T14:01:50.866427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:50.882271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:50.885249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:50.885283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 235
2025-10-10T14:01:50.885217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:50.885660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:50.885785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:50.885802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:50.885812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:50.887265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 235 sessionId:  describe result for acl check
2025-10-10T14:01:50.887381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:50.887391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:50.887401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:50.887431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593030194755646:4753] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:50.889217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:50.890088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:50.890107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:50.890151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:50.890421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:50.890604Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593028616838905:4391]
2025-10-10T14:01:50.892963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:50.894201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:50.894435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:50.893872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593030194755646:4753] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:50.896023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:50.896380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.896390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.896397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.896405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.896412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.896419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.896427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.896434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.896441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.896448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.896454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.896461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.896511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.896623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.896675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.896726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.896773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.896826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.896874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.896922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.896985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.897033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.897083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.897151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.897195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.897268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:50.897329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.897387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:50.897439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.897496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:50.897545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.897603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:50.897653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.897709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:50.897757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.897816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:50.897867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.897921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:50.897969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.898024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:50.898077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.898134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.898181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.898236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.898282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.898342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.898391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.898449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.898914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:50.901993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593030194755646:4753] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:50.911292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593030194755646:4753] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:50.911334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593030194755646:4753] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:50.911352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593030194755646:4753] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:50.911383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:50.924918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:50.941482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593030194755680:4447]
2025-10-10T14:01:50.949178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:50.949236Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:50.949254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:50.949272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:50.949295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 234 [2:7559593028616838905:4391]
2025-10-10T14:01:50.949352Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:50.949415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:50.949429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:50.949441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:50.949453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:50.949501Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:50.949523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:50.949544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:50.951121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.951153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.951167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.951182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.951194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:50.951466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:50.951485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:50.951634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:50.951837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:50.952078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:50.952202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:50.952269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593028616838900:4391]
2025-10-10T14:01:50.952285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593028616838900:4391]
2025-10-10T14:01:50.952300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593028616838900:4391]
2025-10-10T14:01:50.952312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593028616838900:4391]
2025-10-10T14:01:50.952343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:50.952424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:50.952620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:50.952637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:50.952757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593028616838900:4391]
2025-10-10T14:01:50.952778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:50.953094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:50.953108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:50.953122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:50.953159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:50.953183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:50.956214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593030194755616:2442], now have 1 active actors on pipe
2025-10-10T14:01:50.956268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593030194755678:4753], now have 1 active actors on pipe
2025-10-10T14:01:50.956294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593030194755680:4447], now have 1 active actors on pipe
2025-10-10T14:01:50.956341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:50.956363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:50.956447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:50.956489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:50.956513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:50.956524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:50.956559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:50.956609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:50.955671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 234, pipe: [1:7559593030194755680:4447]
2025-10-10T14:01:50.955807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 234
2025-10-10T14:01:50.955910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 234
2025-10-10T14:01:50.956667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:50.957243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:50.957272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:50.957335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:50.959862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca9b409-bf92088b-cb9e8ff2-c133edbb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:50.957997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 235 partition: 0 MaxSeqNo: 36 sessionId: src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0
2025-10-10T14:01:50.994242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0] Write session: try to update token
2025-10-10T14:01:50.994300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:51.062302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:51.062350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:51.062364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:51.062421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:51.062437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:51.062452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:51.062464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:51.062476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:51.062515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593028616838900:4391]
2025-10-10T14:01:51.062544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593028616838900:4391]
2025-10-10T14:01:51.062569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593028616838900:4391]
2025-10-10T14:01:51.062590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593028616838900:4391]
2025-10-10T14:01:51.062733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:51.062764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.062776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:51.063787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:51.063837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:51.063841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:51.063870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:51.063900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:51.127002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId: src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:51.148568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:51.245289Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:51.247467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:51.247516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:51.251577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:51.251721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:51.251733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:51.260135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:51.261525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 235 reason: error at write: Disconnected sessionId: src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0
2025-10-10T14:01:51.261968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 235 sessionId: src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0 is DEAD
2025-10-10T14:01:51.265400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:51.265453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0] Write session will restart in 0.006706s
2025-10-10T14:01:51.265750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0] Write session: Do CDS request
2025-10-10T14:01:51.265824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:51.284493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:51.327579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:51.341265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:51.342353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:51.342382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:51.342435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:51.342706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:51.342876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593032911806273:4399]
2025-10-10T14:01:51.346726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:51.348497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:51.348736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:51.350125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:51.350465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:51.350473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:51.350480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:51.350485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:51.350491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:51.350497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:51.350504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:51.350510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:51.350516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.350522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.350528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.350534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.350577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:51.350678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:51.350721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:51.350762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:51.350804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:51.350847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:51.350914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:51.350957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:51.350997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.351043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.351083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.351121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.351160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:51.351221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:51.351340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:51.351405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:51.351453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:51.351503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:51.351543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:51.351594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:51.351642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:51.351691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:51.351740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:51.351791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:51.351834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:51.351882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:51.351924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:51.351973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:51.352016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.352065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.352106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.352157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.352201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.352252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.352294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.352341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.352744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:51.372111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593030194755680:4447]
2025-10-10T14:01:51.372253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:51.372266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 236
2025-10-10T14:01:51.372750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:51.372896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:51.372915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:51.372926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:51.374816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 236 sessionId:  describe result for acl check
2025-10-10T14:01:51.374938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:51.374948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:51.374956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:51.374974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593034489723028:4765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:51.376969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593034489723028:4765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:51.387718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593034489723028:4765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:51.402592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593034489723028:4765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:51.402645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593034489723028:4765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:51.402662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593034489723028:4765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:51.402702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:51.407434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:51.452624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:51.452683Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:51.452698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:51.452872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:51.452900Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 235 [2:7559593032911806273:4399]
2025-10-10T14:01:51.452970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:51.453024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:51.453038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:51.453050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:51.453060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:51.453107Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:51.453145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:51.453167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:51.456141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.456181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.456194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.456208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.456218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:51.456485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:51.456500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.456628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.456794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.457014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.457139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:51.457212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.457228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.457240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.457253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.457297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:51.457375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:51.457533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:51.457550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:51.457673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.457694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:51.458330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:51.458356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:51.458366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:51.458377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:51.458399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:51.459509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593034489723003:2442], now have 1 active actors on pipe
2025-10-10T14:01:51.459546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593034489723056:4765], now have 1 active actors on pipe
2025-10-10T14:01:51.462166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 235
2025-10-10T14:01:51.462280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 235
2025-10-10T14:01:51.462673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:51.462710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:51.462785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|673af764-49b00430-b08ece32-d3722b8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:51.462821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:51.462839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:51.462849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:51.462896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:51.462938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:51.462982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:51.463863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:51.463892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:51.463949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:51.464472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 236 partition: 0 MaxSeqNo: 36 sessionId: src_id|673af764-49b00430-b08ece32-d3722b8b_0
2025-10-10T14:01:51.469347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|103cb3f6-783572c5-d4215aeb-49a76bd6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|673af764-49b00430-b08ece32-d3722b8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:51.470487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593034489723062:4447]
2025-10-10T14:01:51.471125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 235, pipe: [1:7559593034489723062:4447]
2025-10-10T14:01:51.473230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593034489723062:4447], now have 1 active actors on pipe
2025-10-10T14:01:51.515068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|673af764-49b00430-b08ece32-d3722b8b_0] Write session: try to update token
2025-10-10T14:01:51.515129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|673af764-49b00430-b08ece32-d3722b8b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:51.692247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:51.692300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:51.692312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:51.692416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:51.692430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:51.692443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:51.692453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:51.692465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:51.692496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.692522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.692547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.692569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.692714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:51.692750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:51.692775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:51.692800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:51.710219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:51.710276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.710288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:51.714848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId: src_id|673af764-49b00430-b08ece32-d3722b8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:51.711975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
E1010 14:01:51.718106450  112376 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-10T14:01:51.740396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:51.856986Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:51.858629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:51.858666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:51.858712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593032911806267:4399]
2025-10-10T14:01:51.858863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:51.858887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:51.859026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:51.859788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:51.859607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593034489723062:4447]
2025-10-10T14:01:51.859700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:51.859836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:51.859848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:51.869795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|673af764-49b00430-b08ece32-d3722b8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:51.869868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|673af764-49b00430-b08ece32-d3722b8b_0] Write session will restart in 0.005003s
2025-10-10T14:01:51.870023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|673af764-49b00430-b08ece32-d3722b8b_0] Write session: Do CDS request
2025-10-10T14:01:51.870066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|673af764-49b00430-b08ece32-d3722b8b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:51.868787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 236 reason: error at write: Disconnected sessionId: src_id|673af764-49b00430-b08ece32-d3722b8b_0
2025-10-10T14:01:51.869072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 236 sessionId: src_id|673af764-49b00430-b08ece32-d3722b8b_0 is DEAD
2025-10-10T14:01:51.888604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:51.888637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 237
2025-10-10T14:01:51.888906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|673af764-49b00430-b08ece32-d3722b8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:51.889521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:51.889658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:51.889674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:51.889688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:51.891460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 237 sessionId:  describe result for acl check
2025-10-10T14:01:51.891581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:51.891591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:51.891600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:51.891615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593034489723113:4773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:51.896969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593034489723113:4773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:51.905715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593034489723113:4773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:51.914958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:51.916996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:51.921106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593034489723113:4773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:51.921177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593034489723113:4773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:51.921196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593034489723113:4773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:51.921229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:51.917928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:51.917963Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:51.918006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:51.918266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:51.918443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593032911806373:4410]
2025-10-10T14:01:51.920742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:51.922563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:51.922836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:51.924354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:51.924680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:51.924688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:51.924695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:51.924701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:51.924710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:51.924717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:51.924724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:51.924731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:51.924737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.924743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.924749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.924754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.925135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:51.925257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:51.925305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:51.925350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:51.925395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:51.925444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:51.925487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:51.925532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:51.925572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.925621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.925665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.925708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.925751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:51.925814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:51.925882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:51.925934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:51.925983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:51.926034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:51.926077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:51.926128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:51.926172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:51.926221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:51.926265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:51.926317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:51.926361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:51.926411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:51.926454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:51.926502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:51.926549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.926600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:51.926648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.926694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:51.926738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.926787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:51.926828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.926879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:51.927289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:51.964324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593034489723157:4447]
2025-10-10T14:01:51.986885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:52.000117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:52.000173Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:52.000191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:52.000210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:52.000236Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 236 [2:7559593032911806373:4410]
2025-10-10T14:01:52.000294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:52.000359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:52.000375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:52.000387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:52.000397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:52.000447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:52.000468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:52.000489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:52.001815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.001831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.001844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.001858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.001868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:52.002129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:52.002144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.002283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.002465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.002690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.003331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:52.003421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.003436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.003450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.003462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.003498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:52.003589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593034489723157:4447], now have 1 active actors on pipe
2025-10-10T14:01:52.003612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:52.003679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:52.003693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:52.003705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:52.003717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:52.003776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:52.003792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:52.003823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593034489723150:4773], now have 1 active actors on pipe
2025-10-10T14:01:52.003843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593034489723097:2442], now have 1 active actors on pipe
2025-10-10T14:01:52.003954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.003982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:52.004361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 236
2025-10-10T14:01:52.004453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 236
2025-10-10T14:01:52.004529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 236, pipe: [1:7559593034489723157:4447]
2025-10-10T14:01:52.004488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:52.005368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:52.005402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:52.005492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:52.005524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:52.005542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:52.005552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:52.005590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:52.005633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:52.005677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:52.008966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:52.009003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:52.009078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:52.009660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 237 partition: 0 MaxSeqNo: 36 sessionId: src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0
2025-10-10T14:01:52.013361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|673af764-49b00430-b08ece32-d3722b8b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:52.046644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0] Write session: try to update token
2025-10-10T14:01:52.046707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:52.134062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:52.134108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:52.134122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:52.134132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:52.134143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:52.134179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.134204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.134226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.134246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.134355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:52.134377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:52.134396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:52.134413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:52.134462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:52.134475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:52.134487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:52.134535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:52.134558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.134569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:52.135481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:52.174110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId: src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:52.197574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:52.289696Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:52.314196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:52.314257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:52.314320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:52.314332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:52.314372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593032911806368:4410]
2025-10-10T14:01:52.314589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:52.314878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:52.314841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593034489723157:4447]
2025-10-10T14:01:52.314954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:52.314968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:52.317259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:52.325012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 237 reason: error at write: Disconnected sessionId: src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0
2025-10-10T14:01:52.325377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 237 sessionId: src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0 is DEAD
2025-10-10T14:01:52.329484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:52.329533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0] Write session will restart in 0.008674s
2025-10-10T14:01:52.329695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0] Write session: Do CDS request
2025-10-10T14:01:52.329739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:52.344003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:52.344054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 238
2025-10-10T14:01:52.344717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:52.345267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:52.345397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:52.345420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:52.345430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:52.348208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 238 sessionId:  describe result for acl check
2025-10-10T14:01:52.348337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:52.348353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:52.348362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:52.348378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593038784690489:4779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:52.351174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593038784690489:4779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:52.355715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:52.359561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593038784690489:4779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:52.362170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:52.363080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:52.363110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:52.363153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:52.363416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:52.363601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593037206773730:4412]
2025-10-10T14:01:52.366429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:52.368282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593038784690489:4779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:52.368325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593038784690489:4779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:52.368341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593038784690489:4779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:52.368389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:52.367297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:52.367500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:52.368729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:52.369071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:52.369079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:52.369093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:52.369105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:52.369112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:52.369119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:52.369139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:52.369146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:52.369152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.369158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.369165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.369171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.369218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:52.369327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:52.369380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:52.369420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:52.369469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:52.369527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:52.369569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:52.369616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:52.369661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.369694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.369729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.369760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.369793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:52.369833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:52.369877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:52.369913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:52.369943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:52.369976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:52.370004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:52.370036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:52.370066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:52.370097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:52.370126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:52.370159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:52.370194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:52.370237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:52.370274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:52.370322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:52.370363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.370401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.370430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.370471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.370514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.370551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.370577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.370614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.370906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:52.395093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:52.407612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:52.407673Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:52.407690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:52.407709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:52.407734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 237 [2:7559593037206773730:4412]
2025-10-10T14:01:52.407787Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:52.407852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:52.407866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:52.407878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:52.407888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:52.407933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:52.407968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:52.407989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:52.409410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.409452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.409468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.409483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.409494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:52.409798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:52.409824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.409960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.410217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.410506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 237
2025-10-10T14:01:52.410454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.410634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 237
2025-10-10T14:01:52.410727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:52.410821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593038784690469:2442], now have 1 active actors on pipe
2025-10-10T14:01:52.410874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593038784690522:4779], now have 1 active actors on pipe
2025-10-10T14:01:52.410915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.410935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.410949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.410961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.410999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:52.411028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:52.411054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:52.411067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:52.411076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:52.411079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:52.411274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:52.411301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:52.411362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:52.411391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:52.411558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.411589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:52.411619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:52.411656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2df7d63-e614df69-c6af6289-588af4a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:52.411691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:52.411713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:52.411723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:52.411759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:52.411800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:52.411923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:52.413179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:52.413211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:52.413277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:52.414296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 238 partition: 0 MaxSeqNo: 36 sessionId: src_id|b2df7d63-e614df69-c6af6289-588af4a3_0
2025-10-10T14:01:52.415119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f6d5ec-5c2a5405-516f1a5b-9beaed8c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b2df7d63-e614df69-c6af6289-588af4a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:52.415093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593038784690529:4447]
2025-10-10T14:01:52.415684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 237, pipe: [1:7559593038784690529:4447]
2025-10-10T14:01:52.415739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593038784690529:4447], now have 1 active actors on pipe
2025-10-10T14:01:52.436572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2df7d63-e614df69-c6af6289-588af4a3_0] Write session: try to update token
2025-10-10T14:01:52.436630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2df7d63-e614df69-c6af6289-588af4a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:52.458924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:52.458968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:52.459014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.459149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:52.459514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:52.462334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:52.463359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:52.464478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:52.465508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:52.470562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:52.471104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:52.508302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:52.508348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:52.508361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:52.560133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:52.560172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:52.560181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:52.560188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:52.560195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:52.560225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.560241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.560256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.560271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593037206773725:4412]
2025-10-10T14:01:52.560376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:52.560396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.560403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:52.561288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:52.561333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:52.561368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:52.561403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:52.561435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:52.567476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId: src_id|b2df7d63-e614df69-c6af6289-588af4a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:52.607497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:52.725865Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:52.727853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:52.727887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:52.731816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:52.732088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:52.732119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:52.732885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593038784690529:4447]
2025-10-10T14:01:52.730829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:52.759971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 238 reason: error at write: Disconnected sessionId: src_id|b2df7d63-e614df69-c6af6289-588af4a3_0
2025-10-10T14:01:52.760634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 238 sessionId: src_id|b2df7d63-e614df69-c6af6289-588af4a3_0 is DEAD
2025-10-10T14:01:52.764780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2df7d63-e614df69-c6af6289-588af4a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:52.764846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2df7d63-e614df69-c6af6289-588af4a3_0] Write session will restart in 0.009246s
2025-10-10T14:01:52.765052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2df7d63-e614df69-c6af6289-588af4a3_0] Write session: Do CDS request
2025-10-10T14:01:52.765137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2df7d63-e614df69-c6af6289-588af4a3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:52.782555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2df7d63-e614df69-c6af6289-588af4a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:52.783252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:52.783285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 239
2025-10-10T14:01:52.786311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:52.786466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:52.786485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:52.786495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:52.787769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 239 sessionId:  describe result for acl check
2025-10-10T14:01:52.787903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:52.787913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:52.787923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:52.787940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593038784690577:4784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:52.790711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593038784690577:4784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:52.795724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:52.801260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593038784690577:4784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:52.805875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:52.806771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:52.806804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:52.806849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:52.807091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:52.807253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593037206773811:4414]
2025-10-10T14:01:52.809781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:52.814187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:52.814419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:52.815697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:52.816022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:52.816029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:52.816035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:52.816043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:52.816050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:52.816057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:52.816063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:52.816071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:52.816077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.816083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.816089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.816096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.816147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:52.816243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:52.816289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:52.816332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:52.816374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:52.816415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:52.816457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:52.816497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:52.816538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.816581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.816622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.816672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.816711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:52.816771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:52.816824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:52.816875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:52.816917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:52.816993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:52.817037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:52.817087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:52.817149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:52.817198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:52.817237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:52.817286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:52.817344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:52.817397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:52.817438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:52.817514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:52.817563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.817612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.817651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.817699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.817740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.817788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.817856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.817904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.818314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:52.818265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593038784690577:4784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:52.818313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593038784690577:4784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:52.818330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593038784690577:4784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:52.818361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:52.835460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593038784690625:4447]
2025-10-10T14:01:52.844611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:52.866894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:52.866960Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:52.866979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:52.866999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:52.867023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 238 [2:7559593037206773811:4414]
2025-10-10T14:01:52.867081Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:52.867141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:52.867156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:52.867170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:52.867181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:52.867230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:52.867252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:52.867276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:52.870468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.870513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.870529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.870544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.870555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:52.870837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:52.870867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.872109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 238
2025-10-10T14:01:52.871030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:52.871235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:52.872201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 238, pipe: [1:7559593038784690625:4447]
2025-10-10T14:01:52.871522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:52.872264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 238
2025-10-10T14:01:52.871956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:52.872062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593038784690536:2442], now have 1 active actors on pipe
2025-10-10T14:01:52.872089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593038784690625:4447], now have 1 active actors on pipe
2025-10-10T14:01:52.872113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593038784690612:4784], now have 1 active actors on pipe
2025-10-10T14:01:52.872139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593037206773804:4414]
2025-10-10T14:01:52.872154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593037206773804:4414]
2025-10-10T14:01:52.872167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593037206773804:4414]
2025-10-10T14:01:52.872181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593037206773804:4414]
2025-10-10T14:01:52.872226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:52.872309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:52.872431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:52.872445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:52.872456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:52.872467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:52.872508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:52.872530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:52.872683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593037206773804:4414]
2025-10-10T14:01:52.872728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:52.872753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:52.872824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:52.872857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:52.873036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60e1dd79-fa3179a0-c639f16b-38867899_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:52.873079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:52.873098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:52.873110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:52.873157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:52.873198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:52.873276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:52.873810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:52.873855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:52.873926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:52.874246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 239 partition: 0 MaxSeqNo: 36 sessionId: src_id|60e1dd79-fa3179a0-c639f16b-38867899_0
2025-10-10T14:01:52.877363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2df7d63-e614df69-c6af6289-588af4a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60e1dd79-fa3179a0-c639f16b-38867899_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:52.904327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e1dd79-fa3179a0-c639f16b-38867899_0] Write session: try to update token
2025-10-10T14:01:52.904383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e1dd79-fa3179a0-c639f16b-38867899_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:52.982504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:52.982543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:52.982554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:52.982619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:52.982634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:52.982647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:52.982659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:52.982668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:52.982713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593037206773804:4414]
2025-10-10T14:01:52.982745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593037206773804:4414]
2025-10-10T14:01:52.982770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593037206773804:4414]
2025-10-10T14:01:52.982790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593037206773804:4414]
2025-10-10T14:01:52.982938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:52.982966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:52.982976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:52.984031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:52.985283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:52.985315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:52.985341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:52.985367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:53.063119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId: src_id|60e1dd79-fa3179a0-c639f16b-38867899_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:53.085779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:53.133965Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:53.139285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:53.139333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:53.144173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:53.147751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:53.170661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 239 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60e1dd79-fa3179a0-c639f16b-38867899_0
2025-10-10T14:01:53.171018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 239 sessionId: src_id|60e1dd79-fa3179a0-c639f16b-38867899_0 is DEAD
2025-10-10T14:01:53.173318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e1dd79-fa3179a0-c639f16b-38867899_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:53.173354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e1dd79-fa3179a0-c639f16b-38867899_0] Write session will restart in 0.006052s
2025-10-10T14:01:53.173450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e1dd79-fa3179a0-c639f16b-38867899_0] Write session: Do CDS request
2025-10-10T14:01:53.173493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e1dd79-fa3179a0-c639f16b-38867899_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:53.186248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60e1dd79-fa3179a0-c639f16b-38867899_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:53.200105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:53.200246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593038784690625:4447]
2025-10-10T14:01:53.200312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:53.200324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 240
2025-10-10T14:01:53.204223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:53.204360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:53.204373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:53.204383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:53.207842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 240 sessionId:  describe result for acl check
2025-10-10T14:01:53.207962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:53.207970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:53.207979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:53.207995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593043079657965:4795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:53.211613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:53.210398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593043079657965:4795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:53.216435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:53.217404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:53.217434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:53.217477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:53.217724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:53.217874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593041501741179:4424]
2025-10-10T14:01:53.219394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:53.219655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593043079657965:4795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:53.220353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:53.220575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:53.221765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:53.222064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:53.222071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:53.222077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:53.222082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:53.222087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:53.222093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:53.222100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:53.222105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:53.222112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.222117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.222123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.222128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.222177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:53.222308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:53.222355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:53.222407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:53.222448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:53.222493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:53.222543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:53.222594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:53.222635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.222679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.222722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.222766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.222802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:53.222861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:53.222911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:53.222956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:53.223001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:53.223051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:53.223093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:53.223144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:53.223187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:53.223231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:53.223271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:53.223320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:53.223361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:53.223411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:53.223452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:53.223500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:53.223545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.223595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.223637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.223692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.223734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.223779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.223819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.223867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.224289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:53.227133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593043079657965:4795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:53.227172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593043079657965:4795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:53.227187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593043079657965:4795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:53.227216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:53.252107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:53.271228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:53.271275Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:53.271290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:53.271308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:53.271328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 239 [2:7559593041501741179:4424]
2025-10-10T14:01:53.271375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:53.271423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:53.271437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:53.271448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:53.271685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:53.271737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:53.271767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:53.271782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:53.274324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.274340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.274350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.274357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.274363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:53.274602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:53.274620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.274735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.274897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.275083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.275187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:53.275259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593043079658000:4795], now have 1 active actors on pipe
2025-10-10T14:01:53.275284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593043079657958:2442], now have 1 active actors on pipe
2025-10-10T14:01:53.275310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593041501741174:4424]
2025-10-10T14:01:53.275324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593041501741174:4424]
2025-10-10T14:01:53.275334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593041501741174:4424]
2025-10-10T14:01:53.275346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593041501741174:4424]
2025-10-10T14:01:53.275381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:53.275402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:53.275413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:53.275422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:53.275433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:53.275449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:53.275601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:53.275617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:53.275715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593041501741174:4424]
2025-10-10T14:01:53.275736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:53.275759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:53.278301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:53.278362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:53.278454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25041d78-605c1a41-908164d3-c8673e50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:53.278486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:53.278503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:53.278515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:53.278550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:53.277300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 239
2025-10-10T14:01:53.278592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:53.278635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:53.277391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 239
2025-10-10T14:01:53.279696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:53.279715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:53.280016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 240 partition: 0 MaxSeqNo: 36 sessionId: src_id|25041d78-605c1a41-908164d3-c8673e50_0
2025-10-10T14:01:53.279763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:53.282036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60e1dd79-fa3179a0-c639f16b-38867899_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25041d78-605c1a41-908164d3-c8673e50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:53.304374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593043079658006:4447]
2025-10-10T14:01:53.307069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593043079658006:4447], now have 1 active actors on pipe
2025-10-10T14:01:53.306934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 239, pipe: [1:7559593043079658006:4447]
2025-10-10T14:01:53.316023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25041d78-605c1a41-908164d3-c8673e50_0] Write session: try to update token
2025-10-10T14:01:53.316080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25041d78-605c1a41-908164d3-c8673e50_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:53.408557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:53.408603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:53.408615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:53.408694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:53.408709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:53.408723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:53.408736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:53.408746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:53.408784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593041501741174:4424]
2025-10-10T14:01:53.408810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593041501741174:4424]
2025-10-10T14:01:53.408833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593041501741174:4424]
2025-10-10T14:01:53.408868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593041501741174:4424]
2025-10-10T14:01:53.409034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:53.409078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.409097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:53.409179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:53.409229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:53.409272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:53.409305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:53.415235Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:53.461739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId: src_id|25041d78-605c1a41-908164d3-c8673e50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:53.492408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:53.569242Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:53.571019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:53.571050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:53.573644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:53.573413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593043079658006:4447]
2025-10-10T14:01:53.574370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:53.574581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:53.574596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:53.609943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:53.613485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:53.614417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:53.614435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:53.614480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:53.614742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:53.614919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593041501741268:4433]
2025-10-10T14:01:53.616931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:53.618396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:53.618657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:53.619935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:53.620255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:53.620263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:53.620270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:53.620277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:53.620283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:53.620290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:53.620297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:53.620302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:53.620310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.620316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.620323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.620329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.620375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:53.620471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:53.620511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:53.620549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:53.620589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:53.620629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:53.620669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:53.620707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:53.620742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.620783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.620818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.620856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.620892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:53.620949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:53.621016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:53.621062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:53.621103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:53.621173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:53.621211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:53.621254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:53.621294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:53.621337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:53.621375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:53.621418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:53.621454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:53.621498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:53.621534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:53.621579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:53.621619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.621661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.621698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.621744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.621780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.621823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.621861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.621903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.622271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:53.624758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:01:53.624812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-10T14:01:53.634677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 240 reason: error at write: Disconnected sessionId: src_id|25041d78-605c1a41-908164d3-c8673e50_0
2025-10-10T14:01:53.634958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 240 sessionId: src_id|25041d78-605c1a41-908164d3-c8673e50_0 is DEAD
2025-10-10T14:01:53.637716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25041d78-605c1a41-908164d3-c8673e50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:53.637775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25041d78-605c1a41-908164d3-c8673e50_0] Write session will restart in 0.006701s
2025-10-10T14:01:53.637914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25041d78-605c1a41-908164d3-c8673e50_0] Write session: Do CDS request
2025-10-10T14:01:53.637957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25041d78-605c1a41-908164d3-c8673e50_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:53.650705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25041d78-605c1a41-908164d3-c8673e50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:53.653447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:53.653486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 241
2025-10-10T14:01:53.654083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:53.654215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:53.654231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:53.654243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:53.655730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 241 sessionId:  describe result for acl check
2025-10-10T14:01:53.655852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:53.655862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:53.655871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:53.655889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593043079658054:4803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:53.659267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593043079658054:4803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:53.659748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:53.669097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593043079658054:4803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:53.673626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593043079658075:4447]
2025-10-10T14:01:53.683489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:53.683553Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:53.683572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:53.683593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:53.683616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 240 [2:7559593041501741268:4433]
2025-10-10T14:01:53.683673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:53.683728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:53.683744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:53.683756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:53.683766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:53.683814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:53.683836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:53.683858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:53.689740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593043079658054:4803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:53.689787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593043079658054:4803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:53.689803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593043079658054:4803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:53.689833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:53.708208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 240
2025-10-10T14:01:53.708296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 240, pipe: [1:7559593043079658075:4447]
2025-10-10T14:01:53.708411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 240
2025-10-10T14:01:53.705660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.705699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.705709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.705719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.705727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:53.705945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:53.705958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.706060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:53.706182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:53.706417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:53.706546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:53.706631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593043079658084:4803], now have 1 active actors on pipe
2025-10-10T14:01:53.706659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593043079658075:4447], now have 1 active actors on pipe
2025-10-10T14:01:53.706678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593043079658024:2442], now have 1 active actors on pipe
2025-10-10T14:01:53.706696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:53.706706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:53.706716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:53.706725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:53.706750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:53.706796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:53.706809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:53.706834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:53.706848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:53.706861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:53.706954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:53.706965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:53.707060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:53.707081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:53.707119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:53.709756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:53.709814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:53.709965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:53.710008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:53.710027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:53.710038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:53.710076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:53.710126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:53.710295Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:01:53.710410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:53.710966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 5 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:01:53.711891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:53.711933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:53.712005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:53.711108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:01:53.714074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25041d78-605c1a41-908164d3-c8673e50_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:53.713243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 241 partition: 0 MaxSeqNo: 36 sessionId: src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0
2025-10-10T14:01:53.747492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0] Write session: try to update token
2025-10-10T14:01:53.747554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:53.818788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:53.818833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:53.818856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:53.818909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:53.818925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:53.818938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:53.818949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:53.818960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:53.819003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:53.819030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:53.819062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:53.819092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:53.819289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:53.819328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:53.819423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:53.821387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:53.821448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:53.821475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:53.821502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:53.833352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:53.899218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId: src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:53.923615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:54.007742Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:54.021065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:54.021117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:54.021204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:54.021220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:54.021257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593041501741263:4433]
2025-10-10T14:01:54.022019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:54.022617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:54.023088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593043079658075:4447]
2025-10-10T14:01:54.023239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:54.023413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:54.031062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 241 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0
2025-10-10T14:01:54.031413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 241 sessionId: src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0 is DEAD
2025-10-10T14:01:54.033826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:54.033894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0] Write session will restart in 0.008984s
2025-10-10T14:01:54.034076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0] Write session: Do CDS request
2025-10-10T14:01:54.034134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:54.062178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:54.065263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:54.065299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 242
2025-10-10T14:01:54.065830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:54.065954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:54.065976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:54.065986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:54.067352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 242 sessionId:  describe result for acl check
2025-10-10T14:01:54.067513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:54.067530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:54.067540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:54.067556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593047374625434:4809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:54.070253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593047374625434:4809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:54.078292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593047374625434:4809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:54.079929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:54.083620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:54.084424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:54.084441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:54.084484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:54.084719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:54.084887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593045796708645:4438]
2025-10-10T14:01:54.088927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593047374625434:4809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:54.088972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593047374625434:4809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:54.088988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593047374625434:4809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:54.089035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:54.087084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:54.090344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:54.090605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:54.091807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:54.092123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:54.092141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:54.092148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:54.092155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:54.092162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:54.092168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:54.092174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:54.092180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:54.092185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.092193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.092198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.092204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.092248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:54.092346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:54.092393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:54.092440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:54.092482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:54.092537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:54.092580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:54.092621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:54.092663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.092704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.092745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.092787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.092829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:54.092892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:54.092948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:54.093016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:54.093065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:54.093117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:54.093492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:54.093559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:54.093620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:54.093673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:54.093715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:54.093768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:54.093813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:54.093864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:54.093909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:54.093961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:54.094007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.094056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.094101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.094152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.094192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.094241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.094284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.094334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.094740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:54.124322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:54.125274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593047374625479:4447]
2025-10-10T14:01:54.136925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:54.136987Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:54.137018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:54.137041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:54.137067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 241 [2:7559593045796708645:4438]
2025-10-10T14:01:54.137419Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:54.137500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:54.137514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:54.137528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:54.137541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:54.137592Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:54.137614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:54.137636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:54.148880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.148910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.148919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.148926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.148933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:54.149388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:54.149416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.149531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.149679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.149567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 241, pipe: [1:7559593047374625479:4447]
2025-10-10T14:01:54.149685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 241
2025-10-10T14:01:54.149777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 241
2025-10-10T14:01:54.149880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.149993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:54.150077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593047374625479:4447], now have 1 active actors on pipe
2025-10-10T14:01:54.150115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593047374625417:2442], now have 1 active actors on pipe
2025-10-10T14:01:54.150135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593047374625474:4809], now have 1 active actors on pipe
2025-10-10T14:01:54.150177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:54.150198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:54.150242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.150263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.150276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.150288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.150328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:54.150357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:54.150381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:54.150404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:54.150404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:54.150415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:54.150553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:54.150577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:54.150638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:54.150674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:54.150697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:54.150707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:54.150743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:54.150790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:54.150906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.150935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:54.150964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:54.150977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:54.151417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:54.151448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:54.151512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:54.152308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 242 partition: 0 MaxSeqNo: 36 sessionId: src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0
2025-10-10T14:01:54.153055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d4a9fa4-7312085a-b29ea9c6-8c765d0f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:54.190362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0] Write session: try to update token
2025-10-10T14:01:54.190426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:54.194751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:54.194796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:54.194834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.194954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:54.194964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:54.196786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:54.199120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:54.200492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:54.201743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:54.203290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:54.203688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:54.241297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:54.241346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:54.241359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:54.271433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:54.271582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:54.271594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:54.271601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:54.271609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:54.271638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.271656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.271678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.271700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593045796708640:4438]
2025-10-10T14:01:54.271804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:54.271825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.271833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:54.273203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:54.273240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:54.273259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:54.273276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:54.274358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:54.373832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId: src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:54.396590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:54.424286Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:54.433331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:54.433393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:54.434256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:54.438756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593047374625479:4447]
2025-10-10T14:01:54.438905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:54.439099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:54.485325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 242 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0
2025-10-10T14:01:54.485694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 242 sessionId: src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0 is DEAD
2025-10-10T14:01:54.486375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:54.486440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0] Write session will restart in 0.007037s
2025-10-10T14:01:54.486587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0] Write session: Do CDS request
2025-10-10T14:01:54.486631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:54.500555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:54.504075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:54.504116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 243
2025-10-10T14:01:54.505448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:54.505577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:54.505592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:54.505602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:54.506983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 243 sessionId:  describe result for acl check
2025-10-10T14:01:54.507100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:54.507110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:54.507119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:54.507136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593047374625528:4820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:54.509771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593047374625528:4820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:54.514435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:54.519218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:54.520036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:54.520053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:54.520097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:54.520343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:54.520533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593045796708724:4446]
2025-10-10T14:01:54.522411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593047374625528:4820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:54.522571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:54.524094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:54.524299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:54.525539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:54.525853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:54.525859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:54.525868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:54.525875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:54.525881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:54.525888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:54.525893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:54.525900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:54.525906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.525912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.525917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.525924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.525966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:54.526065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:54.526109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:54.526153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:54.526196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:54.526241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:54.526282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:54.526325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:54.526366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.526408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.526452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.526495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.526534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:54.526594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:54.526688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:54.526753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:54.526797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:54.526845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:54.526885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:54.526936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:54.526979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:54.527027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:54.527074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:54.527122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:54.527165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:54.527226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:54.527270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:54.527321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:54.527364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.527413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.527451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.527502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.527546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.527593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.527636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.527684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.528077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:54.544266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593047374625561:4447]
2025-10-10T14:01:54.545443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593047374625528:4820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:54.545476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593047374625528:4820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:54.545488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593047374625528:4820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:54.545510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:54.553927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:54.575168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:54.575227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:54.575245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:54.575264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:54.575288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 242 [2:7559593045796708724:4446]
2025-10-10T14:01:54.575340Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:54.575408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:54.575422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:54.575433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:54.575445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:54.575491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:54.575513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:54.575534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:54.580117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 242, pipe: [1:7559593047374625561:4447]
2025-10-10T14:01:54.580241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 242
2025-10-10T14:01:54.580324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 242
2025-10-10T14:01:54.579039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.579078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.579091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.579105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.579114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:54.579417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:54.579432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.579563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:54.579859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:54.580138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:54.580243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:54.580325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593047374625564:4820], now have 1 active actors on pipe
2025-10-10T14:01:54.580345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593047374625561:4447], now have 1 active actors on pipe
2025-10-10T14:01:54.580364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593047374625504:2442], now have 1 active actors on pipe
2025-10-10T14:01:54.580387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.580401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.580414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.580425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.580469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:54.580548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:54.580709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:54.580726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:54.580931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.580964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:54.581206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:54.581247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:54.581264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:54.581282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:54.581312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:54.581748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:54.581778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:54.581850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24e40eb6-e8939465-48d72363-484e15c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:54.581897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:54.581927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:54.581942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:54.581995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:54.582063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:54.582134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:54.587711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:54.587779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:54.587874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:54.589403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 243 partition: 0 MaxSeqNo: 36 sessionId: src_id|24e40eb6-e8939465-48d72363-484e15c9_0
2025-10-10T14:01:54.592847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d71422f-548cc32d-de2cdaaa-5258fa37_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24e40eb6-e8939465-48d72363-484e15c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:54.622513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e40eb6-e8939465-48d72363-484e15c9_0] Write session: try to update token
2025-10-10T14:01:54.622573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e40eb6-e8939465-48d72363-484e15c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:54.665035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:54.665082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:54.665117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.665265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:54.667044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:54.667356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:54.673767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:54.674943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:54.676088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:54.686629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:54.687233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:54.687246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:54.687258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:54.687313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:54.819236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:54.819286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:54.819301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:54.819313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:54.819325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:54.819368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.819396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.819419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.819445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593045796708719:4446]
2025-10-10T14:01:54.819650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:54.819674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:54.819696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:54.819767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:54.819807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:54.819833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:54.820353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:54.820394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:54.820422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:54.820448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:54.823295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:54.836733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId: src_id|24e40eb6-e8939465-48d72363-484e15c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:54.865872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:54.987904Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:54.990030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:54.990079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:54.991293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:54.990640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:54.990672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:54.991898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593047374625561:4447]
2025-10-10T14:01:54.991958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:55.022104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 243 reason: error at write: Disconnected sessionId: src_id|24e40eb6-e8939465-48d72363-484e15c9_0
2025-10-10T14:01:55.022464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 243 sessionId: src_id|24e40eb6-e8939465-48d72363-484e15c9_0 is DEAD
2025-10-10T14:01:55.025319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e40eb6-e8939465-48d72363-484e15c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:55.025355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e40eb6-e8939465-48d72363-484e15c9_0] Write session will restart in 0.005131s
2025-10-10T14:01:55.025450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e40eb6-e8939465-48d72363-484e15c9_0] Write session: Do CDS request
2025-10-10T14:01:55.025493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e40eb6-e8939465-48d72363-484e15c9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:55.041000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24e40eb6-e8939465-48d72363-484e15c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:55.050640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:55.050712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 244
2025-10-10T14:01:55.051399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:55.051702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:55.051744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:55.051766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:55.055815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 244 sessionId:  describe result for acl check
2025-10-10T14:01:55.055951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:55.055969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:55.055980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:55.056000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593051669592930:4829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:55.058877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593051669592930:4829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:55.060703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:55.064819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:55.065767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:55.065807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:55.065856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:55.066130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:55.066316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593050091676126:4457]
2025-10-10T14:01:55.068522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593051669592930:4829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:55.074646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:55.078583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:55.078938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:55.080239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:55.080558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.080566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.080573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.080580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.080587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.080628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.080635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.080642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.080647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.080653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.080661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.080667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.080714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.080821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.080869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.080916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.080963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.081008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.081070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.081115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.081173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.081217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.081262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.081306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.081347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.081403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.081463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.081516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.081559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.081615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.081661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.081745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.081789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.081840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.081882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.081981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.082026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.082079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.082125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.082178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.082223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.082274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.082315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.082367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.082411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.082458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.082499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.082548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.082999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:55.081495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593051669592930:4829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:55.081538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593051669592930:4829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:55.081555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593051669592930:4829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:55.081586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:55.091180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593051669592967:4447]
2025-10-10T14:01:55.104608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:55.141502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:55.141565Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:55.141580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:55.141598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:55.141621Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 243 [2:7559593050091676126:4457]
2025-10-10T14:01:55.141672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:55.141734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:55.141750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:55.141762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:55.141773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:55.141822Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:55.141843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:55.141865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:55.143622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.143655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.143668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.143681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.143691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:55.143954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:55.143969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.144099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.144268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.144479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.144588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:55.144654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.144669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.144682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.144694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.144725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:55.144803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:55.144965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:55.144983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:55.145122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.145156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:55.145411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:55.145423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:55.145434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:55.145445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:55.145468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:55.147007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593051669592963:4829], now have 1 active actors on pipe
2025-10-10T14:01:55.147059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593051669592967:4447], now have 1 active actors on pipe
2025-10-10T14:01:55.147083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593047374625605:2442], now have 1 active actors on pipe
2025-10-10T14:01:55.150430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:55.150472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:55.150555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:55.150589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:55.150605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:55.150615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:55.150652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:55.150697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:55.150738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:55.151768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:55.151815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:55.151886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:55.148376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 243
2025-10-10T14:01:55.148415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 243, pipe: [1:7559593051669592967:4447]
2025-10-10T14:01:55.148508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 243
2025-10-10T14:01:55.152783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 244 partition: 0 MaxSeqNo: 36 sessionId: src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0
2025-10-10T14:01:55.153556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24e40eb6-e8939465-48d72363-484e15c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:55.174260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0] Write session: try to update token
2025-10-10T14:01:55.174321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:55.240859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:55.240905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:55.240916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:55.240925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:55.240936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:55.240972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.240997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.241018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.241048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.241273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:55.241293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:55.241303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:55.241344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:55.241367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.241376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:55.241631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:55.241660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:55.241690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:55.241718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:55.243258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:55.273616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId: src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:55.320273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:55.398211Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:55.413420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:55.413479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:55.413547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:55.413561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:55.413604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593050091676121:4457]
2025-10-10T14:01:55.414411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593051669592967:4447]
2025-10-10T14:01:55.414510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:55.414541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:55.414555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:55.413921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:55.414385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:55.446538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 244 reason: error at write: Disconnected sessionId: src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0
2025-10-10T14:01:55.447252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:55.447303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0] Write session will restart in 0.007191s
2025-10-10T14:01:55.447471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0] Write session: Do CDS request
2025-10-10T14:01:55.447515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:55.446878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 244 sessionId: src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0 is DEAD
2025-10-10T14:01:55.460961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:55.460999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 245
2025-10-10T14:01:55.460266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:55.461846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:55.463562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:55.464456Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:55.464496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:55.464579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:55.465147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:55.465829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593050091676195:4459]
2025-10-10T14:01:55.468538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:55.468688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:55.468711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:55.468722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:55.469588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:55.470139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 245 sessionId:  describe result for acl check
2025-10-10T14:01:55.470269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:55.470288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:55.470299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:55.470315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593051669593009:4834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:55.472896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593051669593009:4834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:55.474000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:55.474323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:55.475743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:55.476072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.476088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.476097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.476104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.476112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.476120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.476127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.476134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.476141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.476148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.476155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.476162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.476212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.476333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.476384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.476433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.476496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.476548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.476596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.476646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.476694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.476742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.476790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.476844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.476890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.476965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.477038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.477095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.477156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.477218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.477272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.477334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.477394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.477457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.477502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.477566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.477617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.477677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.477730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.477783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.477851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.477909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.477947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.477989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.478028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.478075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.478124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.478178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.478605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:55.483467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593051669593009:4834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:55.507130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593051669593009:4834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:55.507178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593051669593009:4834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:55.507195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593051669593009:4834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:55.507228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:55.512476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:55.513401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593051669593044:4447]
2025-10-10T14:01:55.536302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:55.542219Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:55.542278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:55.542300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:55.542325Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 244 [2:7559593050091676195:4459]
2025-10-10T14:01:55.542384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:55.542442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:55.542457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:55.542468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:55.542480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:55.542528Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:55.542551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:55.542576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:55.543873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.543908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.543923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.543938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.543950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:55.544226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:55.544253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.544409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.544620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.544886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.545013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:55.545100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.545116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.545150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.545166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.545211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:55.545298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:55.545495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:55.545512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:55.545637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.545659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:55.546027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:55.546042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:55.546054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:55.546064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:55.546090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:55.547254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593051669593044:4447], now have 1 active actors on pipe
2025-10-10T14:01:55.547299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593051669593043:4834], now have 1 active actors on pipe
2025-10-10T14:01:55.547323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593051669592978:2442], now have 1 active actors on pipe
2025-10-10T14:01:55.550616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 244, pipe: [1:7559593051669593044:4447]
2025-10-10T14:01:55.550747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 244
2025-10-10T14:01:55.550835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 244
2025-10-10T14:01:55.551473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:55.551535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:55.551777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:55.551849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:55.551870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:55.551883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:55.551930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:55.551976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:55.552048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:55.552659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:55.552738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:55.552820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:55.553510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 245 partition: 0 MaxSeqNo: 36 sessionId: src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0
2025-10-10T14:01:55.557337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a46681b6-24336f05-27f3a8af-a56a5a5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:55.602564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0] Write session: try to update token
2025-10-10T14:01:55.602626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:55.689552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:55.689596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:55.689607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:55.689719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:55.689731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:55.689745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:55.689755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:55.689765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:55.689798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.689821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.689841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.689871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.689983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:55.690013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:55.690046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:55.690078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:55.710815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:55.710875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.710885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:55.712140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:55.734065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId: src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:55.758335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:55.858766Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:55.861988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:55.862028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:55.862069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593050091676190:4459]
2025-10-10T14:01:55.862201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:55.862206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:55.862231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:55.864023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:55.864231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:55.864411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593051669593044:4447]
2025-10-10T14:01:55.864486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:55.864518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:55.880298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 245 reason: error at write: Disconnected sessionId: src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0
2025-10-10T14:01:55.880617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 245 sessionId: src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0 is DEAD
2025-10-10T14:01:55.880979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:55.881073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0] Write session will restart in 0.005522s
2025-10-10T14:01:55.881245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0] Write session: Do CDS request
2025-10-10T14:01:55.881276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:55.916171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:55.928038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:55.928075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 246
2025-10-10T14:01:55.928555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:55.928675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:55.928696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:55.928705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:55.929885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 246 sessionId:  describe result for acl check
2025-10-10T14:01:55.929996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:55.930005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:55.930014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:55.930029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593051669593116:4847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:55.932352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593051669593116:4847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:55.934615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:55.937971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593051669593116:4847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:55.939291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:55.940071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:55.940087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:55.940127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:55.940379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:55.940543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593050091676292:4463]
2025-10-10T14:01:55.942649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:55.943658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:55.943833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:55.945463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593051669593116:4847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:55.945505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593051669593116:4847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:55.945520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593051669593116:4847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:55.945550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:55.950866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:55.951326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.951334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.951339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.951346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.951352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.951358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.951364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.951372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.951378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.951385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.951391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.951399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.951442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.951544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.951589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.951633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.951678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.951724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.951768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.951810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.951852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.951896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.951938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.951981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.952017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.952079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:55.952137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.952190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:55.952239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.952290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:55.952331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.952380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:55.952421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.952472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:55.952514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.952565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:55.952612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.952660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:55.952703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.952752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:55.952798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.952847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.952890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.952940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.953006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.953068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.953107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.954163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.954603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:55.965251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593051669593153:4447]
2025-10-10T14:01:55.978873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:55.993375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:55.993435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:55.993454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:55.993472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:55.993495Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 245 [2:7559593050091676292:4463]
2025-10-10T14:01:55.993548Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:55.993603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:55.993615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:55.993627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:55.993638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:55.993686Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:55.993707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:55.993728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:55.996541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.996580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.996593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.996606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.996615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:55.996878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:55.996902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:55.997021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:55.997217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:55.997453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:55.997568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:55.997654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593051669593149:4847], now have 1 active actors on pipe
2025-10-10T14:01:55.997682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593051669593074:2442], now have 1 active actors on pipe
2025-10-10T14:01:55.997702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593051669593153:4447], now have 1 active actors on pipe
2025-10-10T14:01:55.997729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:55.997747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:55.997759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:55.997772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:55.997811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:55.997883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:55.998045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:55.998068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:55.998186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:55.998210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:55.998136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 245
2025-10-10T14:01:55.998244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 245
2025-10-10T14:01:55.998311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 245, pipe: [1:7559593051669593153:4447]
2025-10-10T14:01:55.998317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:55.998359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:55.998366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:55.998373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:55.998394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:55.998755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:55.998788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:55.998883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6be19d01-92d52542-1a5ee404-84b6de1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:55.998915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:55.998933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:55.998943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:55.998980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:55.999042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:55.999088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:56.001565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:56.001601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:56.001683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:56.002046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 246 partition: 0 MaxSeqNo: 36 sessionId: src_id|6be19d01-92d52542-1a5ee404-84b6de1_0
2025-10-10T14:01:56.005242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6894c516-fa20ad88-fd0569c-bc5d4c2e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6be19d01-92d52542-1a5ee404-84b6de1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:56.089904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6be19d01-92d52542-1a5ee404-84b6de1_0] Write session: try to update token
2025-10-10T14:01:56.089958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6be19d01-92d52542-1a5ee404-84b6de1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:56.110779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:56.110826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:56.110860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:56.110977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:56.110989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:56.111000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:56.111027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:56.111822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:01:56.116601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:01:56.118024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:56.119580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:56.121142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:01:56.128702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:01:56.129261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:01:56.212055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:56.212099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:56.212112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:56.212124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:56.212136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:56.212176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:56.212201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:56.212222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:56.212244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593050091676287:4463]
2025-10-10T14:01:56.212388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:56.212400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:56.212413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:56.212425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:56.212425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:56.212467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:56.212467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:56.212494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.212495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:56.212505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:56.216088Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:56.232718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId: src_id|6be19d01-92d52542-1a5ee404-84b6de1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:56.258216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:56.378183Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:56.384524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:56.386320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:56.386357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:56.384708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:56.385659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:56.387844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:56.388108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593051669593153:4447]
2025-10-10T14:01:56.395554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be19d01-92d52542-1a5ee404-84b6de1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:56.395613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be19d01-92d52542-1a5ee404-84b6de1_0] Write session will restart in 0.009944s
2025-10-10T14:01:56.395717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be19d01-92d52542-1a5ee404-84b6de1_0] Write session: Do CDS request
2025-10-10T14:01:56.394764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 246 reason: error at write: Disconnected sessionId: src_id|6be19d01-92d52542-1a5ee404-84b6de1_0
2025-10-10T14:01:56.395119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 246 sessionId: src_id|6be19d01-92d52542-1a5ee404-84b6de1_0 is DEAD
2025-10-10T14:01:56.395748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be19d01-92d52542-1a5ee404-84b6de1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:56.411648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6be19d01-92d52542-1a5ee404-84b6de1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:56.413547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:56.413590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 247
2025-10-10T14:01:56.414044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:56.414173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:56.414190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:56.414201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:56.415715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 247 sessionId:  describe result for acl check
2025-10-10T14:01:56.415845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:56.415857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:56.415867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:56.415887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593055964560493:4856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:56.422083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593055964560493:4856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:56.433740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593055964560493:4856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:56.442648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:56.443711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593055964560493:4856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:56.443761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593055964560493:4856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:56.443779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593055964560493:4856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:56.443812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:56.443898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:56.445061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:56.445096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:56.445161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:56.445417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:56.445621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593054386643684:4478]
2025-10-10T14:01:56.447898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:56.449225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:56.449541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:56.450761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:56.451058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:56.451065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:56.451073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:56.451079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:56.451086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:56.451093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:56.451100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:56.451106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:56.451112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.451118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.451124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.451131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.451175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:56.451275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:56.451319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:56.451362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:56.451405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:56.451448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:56.451483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:56.451512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:56.451545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.451585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.451627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.451667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.451706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:56.451766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:56.451822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:56.451874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:56.451920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:56.451959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:56.452002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:56.452049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:56.452081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:56.452116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:56.452146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:56.452181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:56.452212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:56.452249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:56.452281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:56.452316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:56.452347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.452381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.452409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.452444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.452482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.452527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.452558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.452593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.453402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:56.485274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593055964560544:4447]
2025-10-10T14:01:56.492849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:56.524201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:56.524266Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:56.524286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:56.524308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:56.524335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 246 [2:7559593054386643684:4478]
2025-10-10T14:01:56.524397Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:56.524460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:56.524476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:56.524490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:56.524502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:56.524553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:56.524575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:56.524596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:56.526533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.526572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.526588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.526603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.526614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:56.526897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:56.526915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.527071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.527277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.527527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.527654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:56.527753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593055964560539:4856], now have 1 active actors on pipe
2025-10-10T14:01:56.527779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593055964560480:2442], now have 1 active actors on pipe
2025-10-10T14:01:56.527803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593055964560544:4447], now have 1 active actors on pipe
2025-10-10T14:01:56.527832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593054386643678:4478]
2025-10-10T14:01:56.527848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593054386643678:4478]
2025-10-10T14:01:56.527860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593054386643678:4478]
2025-10-10T14:01:56.527875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593054386643678:4478]
2025-10-10T14:01:56.527913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:56.527998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:56.528205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:56.528226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:56.528358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593054386643678:4478]
2025-10-10T14:01:56.528378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:56.528556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:56.528569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:56.528581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:56.528592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:56.528614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:56.529302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 246
2025-10-10T14:01:56.529306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 246
2025-10-10T14:01:56.529393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 246, pipe: [1:7559593055964560544:4447]
2025-10-10T14:01:56.529918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:56.529956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:56.530038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:56.530078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:56.530098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:56.530110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:56.530145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:56.530192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:56.530262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:56.535247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:56.535300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:56.535396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:56.537361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 247 partition: 0 MaxSeqNo: 36 sessionId: src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0
2025-10-10T14:01:56.538480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6be19d01-92d52542-1a5ee404-84b6de1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:56.571479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0] Write session: try to update token
2025-10-10T14:01:56.571541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:56.631937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:56.631985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:56.631999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:56.632010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:56.632020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:56.632058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593054386643678:4478]
2025-10-10T14:01:56.632084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593054386643678:4478]
2025-10-10T14:01:56.632107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593054386643678:4478]
2025-10-10T14:01:56.632128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593054386643678:4478]
2025-10-10T14:01:56.632265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:56.632295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:56.632297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:56.632308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:56.632319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:56.632320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:56.632343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:56.632363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:56.632389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.632401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:56.647663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:56.748389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId: src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:56.801381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:56.859321Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:56.862079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:56.862131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:56.865953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:56.869650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:56.869680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:56.872802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:56.872946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593055964560544:4447]
2025-10-10T14:01:56.895780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 247 reason: error at write: Disconnected sessionId: src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0
2025-10-10T14:01:56.896121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 247 sessionId: src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0 is DEAD
2025-10-10T14:01:56.900091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:56.900121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0] Write session will restart in 0.005405s
2025-10-10T14:01:56.900213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0] Write session: Do CDS request
2025-10-10T14:01:56.900240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:56.909988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:56.910019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 248
2025-10-10T14:01:56.910929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:56.911527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:56.911648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:56.911663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:56.911673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:56.913019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 248 sessionId:  describe result for acl check
2025-10-10T14:01:56.913178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:56.913189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:56.913197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:56.913216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593055964560596:4861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:56.915597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593055964560596:4861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:56.932335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593055964560596:4861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:56.939912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:56.949564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:56.950548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:56.950566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:56.950610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:56.950866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:56.951037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593054386643769:4481]
2025-10-10T14:01:56.953353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:56.954852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:56.955076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:56.956263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:56.956562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:56.956569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:56.956577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:56.956583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:56.956590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:56.956596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:56.956603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:56.956609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:56.956616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.956624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.956631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.956637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.956681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:56.956788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:56.956833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:56.956877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:56.956922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:56.956971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:56.957015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:56.957076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:56.957122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.957187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.957229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.957273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.957316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:56.957380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:56.957440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:56.957492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:56.957542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:56.957593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:56.957636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:56.957688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:56.957736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:56.957787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:56.957832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:56.957951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:56.958000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:56.958052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:56.958096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:56.958151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:56.958198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.958249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:56.958294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.958346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:56.958392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.958443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:56.958484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.958541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:56.958961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:56.971342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593055964560596:4861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:56.971405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593055964560596:4861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:56.971426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593055964560596:4861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:56.971470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:56.972940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593055964560640:4447]
2025-10-10T14:01:57.020776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:57.040825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:57.040894Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:57.040913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:57.040934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:57.040964Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 247 [2:7559593054386643769:4481]
2025-10-10T14:01:57.041025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:57.041111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:57.041299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:57.041314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:57.041328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:57.041385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:57.041409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:57.041431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:57.042878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.042916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:57.042931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:57.042947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:57.042959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:57.043280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:57.043299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.043451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:57.043651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:57.043899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:57.044024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:57.044106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593054386643763:4481]
2025-10-10T14:01:57.044124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593054386643763:4481]
2025-10-10T14:01:57.044139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593054386643763:4481]
2025-10-10T14:01:57.044152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593054386643763:4481]
2025-10-10T14:01:57.044188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:57.044274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:57.044467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:57.044488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:57.044626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593054386643763:4481]
2025-10-10T14:01:57.044645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:57.045551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:57.045571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:57.045587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:57.045602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:57.045635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:57.046697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593055964560565:2442], now have 1 active actors on pipe
2025-10-10T14:01:57.046764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593055964560640:4447], now have 1 active actors on pipe
2025-10-10T14:01:57.046792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593055964560638:4861], now have 1 active actors on pipe
2025-10-10T14:01:57.049309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 247
2025-10-10T14:01:57.049416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 247, pipe: [1:7559593055964560640:4447]
2025-10-10T14:01:57.049496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 247
2025-10-10T14:01:57.053306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:57.053374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:57.053480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:57.053534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:57.053557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:57.053570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:57.053613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:57.053664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:57.053724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:57.061294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:57.061361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:57.061458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:57.061887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 248 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0
2025-10-10T14:01:57.062778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc1bd6a-fe3dde26-eeb96431-8c0ffeed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:57.115978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0] Write session: try to update token
2025-10-10T14:01:57.116036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:57.170037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:57.170086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:57.170098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:57.170156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:57.170172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:57.170185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:57.170197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:57.170207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:57.170244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593054386643763:4481]
2025-10-10T14:01:57.170268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593054386643763:4481]
2025-10-10T14:01:57.170295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593054386643763:4481]
2025-10-10T14:01:57.170320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593054386643763:4481]
2025-10-10T14:01:57.170475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:57.170502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.170515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:57.170880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:57.170917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:57.170946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:57.170973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:57.171757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:57.256507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId: src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:57.278492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:57.317631Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:57.327330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:57.327380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:57.330006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:57.331773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:57.332102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593055964560640:4447]
2025-10-10T14:01:57.332241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:57.348642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:01:57.348721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0] Write session will restart in 0.006332s
2025-10-10T14:01:57.348917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0] Write session: Do CDS request
2025-10-10T14:01:57.348976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:57.344001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 248 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0
2025-10-10T14:01:57.347627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 248 sessionId: src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0 is DEAD
2025-10-10T14:01:57.364908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:57.367709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:57.367745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 249
2025-10-10T14:01:57.371957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:57.372117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:57.372133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:57.372143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:57.375762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 249 sessionId:  describe result for acl check
2025-10-10T14:01:57.375893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:57.375904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:57.375913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:57.375930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593060259527968:4869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:57.378907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593060259527968:4869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:57.390582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593060259527968:4869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:57.401586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593060259527968:4869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:57.401634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593060259527968:4869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:57.401652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593060259527968:4869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:57.401684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:57.402740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:57.407066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:57.408139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:57.408169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:57.408216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:57.408488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:57.408674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593058681611152:4484]
2025-10-10T14:01:57.411035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:57.412213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:57.412434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:57.413755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:57.414079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:57.414088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:57.414096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:57.414104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:57.414111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:57.414119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:57.414127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:57.414135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:57.414142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.414149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:57.414156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:57.414162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:57.414224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:57.414344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:57.414399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:57.414447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:57.414497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:57.414549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:57.414599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:57.414646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:57.414695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.414741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:57.414785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:57.414835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:57.414877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:57.414944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:57.415000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:57.415056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:57.415107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:57.415164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:57.415214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:57.415274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:57.415324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:57.415380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:57.415419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:57.415459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:57.415493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:57.415531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:57.415563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:57.415614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:57.415651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.415690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.415723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:57.415769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:57.415816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:57.415873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:57.415921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:57.415975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:57.416423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:57.430329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593060259528033:4447]
2025-10-10T14:01:57.476985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:57.494744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:57.494792Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:57.494809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:57.494828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:57.494852Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 248 [2:7559593058681611152:4484]
2025-10-10T14:01:57.494905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:57.494962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:57.494978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:57.494992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:57.495003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:57.495049Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:57.495070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:57.495091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:57.498185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.498213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:57.498226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:57.498239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:57.498249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:57.498533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:57.498549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.498681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:57.498853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:57.499070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:57.499181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:57.499255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593058681611145:4484]
2025-10-10T14:01:57.499269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593058681611145:4484]
2025-10-10T14:01:57.499280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593058681611145:4484]
2025-10-10T14:01:57.499292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593058681611145:4484]
2025-10-10T14:01:57.499338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:57.499415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:57.499589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:57.499605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:57.499728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593058681611145:4484]
2025-10-10T14:01:57.499745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:57.500442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:57.500460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:57.500472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:57.500481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:57.500504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:57.501520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593060259527950:2442], now have 1 active actors on pipe
2025-10-10T14:01:57.501550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593060259528033:4447], now have 1 active actors on pipe
2025-10-10T14:01:57.501572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593060259528026:4869], now have 1 active actors on pipe
2025-10-10T14:01:57.501553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 248
2025-10-10T14:01:57.501659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 248, pipe: [1:7559593060259528033:4447]
2025-10-10T14:01:57.501759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 248
2025-10-10T14:01:57.505402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:57.505444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:57.505532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:57.505573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:57.505602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:57.505615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:57.505652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:57.505697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:57.505741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:57.508366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:57.508400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:57.508472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:57.508905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 249 partition: 0 MaxSeqNo: 36 sessionId: src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0
2025-10-10T14:01:57.509826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ea3c89-8dbeeaf0-f3c764bf-311d47ad_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:57.559159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0] Write session: try to update token
2025-10-10T14:01:57.559221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:57.593249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:57.593286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:57.593297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:57.691567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:57.691622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:57.691640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:57.691653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:57.691684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:57.691728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593058681611145:4484]
2025-10-10T14:01:57.691757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593058681611145:4484]
2025-10-10T14:01:57.691784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593058681611145:4484]
2025-10-10T14:01:57.691808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593058681611145:4484]
2025-10-10T14:01:57.692015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:57.692045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:57.692058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:57.692445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:57.692479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:57.692511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:57.692542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:57.695835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:57.881514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId: src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:57.915995Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:57.926534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593060259528033:4447]
2025-10-10T14:01:57.927230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:57.956901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:57.956933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:57.967368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 249 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0
2025-10-10T14:01:57.967644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 249 sessionId: src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0 is DEAD
2025-10-10T14:01:57.972976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:01:57.973015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0] Write session will restart in 0.008194s
2025-10-10T14:01:57.973155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0] Write session: Do CDS request
2025-10-10T14:01:57.973184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:57.996396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:57.996436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 250
2025-10-10T14:01:57.997425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:57.997960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:57.998074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:57.998088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:57.998098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:58.000031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 250 sessionId:  describe result for acl check
2025-10-10T14:01:58.000140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:58.000149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:58.000159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:58.000175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593060259528111:4881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:58.002719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593060259528111:4881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:58.008951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:58.010599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593060259528111:4881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:58.011719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:58.012589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:58.012620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:58.012664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:58.012949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:58.013348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593062976578560:4494]
2025-10-10T14:01:58.015574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:58.016994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:58.017289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:58.018708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:58.019049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:58.019059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:58.019065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:58.019073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:58.019079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:58.019085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:58.019092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:58.019097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:58.019105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.019114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.019120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.019127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.019175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:58.019283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:58.019334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:58.019387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:58.019438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:58.019483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:58.019529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:58.019580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:58.019626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.019674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.019726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.019773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.019817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:58.019887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:58.019947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:58.020003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:58.020055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:58.020110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:58.020159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:58.020217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:58.020267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:58.020318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:58.020361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:58.020415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:58.020466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:58.020521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:58.020569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:58.020622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:58.020672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.020727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.020776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.020832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.020881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.020935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.020984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.021040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.022800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:58.024741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593060259528111:4881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:58.024786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593060259528111:4881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:58.024804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593060259528111:4881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:58.024834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:58.027559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593064554495440:4447]
2025-10-10T14:01:58.081833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:58.097679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:58.097727Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:58.097745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:58.097767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:58.097791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 249 [2:7559593062976578560:4494]
2025-10-10T14:01:58.097848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:58.097916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:58.097930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:58.097942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:58.097955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:58.098005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:58.098028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:58.098051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:58.101393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 249
2025-10-10T14:01:58.101501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 249, pipe: [1:7559593064554495440:4447]
2025-10-10T14:01:58.100087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.101585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 249
2025-10-10T14:01:58.100117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.100130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.100145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.100157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:58.100439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:58.100456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.100594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.100771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.100984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.101111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:58.101216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593064554495438:4881], now have 1 active actors on pipe
2025-10-10T14:01:58.101239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593064554495440:4447], now have 1 active actors on pipe
2025-10-10T14:01:58.101260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593060259528059:2442], now have 1 active actors on pipe
2025-10-10T14:01:58.101288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.101304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.101317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.101330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.101371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:58.101451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:58.101859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:58.101872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:58.101882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:58.101892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:58.102276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:58.102303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:58.102521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:58.102545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:58.102597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.102627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:58.102764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a0572cb-2153ee18-874adef-43796145_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:58.102798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:58.102817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:58.102827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:58.102865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:58.102910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:58.103006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:58.103657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:58.104823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:58.104856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:58.104954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:58.105653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 250 partition: 0 MaxSeqNo: 36 sessionId: src_id|1a0572cb-2153ee18-874adef-43796145_0
2025-10-10T14:01:58.108412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbc7c2e-f88e7a53-12221987-d7b9e1b4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1a0572cb-2153ee18-874adef-43796145_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:58.156500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0572cb-2153ee18-874adef-43796145_0] Write session: try to update token
2025-10-10T14:01:58.156560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0572cb-2153ee18-874adef-43796145_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:58.199911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:58.199947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:58.199958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:58.313799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId: src_id|1a0572cb-2153ee18-874adef-43796145_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:58.335711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:58.335752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:58.335767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:58.335779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:58.335790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:58.335831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.335859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.335883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.335903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.336483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:58.336502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:58.336507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:58.336513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:58.336541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:58.336568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:58.336570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:58.336597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:58.336752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.336768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:58.342016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:58.358557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:58.589864Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:58.618538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:58.618600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:58.618678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:01:58.618692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:58.618735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593062976578555:4494]
2025-10-10T14:01:58.620360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:58.620392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:58.619220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:01:58.621376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593064554495440:4447]
2025-10-10T14:01:58.621550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:58.623751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:58.673210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 250 reason: error at write: Disconnected sessionId: src_id|1a0572cb-2153ee18-874adef-43796145_0
2025-10-10T14:01:58.673556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 250 sessionId: src_id|1a0572cb-2153ee18-874adef-43796145_0 is DEAD
2025-10-10T14:01:58.678161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0572cb-2153ee18-874adef-43796145_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:58.678224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0572cb-2153ee18-874adef-43796145_0] Write session will restart in 0.007251s
2025-10-10T14:01:58.678397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0572cb-2153ee18-874adef-43796145_0] Write session: Do CDS request
2025-10-10T14:01:58.678441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0572cb-2153ee18-874adef-43796145_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:58.688545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:58.693076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:58.693139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 251
2025-10-10T14:01:58.694361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0572cb-2153ee18-874adef-43796145_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:58.695104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:58.695245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:58.695262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:58.695273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:58.696196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:58.697120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:58.697156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:58.697201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:58.697472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:58.697678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593062976578635:4503]
2025-10-10T14:01:58.700068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:58.701279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 251 sessionId:  describe result for acl check
2025-10-10T14:01:58.701404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:58.701414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:58.701423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:58.701441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593064554495496:4887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:58.704114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593064554495496:4887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:58.701296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:58.701547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:58.702834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:58.703139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:58.703148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:58.703155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:58.703161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:58.703170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:58.703177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:58.703184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:58.703193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:58.703200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.703207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.703213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.703221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.703271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:58.703389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:58.703446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:58.703497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:58.703546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:58.703594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:58.703643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:58.703688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:58.703737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.703784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.703835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.703883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.703921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:58.703992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:58.704051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:58.704112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:58.704164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:58.704223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:58.704269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:58.704324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:58.704371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:58.704426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:58.704475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:58.704533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:58.704583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:58.704637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:58.704686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:58.704743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:58.704791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.704846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.704892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.704947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.704998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.705056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.705115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.705295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.705785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:58.711566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593064554495496:4887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:58.720972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593064554495524:4447]
2025-10-10T14:01:58.723651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593064554495496:4887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:58.723700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593064554495496:4887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:58.723720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593064554495496:4887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:58.723753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:58.734159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:58.750133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:58.750186Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:58.750205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:58.750234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:58.750261Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 250 [2:7559593062976578635:4503]
2025-10-10T14:01:58.750322Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:58.750382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:58.750398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:58.750410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:58.750422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:58.750473Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:58.750496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:58.750517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:58.751896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.751914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.751930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.751947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.751960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:58.752238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:58.752256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.752418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:58.752635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:58.752901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:58.755787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 250
2025-10-10T14:01:58.755895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 250, pipe: [1:7559593064554495524:4447]
2025-10-10T14:01:58.756309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:58.756415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593064554495457:2442], now have 1 active actors on pipe
2025-10-10T14:01:58.756442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593064554495524:4447], now have 1 active actors on pipe
2025-10-10T14:01:58.756467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593064554495527:4887], now have 1 active actors on pipe
2025-10-10T14:01:58.756532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:58.756553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:58.756591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593062976578630:4503]
2025-10-10T14:01:58.756606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593062976578630:4503]
2025-10-10T14:01:58.756620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593062976578630:4503]
2025-10-10T14:01:58.756632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593062976578630:4503]
2025-10-10T14:01:58.756669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:58.756754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:58.756977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:58.756999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:58.757069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:58.757117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:58.757150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:58.757162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:58.757196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:58.757248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:58.757390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593062976578630:4503]
2025-10-10T14:01:58.757413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:58.757460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:58.757565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:58.757583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:58.757596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:58.757609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:58.757635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:58.759346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:58.759384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:58.759466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:58.755969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 250
2025-10-10T14:01:58.760063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 251 partition: 0 MaxSeqNo: 36 sessionId: src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0
2025-10-10T14:01:58.765362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0572cb-2153ee18-874adef-43796145_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:58.827859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0] Write session: try to update token
2025-10-10T14:01:58.827927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:58.851655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:58.851688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:58.851700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:58.885063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:58.885115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:58.889298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:58.889350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:58.889362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:58.889415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593062976578630:4503]
2025-10-10T14:01:58.889444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593062976578630:4503]
2025-10-10T14:01:58.889468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593062976578630:4503]
2025-10-10T14:01:58.889490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593062976578630:4503]
2025-10-10T14:01:58.889676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:58.889705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:58.889716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:58.890834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:58.890877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:58.890906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:58.890933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:58.897991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:58.995750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId: src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:59.023698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:59.053985Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:59.057121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:59.057183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:59.062045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:59.058598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:59.058630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:59.095945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 251 reason: error at write: Disconnected sessionId: src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0
2025-10-10T14:01:59.096275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 251 sessionId: src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0 is DEAD
2025-10-10T14:01:59.101364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:59.101411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0] Write session will restart in 0.005496s
2025-10-10T14:01:59.101543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0] Write session: Do CDS request
2025-10-10T14:01:59.101588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:59.110573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:59.110723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593064554495524:4447]
2025-10-10T14:01:59.114374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:59.117393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:59.117427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 252
2025-10-10T14:01:59.117742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:59.117849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:59.117863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:59.117873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:59.119214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 252 sessionId:  describe result for acl check
2025-10-10T14:01:59.119335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:59.119347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:59.119356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:59.119372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593068849462902:4899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:59.122022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593068849462902:4899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:59.128361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:59.131798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:59.132668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:59.132687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:59.132728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:59.132973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:59.133185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593067271546032:4513]
2025-10-10T14:01:59.135523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:59.142550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:59.142818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:59.144138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:59.144459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:59.144467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:59.144475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:59.144483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:59.144490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:59.144498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:59.144505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:59.144512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:59.144521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.144544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.144554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.144561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.144610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:59.144728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:59.144778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:59.144832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:59.144883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:59.141253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593068849462902:4899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:59.144952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:59.145002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:59.145051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:59.145100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.145187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.145237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.145286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.145327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:59.145395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:59.145453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:59.145513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:59.145565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:59.145621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:59.145667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:59.145722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:59.145772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:59.145827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:59.145875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:59.145929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:59.145976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:59.146033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:59.147266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:59.147334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:59.147388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.147442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.147487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.147543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.147594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.147648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.147694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.147749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.148236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:59.165618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593068849462902:4899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:59.165660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593068849462902:4899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:59.165679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593068849462902:4899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:59.165708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:59.180427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:59.197487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:59.197539Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:59.197557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:59.197578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:59.197602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 251 [2:7559593067271546032:4513]
2025-10-10T14:01:59.197662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:59.197720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:59.197737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:59.197749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:59.197761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:59.197811Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:59.197833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:59.197857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:59.200731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.200767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.200782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.200798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.200809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:59.201292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:59.201322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.201468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.201664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.202519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.202820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:59.202976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593068849462898:2442], now have 1 active actors on pipe
2025-10-10T14:01:59.203008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593068849462936:4899], now have 1 active actors on pipe
2025-10-10T14:01:59.203077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:59.203099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:59.203165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593067271546027:4513]
2025-10-10T14:01:59.203184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593067271546027:4513]
2025-10-10T14:01:59.203197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593067271546027:4513]
2025-10-10T14:01:59.203213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593067271546027:4513]
2025-10-10T14:01:59.203256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:59.203295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:59.203309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:59.203320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:59.203332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:59.203346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:59.203539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:59.203556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:59.203625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:59.203656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:59.203675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:59.203685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:59.203718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:59.203758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:59.203896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593067271546027:4513]
2025-10-10T14:01:59.203929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:59.203945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:59.203980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:59.204969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:59.201982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 251
2025-10-10T14:01:59.205000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:59.205065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:59.202099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 251
2025-10-10T14:01:59.207837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 252 partition: 0 MaxSeqNo: 36 sessionId: src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0
2025-10-10T14:01:59.209342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbf31a3-113d80b7-4b9c5505-fecafd7a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:59.210883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593068849462943:4447]
2025-10-10T14:01:59.211493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 251, pipe: [1:7559593068849462943:4447]
2025-10-10T14:01:59.211590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593068849462943:4447], now have 1 active actors on pipe
2025-10-10T14:01:59.274715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0] Write session: try to update token
2025-10-10T14:01:59.274773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:59.297961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:59.297995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:59.298006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:59.341005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:59.341045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:59.341060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:59.341074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:59.341085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:59.341144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593067271546027:4513]
2025-10-10T14:01:59.341168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593067271546027:4513]
2025-10-10T14:01:59.341194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593067271546027:4513]
2025-10-10T14:01:59.341218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593067271546027:4513]
2025-10-10T14:01:59.341327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:59.341361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:59.341370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:59.341390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:59.341397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.341409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:59.341419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:59.344474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:59.446459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId: src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:59.469561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:59.512666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:01:59.516187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:59.516230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:59.519718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593068849462943:4447]
2025-10-10T14:01:59.519807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:01:59.519949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:01:59.519963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:01:59.532766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 252 reason: error at write: Disconnected sessionId: src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0
2025-10-10T14:01:59.533103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 252 sessionId: src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0 is DEAD
2025-10-10T14:01:59.533761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:01:59.533798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0] Write session will restart in 0.009391s
2025-10-10T14:01:59.533892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0] Write session: Do CDS request
2025-10-10T14:01:59.533918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:01:59.536372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:01:59.548572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:59.549756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:59.549790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 253
2025-10-10T14:01:59.550271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:59.550385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:01:59.550408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:01:59.550417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:59.551755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 253 sessionId:  describe result for acl check
2025-10-10T14:01:59.551873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:59.551884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:59.551892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:59.551908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593068849462974:4907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:59.556683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593068849462974:4907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:59.582455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593068849462974:4907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:59.606428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:01:59.607105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593068849462974:4907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:59.607148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593068849462974:4907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:59.607165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593068849462974:4907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:59.607196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:59.612201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:01:59.613029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:01:59.613047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:01:59.613089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:01:59.613367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:01:59.613544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593067271546135:4517]
2025-10-10T14:01:59.615885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:01:59.617088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:01:59.617331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:01:59.618657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:01:59.618971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:59.618981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:59.618988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:59.618995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:59.619002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:59.619008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:59.619015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:59.619023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:59.619029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.619036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.619043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.619049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.619097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:59.619208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:59.619281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:59.619328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:59.619374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:59.619422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:59.619468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:59.619514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:59.619559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.619605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.619648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.619690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.619732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:59.619798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:01:59.619855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:59.619912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:01:59.619963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:59.620014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:01:59.620057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:59.620110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:01:59.620154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:59.620206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:01:59.620249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:59.620301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:01:59.620589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:59.620650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:01:59.620699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:59.620751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:01:59.620799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.620851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.620896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.620950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.620999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.621050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.621104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.621189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.621646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:01:59.620009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593068849463034:4447]
2025-10-10T14:01:59.666368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:01:59.680637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:01:59.680694Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:01:59.680714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:01:59.680735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:01:59.680758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 252 [2:7559593067271546135:4517]
2025-10-10T14:01:59.680816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:01:59.680883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:01:59.680898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:59.680911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:59.680921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:59.680968Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:01:59.680991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:01:59.681013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:01:59.683221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.683250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.683262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.683276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.683287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:01:59.683571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:01:59.683587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.683733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:01:59.683913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:01:59.684142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:01:59.684257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:01:59.684351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593068849462961:2442], now have 1 active actors on pipe
2025-10-10T14:01:59.684374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593068849463029:4907], now have 1 active actors on pipe
2025-10-10T14:01:59.684395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593068849463034:4447], now have 1 active actors on pipe
2025-10-10T14:01:59.684421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593067271546129:4517]
2025-10-10T14:01:59.684435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593067271546129:4517]
2025-10-10T14:01:59.684456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593067271546129:4517]
2025-10-10T14:01:59.684469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593067271546129:4517]
2025-10-10T14:01:59.684516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:01:59.684543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:01:59.684554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:01:59.684561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:01:59.684571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:01:59.684620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:01:59.684815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:01:59.684834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:01:59.684955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593067271546129:4517]
2025-10-10T14:01:59.684981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:01:59.684992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:01:59.685810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:59.685844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:59.685914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:59.685958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:59.685975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:59.685985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:59.686023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:59.686064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:59.686301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:59.686731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:59.686756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:59.686818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:59.688036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|273161ad-af210f6c-aa6443e6-53bd95b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:01:59.685294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 252
2025-10-10T14:01:59.685410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 252
2025-10-10T14:01:59.685478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 252, pipe: [1:7559593068849463034:4447]
2025-10-10T14:01:59.687210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 253 partition: 0 MaxSeqNo: 36 sessionId: src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0
2025-10-10T14:01:59.727293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0] Write session: try to update token
2025-10-10T14:01:59.727353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:01:59.802999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:59.803037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:59.803051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:59.803172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:01:59.803187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:01:59.803200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:01:59.803211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:01:59.803223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:01:59.803257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593067271546129:4517]
2025-10-10T14:01:59.803283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593067271546129:4517]
2025-10-10T14:01:59.803306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593067271546129:4517]
2025-10-10T14:01:59.803327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593067271546129:4517]
2025-10-10T14:01:59.803495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:01:59.803534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:01:59.803570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:01:59.803609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:01:59.822957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:01:59.822995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:01:59.823003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:01:59.850170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:01:59.913320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId: src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:59.936274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:00.014467Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:00.016132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:00.016149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:00.016197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593067271546129:4517]
2025-10-10T14:02:00.016320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:00.016347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:00.016372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:00.017257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:00.017197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:00.017249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593068849463034:4447]
2025-10-10T14:02:00.017342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:00.017354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:00.032738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:00.032818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0] Write session will restart in 0.008018s
2025-10-10T14:02:00.033002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0] Write session: Do CDS request
2025-10-10T14:02:00.033064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:00.030934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 253 reason: error at write: Disconnected sessionId: src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0
2025-10-10T14:02:00.031289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 253 sessionId: src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0 is DEAD
2025-10-10T14:02:00.054768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:00.057408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:00.057443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 254
2025-10-10T14:02:00.057887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:00.057999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:00.058015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:00.058025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:00.059320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 254 sessionId:  describe result for acl check
2025-10-10T14:02:00.059404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:00.059411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:00.059417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:00.059428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593073144430389:4913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:00.061949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593073144430389:4913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:00.077540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:00.080807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593073144430389:4913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:00.079950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:00.080758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:00.080777Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:00.080823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:00.081069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:00.081300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593071566513521:4526]
2025-10-10T14:02:00.083329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:00.086412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:00.086705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:00.087927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:00.088234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:00.088242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:00.088249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:00.088255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:00.088262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:00.088268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:00.088273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:00.088279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:00.088287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.088299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.088315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.088322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.088367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:00.088469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:00.088515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:00.088556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:00.088598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:00.088642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:00.088683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:00.088721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:00.088762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.088805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.088847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.088888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.088937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:00.088999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:00.089053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:00.089105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:00.089181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:00.089230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:00.089276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:00.089324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:00.089373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:00.089424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:00.089467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:00.089514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:00.089558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:00.089609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:00.089656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:00.089708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:00.089754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.089803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.089850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.089899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.089946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.090000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.090041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.090094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.090535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:00.093783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593073144430389:4913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:00.093838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593073144430389:4913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:00.093857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593073144430389:4913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:00.093890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:00.119177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593073144430435:4447]
2025-10-10T14:02:00.140143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:00.152611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:00.152663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:00.152681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:00.152702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:00.152728Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 253 [2:7559593071566513521:4526]
2025-10-10T14:02:00.152784Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:00.152859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:00.152876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:00.152887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:00.152899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:00.152951Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:00.152974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:00.152996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:00.154851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.154880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.154893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.154906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.154917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:00.155201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:00.155219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.155357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.155534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.155767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.155883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:00.155960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.155973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.155985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.155998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.156046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:00.156130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:00.156311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:00.156331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:00.156420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:00.156438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:00.156449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:00.156459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:00.156474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.156499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:00.156942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:00.157554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593073144430435:4447], now have 1 active actors on pipe
2025-10-10T14:02:00.157590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593073144430434:4913], now have 1 active actors on pipe
2025-10-10T14:02:00.157611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593073144430362:2442], now have 1 active actors on pipe
2025-10-10T14:02:00.159891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:00.159942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:00.160020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5107d645-bec573aa-870cd7c0-5df74375_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:00.160055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:00.160074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:00.160085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:00.160123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:00.160168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:00.160214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:00.160729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:00.160757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:00.160816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:00.158678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 253, pipe: [1:7559593073144430435:4447]
2025-10-10T14:02:00.158788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 253
2025-10-10T14:02:00.158856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 253
2025-10-10T14:02:00.161435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 254 partition: 0 MaxSeqNo: 36 sessionId: src_id|5107d645-bec573aa-870cd7c0-5df74375_0
2025-10-10T14:02:00.165733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e105b286-37cc5fe4-1ef41540-e29628fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5107d645-bec573aa-870cd7c0-5df74375_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:00.208375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5107d645-bec573aa-870cd7c0-5df74375_0] Write session: try to update token
2025-10-10T14:02:00.214734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5107d645-bec573aa-870cd7c0-5df74375_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:00.317864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:00.317898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:00.317910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:00.317969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:00.317983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:00.317997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:00.318007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:00.318018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:00.318054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.318079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.318102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.318124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.318366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:00.318392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.318402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:00.318509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:00.318538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:00.318565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:00.318601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:00.321915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:00.343929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId: src_id|5107d645-bec573aa-870cd7c0-5df74375_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:00.368455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:00.489036Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:00.512315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:00.512368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:00.512439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:00.512455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:00.512497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593071566513516:4526]
2025-10-10T14:02:00.517468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:00.518489Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:00.519147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593073144430435:4447]
2025-10-10T14:02:00.519259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:00.519271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:00.525314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:00.534213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 254 reason: error at write: Disconnected sessionId: src_id|5107d645-bec573aa-870cd7c0-5df74375_0
2025-10-10T14:02:00.534545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 254 sessionId: src_id|5107d645-bec573aa-870cd7c0-5df74375_0 is DEAD
2025-10-10T14:02:00.538414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5107d645-bec573aa-870cd7c0-5df74375_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:00.538457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5107d645-bec573aa-870cd7c0-5df74375_0] Write session will restart in 0.005381s
2025-10-10T14:02:00.538560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5107d645-bec573aa-870cd7c0-5df74375_0] Write session: Do CDS request
2025-10-10T14:02:00.538590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5107d645-bec573aa-870cd7c0-5df74375_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:00.549427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:00.549467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 255
2025-10-10T14:02:00.568411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5107d645-bec573aa-870cd7c0-5df74375_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
E1010 14:02:00.573607577  112376 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:02:00.573418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:00.573571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:00.573587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:00.573597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:00.575371Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:02:00.578288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 255 sessionId:  describe result for acl check
2025-10-10T14:02:00.578425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:00.578434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:00.578444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:00.578461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593073144430476:4918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:00.580861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593073144430476:4918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:00.608117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:00.610002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593073144430476:4918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:00.622249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:00.623129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:00.623147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:00.623193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:00.623470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:00.623658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593071566513605:4528]
2025-10-10T14:02:00.625285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593073144430528:4447]
2025-10-10T14:02:00.626282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:00.628245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593073144430476:4918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:00.628289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593073144430476:4918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:00.628307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593073144430476:4918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:00.628342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:00.627521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:00.627751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:00.629273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:00.629645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:00.629654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:00.629662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:00.629670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:00.629677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:00.629683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:00.629691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:00.629699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:00.629708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.629716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.629724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.629733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.629786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:00.629900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:00.629950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:00.630000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:00.630050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:00.630099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:00.630147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:00.630194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:00.630240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.630288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.630334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.630381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.630420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:00.630489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:00.630554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:00.630611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:00.630659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:00.630713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:00.630759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:00.630812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:00.630861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:00.630916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:00.630963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:00.631020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:00.631069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:00.631124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:00.631169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:00.631225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:00.631274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.631329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.631377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.631436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.631485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.631539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.631586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.631642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.632099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:00.674412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:00.689608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:00.689653Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:00.689669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:00.689688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:00.689709Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 254 [2:7559593071566513605:4528]
2025-10-10T14:02:00.689762Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:00.689813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:00.689827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:00.689840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:00.689851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:00.689898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:00.689918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:00.689940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:00.692553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.692570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.692583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.692595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.692606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:00.692880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:00.692897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.693034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:00.693971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 254
2025-10-10T14:02:00.694062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 254, pipe: [1:7559593073144430528:4447]
2025-10-10T14:02:00.694137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 254
2025-10-10T14:02:00.693331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:00.693577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:00.693693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:00.693769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593073144430447:2442], now have 1 active actors on pipe
2025-10-10T14:02:00.693794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593073144430528:4447], now have 1 active actors on pipe
2025-10-10T14:02:00.693816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593073144430533:4918], now have 1 active actors on pipe
2025-10-10T14:02:00.693840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:00.693855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:00.693869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:00.693884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:00.693923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:00.693959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:00.693973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:00.693986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:00.693997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:00.694002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:00.694173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:00.694189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:00.694321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:00.694342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:00.694403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:00.694527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:00.694549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:00.694636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:00.694663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:00.694681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:00.694691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:00.694722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:00.694759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:00.694804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:00.709804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:00.709852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:00.709936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:00.713435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 255 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0
2025-10-10T14:02:00.714704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5107d645-bec573aa-870cd7c0-5df74375_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:00.755703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0] Write session: try to update token
2025-10-10T14:02:00.755757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:00.869628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:00.869660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:00.869673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:00.869725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:00.869740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:00.869753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:00.869765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:00.869777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:00.869810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:00.869838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:00.869863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:00.869886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:00.870079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:00.870105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:00.870117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:00.870242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:00.870271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:00.870299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:00.870329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:00.891217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:00.974994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId: src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:01.020785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:01.057252Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:01.080765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:01.080809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:01.080867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:01.080880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:01.080920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593071566513598:4528]
2025-10-10T14:02:01.081460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:01.082757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:01.082788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:01.082914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:01.098055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:01.098203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593073144430528:4447]
2025-10-10T14:02:01.132973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:01.133040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0] Write session will restart in 0.009973s
2025-10-10T14:02:01.133250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0] Write session: Do CDS request
2025-10-10T14:02:01.133302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:01.132053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 255 reason: error at write: Disconnected sessionId: src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0
2025-10-10T14:02:01.132374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 255 sessionId: src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0 is DEAD
2025-10-10T14:02:01.162669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:01.166017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:01.166045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 256
2025-10-10T14:02:01.166362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:01.166448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:01.166464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:01.166476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:01.167511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 256 sessionId:  describe result for acl check
2025-10-10T14:02:01.167580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:01.167587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:01.167593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:01.167604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593077439397922:4935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:01.169698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593077439397922:4935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:01.175993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:01.180551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:01.181526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:01.181567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:01.181614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:01.181886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:01.182104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593075861481028:4538]
2025-10-10T14:02:01.183641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593077439397922:4935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:01.184697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:01.186011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:01.186251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:01.187174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:01.187474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:01.187488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:01.187494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:01.187499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:01.187504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:01.187508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:01.187512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:01.187517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:01.187522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.187527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.187531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.187535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.187574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:01.187657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:01.187696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:01.187753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:01.187804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:01.187846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:01.187886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:01.187925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:01.187973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.188012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.188053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.188090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.188122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:01.188176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:01.188224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:01.188268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:01.188320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:01.188367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:01.188404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:01.188448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:01.188497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:01.188538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:01.188576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:01.188619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:01.188656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:01.188698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:01.188734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:01.188776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:01.188820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.188862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.188897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.188938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.188985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.189030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.189066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.189109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.189621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:01.191437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593077439397922:4935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:01.191481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593077439397922:4935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:01.191498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593077439397922:4935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:01.191527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:01.198622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593077439397956:4447]
2025-10-10T14:02:01.212728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:01.227090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:01.227145Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:01.227166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:01.227189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:01.227214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 255 [2:7559593075861481028:4538]
2025-10-10T14:02:01.227293Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:01.227358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:01.227374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:01.227387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:01.227399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:01.227450Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:01.227473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:01.227494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:01.247177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.247211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.247222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.247234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.247244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:01.247536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:01.247553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.247700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.247883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.248107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.248227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:01.248294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.248309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.248325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.248338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.248379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:01.248457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:01.248647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:01.248663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:01.248785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.248803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:01.249045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:01.249059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:01.249071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:01.249084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:01.249107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:01.250690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593077439397875:2442], now have 1 active actors on pipe
2025-10-10T14:02:01.250730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593077439397956:4447], now have 1 active actors on pipe
2025-10-10T14:02:01.250753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593077439397955:4935], now have 1 active actors on pipe
2025-10-10T14:02:01.250818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:01.250885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:01.250970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ffc431c-97635905-63150f4c-9eff5684_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:01.251002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:01.251021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:01.251032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:01.251064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:01.251103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:01.251148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:01.251866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:01.251887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:01.251950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:01.249757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 255
2025-10-10T14:02:01.249850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 255, pipe: [1:7559593077439397956:4447]
2025-10-10T14:02:01.249928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 255
2025-10-10T14:02:01.252247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 256 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ffc431c-97635905-63150f4c-9eff5684_0
2025-10-10T14:02:01.253597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c37f886-6feee80a-aaa2ddb7-57f563e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ffc431c-97635905-63150f4c-9eff5684_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:01.288297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffc431c-97635905-63150f4c-9eff5684_0] Write session: try to update token
2025-10-10T14:02:01.288354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffc431c-97635905-63150f4c-9eff5684_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:01.425917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId: src_id|9ffc431c-97635905-63150f4c-9eff5684_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:01.457818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:01.473962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:01.473996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:01.474006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:01.474311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:01.474329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:01.474342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:01.474351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:01.474360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:01.474391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.474416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.474437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.474455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.474644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:01.474668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:01.481612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:01.481675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:01.481714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:01.481747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:01.487214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:01.487265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.487278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:01.488677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:01.632660Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:01.643418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:01.643456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:01.643499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593075861481023:4538]
2025-10-10T14:02:01.644639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:01.644791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593077439397956:4447]
2025-10-10T14:02:01.644868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:01.644880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:01.643808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:01.644557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:01.684214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 256 reason: error at write: Disconnected sessionId: src_id|9ffc431c-97635905-63150f4c-9eff5684_0
2025-10-10T14:02:01.684503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 256 sessionId: src_id|9ffc431c-97635905-63150f4c-9eff5684_0 is DEAD
2025-10-10T14:02:01.689427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffc431c-97635905-63150f4c-9eff5684_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:01.689467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffc431c-97635905-63150f4c-9eff5684_0] Write session will restart in 0.008983s
2025-10-10T14:02:01.689586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffc431c-97635905-63150f4c-9eff5684_0] Write session: Do CDS request
2025-10-10T14:02:01.689615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffc431c-97635905-63150f4c-9eff5684_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:01.704116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffc431c-97635905-63150f4c-9eff5684_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:01.706429Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:01.706469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 257
2025-10-10T14:02:01.708079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:01.708365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:01.708403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:01.708427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:01.716922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 257 sessionId:  describe result for acl check
2025-10-10T14:02:01.717053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:01.717065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:01.717076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:01.717094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593077439398011:4940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:01.719986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593077439398011:4940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:01.724759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:01.730308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:01.731148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:01.731169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:01.731211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:01.731474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:01.731666Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593075861481110:4547]
2025-10-10T14:02:01.730734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593077439398011:4940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:01.734093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:01.738865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593077439398011:4940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:01.738918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593077439398011:4940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:01.738936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593077439398011:4940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:01.738969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:01.736126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:01.736398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:01.737873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:01.738234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:01.738243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:01.738251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:01.738259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:01.738266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:01.738274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:01.738281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:01.738288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:01.738294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.738301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.738309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.738317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.738372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:01.738495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:01.738550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:01.738604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:01.738656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:01.738710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:01.738766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:01.738821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:01.738873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.738929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.738983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.739037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.739083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:01.739162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:01.739229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:01.739292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:01.739351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:01.739414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:01.739469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:01.739532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:01.739586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:01.739648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:01.739702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:01.739763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:01.739815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:01.739876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:01.739925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:01.739985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:01.740040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.740099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.740147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.740230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.740288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.740351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.740404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.740461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.740960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:01.749349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593077439398049:4447]
2025-10-10T14:02:01.789192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:01.801908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:01.801963Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:01.801982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:01.802003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:01.802025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 256 [2:7559593075861481110:4547]
2025-10-10T14:02:01.802076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:01.802123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:01.802135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:01.802145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:01.802153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:01.802187Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:01.802204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:01.802221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:01.803223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.803243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.803255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.803265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.803273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:01.803475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:01.803494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.803601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:01.803736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:01.803918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:01.804001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:01.804049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:01.804058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:01.804068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:01.804077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:01.804107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:01.804160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:01.804304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:01.804315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:01.804440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:01.804460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:01.805686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:01.805716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:01.805732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:01.805744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:01.805772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:01.806007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593077439398045:4940], now have 1 active actors on pipe
2025-10-10T14:02:01.806042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593077439397969:2442], now have 1 active actors on pipe
2025-10-10T14:02:01.806067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593077439398049:4447], now have 1 active actors on pipe
2025-10-10T14:02:01.806559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 256
2025-10-10T14:02:01.806607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 256
2025-10-10T14:02:01.806652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 256, pipe: [1:7559593077439398049:4447]
2025-10-10T14:02:01.810601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 257 partition: 0 MaxSeqNo: 36 sessionId: src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0
2025-10-10T14:02:01.807294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:01.807343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:01.807443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:01.807482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:01.807501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:01.807511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:01.807541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:01.807578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:01.807613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:01.809813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:01.809843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:01.809920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:01.817355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ffc431c-97635905-63150f4c-9eff5684_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:01.849626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0] Write session: try to update token
2025-10-10T14:02:01.849684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:01.936720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:01.936784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:01.936814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:01.936848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:01.936878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:01.936944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:01.936984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:01.937010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:01.937031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:01.937230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:01.937243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:01.937255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:01.937358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:01.937392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:01.937404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:01.941422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:01.941478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:01.941507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:01.941535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:01.947039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:01.969520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId: src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:02.023847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:02.090016Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:02.103194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:02.103246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:02.103314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:02.103330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:02.103372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593075861481105:4547]
2025-10-10T14:02:02.103568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:02.103983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:02.105163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:02.108141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:02.108401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593077439398049:4447]
2025-10-10T14:02:02.112640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 257 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0
2025-10-10T14:02:02.112956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 257 sessionId: src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0 is DEAD
2025-10-10T14:02:02.115249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:02.115321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0] Write session will restart in 0.009293s
2025-10-10T14:02:02.115510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0] Write session: Do CDS request
2025-10-10T14:02:02.115560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:02.139664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:02.139696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 258
2025-10-10T14:02:02.140897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:02.141562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:02.141696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:02.141711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:02.141721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:02.144431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 258 sessionId:  describe result for acl check
2025-10-10T14:02:02.144557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:02.144567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:02.144577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:02.144594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593081734365392:4946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:02.147265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593081734365392:4946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:02.168883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593081734365392:4946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:02.176402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593081734365392:4946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:02.176442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593081734365392:4946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:02.176457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593081734365392:4946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:02.176486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:02.177091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:02.181940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:02.182868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:02.182900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:02.182944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:02.183200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:02.183377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593080156448508:4550]
2025-10-10T14:02:02.185739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:02.186737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:02.186947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:02.188273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:02.188605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:02.188615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:02.188622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:02.188629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:02.188637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:02.188644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:02.188652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:02.188659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:02.188665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.188672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.188680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.188688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.188738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:02.188844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:02.188893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:02.188943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:02.188991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:02.189040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:02.189086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:02.189154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:02.189219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.189274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.189323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.189372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.189416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:02.189486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:02.189550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:02.189608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:02.189660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:02.189714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:02.189759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:02.189814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:02.189861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:02.189911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:02.189959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:02.190013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:02.190058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:02.190114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:02.190160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:02.190211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:02.190258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.190310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.190354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.190406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.190455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.190508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.190554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.190606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.191040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:02.209340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593081734365470:4447]
2025-10-10T14:02:02.229064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:02.244236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:02.244283Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:02.244300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:02.244319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:02.244340Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 257 [2:7559593080156448508:4550]
2025-10-10T14:02:02.244392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:02.244446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:02.244461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:02.244472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:02.244483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:02.244530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:02.244551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:02.244571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:02.256874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.256909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.256923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.256934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.256943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:02.257656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:02.257683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.257814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.257981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.258193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.258307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:02.258385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593081734365379:2442], now have 1 active actors on pipe
2025-10-10T14:02:02.258409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593081734365470:4447], now have 1 active actors on pipe
2025-10-10T14:02:02.258429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593081734365454:4946], now have 1 active actors on pipe
2025-10-10T14:02:02.258451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.258465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.258477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.258490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.258529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:02.258606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:02.258778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:02.258795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:02.258911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.258928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:02.259493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:02.259515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:02.259526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:02.259538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:02.259561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:02.262126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 257
2025-10-10T14:02:02.262227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 257, pipe: [1:7559593081734365470:4447]
2025-10-10T14:02:02.262309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 257
2025-10-10T14:02:02.262939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:02.262979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:02.263105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62e0a2be-21538526-d048fbd-c24abcbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:02.264781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:02.264813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:02.264825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:02.264861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:02.264904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:02.264966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:02.265525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:02.265558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:02.265621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:02.266014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 258 partition: 0 MaxSeqNo: 36 sessionId: src_id|62e0a2be-21538526-d048fbd-c24abcbd_0
2025-10-10T14:02:02.268193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba890087-7e13f5fd-2e2069b8-ce97e7f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|62e0a2be-21538526-d048fbd-c24abcbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:02.315385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e0a2be-21538526-d048fbd-c24abcbd_0] Write session: try to update token
2025-10-10T14:02:02.315439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e0a2be-21538526-d048fbd-c24abcbd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:02.440077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:02.448200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:02.448236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:02.448310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:02.448325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:02.448338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:02.448348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:02.448359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:02.448398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.448425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.448448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.448468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.448677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:02.448704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.448716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:02.448812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:02.448862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:02.448891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:02.448934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:02.449754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:02.477236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId: src_id|62e0a2be-21538526-d048fbd-c24abcbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:02.508566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:02.650890Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:02.664239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:02.664297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:02.664389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:02.664402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:02.664445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593080156448502:4550]
2025-10-10T14:02:02.664763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:02.665024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:02.667163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593081734365470:4447]
2025-10-10T14:02:02.667265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:02.669377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:02.714858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 258 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62e0a2be-21538526-d048fbd-c24abcbd_0
2025-10-10T14:02:02.715228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 258 sessionId: src_id|62e0a2be-21538526-d048fbd-c24abcbd_0 is DEAD
2025-10-10T14:02:02.721677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e0a2be-21538526-d048fbd-c24abcbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:02.721723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e0a2be-21538526-d048fbd-c24abcbd_0] Write session will restart in 0.007976s
2025-10-10T14:02:02.721833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e0a2be-21538526-d048fbd-c24abcbd_0] Write session: Do CDS request
2025-10-10T14:02:02.721867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e0a2be-21538526-d048fbd-c24abcbd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:02.739852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:02.739887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 259
2025-10-10T14:02:02.741869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62e0a2be-21538526-d048fbd-c24abcbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:02.745648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:02.745810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:02.745835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:02.745846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:02.750360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 259 sessionId:  describe result for acl check
2025-10-10T14:02:02.750494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:02.750504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:02.750512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:02.750529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593081734365544:4960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:02.753036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593081734365544:4960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:02.757964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:02.759520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:02.760243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:02.760270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:02.760312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:02.760554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:02.760735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593080156448625:4559]
2025-10-10T14:02:02.762839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:02.764509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:02.765228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:02.766809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:02.767197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:02.767206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:02.769322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593081734365559:4447]
2025-10-10T14:02:02.767214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:02.767222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:02.767230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:02.767237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:02.767245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:02.767253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:02.767260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.767268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.767276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.767283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.767341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:02.767463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:02.767531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:02.767588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:02.767640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:02.767699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:02.767751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:02.767804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:02.767853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.767915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.767966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.768018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.768067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:02.768145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:02.768212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:02.768275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:02.768335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:02.768396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:02.768446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:02.768508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:02.768561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:02.768616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:02.768677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:02.768738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:02.768791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:02.768861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:02.768911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:02.768969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:02.769021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.769090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.769789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.769863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.769923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.769984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.770031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.770100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.770617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:02.793286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593081734365544:4960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:02.812341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:02.811886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593081734365544:4960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:02.811975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593081734365544:4960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:02.812007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593081734365544:4960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:02.812072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:02.824352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:02.824391Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:02.824404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:02.824420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:02.824439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 258 [2:7559593080156448625:4559]
2025-10-10T14:02:02.824481Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:02.824533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:02.824549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:02.824562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:02.824573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:02.824607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:02.824624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:02.824642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:02.892048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.892081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.892092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.892101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.892111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:02.892373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:02.892389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:02.892519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:02.892677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:02.892868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:02.892977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:02.893045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593080156448620:4559]
2025-10-10T14:02:02.893060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593080156448620:4559]
2025-10-10T14:02:02.893072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593080156448620:4559]
2025-10-10T14:02:02.893085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593080156448620:4559]
2025-10-10T14:02:02.893266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:02.893279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:02.893290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:02.893302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:02.893649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:02.893757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:02.893936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:02.893952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:02.893995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593081734365559:4447], now have 1 active actors on pipe
2025-10-10T14:02:02.894018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593081734365581:4960], now have 1 active actors on pipe
2025-10-10T14:02:02.894039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593081734365500:2442], now have 1 active actors on pipe
2025-10-10T14:02:02.894154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593080156448620:4559]
2025-10-10T14:02:02.894187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:02.894347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:02.897762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 258, pipe: [1:7559593081734365559:4447]
2025-10-10T14:02:02.898623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:02.897878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 258
2025-10-10T14:02:02.898654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:02.897951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 258
2025-10-10T14:02:02.898709Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:02.898731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:02.898744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:02.898751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:02.898777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:02.898806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:02.898839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:02.906715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 259 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0
2025-10-10T14:02:02.909356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62e0a2be-21538526-d048fbd-c24abcbd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:02.905904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:02.905951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:02.906034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:02.925437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:02.925470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:02.925483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:02.964245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0] Write session: try to update token
2025-10-10T14:02:02.964311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:03.035173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:03.035202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:03.035210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:03.035256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:03.035266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:03.035275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:03.035282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:03.035290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:03.035316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593080156448620:4559]
2025-10-10T14:02:03.035334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593080156448620:4559]
2025-10-10T14:02:03.035349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593080156448620:4559]
2025-10-10T14:02:03.035361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593080156448620:4559]
2025-10-10T14:02:03.035486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:03.035513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.035524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:03.036535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:03.038171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:03.038215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:03.038233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:03.038253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:03.136091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId: src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:03.169287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:03.235246Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:03.237220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:03.237267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:03.239672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593081734365559:4447]
2025-10-10T14:02:03.239770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:03.239783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:03.241367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:03.243722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:03.288796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 259 reason: error at write: Disconnected sessionId: src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0
2025-10-10T14:02:03.289050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 259 sessionId: src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0 is DEAD
2025-10-10T14:02:03.289580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:03.289609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0] Write session will restart in 0.007693s
2025-10-10T14:02:03.289698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0] Write session: Do CDS request
2025-10-10T14:02:03.289727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:03.306345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:03.306379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 260
2025-10-10T14:02:03.310208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:03.310872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:03.311016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:03.311038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:03.311057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:03.311991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 260 sessionId:  describe result for acl check
2025-10-10T14:02:03.312095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:03.312114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:03.312123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:03.312142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593086029332937:4967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:03.314010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593086029332937:4967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:03.324954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593086029332937:4967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:03.335296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:03.339439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:03.339754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593086029332937:4967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:03.339789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593086029332937:4967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:03.339799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593086029332937:4967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:03.339820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:03.340183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593086029332987:4447]
2025-10-10T14:02:03.340204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:03.340238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:03.340281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:03.340524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:03.340734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593084451416019:4570]
2025-10-10T14:02:03.342864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:03.344583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:03.344781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:03.345949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:03.346225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:03.346235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:03.346240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:03.346247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:03.346253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:03.346259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:03.346266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:03.346274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:03.346281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.346287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.346293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.346300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.346345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:03.346451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:03.346497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:03.346542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:03.346584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:03.346625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:03.346665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:03.346705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:03.346742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.346783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.346825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.346865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.346904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:03.346962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:03.348207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:03.348280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:03.348333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:03.348385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:03.348430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:03.348480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:03.348525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:03.348576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:03.348617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:03.348661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:03.348705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:03.348751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:03.348793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:03.348843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:03.348888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.348932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.348973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.349436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.349496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.349549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.349595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.349643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.350055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:03.374073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:03.392226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:03.392279Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:03.392298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:03.392322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:03.392348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 259 [2:7559593084451416019:4570]
2025-10-10T14:02:03.392405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:03.392472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:03.392488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:03.392500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:03.392512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:03.392561Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:03.392582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:03.392606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:03.402339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 259, pipe: [1:7559593086029332987:4447]
2025-10-10T14:02:03.402449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 259
2025-10-10T14:02:03.402518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 259
2025-10-10T14:02:03.400936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.400973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.400989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.401002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.401015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:03.401327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:03.401343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.401487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.401674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.401914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.402022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:03.402103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593086029332987:4447], now have 1 active actors on pipe
2025-10-10T14:02:03.402126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593086029332986:4967], now have 1 active actors on pipe
2025-10-10T14:02:03.402148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593086029332914:2442], now have 1 active actors on pipe
2025-10-10T14:02:03.402173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.402188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.402202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.402215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.402257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:03.402340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:03.402511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:03.402528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:03.402654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.402672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:03.402787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:03.402801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:03.402812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:03.402823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:03.402849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:03.404032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:03.404075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:03.404162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:03.404194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:03.404213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:03.404223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:03.404261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:03.404303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:03.404349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:03.405028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:03.405056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:03.405119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:03.405505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 260 partition: 0 MaxSeqNo: 36 sessionId: src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0
2025-10-10T14:02:03.409380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9a2138-821bbdba-b59b09ef-9842ffd8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:03.440962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0] Write session: try to update token
2025-10-10T14:02:03.441022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:03.505086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:03.505116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:03.507947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:03.508119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:03.508133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:03.508146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:03.508157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:03.508179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:03.508216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.508246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.508269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.508294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.509420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:03.509467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:03.509496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:03.509522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:03.518776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:03.518829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.518842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:03.519981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:03.625283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId: src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:03.659152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:03.742166Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:03.751216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:03.751254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:03.751298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593084451416013:4570]
2025-10-10T14:02:03.751457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:03.751483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:03.753502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:03.754720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:03.757430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593086029332987:4447]
2025-10-10T14:02:03.757619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:03.757648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:03.772643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 260 reason: error at write: Disconnected sessionId: src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0
2025-10-10T14:02:03.773305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:03.773341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0] Write session will restart in 0.005161s
2025-10-10T14:02:03.773433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0] Write session: Do CDS request
2025-10-10T14:02:03.773463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:03.783762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:03.792825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 260 sessionId: src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0 is DEAD
2025-10-10T14:02:03.804252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:03.804389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:03.804402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 261
2025-10-10T14:02:03.809398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:03.809547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:03.809563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:03.809572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:03.811362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 261 sessionId:  describe result for acl check
2025-10-10T14:02:03.811464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:03.811475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:03.811484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:03.811501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593086029333026:4975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:03.813997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593086029333026:4975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:03.843732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593086029333026:4975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:03.856067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:03.857568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593086029333082:4447]
2025-10-10T14:02:03.866087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:03.867051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:03.867069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:03.867112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:03.867363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:03.867538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593084451416118:4574]
2025-10-10T14:02:03.869714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:03.871730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:03.874319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593086029333026:4975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:03.871943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:03.874366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593086029333026:4975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:03.873149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:03.874383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593086029333026:4975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:03.873490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:03.874411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:03.873497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:03.873503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:03.873509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:03.873516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:03.873522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:03.873528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:03.873534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:03.873541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.873546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.873553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.873559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.873603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:03.873700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:03.873744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:03.873785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:03.873832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:03.873877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:03.873917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:03.873959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:03.874001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.874044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.874084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.874124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.874159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:03.874215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:03.874266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:03.874314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:03.874358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:03.874403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:03.874441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:03.874488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:03.874530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:03.874578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:03.874619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:03.874668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:03.874712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:03.874758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:03.874799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:03.874842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:03.874884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.874931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.874970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.875016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.875056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.875103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.875141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.875188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.877099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:03.916867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:03.932396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:03.932446Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:03.932461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:03.932482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:03.932504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 260 [2:7559593084451416118:4574]
2025-10-10T14:02:03.932556Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:03.932613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:03.932628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:03.932640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:03.932655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:03.932700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:03.932721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:03.932744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:03.935499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.935532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.935545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.935558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.935568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:03.935834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:03.935849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:03.935981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:03.936156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:03.936368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:03.936475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:03.936545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:03.936572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:03.936586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:03.936597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:03.936628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:03.936706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:03.936800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:03.936810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:03.936820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:03.936830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:03.936861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:03.936877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:03.937007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:03.937037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:03.937085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593086029333082:4447], now have 1 active actors on pipe
2025-10-10T14:02:03.937106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593086029333090:4975], now have 1 active actors on pipe
2025-10-10T14:02:03.937160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:03.937196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593086029333015:2442], now have 1 active actors on pipe
2025-10-10T14:02:03.937295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 260, pipe: [1:7559593086029333082:4447]
2025-10-10T14:02:03.937411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 260
2025-10-10T14:02:03.937480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 260
2025-10-10T14:02:03.938872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:03.938908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:03.938994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|257c4102-431fa03b-35d66165-2ba30038_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:03.939028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:03.939048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:03.939058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:03.939100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:03.939146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:03.939189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:03.942075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:03.942103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:03.942169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:03.942831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 261 partition: 0 MaxSeqNo: 36 sessionId: src_id|257c4102-431fa03b-35d66165-2ba30038_0
2025-10-10T14:02:03.943674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cdd8c5b-3bf561ed-6204f35b-b96f51d2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|257c4102-431fa03b-35d66165-2ba30038_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:03.996393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|257c4102-431fa03b-35d66165-2ba30038_0] Write session: try to update token
2025-10-10T14:02:03.996445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|257c4102-431fa03b-35d66165-2ba30038_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:04.176443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId: src_id|257c4102-431fa03b-35d66165-2ba30038_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:04.186649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:04.186682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:04.186692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:04.186744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:04.186757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:04.186767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:04.186776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:04.186785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:04.186815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:04.186838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:04.186859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:04.186878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:04.187064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:04.187088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:04.187097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:04.187237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:04.187275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:04.187306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:04.187334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:04.194208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:04.212300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:04.343567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:04.360458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:04.360508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:04.360580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:04.360593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:04.360634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593084451416111:4574]
2025-10-10T14:02:04.361288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:04.362145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:04.362564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:04.362699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593086029333082:4447]
2025-10-10T14:02:04.362713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:04.362724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:04.384578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 261 reason: error at write: Disconnected sessionId: src_id|257c4102-431fa03b-35d66165-2ba30038_0
2025-10-10T14:02:04.384924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 261 sessionId: src_id|257c4102-431fa03b-35d66165-2ba30038_0 is DEAD
2025-10-10T14:02:04.385772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257c4102-431fa03b-35d66165-2ba30038_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:04.385823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257c4102-431fa03b-35d66165-2ba30038_0] Write session will restart in 0.007571s
2025-10-10T14:02:04.385984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257c4102-431fa03b-35d66165-2ba30038_0] Write session: Do CDS request
2025-10-10T14:02:04.386029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257c4102-431fa03b-35d66165-2ba30038_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:04.403931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:04.403967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 262
2025-10-10T14:02:04.404814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|257c4102-431fa03b-35d66165-2ba30038_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:04.405378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:04.405502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:04.405516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:04.405542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:04.407063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 262 sessionId:  describe result for acl check
2025-10-10T14:02:04.407185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:04.407196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:04.407206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:04.407222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593090324300468:4987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:04.415124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593090324300468:4987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:04.439808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:04.438981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593090324300468:4987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:04.449059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:04.450012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:04.450031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:04.450076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:04.450345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:04.450533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593088746383538:4589]
2025-10-10T14:02:04.452924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:04.454512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:04.454780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:04.456187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:04.456536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:04.456546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:04.456553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:04.456561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:04.456568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:04.456576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:04.456585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:04.456594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:04.456602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:04.456610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:04.456617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:04.456625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:04.456677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:04.456798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:04.456852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:04.456903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:04.456953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:04.457004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:04.457057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:04.457106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:04.457180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:04.457243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:04.457296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:04.457349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:04.457395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:04.457472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:04.457539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:04.457600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:04.457658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:04.457718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:04.457766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:04.457823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:04.457877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:04.457937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:04.457986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:04.458045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:04.458096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:04.458150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:04.458199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:04.458255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:04.458307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:04.459475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:04.459569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:04.459641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:04.459697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:04.459758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:04.459807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:04.459866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:04.460374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:04.462143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593090324300513:4447]
2025-10-10T14:02:04.467298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593090324300468:4987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:04.467347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593090324300468:4987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:04.467364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593090324300468:4987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:04.467397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:04.498336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:04.511793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:04.512117Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:04.512140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:04.512161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:04.512185Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 261 [2:7559593088746383538:4589]
2025-10-10T14:02:04.512246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:04.512305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:04.512321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:04.512334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:04.512346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:04.512394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:04.512417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:04.512438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:04.542243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:04.542273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:04.542288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:04.542300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:04.542312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:04.542596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:04.542613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:04.542757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:04.542937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:04.543152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:04.543269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:04.543355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:04.543370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:04.543383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:04.543395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:04.543431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:04.543510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:04.543695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:04.543712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:04.543837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:04.543857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:04.545645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 261, pipe: [1:7559593090324300513:4447]
2025-10-10T14:02:04.545763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 261
2025-10-10T14:02:04.545840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 261
2025-10-10T14:02:04.545064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:04.545086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:04.545097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:04.545110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:04.545148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:04.548183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593090324300513:4447], now have 1 active actors on pipe
2025-10-10T14:02:04.548221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593090324300516:4987], now have 1 active actors on pipe
2025-10-10T14:02:04.548246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593090324300435:2442], now have 1 active actors on pipe
2025-10-10T14:02:04.548297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:04.548323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:04.548415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe188c26-255817e3-ae11b226-af9472d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:04.548448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:04.548469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:04.548480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:04.548517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:04.548560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:04.548610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:04.550174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:04.550206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:04.550276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:04.550684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 262 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe188c26-255817e3-ae11b226-af9472d0_0
2025-10-10T14:02:04.551519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|257c4102-431fa03b-35d66165-2ba30038_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe188c26-255817e3-ae11b226-af9472d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:04.609290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:04.609326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:04.609339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:04.626680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe188c26-255817e3-ae11b226-af9472d0_0] Write session: try to update token
2025-10-10T14:02:04.626746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe188c26-255817e3-ae11b226-af9472d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:04.795644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:04.795676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:04.795687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:04.795774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:04.795782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:04.795791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:04.795799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:04.795805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:04.795828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:04.795844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:04.795858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:04.795872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:04.797143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:04.797175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:04.797199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:04.797242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:04.836575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId: src_id|fe188c26-255817e3-ae11b226-af9472d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:04.847372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:04.847432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:04.847445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:04.848520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:04.879405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:05.010772Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:05.055855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:05.055885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:05.055927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593088746383532:4589]
2025-10-10T14:02:05.056064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:05.056088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:05.056400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:05.057513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:05.058493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593090324300513:4447]
2025-10-10T14:02:05.058589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:05.058601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:05.060150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:05.066422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 262 reason: error at write: Disconnected sessionId: src_id|fe188c26-255817e3-ae11b226-af9472d0_0
2025-10-10T14:02:05.066749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 262 sessionId: src_id|fe188c26-255817e3-ae11b226-af9472d0_0 is DEAD
2025-10-10T14:02:05.070611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe188c26-255817e3-ae11b226-af9472d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:05.070700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe188c26-255817e3-ae11b226-af9472d0_0] Write session will restart in 0.009679s
2025-10-10T14:02:05.070914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe188c26-255817e3-ae11b226-af9472d0_0] Write session: Do CDS request
2025-10-10T14:02:05.070972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe188c26-255817e3-ae11b226-af9472d0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:05.092889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe188c26-255817e3-ae11b226-af9472d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:05.092808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:05.092844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 263
2025-10-10T14:02:05.093479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:05.093624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:05.093639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:05.093650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:05.095988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 263 sessionId:  describe result for acl check
2025-10-10T14:02:05.096126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:05.096137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:05.096148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:05.096164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593094619267850:4992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:05.103493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593094619267850:4992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:05.116655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593094619267850:4992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:05.140456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:05.142440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593094619267850:4992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:05.142494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593094619267850:4992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:05.142512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593094619267850:4992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:05.142544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:05.150381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:05.151338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:05.151356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:05.151401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:05.151678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:05.151861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593093041350922:4591]
2025-10-10T14:02:05.154051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:05.157824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593094619267917:4447]
2025-10-10T14:02:05.160314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:05.160610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:05.161943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:05.162283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:05.162291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:05.162298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:05.162305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:05.162312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:05.162320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:05.162327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:05.162336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:05.162344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.162351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.162357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.162365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.162415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:05.162524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:05.162574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:05.162621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:05.162664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:05.162711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:05.162754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:05.162800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:05.162844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.162891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.162933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.162978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.163021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:05.163083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:05.163141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:05.163193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:05.163238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:05.163289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:05.163333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:05.163386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:05.163435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:05.163488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:05.163532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:05.163587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:05.163637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:05.163688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:05.163731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:05.163785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:05.163832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.163885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.163928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.163978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.164022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.164071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.164114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.164165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.164587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:05.202170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:05.246596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:05.246648Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:05.246665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:05.246684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:05.246710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 262 [2:7559593093041350922:4591]
2025-10-10T14:02:05.246765Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:05.246831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:05.246848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:05.246859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:05.246870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:05.246922Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:05.246943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:05.246966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:05.248235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.248250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.248264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.248277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.248289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:05.248562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:05.248578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.248715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.248882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.249097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.249259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:05.249345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.249358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.249370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.249383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.249424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:05.249500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:05.249667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:05.249683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:05.249809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.249840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:05.250267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:05.250279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:05.250290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:05.250300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:05.250325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:05.251018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593094619267836:2442], now have 1 active actors on pipe
2025-10-10T14:02:05.251048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593094619267917:4447], now have 1 active actors on pipe
2025-10-10T14:02:05.251082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593094619267914:4992], now have 1 active actors on pipe
2025-10-10T14:02:05.252316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 262
2025-10-10T14:02:05.252418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 262, pipe: [1:7559593094619267917:4447]
2025-10-10T14:02:05.252487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 262
2025-10-10T14:02:05.256259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:05.256312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:05.256403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:05.256447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:05.256466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:05.256476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:05.256517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:05.257706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 263 partition: 0 MaxSeqNo: 36 sessionId: src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0
2025-10-10T14:02:05.259004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe188c26-255817e3-ae11b226-af9472d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:05.256566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:05.256619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:05.257181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:05.257200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:05.257275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:05.309908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0] Write session: try to update token
2025-10-10T14:02:05.309964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:05.349329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:05.349362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:05.349374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:05.413019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:05.413056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:05.413069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:05.413078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:05.413087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:05.413121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.414488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.414526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.414545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.415010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:05.415040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:05.415078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:05.415110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:05.475544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:05.475594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.475605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:05.476609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:05.507473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId: src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:05.540658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:05.686935Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:05.690407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:05.690442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:05.690488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593093041350916:4591]
2025-10-10T14:02:05.690631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:05.690657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:05.693260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:05.694619Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:05.698715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:05.698852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593094619267917:4447]
2025-10-10T14:02:05.698923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:05.720981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:05.721035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0] Write session will restart in 0.009195s
2025-10-10T14:02:05.721187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0] Write session: Do CDS request
2025-10-10T14:02:05.721228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:05.719048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 263 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0
2025-10-10T14:02:05.719547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 263 sessionId: src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0 is DEAD
2025-10-10T14:02:05.745821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:05.780925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:05.780958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 264
2025-10-10T14:02:05.782009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:05.782140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:05.782154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:05.782164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:05.783944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:05.784423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 264 sessionId:  describe result for acl check
2025-10-10T14:02:05.784540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:05.784549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:05.784558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:05.784572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593094619268006:5004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:05.787123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593094619268006:5004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:05.789880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:05.790632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:05.790649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:05.790692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:05.790923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:05.791093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593093041351040:4601]
2025-10-10T14:02:05.793054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:05.799052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593094619268006:5004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:05.799403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593094619268038:4447]
2025-10-10T14:02:05.796910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:05.797171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:05.798403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:05.798751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:05.798758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:05.798765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:05.798771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:05.798777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:05.798783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:05.798789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:05.798796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:05.798801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.798807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.798814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.798820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.798864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:05.798969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:05.799013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:05.799055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:05.799094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:05.799134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:05.799173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:05.799213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:05.799253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.799308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.799361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.799405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.799443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:05.799501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:05.799557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:05.799605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:05.799647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:05.799694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:05.799733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:05.799779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:05.799820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:05.799867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:05.799921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:05.799971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:05.800014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:05.800061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:05.800111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:05.800159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:05.800202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.800259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.800301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.800350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.800389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.800435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.800473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.800530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.800954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:05.817893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593094619268006:5004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:05.817938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593094619268006:5004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:05.817958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593094619268006:5004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:05.817991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:05.832631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:05.860200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:05.860399Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:05.860421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:05.860442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:05.860465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 263 [2:7559593093041351040:4601]
2025-10-10T14:02:05.860518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:05.860580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:05.860594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:05.860606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:05.860617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:05.860664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:05.860685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:05.860707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:05.862229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.862244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.862257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.862271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.862280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:05.862543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:05.862558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:05.862693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:05.862862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:05.863076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:05.863180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:05.863253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:05.863267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:05.863280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:05.863291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:05.863332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:05.863408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:05.863568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:05.863585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:05.864398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:05.864410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:05.864421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:05.864432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:05.864905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:05.864944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:05.865043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593094619268050:5004], now have 1 active actors on pipe
2025-10-10T14:02:05.865065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593094619268038:4447], now have 1 active actors on pipe
2025-10-10T14:02:05.865086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593094619267956:2442], now have 1 active actors on pipe
2025-10-10T14:02:05.865339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:05.866466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:05.866497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:05.866588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49426ce0-74e66b11-1778804c-52c1e44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:05.866620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:05.866638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:05.866649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:05.866687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:05.866727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:05.866775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:05.865353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 263
2025-10-10T14:02:05.865415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 263, pipe: [1:7559593094619268038:4447]
2025-10-10T14:02:05.865463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 263
2025-10-10T14:02:05.878167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:05.878212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:05.878293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:05.879051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 264 partition: 0 MaxSeqNo: 36 sessionId: src_id|49426ce0-74e66b11-1778804c-52c1e44_0
2025-10-10T14:02:05.879680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b1c0e0-6a9fea92-319f182e-ed48f626_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49426ce0-74e66b11-1778804c-52c1e44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:05.929232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49426ce0-74e66b11-1778804c-52c1e44_0] Write session: try to update token
2025-10-10T14:02:05.929304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49426ce0-74e66b11-1778804c-52c1e44_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:05.960636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:05.960667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:05.960679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:06.038443Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:06.038478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:06.038489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:06.038498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:06.038507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:06.038542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:06.038564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:06.038584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:06.038602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:06.041300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:06.041350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:06.041374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:06.041397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:06.050472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:06.050525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:06.050536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:06.065470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:06.139743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId: src_id|49426ce0-74e66b11-1778804c-52c1e44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:06.162058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:06.234658Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:06.255289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:06.255323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:06.255365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593093041351029:4601]
2025-10-10T14:02:06.255514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:06.255535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:06.255736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:06.256481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:06.257487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593094619268038:4447]
2025-10-10T14:02:06.257628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:06.257823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:06.325582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49426ce0-74e66b11-1778804c-52c1e44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:06.325630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49426ce0-74e66b11-1778804c-52c1e44_0] Write session will restart in 0.007119s
2025-10-10T14:02:06.325730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49426ce0-74e66b11-1778804c-52c1e44_0] Write session: Do CDS request
2025-10-10T14:02:06.325758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49426ce0-74e66b11-1778804c-52c1e44_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:06.323575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 264 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49426ce0-74e66b11-1778804c-52c1e44_0
2025-10-10T14:02:06.323899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 264 sessionId: src_id|49426ce0-74e66b11-1778804c-52c1e44_0 is DEAD
2025-10-10T14:02:06.342239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49426ce0-74e66b11-1778804c-52c1e44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:06.342748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:06.345446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:06.345480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 265
2025-10-10T14:02:06.345831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:06.345963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:06.345978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:06.345989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:06.347483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 265 sessionId:  describe result for acl check
2025-10-10T14:02:06.347608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:06.347625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:06.347637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:06.347654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593098914235437:5016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:06.349492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:06.352097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593098914235437:5016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:06.354951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593098914235448:4447]
2025-10-10T14:02:06.350738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:06.350787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:06.350851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:06.351255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:06.351518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593097336318458:4610]
2025-10-10T14:02:06.355565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:06.356938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:06.357184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:06.359488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593098914235437:5016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:06.358507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:06.358841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:06.358850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:06.358857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:06.358864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:06.358870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:06.358877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:06.358884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:06.358890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:06.358897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:06.358904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:06.358912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:06.358918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:06.358963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:06.359067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:06.359114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:06.359166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:06.359209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:06.359254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:06.359296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:06.359339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:06.359383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:06.359430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:06.359471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:06.359512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:06.359551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:06.359612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:06.359665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:06.359721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:06.359768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:06.359821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:06.359867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:06.359916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:06.359962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:06.360015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:06.360059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:06.360111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:06.360152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:06.360204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:06.360248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:06.360299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:06.360349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:06.360400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:06.360442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:06.360493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:06.360538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:06.360589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:06.360630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:06.360685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:06.361113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:06.379079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593098914235437:5016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:06.379122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593098914235437:5016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:06.379139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593098914235437:5016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:06.379170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:06.403075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:06.420634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:06.420688Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:06.420707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:06.420728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:06.420753Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 264 [2:7559593097336318458:4610]
2025-10-10T14:02:06.420808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:06.420874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:06.420890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:06.420901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:06.420912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:06.420959Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:06.420982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:06.421005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:06.426210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:06.426251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:06.426265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:06.426279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:06.426289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:06.427510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 264
2025-10-10T14:02:06.427586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 264, pipe: [1:7559593098914235448:4447]
2025-10-10T14:02:06.427640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 264
2025-10-10T14:02:06.426579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:06.426604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:06.426742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:06.426914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:06.427124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:06.427229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:06.427314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593098914235470:5016], now have 1 active actors on pipe
2025-10-10T14:02:06.427335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593098914235448:4447], now have 1 active actors on pipe
2025-10-10T14:02:06.427355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593098914235376:2442], now have 1 active actors on pipe
2025-10-10T14:02:06.427379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.427393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.427404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.427418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.427458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:06.427535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:06.427619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:06.427636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:06.427646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:06.427656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:06.427697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:06.427714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:06.427837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.427865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:06.427908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:06.428374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:06.428401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:06.428486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:06.428518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:06.428535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:06.428545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:06.428582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:06.428626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:06.428671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:06.435149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 265 partition: 0 MaxSeqNo: 36 sessionId: src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0
2025-10-10T14:02:06.436661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49426ce0-74e66b11-1778804c-52c1e44_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:06.433025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:06.433073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:06.433172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:06.469665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0] Write session: try to update token
2025-10-10T14:02:06.469738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:06.662241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:06.662283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:06.662293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:06.662347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:06.662359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:06.662370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:06.662377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:06.662387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:06.662420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.662443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.662464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.662483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.662681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:06.662705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:06.662716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:06.663716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:06.665306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:06.665351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:06.665386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:06.665419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:06.673246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId: src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:06.724742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:06.889035Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:06.901642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:06.901700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:06.901787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:06.901800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:06.901842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593097336318453:4610]
2025-10-10T14:02:06.902368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:06.903946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:06.906162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:06.962774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593098914235448:4447]
2025-10-10T14:02:06.962851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:06.962953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 265 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0
2025-10-10T14:02:06.963256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 265 sessionId: src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0 is DEAD
2025-10-10T14:02:06.969394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:06.969439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0] Write session will restart in 0.007310s
2025-10-10T14:02:06.969534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0] Write session: Do CDS request
2025-10-10T14:02:06.969565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:06.985667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:06.995446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:06.995484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 266
2025-10-10T14:02:07.001810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:07.001977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:07.001992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:07.002002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:07.006460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 266 sessionId:  describe result for acl check
2025-10-10T14:02:07.006599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:07.006612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:07.006622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:07.006639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593103209202846:5026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:07.016835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:07.019287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:07.020194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:07.020213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:07.020255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:07.020610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:07.020823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593101631285857:4620]
2025-10-10T14:02:07.024740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593103209202846:5026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:07.023313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:07.026057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:07.026322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:07.027667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:07.028016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:07.028025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:07.028034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:07.028040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:07.028047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:07.028056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:07.028064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:07.028070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:07.028077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.028085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.028093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.028101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.028151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:07.028290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:07.028340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:07.028391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:07.028443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:07.028494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:07.028552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:07.028603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:07.028650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.028706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.028756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.028808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.028852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:07.028927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:07.028991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:07.029052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:07.029108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:07.029266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:07.029340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:07.029400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:07.029454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:07.029513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:07.029569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:07.029625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:07.029676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:07.029734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:07.029783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:07.029844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:07.029901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.029960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.030010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.030069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.030122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.030180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.030268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.030324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.030840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:07.041037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593103209202846:5026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:07.063383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593103209202846:5026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:07.063431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593103209202846:5026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:07.063449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593103209202846:5026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:07.063483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:07.065787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593103209202881:4447]
2025-10-10T14:02:07.067253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:07.091254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:07.091309Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:07.091326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:07.091346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:07.091368Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 265 [2:7559593101631285857:4620]
2025-10-10T14:02:07.091423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:07.091481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:07.091497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:07.091508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:07.091519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:07.091568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:07.091590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:07.091610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:07.095813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.095845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.095861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.095874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.095887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:07.097487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:07.097509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.097654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.097853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.098111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.098241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:07.098323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593098914235510:2442], now have 1 active actors on pipe
2025-10-10T14:02:07.098348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593103209202880:5026], now have 1 active actors on pipe
2025-10-10T14:02:07.098373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593103209202881:4447], now have 1 active actors on pipe
2025-10-10T14:02:07.098436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:07.098457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:07.098493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.098510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.098523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.098537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.098578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:07.098670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:07.097277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 265
2025-10-10T14:02:07.097410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 265
2025-10-10T14:02:07.097473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 265, pipe: [1:7559593103209202881:4447]
2025-10-10T14:02:07.098898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:07.098936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:07.099009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:07.099039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:07.099058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:07.099070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:07.099102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:07.099142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:07.099274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.099298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:07.099344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:07.099662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:07.099677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:07.099689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:07.099703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:07.099725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:07.113046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:07.113097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:07.113206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:07.117402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 266 partition: 0 MaxSeqNo: 36 sessionId: src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0
2025-10-10T14:02:07.121697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58e80b1-df449cb9-7889d437-abb6d99c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:07.190162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0] Write session: try to update token
2025-10-10T14:02:07.190215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:07.196242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:07.196280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:07.196294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:07.405812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:07.405848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:07.405860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:07.405871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:07.405882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:07.405916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.405938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.405959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.405979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.406129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:07.406142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:07.406152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:07.406940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:07.406977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:07.407015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:07.407047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:07.461254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:07.461317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.461327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:07.462380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:07.473009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId: src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:07.515860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:07.699080Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:07.700726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:07.700744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:07.700795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593101631285852:4620]
2025-10-10T14:02:07.700949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:07.700973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:07.701419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:07.705616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:07.705652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:07.702359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:07.706777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593103209202881:4447]
2025-10-10T14:02:07.706888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:07.724218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 266 reason: error at write: Disconnected sessionId: src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0
2025-10-10T14:02:07.724535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 266 sessionId: src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0 is DEAD
2025-10-10T14:02:07.728340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:07.728375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0] Write session will restart in 0.008818s
2025-10-10T14:02:07.728470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0] Write session: Do CDS request
2025-10-10T14:02:07.728501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:07.757656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:07.759626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:07.759661Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 267
2025-10-10T14:02:07.761622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:07.761795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:07.761815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:07.761834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:07.763758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 267 sessionId:  describe result for acl check
2025-10-10T14:02:07.763901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:07.763913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:07.763924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:07.763941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593103209202946:5036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:07.772188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593103209202946:5036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:07.786226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593103209202946:5036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:07.805623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593103209203001:4447]
2025-10-10T14:02:07.809746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593103209202946:5036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:07.809789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593103209202946:5036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:07.809808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593103209202946:5036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:07.809844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:07.810104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:07.812815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:07.813713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:07.813744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:07.813789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:07.814046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:07.814231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593101631285992:4631]
2025-10-10T14:02:07.816486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:07.824399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:07.824688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:07.826471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:07.826846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:07.826857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:07.826864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:07.826872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:07.826879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:07.826887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:07.826896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:07.826905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:07.826913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.826921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.826929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.826937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.826993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:07.827115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:07.827169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:07.827221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:07.827272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:07.827328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:07.827379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:07.827430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:07.827485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.827537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.827589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.827637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.827684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:07.827758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:07.827843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:07.827907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:07.827967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:07.828029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:07.828086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:07.828148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:07.828203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:07.828262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:07.828315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:07.828374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:07.828426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:07.828485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:07.828539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:07.828599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:07.828653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.828713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.828762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.828822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.828877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.828934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.828984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.829041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.832311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:07.858779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:07.873358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:07.873415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:07.873436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:07.873459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:07.873485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 266 [2:7559593101631285992:4631]
2025-10-10T14:02:07.873548Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:07.873611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:07.873627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:07.873641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:07.873653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:07.873703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:07.873726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:07.873751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:07.934425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.934458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.934470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.934482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.934494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:07.934779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:07.934796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:07.934940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:07.935122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:07.937177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 266
2025-10-10T14:02:07.937328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 266, pipe: [1:7559593103209203001:4447]
2025-10-10T14:02:07.937337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 266
2025-10-10T14:02:07.941751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:07.941923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:07.942163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593103209202920:2442], now have 1 active actors on pipe
2025-10-10T14:02:07.942198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593103209203001:4447], now have 1 active actors on pipe
2025-10-10T14:02:07.942224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593103209203005:5036], now have 1 active actors on pipe
2025-10-10T14:02:07.942306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:07.942329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:07.942371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:07.942387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:07.942402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:07.942416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:07.942467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:07.942535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:07.942554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:07.942562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:07.942566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:07.942579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:07.942784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:07.942802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:07.942876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:07.942906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:07.942924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:07.942936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:07.942975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:07.943021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:07.943163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:07.943203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:07.943248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:07.943256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:07.951230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 267 partition: 0 MaxSeqNo: 36 sessionId: src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0
2025-10-10T14:02:07.952075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44836040-7f2b5614-852ff6f6-38e3aa7d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:07.949009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:07.949060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:07.949165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:07.973849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:07.973896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:07.973909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:07.990440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0] Write session: try to update token
2025-10-10T14:02:07.990500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:08.046114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:08.046147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:08.046162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:08.046175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:08.046188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:08.046226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:08.046255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:08.046280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:08.046305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:08.046882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:08.046924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:08.046957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:08.046990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:08.105977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:08.106032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.106042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:08.107045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:08.138707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId: src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:08.179557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:08.305752Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:08.307393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:08.307412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:08.307458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593101631285986:4631]
2025-10-10T14:02:08.307617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:08.307641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:08.307859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:08.308830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:08.310311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:08.310369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:08.310476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593103209203001:4447]
2025-10-10T14:02:08.310601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:08.319496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 267 reason: error at write: Disconnected sessionId: src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0
2025-10-10T14:02:08.319830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 267 sessionId: src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0 is DEAD
2025-10-10T14:02:08.321154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:08.321210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0] Write session will restart in 0.007889s
2025-10-10T14:02:08.321401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0] Write session: Do CDS request
2025-10-10T14:02:08.321445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:08.337149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:08.337192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 268
2025-10-10T14:02:08.342590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:08.343589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:08.343740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:08.343758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:08.343768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:08.346352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 268 sessionId:  describe result for acl check
2025-10-10T14:02:08.346485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:08.346496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:08.346505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:08.346522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593107504170340:5042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:08.348925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593107504170340:5042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:08.369599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593107504170340:5042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:08.388577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593107504170340:5042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:08.388628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593107504170340:5042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:08.388647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593107504170340:5042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:08.388682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:08.392326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:08.400526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:08.401231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:08.401262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:08.401318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:08.401589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:08.401777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593105926253379:4633]
2025-10-10T14:02:08.403922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:08.405456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:08.405629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:08.406879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:08.407181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:08.407188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:08.407194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:08.407200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:08.407207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:08.407215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:08.407222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:08.407229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:08.407236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.407244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.407249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.407257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.407304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:08.407409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:08.407456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:08.407498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:08.407529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:08.407576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:08.407620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:08.407662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:08.407707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.407752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.407796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.407839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.407880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:08.407940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:08.408846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:08.408917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:08.408973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:08.409027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:08.409071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:08.409135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:08.409193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:08.409246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:08.409293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:08.409355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:08.409402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:08.409453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:08.409500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:08.409553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:08.409597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.409649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.409693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.409742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.409777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.409813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.409843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.409876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.410181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:08.410544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593107504170415:4447]
2025-10-10T14:02:08.436251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:08.457885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:08.457934Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:08.457953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:08.457975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:08.458000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 267 [2:7559593105926253379:4633]
2025-10-10T14:02:08.458060Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:08.458127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:08.458144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:08.458155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:08.458168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:08.458220Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:08.458247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:08.458271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:08.459566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.459584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.459598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.459611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.459626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:08.460884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:08.460914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.461066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.461282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.461524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.461602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:08.461663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593105926253372:4633]
2025-10-10T14:02:08.461673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593105926253372:4633]
2025-10-10T14:02:08.461682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593105926253372:4633]
2025-10-10T14:02:08.461691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593105926253372:4633]
2025-10-10T14:02:08.461730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:08.461820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:08.461963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:08.461976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:08.461988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:08.461994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:08.461999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:08.462013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:08.462172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593107504170415:4447], now have 1 active actors on pipe
2025-10-10T14:02:08.462194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593105926253372:4633]
2025-10-10T14:02:08.462213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:08.462233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:08.462301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593107504170329:2442], now have 1 active actors on pipe
2025-10-10T14:02:08.462322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593107504170410:5042], now have 1 active actors on pipe
2025-10-10T14:02:08.465416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 267
2025-10-10T14:02:08.465551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 267
2025-10-10T14:02:08.465633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 267, pipe: [1:7559593107504170415:4447]
2025-10-10T14:02:08.478179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:08.478222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:08.478293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:08.478323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:08.478335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:08.478344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:08.478378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:08.478415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:08.478447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:08.481402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:08.481447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:08.481536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:08.484409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 268 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0
2025-10-10T14:02:08.489390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da5e2167-8a1a5c75-4b7a20b1-c5bb3361_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:08.538992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0] Write session: try to update token
2025-10-10T14:02:08.539061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:08.595570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:08.595604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:08.595616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:08.595671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:08.595684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:08.595695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:08.595706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:08.595717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:08.595749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593105926253372:4633]
2025-10-10T14:02:08.595774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593105926253372:4633]
2025-10-10T14:02:08.595797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593105926253372:4633]
2025-10-10T14:02:08.595814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593105926253372:4633]
2025-10-10T14:02:08.595947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:08.595980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.595990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:08.596938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:08.597367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:08.597405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:08.597433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:08.597468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:08.751472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId: src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:08.796106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:08.837027Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:08.844257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:08.844305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:08.849442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:08.849477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:08.858649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 268 reason: error at write: Disconnected sessionId: src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0
2025-10-10T14:02:08.859014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 268 sessionId: src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0 is DEAD
2025-10-10T14:02:08.861617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:08.861647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0] Write session will restart in 0.006446s
2025-10-10T14:02:08.861738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0] Write session: Do CDS request
2025-10-10T14:02:08.861765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:08.878092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:08.879453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:08.907161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593107504170415:4447]
2025-10-10T14:02:08.907224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:08.907449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:08.907460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 269
2025-10-10T14:02:08.914353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:08.914493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:08.914510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:08.914520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:08.916043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 269 sessionId:  describe result for acl check
2025-10-10T14:02:08.916157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:08.916167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:08.916176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:08.916193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593107504170472:5053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:08.918753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593107504170472:5053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:08.937533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593107504170472:5053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:08.955697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:08.963915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:08.964737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:08.964757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:08.964810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:08.965054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:08.965258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593105926253496:4643]
2025-10-10T14:02:08.967463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:08.969732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593107504170472:5053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:08.969776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593107504170472:5053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:08.969794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593107504170472:5053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:08.969825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:08.973405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:08.973645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:08.974820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:08.975089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:08.975096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:08.975103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:08.975110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:08.975116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:08.975123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:08.975130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:08.975136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:08.975142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.975148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.975153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.975159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.975202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:08.975297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:08.975345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:08.975387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:08.975431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:08.975473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:08.975515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:08.975558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:08.977498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.977565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.977610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.977652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.977695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:08.977782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:08.977841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:08.977893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:08.977941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:08.977988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:08.978027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:08.978076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:08.978119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:08.978168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:08.978210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:08.978257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:08.978299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:08.978346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:08.978388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:08.978435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:08.978477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.978524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:08.978565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.978615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:08.978656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.978706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:08.978746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.978795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:08.979179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:09.009487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593111799137844:4447]
2025-10-10T14:02:09.025963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:09.039397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:09.039442Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:09.039457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:09.039474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:09.039505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 268 [2:7559593105926253496:4643]
2025-10-10T14:02:09.039556Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:09.039610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:09.039625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:09.039636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:09.039645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:09.039689Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:09.039709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:09.039730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:09.042187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.042219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:09.042231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:09.042242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:09.042252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:09.042499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:09.042513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.042632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:09.042790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:09.042988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:09.043090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:09.043157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.043170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.043182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.043193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.043224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:09.043297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:09.043454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:09.043468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:09.043585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.043602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:09.043843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:09.043854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:09.043865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:09.043875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:09.043894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:09.045801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 268
2025-10-10T14:02:09.045879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 268, pipe: [1:7559593111799137844:4447]
2025-10-10T14:02:09.045956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 268
2025-10-10T14:02:09.054425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593107504170544:5053], now have 1 active actors on pipe
2025-10-10T14:02:09.054481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593111799137844:4447], now have 1 active actors on pipe
2025-10-10T14:02:09.054501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593107504170468:2442], now have 1 active actors on pipe
2025-10-10T14:02:09.054575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:09.054599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:09.054703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:09.054738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:09.054755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:09.054765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:09.054801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:09.054846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:09.054898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:09.059294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:09.059654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 269 partition: 0 MaxSeqNo: 36 sessionId: src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0
2025-10-10T14:02:09.059332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:09.059400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:09.061639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5b022eb-982f4fcb-69f0df4e-ff7f8e37_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:09.107477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0] Write session: try to update token
2025-10-10T14:02:09.107532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:09.336320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId: src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:09.360181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:09.360214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:09.360225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:09.360337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:09.360356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:09.360376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:09.360392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:09.360405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:09.360449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.360490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.360522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.360557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.360724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:09.360769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:09.360816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:09.360852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:09.390264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:09.397525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:09.397583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.397593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:09.398516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:09.566700Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:09.568397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:09.568414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:09.568462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593105926253491:4643]
2025-10-10T14:02:09.568614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:09.568642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:09.568801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:09.569728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:09.570375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:09.570520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593111799137844:4447]
2025-10-10T14:02:09.570589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:09.581384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:09.581462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0] Write session will restart in 0.006719s
2025-10-10T14:02:09.581659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0] Write session: Do CDS request
2025-10-10T14:02:09.581704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:09.580309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 269 reason: status is not ok: tablet will be restarted right now sessionId: src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0
2025-10-10T14:02:09.580692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 269 sessionId: src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0 is DEAD
2025-10-10T14:02:09.613507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:09.613546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 270
2025-10-10T14:02:09.614086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:09.617555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:09.617723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:09.617740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:09.617751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:09.624555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 270 sessionId:  describe result for acl check
2025-10-10T14:02:09.624705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:09.624722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:09.624732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:09.624749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593111799137898:5063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:09.627451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593111799137898:5063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:09.635492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593111799137898:5063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:09.671980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593111799137951:4447]
2025-10-10T14:02:09.675197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593111799137898:5063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:09.675249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593111799137898:5063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:09.675266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593111799137898:5063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:09.675300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:09.697741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:09.701375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:09.702129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:09.702159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:09.702203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:09.702480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:09.702681Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593110221220927:4653]
2025-10-10T14:02:09.705106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:09.706221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:09.706457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:09.707827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:09.708174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:09.708183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:09.708191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:09.708200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:09.708206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:09.708217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:09.708225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:09.708244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:09.708251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.708259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:09.708269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:09.708276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:09.708329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:09.708456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:09.708516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:09.708569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:09.708625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:09.708679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:09.708734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:09.708786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:09.708839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.708894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:09.708942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:09.708994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:09.709041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:09.709116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:09.709351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:09.709419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:09.709476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:09.709540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:09.709591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:09.709653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:09.709708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:09.709769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:09.709820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:09.709882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:09.709938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:09.709999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:09.710050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:09.710112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:09.710167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.710226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.710275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:09.710338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:09.710389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:09.710448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:09.710512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:09.710572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:09.711087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:09.740469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:09.754931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:09.754985Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:09.755006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:09.755031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:09.755057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 269 [2:7559593110221220927:4653]
2025-10-10T14:02:09.755121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:09.755183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:09.755198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:09.755212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:09.755225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:09.755275Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:09.755299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:09.755323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:09.756737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.756756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:09.756773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:09.756788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:09.756801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:09.757088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:09.757108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.759948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:09.760256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:09.760538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:09.760674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:09.760767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593111799137956:5063], now have 1 active actors on pipe
2025-10-10T14:02:09.758520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 269
2025-10-10T14:02:09.758619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 269, pipe: [1:7559593111799137951:4447]
2025-10-10T14:02:09.758703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 269
2025-10-10T14:02:09.760795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593111799137951:4447], now have 1 active actors on pipe
2025-10-10T14:02:09.760818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593111799137885:2442], now have 1 active actors on pipe
2025-10-10T14:02:09.760868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:09.760894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:09.760948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593110221220922:4653]
2025-10-10T14:02:09.760964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593110221220922:4653]
2025-10-10T14:02:09.760979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593110221220922:4653]
2025-10-10T14:02:09.761000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593110221220922:4653]
2025-10-10T14:02:09.761043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:09.761152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:09.761414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:09.761430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:09.761444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:09.761459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:09.762080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:09.762112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:09.762187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e4452b5-54433815-a66c89e2-66944582_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:09.762221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:09.762241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:09.762255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:09.762293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:09.762337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:09.762492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593110221220922:4653]
2025-10-10T14:02:09.762528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:09.762582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:09.763026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:09.765083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:09.765120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:09.765232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:09.765790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 270 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e4452b5-54433815-a66c89e2-66944582_0
2025-10-10T14:02:09.769813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97ce8b8b-f254b379-4f58f3a2-c0d19c0c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e4452b5-54433815-a66c89e2-66944582_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:09.827144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4452b5-54433815-a66c89e2-66944582_0] Write session: try to update token
2025-10-10T14:02:09.827205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4452b5-54433815-a66c89e2-66944582_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:09.852920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:09.852957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:09.852971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:09.924091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:09.924131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:09.924146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:09.924157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:09.924169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:09.924207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593110221220922:4653]
2025-10-10T14:02:09.924237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593110221220922:4653]
2025-10-10T14:02:09.924262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593110221220922:4653]
2025-10-10T14:02:09.924286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593110221220922:4653]
2025-10-10T14:02:09.924442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:09.924472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:09.924485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:09.925555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:09.925593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:09.925627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:09.925658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:09.929638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:09.961195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId: src_id|1e4452b5-54433815-a66c89e2-66944582_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:09.996403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:10.082095Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:10.084351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:10.084383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:10.087536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:10.091079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:10.093990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593111799137951:4447]
2025-10-10T14:02:10.094104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:10.098451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 270 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1e4452b5-54433815-a66c89e2-66944582_0
2025-10-10T14:02:10.105512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 270 sessionId: src_id|1e4452b5-54433815-a66c89e2-66944582_0 is DEAD
2025-10-10T14:02:10.109329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4452b5-54433815-a66c89e2-66944582_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:10.109378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4452b5-54433815-a66c89e2-66944582_0] Write session will restart in 0.007948s
2025-10-10T14:02:10.109484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4452b5-54433815-a66c89e2-66944582_0] Write session: Do CDS request
2025-10-10T14:02:10.109513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4452b5-54433815-a66c89e2-66944582_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:10.126573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4452b5-54433815-a66c89e2-66944582_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:10.126668Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:10.126699Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 271
2025-10-10T14:02:10.127496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:10.127624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:10.127640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:10.127650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:10.130535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 271 sessionId:  describe result for acl check
2025-10-10T14:02:10.130722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:10.130738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:10.130753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:10.130777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593116094105303:5068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:10.140115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593116094105303:5068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:10.152965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593116094105303:5068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:10.161023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593116094105303:5068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:10.161069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593116094105303:5068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:10.161085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593116094105303:5068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:10.161115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:10.195784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593116094105377:4447]
2025-10-10T14:02:10.205589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:10.210722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:10.211573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:10.211591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:10.211634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:10.211891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:10.212382Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593114516188319:4656]
2025-10-10T14:02:10.214605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:10.215864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:10.216078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:10.217400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:10.217713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:10.217720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:10.217727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:10.217733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:10.217740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:10.217746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:10.217753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:10.217759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:10.217765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:10.217771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:10.217778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:10.217785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:10.217830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:10.217939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:10.217990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:10.218036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:10.218085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:10.218131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:10.218175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:10.218218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:10.218262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:10.218307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:10.218349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:10.218395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:10.218435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:10.218500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:10.218556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:10.218712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:10.218760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:10.218813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:10.218859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:10.218912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:10.218961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:10.219015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:10.219059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:10.219111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:10.219157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:10.219210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:10.219253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:10.219301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:10.219348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:10.219399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:10.219444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:10.219496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:10.219540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:10.219592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:10.219635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:10.219689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:10.220142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:10.256185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:10.275364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:10.275403Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:10.275415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:10.275430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:10.275449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 270 [2:7559593114516188319:4656]
2025-10-10T14:02:10.275495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:10.275542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:10.275555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:10.275565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:10.275575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:10.275619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:10.275637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:10.275656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:10.278140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:10.278161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:10.278173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:10.278184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:10.278194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:10.278443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:10.278459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:10.278581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:10.278741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:10.278944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:10.279047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:10.279117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.279130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.279142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.279154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.279194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:10.279269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:10.279427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:10.279443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:10.279560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.279578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:10.282810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 270, pipe: [1:7559593116094105377:4447]
2025-10-10T14:02:10.282912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 270
2025-10-10T14:02:10.282986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 270
2025-10-10T14:02:10.280257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:10.280273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:10.280283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:10.280293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:10.280315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:10.293709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593116094105377:4447], now have 1 active actors on pipe
2025-10-10T14:02:10.293757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593116094105290:2442], now have 1 active actors on pipe
2025-10-10T14:02:10.293781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593116094105345:5068], now have 1 active actors on pipe
2025-10-10T14:02:10.293867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:10.293891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:10.293981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|864648d8-573001d7-8a640721-e6432ab3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:10.294020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:10.294039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:10.294050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:10.294091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:10.294140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:10.294191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:10.295109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:10.295136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:10.295201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:10.295557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 271 partition: 0 MaxSeqNo: 36 sessionId: src_id|864648d8-573001d7-8a640721-e6432ab3_0
2025-10-10T14:02:10.296451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4452b5-54433815-a66c89e2-66944582_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|864648d8-573001d7-8a640721-e6432ab3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:10.342984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|864648d8-573001d7-8a640721-e6432ab3_0] Write session: try to update token
2025-10-10T14:02:10.343050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|864648d8-573001d7-8a640721-e6432ab3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:10.539789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:10.539822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:10.539833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:10.539882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:10.539895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:10.539906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:10.539916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:10.539925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:10.539958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.539983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.540006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.540027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.540193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:10.540223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:10.540234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:10.541470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:10.541516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:10.541547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:10.541579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:10.549412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:10.565346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId: src_id|864648d8-573001d7-8a640721-e6432ab3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:10.587631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:10.841228Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:10.872098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:10.872141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:10.872204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:10.872216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:10.872254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593114516188314:4656]
2025-10-10T14:02:10.872487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:10.873638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:10.877038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:10.873809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:10.873832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:10.914088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593116094105377:4447]
2025-10-10T14:02:10.914182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 271 reason: error at write: Disconnected sessionId: src_id|864648d8-573001d7-8a640721-e6432ab3_0
2025-10-10T14:02:10.914516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 271 sessionId: src_id|864648d8-573001d7-8a640721-e6432ab3_0 is DEAD
2025-10-10T14:02:10.917430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864648d8-573001d7-8a640721-e6432ab3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:10.917468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864648d8-573001d7-8a640721-e6432ab3_0] Write session will restart in 0.005020s
2025-10-10T14:02:10.917562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864648d8-573001d7-8a640721-e6432ab3_0] Write session: Do CDS request
2025-10-10T14:02:10.917589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864648d8-573001d7-8a640721-e6432ab3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:10.938237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|864648d8-573001d7-8a640721-e6432ab3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:10.966564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:10.966601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 272
2025-10-10T14:02:10.969544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:10.969674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:10.969689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:10.969700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:10.973026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 272 sessionId:  describe result for acl check
2025-10-10T14:02:10.973144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:10.973154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:10.973164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:10.973180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593116094105473:5082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:10.976235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593116094105473:5082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:10.993664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593116094105473:5082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:11.006845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593116094105473:5082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:11.006893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593116094105473:5082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:11.006910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593116094105473:5082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:11.006941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:11.011061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:11.012745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593120389072827:4447]
2025-10-10T14:02:11.017188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:11.018081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:11.018100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:11.018148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:11.018418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:11.018589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593118811155750:4666]
2025-10-10T14:02:11.020589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:11.027317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:11.027591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:11.032942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:11.033452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:11.033461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:11.033468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:11.033475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:11.033480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:11.033485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:11.033493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:11.033499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:11.033504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.033511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.033517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.033523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.033570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:11.033670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:11.033714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:11.033755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:11.033795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:11.033838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:11.033880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:11.033922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:11.033962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.034005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.034046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.034083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.034122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:11.034183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:11.034236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:11.034286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:11.034329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:11.034376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:11.034417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:11.034465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:11.034509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:11.034558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:11.034600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:11.034649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:11.034692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:11.034738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:11.034778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:11.034826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:11.034869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.034918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.034960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.035009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.035055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.035124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.035166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.035216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.035623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:11.077852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:11.105294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:11.105336Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:11.105353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:11.105388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:11.105413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 271 [2:7559593118811155750:4666]
2025-10-10T14:02:11.105468Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:11.105536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:11.105554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:11.105567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:11.105579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:11.105643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:11.105666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:11.105688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:11.107009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.107025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.107039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.107052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.107062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:11.107331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:11.107347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.107489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.107667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.107881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.108000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:11.108076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593118811155741:4666]
2025-10-10T14:02:11.108092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593118811155741:4666]
2025-10-10T14:02:11.108105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593118811155741:4666]
2025-10-10T14:02:11.108116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593118811155741:4666]
2025-10-10T14:02:11.108157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:11.108236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:11.108517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:11.108530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:11.108540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:11.108552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:11.109436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:11.109457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:11.109647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593120389072827:4447], now have 1 active actors on pipe
2025-10-10T14:02:11.109670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593120389072824:5082], now have 1 active actors on pipe
2025-10-10T14:02:11.109689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593116094105426:2442], now have 1 active actors on pipe
2025-10-10T14:02:11.109711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593118811155741:4666]
2025-10-10T14:02:11.109745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:11.110047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 271, pipe: [1:7559593120389072827:4447]
2025-10-10T14:02:11.110153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 271
2025-10-10T14:02:11.110216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 271
2025-10-10T14:02:11.109942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:11.110667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:11.110692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:11.110774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:11.110805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:11.110822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:11.110831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:11.110867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:11.110911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:11.110971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:11.125316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:11.125381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:11.125476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:11.126009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 272 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0
2025-10-10T14:02:11.129356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|864648d8-573001d7-8a640721-e6432ab3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
E1010 14:02:11.183504646  106882 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:02:11.198439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0] Write session: try to update token
2025-10-10T14:02:11.198499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:11.207339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:11.207368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:11.207381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:11.296864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:11.296901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:11.296919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:11.296932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:11.296944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:11.296984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593118811155741:4666]
2025-10-10T14:02:11.297011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593118811155741:4666]
2025-10-10T14:02:11.297034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593118811155741:4666]
2025-10-10T14:02:11.297054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593118811155741:4666]
2025-10-10T14:02:11.297272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:11.297318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.297342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:11.297897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:11.297932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:11.297961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:11.305181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:11.319307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:11.373258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId: src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:11.416546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:11.571834Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:11.601463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:11.601507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:11.604563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593120389072827:4447]
2025-10-10T14:02:11.604665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:11.604677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:11.604629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:11.610886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:11.701683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593120389072904:4447]
2025-10-10T14:02:11.727201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:11.727855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:11.728924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:11.728953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:11.729009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:11.729298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:11.729507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593118811155859:4675]
2025-10-10T14:02:11.731547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:11.734891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 272 reason: error at write: Disconnected sessionId: src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0
2025-10-10T14:02:11.735207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 272 sessionId: src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0 is DEAD
2025-10-10T14:02:11.737709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:11.737738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0] Write session will restart in 0.006334s
2025-10-10T14:02:11.737832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0] Write session: Do CDS request
2025-10-10T14:02:11.737861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:11.738747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:11.739006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:11.740338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:11.740664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:11.740673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:11.740680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:11.740687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:11.740693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:11.740701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:11.740708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:11.740715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:11.740721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.740727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.740734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.740742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.740788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:11.740896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:11.740945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:11.740994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:11.741040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:11.741088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:11.741167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:11.741214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:11.741260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.741305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.741349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.741405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.741450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:11.741514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:11.741570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:11.741622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:11.741671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:11.741723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:11.741767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:11.741815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:11.741860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:11.741910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:11.741958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:11.742009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:11.742053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:11.742102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:11.742143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:11.742194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:11.742238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.742289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.742334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.742387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.742433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.742484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.742527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.742577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.742999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:11.752156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:11.752191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 273
2025-10-10T14:02:11.752492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:11.756186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:11.756324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:11.756339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:11.756349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:11.761512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 273 sessionId:  describe result for acl check
2025-10-10T14:02:11.761635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:11.761644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:11.761654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:11.761672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593120389072927:5092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:11.764070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593120389072927:5092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:11.788992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593120389072927:5092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:11.793765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:11.815504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:11.815545Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:11.815561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:11.815580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:11.815602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 272 [2:7559593118811155859:4675]
2025-10-10T14:02:11.815653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:11.815713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:11.815727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:11.815739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:11.815754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:11.815802Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:11.815825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:11.815847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:11.827192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593120389072927:5092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:11.827236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593120389072927:5092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:11.827252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593120389072927:5092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:11.827285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:11.859217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 272, pipe: [1:7559593120389072904:4447]
2025-10-10T14:02:11.859324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 272
2025-10-10T14:02:11.859385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 272
2025-10-10T14:02:11.857471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.857495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.857505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.857514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.857523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:11.857778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:11.857792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:11.857918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:11.858070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:11.858264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:11.858360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:11.858454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593120389072904:4447], now have 1 active actors on pipe
2025-10-10T14:02:11.858478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593120389072955:5092], now have 1 active actors on pipe
2025-10-10T14:02:11.858497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593120389072862:2442], now have 1 active actors on pipe
2025-10-10T14:02:11.858521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:11.858534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:11.858547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:11.858558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:11.858596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:11.858673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:11.858833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:11.858850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:11.858967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:11.858985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:11.859173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:11.859183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:11.859192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:11.859201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:11.859221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:11.865590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:11.865637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:11.865741Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:11.865779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:11.865798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:11.865808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:11.865846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:11.865895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:11.865945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:11.873440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:11.873481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:11.873569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:11.881493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 273 partition: 0 MaxSeqNo: 36 sessionId: src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0
2025-10-10T14:02:11.882410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e308ccb-7c38a7c5-91cdc6e0-d56d8be2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:11.917244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:11.917276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:11.917289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:11.934246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0] Write session: try to update token
2025-10-10T14:02:11.934307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:12.008906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:12.019449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:12.019480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:12.019491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:12.019502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:12.019542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:12.019571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:12.019595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:12.019616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:12.019783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:12.019795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:12.019806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:12.019907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:12.019932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:12.019943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:12.020877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:12.021357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:12.021403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:12.021433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:12.021460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:12.089144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId: src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:12.122664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:12.278631Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:12.299149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:12.302632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593120389072904:4447]
2025-10-10T14:02:12.299200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:12.302730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:12.299271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:12.299284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:12.299325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593118811155853:4675]
2025-10-10T14:02:12.299795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:12.300930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:12.336592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:12.336729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 273 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0
2025-10-10T14:02:12.337076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 273 sessionId: src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0 is DEAD
2025-10-10T14:02:12.340250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:12.340291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0] Write session will restart in 0.005404s
2025-10-10T14:02:12.340379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0] Write session: Do CDS request
2025-10-10T14:02:12.340404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:12.358014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:12.367521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:12.367558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 274
2025-10-10T14:02:12.369804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:12.369933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:12.369949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:12.369960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:12.371370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 274 sessionId:  describe result for acl check
2025-10-10T14:02:12.371487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:12.371497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:12.371505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:12.371520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593124684040302:5104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:12.373985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593124684040302:5104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:12.384454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593124684040302:5104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:12.409658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593124684040370:4447]
2025-10-10T14:02:12.410341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593124684040302:5104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:12.410366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593124684040302:5104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:12.410382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593124684040302:5104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:12.410410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:12.433061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:12.441897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:12.442732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:12.442751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:12.442794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:12.443036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:12.443208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593123106123281:4685]
2025-10-10T14:02:12.449251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:12.457546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:12.457814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:12.459145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:12.459457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:12.459465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:12.459471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:12.459479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:12.459485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:12.459492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:12.459498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:12.459505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:12.459511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:12.459517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:12.459523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:12.459529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:12.459571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:12.459674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:12.459717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:12.459759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:12.459796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:12.459841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:12.459883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:12.459925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:12.459965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:12.460007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:12.460050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:12.460091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:12.460133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:12.460192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:12.460246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:12.460299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:12.460343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:12.460391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:12.460434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:12.460484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:12.460528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:12.460579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:12.460619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:12.460669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:12.460710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:12.460820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:12.460863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:12.460911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:12.460956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:12.461005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:12.461044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:12.461092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:12.461159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:12.461210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:12.461252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:12.461300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:12.461711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:12.579112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:12.633979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:12.634020Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:12.634037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:12.634057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:12.634081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 273 [2:7559593123106123281:4685]
2025-10-10T14:02:12.634139Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:12.634200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:12.634218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:12.634231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:12.634242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:12.634301Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:12.634322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:12.634344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:12.635671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:12.635686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:12.635699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:12.635712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:12.635722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:12.635991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:12.636008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:12.636148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:12.636326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:12.636547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:12.636662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:12.636736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:12.636749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:12.636762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:12.636775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:12.636819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:12.636907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:12.637080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:12.637095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:12.637340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:12.637353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:12.637365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:12.637376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:12.642062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:12.642128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:12.642193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593124684040290:2442], now have 1 active actors on pipe
2025-10-10T14:02:12.642218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593124684040370:4447], now have 1 active actors on pipe
2025-10-10T14:02:12.642242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593124684040373:5104], now have 1 active actors on pipe
2025-10-10T14:02:12.642022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 273, pipe: [1:7559593124684040370:4447]
2025-10-10T14:02:12.642128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 273
2025-10-10T14:02:12.642201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 273
2025-10-10T14:02:12.642429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:12.643412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:12.643443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:12.643552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:12.643587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:12.643614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:12.643624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:12.643663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:12.643707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:12.643753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:12.649319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:12.649351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:12.649464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:12.653514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 274 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0
2025-10-10T14:02:12.657741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f95b01a8-e14b577-56004d28-c1b91bd9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:12.735813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:12.735839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:12.735850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:12.757821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0] Write session: try to update token
2025-10-10T14:02:12.757885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:13.023724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:13.042260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:13.042290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:13.042523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:13.042538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:13.042553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:13.042562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:13.042572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:13.042609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:13.042637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:13.042659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:13.042680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:13.045739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:13.045777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:13.045805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:13.045831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:13.071365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:13.071412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:13.071424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:13.072686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:13.193464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId: src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:13.289584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:13.661321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593124684040302:5104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:13.695308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593124684040302:5104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-10T14:02:13.695348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593124684040302:5104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:13.950567Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:13.952967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:13.952985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:13.953033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593123106123275:4685]
2025-10-10T14:02:13.953159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:13.969404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:13.969471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:13.970753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:13.976668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593124684040370:4447]
2025-10-10T14:02:13.976768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:14.007782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 274 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0
2025-10-10T14:02:14.008169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 274 sessionId: src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0 is DEAD
2025-10-10T14:02:14.013196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:14.013237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0] Write session will restart in 0.007265s
2025-10-10T14:02:14.013331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0] Write session: Do CDS request
2025-10-10T14:02:14.013360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:14.029228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:14.074645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:14.080816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:14.081806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:14.081825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:14.081874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:14.082145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:14.082325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593131696058011:4696]
2025-10-10T14:02:14.084645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:14.092031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:14.092287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:14.093705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:14.094028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:14.094035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:14.094043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:14.094050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:14.094057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:14.094063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:14.094069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:14.094075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:14.094083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.094089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.094095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.094102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.094148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:14.094251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:14.094304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:14.094351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:14.094400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:14.094450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:14.094494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:14.094540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:14.094585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.094632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.094672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.094715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.094756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:14.094822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:14.094881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:14.094940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:14.094991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:14.095044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:14.095090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:14.095143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:14.095190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:14.095242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:14.095290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:14.095341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:14.095389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:14.095442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:14.095488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:14.096521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:14.107508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.107598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.107647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.107706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.107756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.107814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.107860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.107915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.108356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:14.106248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:14.106462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593133273975147:4447]
2025-10-10T14:02:14.106543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:14.106557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 275
2025-10-10T14:02:14.115553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:14.115722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:14.115739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:14.115750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:14.122701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 275 sessionId:  describe result for acl check
2025-10-10T14:02:14.122858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:14.122870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:14.122879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:14.122899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593133273975155:5126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:14.136409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593133273975155:5126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:14.179156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593133273975155:5126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:14.191749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:14.210947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593133273975155:5126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:14.210994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593133273975155:5126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:14.211013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593133273975155:5126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:14.211046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:14.236218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:14.236460Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:14.236482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:14.236501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:14.236524Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 274 [2:7559593131696058011:4696]
2025-10-10T14:02:14.236578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:14.236640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:14.236654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:14.236665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:14.236676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:14.236726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:14.236749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:14.236771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:14.238081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.238096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.238109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.238123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.238136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:14.238405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:14.238423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.238559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.238736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.238968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.239083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:14.239154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.239169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.239185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.239197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.239245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:14.239324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:14.239504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:14.239521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:14.239651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.239669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:14.242696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 274
2025-10-10T14:02:14.242797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 274, pipe: [1:7559593133273975147:4447]
2025-10-10T14:02:14.242869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 274
2025-10-10T14:02:14.240710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:14.240726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:14.240737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:14.240748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:14.240771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:14.253282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593133273975147:4447], now have 1 active actors on pipe
2025-10-10T14:02:14.253339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593133273975196:5126], now have 1 active actors on pipe
2025-10-10T14:02:14.253365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593133273975146:2442], now have 1 active actors on pipe
2025-10-10T14:02:14.253461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:14.253485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:14.253580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:14.253619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:14.261405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:14.261431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:14.261643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:14.261703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:14.261769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:14.262492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:14.262520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:14.262593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:14.262961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 275 partition: 0 MaxSeqNo: 36 sessionId: src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0
2025-10-10T14:02:14.265980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c7347a7-947431e4-d6ae05bc-ff19af31_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:14.333789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0] Write session: try to update token
2025-10-10T14:02:14.333851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:14.341450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:14.341476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:14.341487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:14.479081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:14.479113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:14.479125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:14.479136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:14.479146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:14.479184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.479211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.479234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.479254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.479408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:14.479432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:14.479443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:14.479544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:14.479567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.479578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:14.480530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:14.485261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:14.485308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:14.485343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:14.485382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:14.541080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId: src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:14.613560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:14.706407Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:14.753098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:14.753164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:14.753217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:14.753230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:14.753272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593131696058005:4696]
2025-10-10T14:02:14.753736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:14.757219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593133273975147:4447]
2025-10-10T14:02:14.757321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:14.757333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:14.760743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:14.764485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:14.770933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 275 reason: error at write: Disconnected sessionId: src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0
2025-10-10T14:02:14.771296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 275 sessionId: src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0 is DEAD
2025-10-10T14:02:14.775952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:14.776035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0] Write session will restart in 0.008611s
2025-10-10T14:02:14.776194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0] Write session: Do CDS request
2025-10-10T14:02:14.776246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:14.810972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:14.815833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:14.815872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 276
2025-10-10T14:02:14.816523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:14.816656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:14.816673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:14.816683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:14.818178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 276 sessionId:  describe result for acl check
2025-10-10T14:02:14.818294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:14.818304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:14.818313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:14.818329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593133273975250:5135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:14.820957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593133273975250:5135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:14.856955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593133273975250:5135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:14.857384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593133273975301:4447]
2025-10-10T14:02:14.886672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:14.889115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593133273975250:5135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:14.889182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593133273975250:5135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:14.889199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593133273975250:5135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:14.889231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:14.894588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:14.895509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:14.895538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:14.895587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:14.895868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:14.896054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593131696058148:4708]
2025-10-10T14:02:14.898187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:14.900250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:14.900463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:14.901744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:14.902055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:14.902062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:14.902069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:14.902076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:14.902082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:14.902091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:14.902099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:14.902108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:14.902114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.902122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.902129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.902135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.902182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:14.902283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:14.902330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:14.902374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:14.902418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:14.902463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:14.902509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:14.902557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:14.902610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.902657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.902702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.902751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.902792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:14.902856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:14.902919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:14.902977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:14.903027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:14.903084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:14.903127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:14.903179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:14.903229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:14.903283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:14.903330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:14.903384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:14.903431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:14.903483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:14.903529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:14.903580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:14.903626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.903680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.903726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.903781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.903828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.903880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.903925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.903976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.904407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:14.942064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:14.956108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:14.956148Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:14.956161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:14.956180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:14.956201Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 275 [2:7559593131696058148:4708]
2025-10-10T14:02:14.956251Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:14.956304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:14.956320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:14.956332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:14.956343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:14.956390Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:14.956412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:14.956435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:14.960935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.960953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.960967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.960980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.960990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:14.961286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:14.961301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:14.961439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:14.961632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:14.961840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:14.961946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:14.962021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593131696058142:4708]
2025-10-10T14:02:14.962036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593131696058142:4708]
2025-10-10T14:02:14.962048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593131696058142:4708]
2025-10-10T14:02:14.962059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593131696058142:4708]
2025-10-10T14:02:14.962106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:14.962187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:14.962358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:14.962375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:14.962511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593131696058142:4708]
2025-10-10T14:02:14.962529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:14.963797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:14.963819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:14.963830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:14.963841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:14.963865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:14.966711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 275
2025-10-10T14:02:14.966797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 275, pipe: [1:7559593133273975301:4447]
2025-10-10T14:02:14.966861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 275
2025-10-10T14:02:14.971666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593133273975331:5135], now have 1 active actors on pipe
2025-10-10T14:02:14.971715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593133273975301:4447], now have 1 active actors on pipe
2025-10-10T14:02:14.971735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593133273975237:2442], now have 1 active actors on pipe
2025-10-10T14:02:14.971785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:14.971809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:14.971908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:14.971945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:14.971964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:14.971974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:14.972013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:14.972058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:14.972105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:14.972983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:14.973006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:14.973060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:14.973488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 276 partition: 0 MaxSeqNo: 36 sessionId: src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0
2025-10-10T14:02:14.974428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f076421e-8b7d1db8-e0826b5f-a2ac1c62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:15.016688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0] Write session: try to update token
2025-10-10T14:02:15.016755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:15.057301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:15.057336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:15.057350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:15.172813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:15.172855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:15.172870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:15.172883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:15.172894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:15.172932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593131696058142:4708]
2025-10-10T14:02:15.172962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593131696058142:4708]
2025-10-10T14:02:15.172990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593131696058142:4708]
2025-10-10T14:02:15.173012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593131696058142:4708]
2025-10-10T14:02:15.173214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:15.173228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:15.173240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:15.173285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:15.173315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.173328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:15.174404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:15.177858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:15.177904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:15.177937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:15.177967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:15.269287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId: src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:15.327851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:15.360546Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:15.380599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:15.380645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:15.384166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:15.386911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593133273975301:4447]
2025-10-10T14:02:15.387085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:15.387312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:15.419030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 276 reason: status is not ok: tablet will be restarted right now sessionId: src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0
2025-10-10T14:02:15.419383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 276 sessionId: src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0 is DEAD
2025-10-10T14:02:15.425443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:15.425506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0] Write session will restart in 0.005905s
2025-10-10T14:02:15.425621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0] Write session: Do CDS request
2025-10-10T14:02:15.425662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:15.446259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:15.446313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 277
2025-10-10T14:02:15.455648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:15.456475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:15.456665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:15.456687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:15.456699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:15.465846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 277 sessionId:  describe result for acl check
2025-10-10T14:02:15.466035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:15.466048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:15.466061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:15.466082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593137568942684:5141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:15.481720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593137568942684:5141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:15.489457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593137568942722:4447]
2025-10-10T14:02:15.496824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593137568942684:5141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:15.502591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:15.508681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:15.509784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:15.509820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:15.509888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:15.510238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:15.510484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593135991025562:4710]
2025-10-10T14:02:15.513389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593137568942684:5141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:15.513446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593137568942684:5141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:15.513481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593137568942684:5141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:15.513521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:15.515407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:15.516672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:15.516944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:15.518445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:15.518830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:15.518840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:15.518848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:15.518856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:15.518864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:15.518872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:15.518879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:15.518888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:15.518895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.518902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.518911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.518918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.518971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:15.519098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:15.519156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:15.519213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:15.519266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:15.519319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:15.519373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:15.519425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:15.519479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.519534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.519587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.519639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.519686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:15.519760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:15.519828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:15.519894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:15.519951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:15.520016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:15.520071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:15.520134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:15.520191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:15.520252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:15.520306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:15.520364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:15.520415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:15.520472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:15.520527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:15.520591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:15.520648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.520711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.520763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.520827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.520884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.520947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.520999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.521061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.523181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:15.574893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
E1010 14:02:15.587158638  107558 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:02:15.590124Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:02:15.605484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:15.605536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:15.605554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:15.605574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:15.605601Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 276 [2:7559593135991025562:4710]
2025-10-10T14:02:15.605656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:15.605722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:15.605738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:15.605750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:15.605762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:15.605808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:15.605830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:15.605852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:15.607057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.607072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.607086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.607099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.607110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:15.607385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:15.607401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.607561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.607754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.607986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.608103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:15.608182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593135991025557:4710]
2025-10-10T14:02:15.608196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593135991025557:4710]
2025-10-10T14:02:15.608210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593135991025557:4710]
2025-10-10T14:02:15.608222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593135991025557:4710]
2025-10-10T14:02:15.608272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:15.608353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:15.608473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:15.608490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:15.608504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:15.608518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:15.608526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:15.608543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:15.608675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593135991025557:4710]
2025-10-10T14:02:15.608697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:15.608761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:15.608829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593137568942722:4447], now have 1 active actors on pipe
2025-10-10T14:02:15.608854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593137568942653:2442], now have 1 active actors on pipe
2025-10-10T14:02:15.609695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 276, pipe: [1:7559593137568942722:4447]
2025-10-10T14:02:15.608876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593137568942743:5141], now have 1 active actors on pipe
2025-10-10T14:02:15.609840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 276
2025-10-10T14:02:15.609938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 276
2025-10-10T14:02:15.617253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27357d45-a6d48a80-988dbd1c-5112b9a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:15.613760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:15.613806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:15.613890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:15.616544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 277 partition: 0 MaxSeqNo: 36 sessionId: src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0
2025-10-10T14:02:15.613924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:15.613943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:15.613955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:15.613991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:15.614034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:15.614084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:15.615831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:15.615856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:15.615940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:15.639879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0] Write session: try to update token
2025-10-10T14:02:15.639937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:15.681171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:15.681220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:15.681243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:15.681263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:15.681281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:15.681332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593135991025557:4710]
2025-10-10T14:02:15.681376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593135991025557:4710]
2025-10-10T14:02:15.681417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593135991025557:4710]
2025-10-10T14:02:15.681458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593135991025557:4710]
2025-10-10T14:02:15.681674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:15.681718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.681698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:15.681742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:15.681772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:15.681815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:15.681854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:15.682835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:15.734887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId: src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:15.763652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:15.831540Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:15.834586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:15.834632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:15.837404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593137568942722:4447]
2025-10-10T14:02:15.837589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:15.837805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:15.837827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:15.838913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:15.890086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 277 reason: error at write: Disconnected sessionId: src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0
2025-10-10T14:02:15.890403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 277 sessionId: src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0 is DEAD
2025-10-10T14:02:15.897401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:15.897468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0] Write session will restart in 0.009679s
2025-10-10T14:02:15.897636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0] Write session: Do CDS request
2025-10-10T14:02:15.897700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:15.916511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:15.918437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:15.918475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 278
2025-10-10T14:02:15.918881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:15.918993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:15.919009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:15.919019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:15.920378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 278 sessionId:  describe result for acl check
2025-10-10T14:02:15.920499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:15.920509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:15.920518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:15.920535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593137568942850:5154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:15.923180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593137568942850:5154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:15.937457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:15.942705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593137568942850:5154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:15.942938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593137568942875:4447]
2025-10-10T14:02:15.945199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:15.945997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:15.946014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:15.946056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:15.946296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:15.946452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593135991025677:4719]
2025-10-10T14:02:15.948575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:15.952940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:15.953188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:15.954427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:15.954729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:15.954736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:15.954742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:15.954748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:15.954753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:15.954759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:15.954765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:15.954771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:15.954778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.954784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.954789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.954796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.954841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:15.954940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:15.954984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:15.955027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:15.955069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:15.955110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:15.955152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:15.955192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:15.955230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.955274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.955317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.955359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.955397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:15.955457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:15.955509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:15.955557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:15.955600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:15.955648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:15.955692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:15.955738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:15.955784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:15.955832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:15.955874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:15.955924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:15.955969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:15.956019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:15.956060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:15.956107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:15.956152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.956199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:15.956238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.956285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:15.956327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.956376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:15.956417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.956464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:15.956859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:15.974906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593137568942850:5154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:15.974960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593137568942850:5154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:15.974979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593137568942850:5154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:15.975011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:15.989342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:16.025491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:16.025544Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:16.025563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:16.025586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:16.025609Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 277 [2:7559593135991025677:4719]
2025-10-10T14:02:16.025673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:16.025740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:16.025757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:16.025771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:16.025783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:16.025836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:16.025859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:16.025883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:16.028637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:16.028656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:16.028673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:16.028688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:16.028700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:16.030665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:16.030695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:16.030849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:16.031045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:16.031284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:16.031410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:16.031455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593137568942875:4447], now have 1 active actors on pipe
2025-10-10T14:02:16.031481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593137568942891:5154], now have 1 active actors on pipe
2025-10-10T14:02:16.031507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593137568942785:2442], now have 1 active actors on pipe
2025-10-10T14:02:16.031596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:16.031620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:16.031673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593135991025672:4719]
2025-10-10T14:02:16.031688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593135991025672:4719]
2025-10-10T14:02:16.031703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593135991025672:4719]
2025-10-10T14:02:16.031718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593135991025672:4719]
2025-10-10T14:02:16.031758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:16.030463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 277, pipe: [1:7559593137568942875:4447]
2025-10-10T14:02:16.031841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:16.030593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 277
2025-10-10T14:02:16.032029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:16.030664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 277
2025-10-10T14:02:16.032046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:16.032110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d452f6ad-145388c-4b94bd17-842eb3df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:16.032139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:16.032157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:16.032168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:16.032201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:16.032243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:16.032382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593135991025672:4719]
2025-10-10T14:02:16.032403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:16.032446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:16.036284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:16.036306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:16.036321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:16.036334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:16.036368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:16.043470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:16.043513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:16.043600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:16.044153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 278 partition: 0 MaxSeqNo: 36 sessionId: src_id|d452f6ad-145388c-4b94bd17-842eb3df_0
2025-10-10T14:02:16.045316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14482814-13076cd5-11b893ed-7b9a1e7b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d452f6ad-145388c-4b94bd17-842eb3df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:16.101342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d452f6ad-145388c-4b94bd17-842eb3df_0] Write session: try to update token
2025-10-10T14:02:16.101396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d452f6ad-145388c-4b94bd17-842eb3df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:16.123892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:16.123921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:16.123933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:16.220730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:16.220770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:16.220784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:16.220794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:16.220805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:16.220841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593135991025672:4719]
2025-10-10T14:02:16.220868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593135991025672:4719]
2025-10-10T14:02:16.220890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593135991025672:4719]
2025-10-10T14:02:16.220910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593135991025672:4719]
2025-10-10T14:02:16.221076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:16.221110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:16.221120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:16.221268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:16.221296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:16.221321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:16.221347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:16.237648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:16.355637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId: src_id|d452f6ad-145388c-4b94bd17-842eb3df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:16.393707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:16.568852Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:16.581251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:16.581296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:16.586169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593137568942875:4447]
2025-10-10T14:02:16.586274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:16.586287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:16.589417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:16.597390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:16.605563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d452f6ad-145388c-4b94bd17-842eb3df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:16.605609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d452f6ad-145388c-4b94bd17-842eb3df_0] Write session will restart in 0.005714s
2025-10-10T14:02:16.605705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d452f6ad-145388c-4b94bd17-842eb3df_0] Write session: Do CDS request
2025-10-10T14:02:16.605732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d452f6ad-145388c-4b94bd17-842eb3df_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:16.603975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 278 reason: error at write: Disconnected sessionId: src_id|d452f6ad-145388c-4b94bd17-842eb3df_0
2025-10-10T14:02:16.604320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 278 sessionId: src_id|d452f6ad-145388c-4b94bd17-842eb3df_0 is DEAD
2025-10-10T14:02:16.622906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:16.622942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 279
2025-10-10T14:02:16.626034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d452f6ad-145388c-4b94bd17-842eb3df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:16.631902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:16.632079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:16.632097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:16.632110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:16.646573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 279 sessionId:  describe result for acl check
2025-10-10T14:02:16.646705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:16.646716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:16.646725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:16.646743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593141863910232:5163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:16.659502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593141863910232:5163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:16.689471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593141863910250:4447]
2025-10-10T14:02:16.734105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593141863910232:5163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:16.757425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:16.766858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:16.767671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:16.767688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:16.767733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:16.767984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:16.768163Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593140285993111:4730]
2025-10-10T14:02:16.773611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:16.777773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:16.778588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593141863910232:5163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:16.778023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:16.778633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593141863910232:5163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:16.779314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:16.779635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:16.778650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593141863910232:5163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:16.779643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:16.778681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:16.779650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:16.779659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:16.779666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:16.779674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:16.779681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:16.779688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:16.779695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:16.779702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:16.779709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:16.779716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:16.779766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:16.779881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:16.779931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:16.779981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:16.780022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:16.780073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:16.780121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:16.780166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:16.780214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:16.780264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:16.780312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:16.780357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:16.780403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:16.780475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:16.780531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:16.780587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:16.780637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:16.780691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:16.780740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:16.780796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:16.780847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:16.780899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:16.780946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:16.781001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:16.781051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:16.781106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:16.789421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:16.789536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:16.789591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:16.789647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:16.789692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:16.789749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:16.789799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:16.789856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:16.789902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:16.789959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:16.790389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:16.844444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:16.895850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:16.895893Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:16.895911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:16.895931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:16.895955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 278 [2:7559593140285993111:4730]
2025-10-10T14:02:16.896011Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:16.896066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:16.896081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:16.896095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:16.896106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:16.896154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:16.896175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:16.896197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:16.898765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:16.898786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:16.898802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:16.898815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:16.898828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:16.899918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:16.899946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:16.901292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 278, pipe: [1:7559593141863910250:4447]
2025-10-10T14:02:16.900099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:16.901429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 278
2025-10-10T14:02:16.900295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:16.901516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 278
2025-10-10T14:02:16.900543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:16.900667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:16.900714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593141863910250:4447], now have 1 active actors on pipe
2025-10-10T14:02:16.900741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593141863910325:5163], now have 1 active actors on pipe
2025-10-10T14:02:16.900764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593141863910216:2442], now have 1 active actors on pipe
2025-10-10T14:02:16.900828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:16.900843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:16.900856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:16.900870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:16.900912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:16.900998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:16.901212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:16.901230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:16.901359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:16.901381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:16.902577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:16.902599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:16.902612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:16.902623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:16.902647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:16.905523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:16.905561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:16.905645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|247b3d42-b3b799a8-d596afb-993842cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:16.905676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:16.905693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:16.905705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:16.905741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:16.905802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:16.905854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:16.906782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:16.906814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:16.906883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:16.914038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 279 partition: 0 MaxSeqNo: 36 sessionId: src_id|247b3d42-b3b799a8-d596afb-993842cb_0
2025-10-10T14:02:16.917772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d452f6ad-145388c-4b94bd17-842eb3df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|247b3d42-b3b799a8-d596afb-993842cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:16.990586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|247b3d42-b3b799a8-d596afb-993842cb_0] Write session: try to update token
2025-10-10T14:02:16.990648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|247b3d42-b3b799a8-d596afb-993842cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:16.993379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:16.993414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:16.993426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:17.094033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:17.094062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:17.094073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:17.116186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:17.116221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:17.116261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:17.116394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:17.116402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:02:17.118066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:02:17.180720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:17.181982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:17.183264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:17.199824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:02:17.256767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId: src_id|247b3d42-b3b799a8-d596afb-993842cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:17.263648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:17.263676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:17.263686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:17.263810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:02:17.313841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:17.313877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:17.313890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:17.313901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:17.313912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:17.313956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:17.313983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:17.314006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:17.314029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593140285993106:4730]
2025-10-10T14:02:17.314177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:17.314206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:17.314217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:17.315269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:17.317277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:17.317309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:17.317338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:17.317365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:17.347969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:17.642126Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:17.643876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:17.643907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:17.647260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:17.697771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593141863910250:4447]
2025-10-10T14:02:17.709848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:17.735277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:17.746149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 279 reason: status is not ok: tablet will be restarted right now sessionId: src_id|247b3d42-b3b799a8-d596afb-993842cb_0
2025-10-10T14:02:17.746489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 279 sessionId: src_id|247b3d42-b3b799a8-d596afb-993842cb_0 is DEAD
2025-10-10T14:02:17.749765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|247b3d42-b3b799a8-d596afb-993842cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:17.749795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|247b3d42-b3b799a8-d596afb-993842cb_0] Write session will restart in 0.009285s
2025-10-10T14:02:17.749889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|247b3d42-b3b799a8-d596afb-993842cb_0] Write session: Do CDS request
2025-10-10T14:02:17.749918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|247b3d42-b3b799a8-d596afb-993842cb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:17.764774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|247b3d42-b3b799a8-d596afb-993842cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:17.765732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:17.765484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:17.765539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 280
2025-10-10T14:02:17.777783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:17.778723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:17.778743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:17.778789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:17.779059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:17.779238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593144580960547:4739]
2025-10-10T14:02:17.781866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:17.788908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:17.786460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:17.787041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:17.789087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:17.789701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:17.789728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:17.789736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:17.789743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:17.789750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:17.789756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:17.789764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:17.789770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:17.789777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:17.789784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:17.789793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:17.789799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:17.789846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:17.789959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:17.790007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:17.790052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:17.790095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:17.790578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:17.790631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:17.790676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:17.790720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:17.790776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:17.790821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:17.790865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:17.790911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:17.790971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:17.791028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:17.791084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:17.791127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:17.791176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:17.791220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:17.791272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:17.791318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:17.791368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:17.791412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:17.791461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:17.791508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:17.791559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:17.791616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:17.791666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:17.791714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:17.791762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:17.791804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:17.791854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:17.791896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:17.791942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:17.791983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:17.792033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:17.792457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:17.808693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:17.808731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:17.808742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:17.811970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593146158877740:4447]
2025-10-10T14:02:17.814256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 280 sessionId:  describe result for acl check
2025-10-10T14:02:17.814370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:17.814379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:17.814398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:17.814413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593146158877744:5176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:17.816696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593146158877744:5176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:17.842989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593146158877744:5176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:17.855991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593146158877744:5176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:17.856040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593146158877744:5176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:17.856056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593146158877744:5176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:17.856087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:17.880295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:17.895218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:17.895261Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:17.895276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:17.895293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:17.895316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 279 [2:7559593144580960547:4739]
2025-10-10T14:02:17.895366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:17.895423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:17.895436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:17.895447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:17.895457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:17.895503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:17.895523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:17.895545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:17.898141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:17.898161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:17.898173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:17.898185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:17.898194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:17.898457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:17.898472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:17.898598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:17.898762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:17.898966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:17.899070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:17.899144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:17.899158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:17.899170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:17.899181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:17.899226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:17.899299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:17.899459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:17.899477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:17.899602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:17.899620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:17.902362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 279
2025-10-10T14:02:17.902458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 279
2025-10-10T14:02:17.902510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 279, pipe: [1:7559593146158877740:4447]
2025-10-10T14:02:17.900298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:17.900316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:17.900327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:17.900336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:17.900358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:17.902448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593146158877722:2442], now have 1 active actors on pipe
2025-10-10T14:02:17.902482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593146158877784:5176], now have 1 active actors on pipe
2025-10-10T14:02:17.902504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593146158877740:4447], now have 1 active actors on pipe
2025-10-10T14:02:17.906307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:17.906344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:17.906436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:17.906472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:17.906490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:17.906500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:17.906534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:17.906579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:17.906626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:17.910992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:17.911025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:17.911095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:17.911511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 280 partition: 0 MaxSeqNo: 36 sessionId: src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0
2025-10-10T14:02:17.913334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|247b3d42-b3b799a8-d596afb-993842cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:17.960872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0] Write session: try to update token
2025-10-10T14:02:17.960929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:18.063107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:18.063144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:18.063156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:18.063213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:18.063228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:18.063242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:18.063253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:18.063265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:18.063301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:18.063330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:18.063354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:18.063377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:18.063509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:18.063547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:18.063577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:18.063582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:18.063604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:18.063614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:18.063614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:18.074228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:18.145413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId: src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:18.213457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:18.277496Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:18.288835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:18.288884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:18.288951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:18.288967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:18.289009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593144580960541:4739]
2025-10-10T14:02:18.289540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:18.290571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:18.294345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593146158877740:4447]
2025-10-10T14:02:18.294544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:18.294708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:18.294733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:18.328890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:18.328934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0] Write session will restart in 0.009135s
2025-10-10T14:02:18.329044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0] Write session: Do CDS request
2025-10-10T14:02:18.329075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:18.326447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 280 reason: error at write: Disconnected sessionId: src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0
2025-10-10T14:02:18.326751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 280 sessionId: src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0 is DEAD
2025-10-10T14:02:18.345444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:18.345479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 281
2025-10-10T14:02:18.353988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:18.354604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:18.354759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:18.354777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:18.354787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:18.360430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 281 sessionId:  describe result for acl check
2025-10-10T14:02:18.360557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:18.360568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:18.360579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:18.360595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593150453845147:5186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:18.363355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593150453845147:5186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:18.383946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593150453845147:5186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:18.396240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:18.399080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593150453845204:4447]
2025-10-10T14:02:18.406825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:18.407764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:18.407783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:18.407827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:18.408098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:18.408279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593148875927955:4744]
2025-10-10T14:02:18.407235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593150453845147:5186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:18.407288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593150453845147:5186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:18.407306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593150453845147:5186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:18.407339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:18.411040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:18.417425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:18.417726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:18.419087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:18.419426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:18.419434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:18.419443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:18.419450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:18.419457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:18.419462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:18.419470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:18.419478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:18.419485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:18.419493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:18.419500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:18.419508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:18.419562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:18.419683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:18.419735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:18.419787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:18.419838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:18.419897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:18.419942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:18.419995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:18.420046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:18.420097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:18.420146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:18.420196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:18.420242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:18.420317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:18.420382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:18.420441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:18.420495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:18.420558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:18.420609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:18.420670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:18.420724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:18.420783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:18.420834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:18.420894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:18.420951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:18.421009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:18.421061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:18.421120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:18.425235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:18.425325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:18.425383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:18.425450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:18.425507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:18.425586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:18.425626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:18.425670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:18.426078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:18.472967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:18.503179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:18.503228Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:18.503248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:18.503270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:18.503295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 280 [2:7559593148875927955:4744]
2025-10-10T14:02:18.503359Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:18.503423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:18.503439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:18.503454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:18.503465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:18.503515Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:18.503537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:18.503560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:18.504977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:18.504994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:18.505012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:18.505027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:18.505039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:18.506821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 280
2025-10-10T14:02:18.506914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 280
2025-10-10T14:02:18.506980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 280, pipe: [1:7559593150453845204:4447]
2025-10-10T14:02:18.507466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:18.507493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:18.507651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:18.507859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:18.508119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:18.508248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:18.508333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593150453845210:5186], now have 1 active actors on pipe
2025-10-10T14:02:18.508359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593150453845113:2442], now have 1 active actors on pipe
2025-10-10T14:02:18.508384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593150453845204:4447], now have 1 active actors on pipe
2025-10-10T14:02:18.508451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:18.508474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:18.508510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.508524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.508538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.508550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.508592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:18.508695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:18.508891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:18.508908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:18.508976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:18.509005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:18.509025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:18.509037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:18.509071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:18.509111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:18.509257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.509281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:18.509331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:18.510474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:18.510495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:18.510507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:18.510520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:18.510543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:18.517919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:18.517958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:18.518045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:18.518513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 281 partition: 0 MaxSeqNo: 36 sessionId: src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0
2025-10-10T14:02:18.521880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5b0e1ac-b9d673cf-911df034-1331c28d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:18.555343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0] Write session: try to update token
2025-10-10T14:02:18.555401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:18.766343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:18.766375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:18.766389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:18.766499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:18.766515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:18.766531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:18.766544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:18.766556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:18.766595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.766622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.766648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.766670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.767706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:18.767743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:18.767776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:18.767806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:18.783548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:18.783614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:18.783627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:18.788550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId: src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:18.797559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:18.852874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:18.974418Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:18.977881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:18.977905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:18.977948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593148875927948:4744]
2025-10-10T14:02:18.978077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:18.978102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:18.981892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:18.981939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:18.983162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:18.987563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:18.987831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593150453845204:4447]
2025-10-10T14:02:19.043133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 281 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0
2025-10-10T14:02:19.043445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 281 sessionId: src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0 is DEAD
2025-10-10T14:02:19.049464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:19.049525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0] Write session will restart in 0.005693s
2025-10-10T14:02:19.049709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0] Write session: Do CDS request
2025-10-10T14:02:19.049758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:19.059938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:19.059971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 282
2025-10-10T14:02:19.060607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:19.061369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:19.061512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:19.061529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:19.061554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:19.063356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 282 sessionId:  describe result for acl check
2025-10-10T14:02:19.063498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:19.063509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:19.063520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:19.063538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593154748812610:5191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:19.064818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:19.066329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593154748812610:5191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:19.072915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:19.073912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:19.073941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:19.073991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:19.074292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:19.074497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593153170895383:4754]
2025-10-10T14:02:19.076568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:19.077821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:19.077985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:19.078835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:19.079076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:19.079085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:19.079091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:19.079099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:19.079107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:19.079116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:19.079124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:19.079132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:19.079141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.079149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.079157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.079164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.079206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:19.079298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:19.079337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:19.079378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:19.079424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:19.079475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:19.079517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:19.079550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:19.079583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.079882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.079924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.079963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.079997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:19.080044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:19.080123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:19.080178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:19.080216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:19.080255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:19.080288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:19.080328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:19.080362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:19.080399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:19.080432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:19.080471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:19.080502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:19.080541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:19.080575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:19.080612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:19.080647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.080686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.080731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.080770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.080805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.080843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.080874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.080911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.081347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:19.109621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593154748812628:4447]
2025-10-10T14:02:19.114530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593154748812610:5191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:19.131282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593154748812610:5191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:19.131334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593154748812610:5191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:19.131360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593154748812610:5191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:19.131394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:19.134716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:19.148002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:19.148052Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:19.148070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:19.148091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:19.148115Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 281 [2:7559593153170895383:4754]
2025-10-10T14:02:19.148172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:19.148233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:19.148248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:19.148261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:19.148273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:19.148322Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:19.148345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:19.148366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:19.152863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 281, pipe: [1:7559593154748812628:4447]
2025-10-10T14:02:19.152885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 281
2025-10-10T14:02:19.152969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 281
2025-10-10T14:02:19.150682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.150711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.150726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.150743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.150756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:19.151039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:19.151058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.151209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.151442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.151697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.151832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:19.151905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.151920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.151934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.151946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.151980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:19.152066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:19.152154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:19.152172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:19.152185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:19.152200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:19.153211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:19.153244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:19.153447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593154748812628:4447], now have 1 active actors on pipe
2025-10-10T14:02:19.153478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593154748812645:5191], now have 1 active actors on pipe
2025-10-10T14:02:19.153503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593150453845250:2442], now have 1 active actors on pipe
2025-10-10T14:02:19.153574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:19.153601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:19.153681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.153720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:19.153864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d836a2c-88b07606-cbe290ee-830b4384_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:19.153909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:19.153931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:19.153943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:19.153983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:19.154028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:19.154152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:19.154336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:19.160846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 282 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d836a2c-88b07606-cbe290ee-830b4384_0
2025-10-10T14:02:19.160341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:19.160384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:19.160468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:19.165365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38304d4-4f73b580-3ed43889-bf4d5bdc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d836a2c-88b07606-cbe290ee-830b4384_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:19.208712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:19.208744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:19.208756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:19.211301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d836a2c-88b07606-cbe290ee-830b4384_0] Write session: try to update token
2025-10-10T14:02:19.211365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d836a2c-88b07606-cbe290ee-830b4384_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:19.375735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:19.375763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:19.375776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:19.375788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:19.375800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:19.375834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.375861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.375887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.375914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.376133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:19.376145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:19.376157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:19.376199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:19.376224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.376236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:19.376695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:19.376733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:19.376765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:19.376795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:19.377582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:19.436035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId: src_id|9d836a2c-88b07606-cbe290ee-830b4384_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:19.489965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:19.558242Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:19.571217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:19.571264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:19.571331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:19.571346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:19.571387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593153170895377:4754]
2025-10-10T14:02:19.571682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:19.572013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:19.573504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593154748812628:4447]
2025-10-10T14:02:19.573716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:19.583548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 282 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d836a2c-88b07606-cbe290ee-830b4384_0
2025-10-10T14:02:19.583916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 282 sessionId: src_id|9d836a2c-88b07606-cbe290ee-830b4384_0 is DEAD
2025-10-10T14:02:19.587413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d836a2c-88b07606-cbe290ee-830b4384_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:19.587493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d836a2c-88b07606-cbe290ee-830b4384_0] Write session will restart in 0.007775s
2025-10-10T14:02:19.587655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d836a2c-88b07606-cbe290ee-830b4384_0] Write session: Do CDS request
2025-10-10T14:02:19.587730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d836a2c-88b07606-cbe290ee-830b4384_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:19.601357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d836a2c-88b07606-cbe290ee-830b4384_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:19.606649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:19.606786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:19.606799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 283
2025-10-10T14:02:19.610133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:19.610269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:19.610284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:19.610293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:19.621817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 283 sessionId:  describe result for acl check
2025-10-10T14:02:19.622056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:19.622077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:19.622093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:19.622120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593154748812698:5203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:19.625110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593154748812698:5203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:19.638083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593154748812698:5203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:19.651241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593154748812698:5203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:19.651284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593154748812698:5203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:19.651301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593154748812698:5203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:19.651330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:19.670792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:19.673954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593154748812773:4447]
2025-10-10T14:02:19.678598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:19.679477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:19.679494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:19.679538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:19.679792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:19.679975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593153170895512:4761]
2025-10-10T14:02:19.682077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:19.688440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:19.688713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:19.689991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:19.690306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:19.690314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:19.690319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:19.690326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:19.690332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:19.690339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:19.690347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:19.690353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:19.690360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.690367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.690372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.690379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.690425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:19.690527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:19.690573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:19.690617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:19.690658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:19.690702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:19.690743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:19.690783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:19.690821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.690863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.690905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.690947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.690986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:19.691044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:19.691097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:19.691146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:19.691192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:19.691239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:19.691277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:19.691327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:19.691371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:19.691422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:19.691467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:19.691516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:19.691558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:19.691605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:19.691653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:19.691703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:19.691750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.691798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.691840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.691893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.691937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.691986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.692028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.692074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.692474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:19.737366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:19.756855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:19.757102Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:19.757122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:19.757155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:19.757180Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 282 [2:7559593153170895512:4761]
2025-10-10T14:02:19.757242Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:19.757320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:19.757333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:19.757344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:19.757354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:19.757402Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:19.757423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:19.757446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:19.784132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.784161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.784173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.784184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.784195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:19.784487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:19.784503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.784629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:19.784786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:19.784987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:19.785092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:19.785197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593154748812773:4447], now have 1 active actors on pipe
2025-10-10T14:02:19.785221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593154748812682:2442], now have 1 active actors on pipe
2025-10-10T14:02:19.785239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593154748812768:5203], now have 1 active actors on pipe
2025-10-10T14:02:19.785264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:19.785278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:19.785289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:19.785300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:19.785342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:19.785423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:19.785598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:19.785615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:19.785745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:19.785765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:19.786070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:19.786083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:19.786094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:19.786104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:19.786128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:19.785528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 282, pipe: [1:7559593154748812773:4447]
2025-10-10T14:02:19.785638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 282
2025-10-10T14:02:19.785712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 282
2025-10-10T14:02:19.793310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:19.793359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:19.793443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:19.793478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:19.793509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:19.793519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:19.793554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:19.793622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:19.793662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:19.797769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:19.797812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:19.797894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:19.798599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 283 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0
2025-10-10T14:02:19.805979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d836a2c-88b07606-cbe290ee-830b4384_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:19.860786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:19.860814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:19.860826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:19.886454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0] Write session: try to update token
2025-10-10T14:02:19.886519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:19.987445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:19.987479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:19.987494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:19.987505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:19.987515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:19.987554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:19.987582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:19.987607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:19.987628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:19.987856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:19.987867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:19.987878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:19.987925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:19.987950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:19.987961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:19.989003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:19.993349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:19.993433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:19.993504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:19.993583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:20.074065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId: src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:20.103953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:20.192170Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:20.222877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:20.222933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:20.223000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:20.223014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:20.223054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593153170895507:4761]
2025-10-10T14:02:20.223460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:20.225313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:20.225308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:20.225345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:20.230227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593154748812773:4447]
2025-10-10T14:02:20.230402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:20.253330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 283 reason: error at write: Disconnected sessionId: src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0
2025-10-10T14:02:20.253684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 283 sessionId: src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0 is DEAD
2025-10-10T14:02:20.257752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:20.257789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0] Write session will restart in 0.005396s
2025-10-10T14:02:20.257901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0] Write session: Do CDS request
2025-10-10T14:02:20.257932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:20.273241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:20.273681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:20.273716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 284
2025-10-10T14:02:20.274084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:20.274208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:20.274225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:20.274235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:20.275929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 284 sessionId:  describe result for acl check
2025-10-10T14:02:20.276105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:20.276123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:20.276139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:20.276167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593159043780130:5212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:20.279824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593159043780130:5212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:20.292903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593159043780130:5212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:20.311681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593159043780130:5212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:20.311734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593159043780130:5212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:20.311753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593159043780130:5212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:20.311789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:20.333242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593159043780219:4447]
2025-10-10T14:02:20.332738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:20.338905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:20.339607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:20.339624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:20.339653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:20.339844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:20.339957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593157465862936:4767]
2025-10-10T14:02:20.341930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:20.343022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:20.343263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:20.344685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:20.345043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:20.345052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:20.345059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:20.345067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:20.345713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:20.345736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:20.345745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:20.345753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:20.345762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:20.345770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:20.345778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:20.345786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:20.345842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:20.345965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:20.346020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:20.346074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:20.346126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:20.346180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:20.346230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:20.346280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:20.346332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:20.346388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:20.346439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:20.346487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:20.346534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:20.346612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:20.346678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:20.346739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:20.346797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:20.346860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:20.346911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:20.346971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:20.347026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:20.347082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:20.347135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:20.347194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:20.347244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:20.347299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:20.347347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:20.347407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:20.347464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:20.347522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:20.347573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:20.347631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:20.347688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:20.347747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:20.347799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:20.347857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:20.348309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:20.420916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:20.436232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:20.436284Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:20.436302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:20.436322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:20.436344Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 283 [2:7559593157465862936:4767]
2025-10-10T14:02:20.436405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:20.436466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:20.436481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:20.436493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:20.436504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:20.436553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:20.436576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:20.436598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:20.439632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:20.439664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:20.439680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:20.439694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:20.439707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:20.439994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:20.440013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:20.440164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:20.441392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 283
2025-10-10T14:02:20.441479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 283, pipe: [1:7559593159043780219:4447]
2025-10-10T14:02:20.441552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 283
2025-10-10T14:02:20.441698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:20.442003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:20.442153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:20.442304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593159043780212:5212], now have 1 active actors on pipe
2025-10-10T14:02:20.442332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593159043780219:4447], now have 1 active actors on pipe
2025-10-10T14:02:20.442357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593159043780119:2442], now have 1 active actors on pipe
2025-10-10T14:02:20.442406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:20.442431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:20.442497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.442513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.442528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.442542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.442581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:20.442682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:20.442884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:20.442901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:20.442965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:20.442998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:20.443017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:20.443028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:20.443064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:20.443107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:20.443247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.443270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:20.443320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:20.443656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:20.443675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:20.443687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:20.443699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:20.443724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:20.448286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:20.448325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:20.448412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:20.448802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 284 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0
2025-10-10T14:02:20.450271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c6b47e4-97a6b0a5-437db29-bb5595d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:20.526523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0] Write session: try to update token
2025-10-10T14:02:20.526583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:20.700573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:20.700608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:20.700621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:20.700678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:20.700694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:20.700706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:20.700718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:20.700729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:20.700766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.700791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.700817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.700841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.701058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:20.701086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:20.701099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:20.704857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:20.704909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:20.704943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:20.704974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:20.709626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:20.757260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId: src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:20.799342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:20.947060Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:20.976036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:20.976087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:20.976146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:20.976161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:20.976202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593157465862931:4767]
2025-10-10T14:02:20.976463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:20.976936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:20.977905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:20.977935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:21.013037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 284 reason: error at write: Disconnected sessionId: src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0
2025-10-10T14:02:21.013384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 284 sessionId: src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0 is DEAD
2025-10-10T14:02:21.017754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:21.017786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0] Write session will restart in 0.005529s
2025-10-10T14:02:21.017882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0] Write session: Do CDS request
2025-10-10T14:02:21.017912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:21.030152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:21.036817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593159043780219:4447]
2025-10-10T14:02:21.036970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:21.040120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:21.040138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 285
2025-10-10T14:02:21.040735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:21.040875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:21.040890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:21.040900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:21.042836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 285 sessionId:  describe result for acl check
2025-10-10T14:02:21.042959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:21.042970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:21.042979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:21.042997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593163338747606:5226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:21.047154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593163338747606:5226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:21.059671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593163338747606:5226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:21.065574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:21.072308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:21.073320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:21.073340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:21.073389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:21.073718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:21.073905Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593161760830385:4776]
2025-10-10T14:02:21.073210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593163338747606:5226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:21.073270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593163338747606:5226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:21.073288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593163338747606:5226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:21.073323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:21.076268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:21.077575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:21.077841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:21.079304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:21.079695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:21.079705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:21.079712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:21.079720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:21.079728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:21.079736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:21.079743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:21.079750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:21.079759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.079767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.079774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.079782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.079835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:21.079954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:21.080004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:21.080057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:21.080106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:21.080158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:21.080208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:21.080256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:21.080308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.080359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.080405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.080452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.080497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:21.080568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:21.080631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:21.080691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:21.080744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:21.080803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:21.080854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:21.080911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:21.080968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:21.081030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:21.081080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:21.081244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:21.081307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:21.081375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:21.081427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:21.081489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:21.081544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.081619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.081669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.081747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.081797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.081857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.081907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.081966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.082451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:21.127983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:21.135893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593163338747674:4447]
2025-10-10T14:02:21.143559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:21.143606Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:21.143622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:21.143644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:21.143668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 284 [2:7559593161760830385:4776]
2025-10-10T14:02:21.143727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:21.143784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:21.143801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:21.143814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:21.143825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:21.143874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:21.143895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:21.143919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:21.146696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.146725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.146881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.146900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.146913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:21.147216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:21.147235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.147382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.147591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.149324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 284
2025-10-10T14:02:21.149445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 284
2025-10-10T14:02:21.149508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 284, pipe: [1:7559593163338747674:4447]
2025-10-10T14:02:21.150723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.150878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:21.150977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593163338747588:2442], now have 1 active actors on pipe
2025-10-10T14:02:21.151003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593163338747667:5226], now have 1 active actors on pipe
2025-10-10T14:02:21.151029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593163338747674:4447], now have 1 active actors on pipe
2025-10-10T14:02:21.151109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:21.151134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:21.151175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.151191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.151207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.151221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.151261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:21.151369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:21.151563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:21.151581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:21.151653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6351b2ed-44e34eb-88d53004-5139c047_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:21.151686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:21.151705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:21.151717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:21.151753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:21.151795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:21.151933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.151957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:21.152003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:21.152710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:21.152730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:21.152741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:21.152753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:21.152780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:21.157932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:21.157973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:21.158067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:21.158581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 285 partition: 0 MaxSeqNo: 36 sessionId: src_id|6351b2ed-44e34eb-88d53004-5139c047_0
2025-10-10T14:02:21.159377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b3bc1d8-cdfafced-e01c1ff4-6bb12689_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6351b2ed-44e34eb-88d53004-5139c047_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:21.217998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6351b2ed-44e34eb-88d53004-5139c047_0] Write session: try to update token
2025-10-10T14:02:21.218060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6351b2ed-44e34eb-88d53004-5139c047_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:21.338727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:21.338763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:21.338774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:21.338885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:21.338898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:21.338910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:21.338922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:21.338933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:21.338966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.338993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.339017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.339039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.339197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:21.339245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:21.339289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:21.339325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:21.373187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:21.373245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.373257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:21.374550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:21.545972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId: src_id|6351b2ed-44e34eb-88d53004-5139c047_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:21.585062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:21.644793Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:21.648058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:21.648088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:21.648139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593161760830380:4776]
2025-10-10T14:02:21.648300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:21.648324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:21.648678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:21.650644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:21.650788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:21.650801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:21.652030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:21.706472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593163338747674:4447]
2025-10-10T14:02:21.743622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 285 reason: error at write: Disconnected sessionId: src_id|6351b2ed-44e34eb-88d53004-5139c047_0
2025-10-10T14:02:21.746354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6351b2ed-44e34eb-88d53004-5139c047_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:21.746403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6351b2ed-44e34eb-88d53004-5139c047_0] Write session will restart in 0.006818s
2025-10-10T14:02:21.746567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6351b2ed-44e34eb-88d53004-5139c047_0] Write session: Do CDS request
2025-10-10T14:02:21.746613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6351b2ed-44e34eb-88d53004-5139c047_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:21.744927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 285 sessionId: src_id|6351b2ed-44e34eb-88d53004-5139c047_0 is DEAD
2025-10-10T14:02:21.763666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6351b2ed-44e34eb-88d53004-5139c047_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:21.767679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:21.769523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:21.769560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 286
2025-10-10T14:02:21.769933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:21.770049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:21.770066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:21.770076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:21.775014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 286 sessionId:  describe result for acl check
2025-10-10T14:02:21.775156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:21.775168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:21.775177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:21.775194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593163338747775:5235] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:21.777941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593163338747775:5235] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:21.777833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:21.778784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:21.778802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:21.778845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:21.779122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:21.779496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593161760830502:4784]
2025-10-10T14:02:21.781917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:21.784026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:21.784253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:21.785664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:21.786057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:21.786068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:21.786077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:21.786085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:21.786092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:21.786100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:21.786109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:21.786116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:21.786124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.786131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.786139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.786145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.786195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:21.786321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:21.786383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:21.786434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:21.786486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:21.786540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:21.786597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:21.786649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:21.786698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.786750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.786801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.786850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.786901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:21.787076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:21.787226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:21.787375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:21.787515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:21.787648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:21.787766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:21.787916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:21.788019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:21.788142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:21.788191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:21.788277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:21.788392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:21.788508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:21.788615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:21.788711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:21.788770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.788823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.788869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.788923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.788971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.789029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.789078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.791209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593163338747775:5235] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:21.793240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.794010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:21.806477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593163338747802:4447]
2025-10-10T14:02:21.813435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593163338747775:5235] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:21.813484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593163338747775:5235] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:21.813504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593163338747775:5235] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:21.813540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:21.844002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:21.915149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:21.915199Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:21.915219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:21.915242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:21.915268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 285 [2:7559593161760830502:4784]
2025-10-10T14:02:21.915334Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:21.915398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:21.915415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:21.915430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:21.915444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:21.915494Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:21.915520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:21.915544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:21.916834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.916854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.916870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.916885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.916898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:21.917194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:21.917215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:21.917386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:21.917622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:21.917882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:21.918026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:21.920008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 285
2025-10-10T14:02:21.920101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 285, pipe: [1:7559593163338747802:4447]
2025-10-10T14:02:21.920184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 285
2025-10-10T14:02:21.918106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:21.918135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:21.918149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:21.918163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:21.918207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:21.918298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:21.918503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:21.918522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:21.918662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:21.918686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:21.918940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:21.918953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:21.918967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:21.918980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:21.919004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:21.919911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593163338747805:5235], now have 1 active actors on pipe
2025-10-10T14:02:21.919942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593163338747802:4447], now have 1 active actors on pipe
2025-10-10T14:02:21.919968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593163338747690:2442], now have 1 active actors on pipe
2025-10-10T14:02:21.921336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:21.921375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:21.921491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|425f9d79-d49b72d1-8d394310-988841c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:21.921528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:21.921548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:21.921560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:21.921622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:21.921668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:21.921723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:21.923173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:21.923205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:21.923283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:21.924542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6351b2ed-44e34eb-88d53004-5139c047_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|425f9d79-d49b72d1-8d394310-988841c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:21.923702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 286 partition: 0 MaxSeqNo: 36 sessionId: src_id|425f9d79-d49b72d1-8d394310-988841c8_0
2025-10-10T14:02:21.965926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|425f9d79-d49b72d1-8d394310-988841c8_0] Write session: try to update token
2025-10-10T14:02:21.965987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|425f9d79-d49b72d1-8d394310-988841c8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:22.006595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:22.006629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:22.006644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:22.006658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:22.006669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:22.006707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:22.006735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:22.006761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:22.006784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:22.006994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:22.007036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:22.007049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:22.008153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:22.012959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:22.013023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:22.013060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:22.013097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:22.087761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId: src_id|425f9d79-d49b72d1-8d394310-988841c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:22.134100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:22.154693Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:22.166287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:22.166343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:22.166411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:22.166428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:22.166473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593161760830496:4784]
2025-10-10T14:02:22.168164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:22.168775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:22.169693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:22.169721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:22.170796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:22.170961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593163338747802:4447]
2025-10-10T14:02:22.215235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 286 reason: error at write: Disconnected sessionId: src_id|425f9d79-d49b72d1-8d394310-988841c8_0
2025-10-10T14:02:22.215573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 286 sessionId: src_id|425f9d79-d49b72d1-8d394310-988841c8_0 is DEAD
2025-10-10T14:02:22.217516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425f9d79-d49b72d1-8d394310-988841c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:22.217583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425f9d79-d49b72d1-8d394310-988841c8_0] Write session will restart in 0.009877s
2025-10-10T14:02:22.217778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425f9d79-d49b72d1-8d394310-988841c8_0] Write session: Do CDS request
2025-10-10T14:02:22.217833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425f9d79-d49b72d1-8d394310-988841c8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:22.234548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:22.234607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 287
2025-10-10T14:02:22.235125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|425f9d79-d49b72d1-8d394310-988841c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:22.236209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:22.236469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:22.236504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:22.236538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:22.241344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 287 sessionId:  describe result for acl check
2025-10-10T14:02:22.241474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:22.241483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:22.241493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:22.241511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593167633715167:5241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:22.246056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593167633715167:5241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:22.273241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593167633715167:5241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:22.273498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593167633715223:4447]
2025-10-10T14:02:22.298469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593167633715167:5241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:22.298526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593167633715167:5241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:22.298545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593167633715167:5241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:22.298581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:22.310605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:22.313300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:22.314218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:22.314250Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:22.314299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:22.314607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:22.314799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593166055797937:4796]
2025-10-10T14:02:22.317183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:22.329149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:22.329457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:22.330937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:22.331310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:22.331317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:22.331324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:22.331331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:22.331338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:22.331346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:22.331353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:22.331360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:22.331366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:22.331371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:22.331378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:22.331385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:22.331433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:22.331544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:22.331593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:22.331642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:22.331685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:22.331732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:22.331777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:22.331821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:22.331866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:22.331911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:22.331953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:22.331998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:22.332040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:22.332104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:22.332161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:22.332214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:22.332261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:22.332315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:22.333413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:22.333483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:22.333533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:22.333585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:22.333644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:22.333701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:22.333747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:22.333800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:22.333848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:22.333899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:22.333948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:22.334001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:22.334048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:22.334101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:22.334145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:22.334215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:22.334257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:22.334304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:22.344248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:22.472475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:22.492405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:22.492452Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:22.492469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:22.492490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:22.492515Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 286 [2:7559593166055797937:4796]
2025-10-10T14:02:22.492575Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:22.492640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:22.492656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:22.492667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:22.492679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:22.492730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:22.492754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:22.492776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:22.495634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:22.495659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:22.495673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:22.495688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:22.495699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:22.495994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:22.496010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:22.496152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:22.496329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:22.496545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:22.496658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:22.496732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593166055797932:4796]
2025-10-10T14:02:22.496745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593166055797932:4796]
2025-10-10T14:02:22.496757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593166055797932:4796]
2025-10-10T14:02:22.496770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593166055797932:4796]
2025-10-10T14:02:22.496818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:22.496903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:22.496959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:22.496971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:22.496983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:22.496995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:22.497075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:22.497093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:22.497413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593166055797932:4796]
2025-10-10T14:02:22.497441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:22.497503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593167633715223:4447], now have 1 active actors on pipe
2025-10-10T14:02:22.497527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593167633715234:5241], now have 1 active actors on pipe
2025-10-10T14:02:22.497548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593167633715133:2442], now have 1 active actors on pipe
2025-10-10T14:02:22.498759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:22.501183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 286, pipe: [1:7559593167633715223:4447]
2025-10-10T14:02:22.501293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 286
2025-10-10T14:02:22.501306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 286
2025-10-10T14:02:22.505570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:22.505630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:22.505743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:22.505793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:22.505815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:22.505827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:22.505868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:22.505921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:22.505976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:22.511918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:22.511962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:22.512049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:22.514899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 287 partition: 0 MaxSeqNo: 36 sessionId: src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0
2025-10-10T14:02:22.517206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|425f9d79-d49b72d1-8d394310-988841c8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:22.593512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:22.593541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:22.593554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:22.593977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0] Write session: try to update token
2025-10-10T14:02:22.594031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:22.741006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:22.741036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:22.741048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:22.741105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:22.741120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:22.741158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:22.741169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:22.741181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:22.741218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593166055797932:4796]
2025-10-10T14:02:22.741244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593166055797932:4796]
2025-10-10T14:02:22.741268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593166055797932:4796]
2025-10-10T14:02:22.741288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593166055797932:4796]
2025-10-10T14:02:22.741417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:22.741442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:22.741444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:22.741453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:22.741477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:22.741517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:22.741547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:22.742554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:22.822221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId: src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:22.877340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:23.207718Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:23.214680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:23.214725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:23.218541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:23.218729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593167633715223:4447]
2025-10-10T14:02:23.218828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:23.218849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:23.222378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:23.346097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 287 reason: error at write: Disconnected sessionId: src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0
2025-10-10T14:02:23.346488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 287 sessionId: src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0 is DEAD
2025-10-10T14:02:23.349685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:23.349720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0] Write session will restart in 0.006273s
2025-10-10T14:02:23.349819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0] Write session: Do CDS request
2025-10-10T14:02:23.349850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:23.373990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:23.398893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:23.408070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:23.408927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:23.408945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:23.408985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:23.409255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:23.409455Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593170350765376:4805]
2025-10-10T14:02:23.411529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:23.417475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:23.417781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:23.419185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:23.419541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:23.419549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:23.419556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:23.419563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:23.419571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:23.419579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:23.419586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:23.419594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:23.419602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:23.419609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:23.419617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:23.419626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:23.419674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:23.419787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:23.419841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:23.419894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:23.419943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:23.419993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:23.420041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:23.420088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:23.420135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:23.420181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:23.420226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:23.420277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:23.420322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:23.420390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:23.420449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:23.420508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:23.420555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:23.420611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:23.420657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:23.420710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:23.420761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:23.420816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:23.420864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:23.420954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:23.421013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:23.421070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:23.421118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:23.437614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:23.437730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:23.437799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:23.437850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:23.437910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:23.437963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:23.438019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:23.438073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:23.438133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:23.438614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:23.449213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593171928682667:4447]
2025-10-10T14:02:23.449397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:23.449414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 288
2025-10-10T14:02:23.465410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:23.465612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:23.465631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:23.465661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:23.467510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 288 sessionId:  describe result for acl check
2025-10-10T14:02:23.467640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:23.467650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:23.467659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:23.467676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593171928682674:5255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:23.470409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593171928682674:5255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:23.504194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593171928682674:5255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:23.511903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:23.549013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593171928682674:5255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:23.549066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593171928682674:5255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:23.549086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593171928682674:5255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:23.549120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:23.625728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:02:23.625803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-10-10T14:02:23.635710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:23.635758Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:23.635775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:23.635796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:23.635820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 287 [2:7559593170350765376:4805]
2025-10-10T14:02:23.635872Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:23.635931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:23.635947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:23.635959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:23.635972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:23.636021Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:23.636043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:23.636067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:23.642270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:23.642299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:23.642313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:23.642326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:23.642338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:23.642630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:23.642647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:23.642784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:23.642964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:23.643174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:23.643286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:23.643368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593170350765371:4805]
2025-10-10T14:02:23.643385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593170350765371:4805]
2025-10-10T14:02:23.643398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593170350765371:4805]
2025-10-10T14:02:23.643411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593170350765371:4805]
2025-10-10T14:02:23.643458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:23.643539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:23.643711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:23.643731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:23.643871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593170350765371:4805]
2025-10-10T14:02:23.643890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:23.648718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 287, pipe: [1:7559593171928682667:4447]
2025-10-10T14:02:23.648923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 287
2025-10-10T14:02:23.649026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 287
2025-10-10T14:02:23.644756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:23.644774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:23.644786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:23.644798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:23.644824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:23.661392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593171928682667:4447], now have 1 active actors on pipe
2025-10-10T14:02:23.661445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593171928682589:2442], now have 1 active actors on pipe
2025-10-10T14:02:23.661468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593171928682702:5255], now have 1 active actors on pipe
2025-10-10T14:02:23.661613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:23.661638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:23.661833Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:02:23.661962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:23.661996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:23.662013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:23.662026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:23.662065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:23.662111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:23.662155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:23.664429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 6 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:02:23.664584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:02:23.671620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:23.671670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:23.671768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:23.672349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 288 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0
2025-10-10T14:02:23.675205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9af5075-5533d5eb-aae3caad-b3276d94_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:23.739649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:23.739686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:23.739698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:23.770799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0] Write session: try to update token
2025-10-10T14:02:23.770861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:23.884957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:23.884992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:23.885003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:23.885064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:23.885080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:23.885093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:23.885104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:23.885115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:23.885174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593170350765371:4805]
2025-10-10T14:02:23.885199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593170350765371:4805]
2025-10-10T14:02:23.885224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593170350765371:4805]
2025-10-10T14:02:23.885245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593170350765371:4805]
2025-10-10T14:02:23.885387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:23.885413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:23.885425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:23.886511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:23.895783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:23.895841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:23.895870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:23.895896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:24.064291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId: src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:24.142748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:24.406388Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:24.439811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:24.439853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:24.447238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:24.447166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593171928682667:4447]
2025-10-10T14:02:24.447242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:24.447373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:24.447383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:24.547474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593176223650090:4447]
2025-10-10T14:02:24.547576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 288 reason: error at write: Disconnected sessionId: src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0
2025-10-10T14:02:24.547925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 288 sessionId: src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0 is DEAD
2025-10-10T14:02:24.549727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:24.549758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0] Write session will restart in 0.009931s
2025-10-10T14:02:24.549854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0] Write session: Do CDS request
2025-10-10T14:02:24.549881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:24.563852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:24.563894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 289
2025-10-10T14:02:24.564729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:24.565270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:24.565393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:24.565409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:24.565420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:24.566720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 289 sessionId:  describe result for acl check
2025-10-10T14:02:24.566836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:24.566847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:24.566855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:24.566871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593176223650117:5265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:24.573508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593176223650117:5265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:24.589306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593176223650117:5265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:24.599451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:24.606331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:24.607199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:24.607217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:24.607267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:24.607524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:24.607704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593174645732823:4818]
2025-10-10T14:02:24.610114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:24.618647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593176223650117:5265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:24.618695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593176223650117:5265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:24.618713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593176223650117:5265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:24.618744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:24.620164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:24.620428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:24.621754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:24.622097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:24.622106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:24.622112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:24.622118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:24.622123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:24.622131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:24.622138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:24.622146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:24.622152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:24.622160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:24.622166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:24.622173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:24.622239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:24.622343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:24.622388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:24.622435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:24.622476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:24.622523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:24.622566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:24.622609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:24.622653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:24.622700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:24.622744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:24.622785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:24.622826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:24.622893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:24.622949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:24.623001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:24.623046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:24.623103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:24.623151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:24.623202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:24.623251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:24.623305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:24.623349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:24.623406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:24.623453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:24.623503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:24.623549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:24.623601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:24.623650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:24.623702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:24.623744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:24.623798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:24.623842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:24.623893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:24.623938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:24.623991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:24.624469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:24.704993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:24.779563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:24.779601Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:24.779618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:24.779638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:24.779661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 288 [2:7559593174645732823:4818]
2025-10-10T14:02:24.779716Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:24.779777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:24.779793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:24.779805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:24.779817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:24.779865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:24.779888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:24.779909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:24.781263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:24.781280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:24.781294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:24.781308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:24.781318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:24.781598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:24.781615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:24.781772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:24.781950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:24.782177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:24.782945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 288
2025-10-10T14:02:24.783063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 288
2025-10-10T14:02:24.783129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 288, pipe: [1:7559593176223650090:4447]
2025-10-10T14:02:24.789759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:24.789870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593176223650051:2442], now have 1 active actors on pipe
2025-10-10T14:02:24.789893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593176223650162:5265], now have 1 active actors on pipe
2025-10-10T14:02:24.789914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593176223650090:4447], now have 1 active actors on pipe
2025-10-10T14:02:24.789976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:24.789995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:24.790038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:24.790050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:24.790063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:24.790074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:24.790114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:24.790196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:24.790371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:24.790388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:24.790452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:24.790484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:24.790500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:24.790511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:24.790547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:24.790592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:24.790724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:24.790744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:24.790787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:24.791596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:24.791614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:24.791626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:24.791637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:24.791663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:24.799311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:24.799357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:24.799471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:24.800056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 289 partition: 0 MaxSeqNo: 36 sessionId: src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0
2025-10-10T14:02:24.801019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ddc38e9-31b8164e-10ad161-4e8428f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:24.869907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0] Write session: try to update token
2025-10-10T14:02:24.869973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:24.880567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:24.880599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:24.880611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:25.035530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:25.035564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:25.035577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:25.035587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:25.035598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:25.035639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:25.035665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:25.035689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:25.035709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:25.035853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:25.035887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:25.035918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:25.035934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:25.035944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:25.035947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:25.035958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:25.036004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:25.036030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:25.036040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:25.047161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:25.099515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId: src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:25.143946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:25.383860Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:25.444837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:25.444901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:25.445003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:25.445018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:25.445064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593174645732818:4818]
2025-10-10T14:02:25.445532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:25.446220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:25.446381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:25.446392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:25.448273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593176223650090:4447]
2025-10-10T14:02:25.449324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:25.519716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 289 reason: error at write: Disconnected sessionId: src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0
2025-10-10T14:02:25.520037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 289 sessionId: src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0 is DEAD
2025-10-10T14:02:25.521577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:25.521611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0] Write session will restart in 0.006332s
2025-10-10T14:02:25.521720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0] Write session: Do CDS request
2025-10-10T14:02:25.521747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:25.542284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:25.577266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:25.586253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:25.587188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:25.587209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:25.587257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:25.587526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:25.587756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593178940700264:4825]
2025-10-10T14:02:25.589869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:25.591136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:25.591174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 290
2025-10-10T14:02:25.591456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593180518617585:4447]
2025-10-10T14:02:25.591589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:25.591694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:25.591710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:25.591719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:25.597342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 290 sessionId:  describe result for acl check
2025-10-10T14:02:25.597480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:25.597491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:25.597500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:25.597518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593180518617591:5276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:25.600225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593180518617591:5276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:25.597799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:25.598064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:25.599381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:25.599766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:25.599776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:25.599783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:25.599789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:25.599795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:25.599801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:25.599807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:25.599813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:25.599819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:25.599825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:25.599838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:25.599846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:25.599891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:25.599986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:25.600032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:25.600073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:25.600109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:25.600155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:25.600195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:25.600233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:25.600278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:25.600320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:25.600358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:25.600394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:25.600434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:25.600491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:25.600543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:25.600588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:25.600631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:25.600680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:25.600717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:25.600762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:25.600803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:25.600851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:25.600892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:25.600940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:25.600979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:25.601026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:25.601065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:25.601112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:25.601247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:25.601295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:25.601330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:25.601374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:25.601413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:25.601457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:25.601496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:25.601540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:25.601928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:25.665765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:25.677295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593180518617591:5276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:25.702858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593180518617591:5276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:25.702915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593180518617591:5276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:25.702931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593180518617591:5276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:25.702964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:25.723925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:25.723967Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:25.723983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:25.724003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:25.724026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 289 [2:7559593178940700264:4825]
2025-10-10T14:02:25.724078Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:25.724138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:25.724153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:25.724164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:25.724176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:25.724223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:25.724246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:25.724267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:25.726798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:25.726824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:25.726838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:25.726850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:25.726861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:25.727146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:25.727164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:25.727299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:25.727466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:25.727680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:25.727786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:25.727862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:25.727877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:25.727891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:25.727904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:25.727953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:25.728035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:25.728204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:25.728223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:25.728368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:25.728387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:25.729276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:25.729293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:25.729304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:25.729317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:25.729342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:25.735312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 289
2025-10-10T14:02:25.735394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 289, pipe: [1:7559593180518617585:4447]
2025-10-10T14:02:25.735458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 289
2025-10-10T14:02:25.736054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593180518617625:5276], now have 1 active actors on pipe
2025-10-10T14:02:25.736087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593180518617585:4447], now have 1 active actors on pipe
2025-10-10T14:02:25.736115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593180518617487:2442], now have 1 active actors on pipe
2025-10-10T14:02:25.743440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:25.743487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:25.743596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:25.743636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:25.743655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:25.743667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:25.743708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:25.743760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:25.743816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:25.754268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 290 partition: 0 MaxSeqNo: 36 sessionId: src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0
2025-10-10T14:02:25.757425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dc7fde5-b95dc84f-ec4ffba7-68f85130_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:25.753803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:25.753845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:25.753927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:25.844889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:25.844929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:25.844940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:25.845005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:25.845020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:25.845059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:25.845182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:25.865333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:02:25.893238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0] Write session: try to update token
2025-10-10T14:02:25.893296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:25.910348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:02:25.912214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:25.934364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:25.935804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:25.941879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:02:25.942506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:25.942520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:25.942532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:25.942587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:02:26.162219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:26.162251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:26.162262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:26.162316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:26.162328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:26.162340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:26.162349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:26.162359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:26.162395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:26.162421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:26.162441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:26.162460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593178940700259:4825]
2025-10-10T14:02:26.162604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:26.162628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:26.162638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:26.163575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:26.165231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:26.165260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:26.165283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:26.165309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:26.203026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId: src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:26.231238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:26.361085Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:26.370926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:26.370965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:26.378309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:26.378450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:26.378461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:26.381119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:26.387458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593180518617585:4447]
2025-10-10T14:02:26.388183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 290 reason: error at write: Disconnected sessionId: src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0
2025-10-10T14:02:26.388496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 290 sessionId: src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0 is DEAD
2025-10-10T14:02:26.389476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 631 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 15769614 MessagesInflight: 10 }
2025-10-10T14:02:26.389563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:26.389586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0] Write session will restart in 0.007038s
2025-10-10T14:02:26.389684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0] Write session: Do CDS request
2025-10-10T14:02:26.389722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:26.414370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:26.415038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:26.415075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 291
2025-10-10T14:02:26.415474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:26.415593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:26.415607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:26.415617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:26.418088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 291 sessionId:  describe result for acl check
2025-10-10T14:02:26.418218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:26.418228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:26.418236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:26.418255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593184813584981:5293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:26.422093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593184813584981:5293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:26.450811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593184813584981:5293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:26.465760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593184813584981:5293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:26.465807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593184813584981:5293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:26.465823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593184813584981:5293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:26.465855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:26.486230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593184813585079:4447]
2025-10-10T14:02:26.481348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:26.485482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:26.486416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:26.486436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:26.486485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:26.486754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:26.486937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593183235667702:4837]
2025-10-10T14:02:26.489037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:26.490505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:26.490710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:26.491909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:26.492236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:26.492245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:26.492251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:26.492258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:26.492264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:26.492270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:26.492278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:26.492284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:26.492290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:26.492297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:26.492304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:26.492311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:26.492357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:26.492462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:26.492508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:26.492553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:26.492598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:26.492641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:26.492687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:26.492733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:26.492776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:26.492820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:26.492862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:26.492902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:26.492945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:26.493007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:26.493065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:26.493143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:26.493196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:26.493250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:26.493298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:26.493350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:26.493395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:26.493447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:26.493490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:26.493542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:26.493587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:26.493640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:26.493682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:26.493750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:26.493797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:26.493847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:26.493892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:26.493946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:26.493992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:26.494045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:26.494089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:26.494136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:26.494547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:26.551813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:26.569250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:26.569293Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:26.569310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:26.569331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:26.569358Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 290 [2:7559593183235667702:4837]
2025-10-10T14:02:26.569417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:26.569477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:26.569492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:26.569504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:26.569515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:26.569563Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:26.569584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:26.569604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:26.571883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:26.571899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:26.571913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:26.571925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:26.571935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:26.572222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:26.572238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:26.572373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:26.572543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:26.572755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:26.572862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:26.572936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593183235667697:4837]
2025-10-10T14:02:26.572951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593183235667697:4837]
2025-10-10T14:02:26.572963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593183235667697:4837]
2025-10-10T14:02:26.572976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593183235667697:4837]
2025-10-10T14:02:26.574169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 290
2025-10-10T14:02:26.574276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 290
2025-10-10T14:02:26.574335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 290, pipe: [1:7559593184813585079:4447]
2025-10-10T14:02:26.573119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:26.573149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:26.573162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:26.573174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:26.573368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:26.573480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:26.573656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:26.573671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:26.573738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593184813584969:2442], now have 1 active actors on pipe
2025-10-10T14:02:26.573759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593184813585059:5293], now have 1 active actors on pipe
2025-10-10T14:02:26.573778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593184813585079:4447], now have 1 active actors on pipe
2025-10-10T14:02:26.573895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593183235667697:4837]
2025-10-10T14:02:26.573925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:26.574178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:26.575901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:26.575931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:26.576017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:26.576048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:26.576067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:26.576081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:26.576128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:26.576174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:26.576218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:26.576950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:26.576982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:26.577040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:26.577951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 291 partition: 0 MaxSeqNo: 36 sessionId: src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0
2025-10-10T14:02:26.588262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22e7f25f-74a32ab9-36f72304-b94bbe2b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:26.698849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:26.698882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:26.698894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:26.698951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:26.698966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:26.698980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:26.698991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:26.699001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:26.699037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593183235667697:4837]
2025-10-10T14:02:26.699061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593183235667697:4837]
2025-10-10T14:02:26.699083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593183235667697:4837]
2025-10-10T14:02:26.699102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593183235667697:4837]
2025-10-10T14:02:26.699248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:26.699274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:26.699285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:26.700275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:26.700823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:26.700854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:26.700893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:26.700920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:26.717756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0] Write session: try to update token
2025-10-10T14:02:26.717817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0] Send 10 message(s) (0 left), first sequence number is 37
E1010 14:02:26.774836288  112381 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:02:26.880928Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:26.893823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:26.893977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:26.893988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:26.894039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 291 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0
2025-10-10T14:02:26.894356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 291 sessionId: src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0 is DEAD
2025-10-10T14:02:26.894428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593184813585079:4447]
2025-10-10T14:02:26.954538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:02:26.954582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0] Write session will restart in 0.006421s
2025-10-10T14:02:26.954681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0] Write session: Do CDS request
2025-10-10T14:02:26.954709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:26.970757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:26.970601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:26.970638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 292
2025-10-10T14:02:26.977461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:26.977746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:26.977775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:26.977796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:26.987811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 292 sessionId:  describe result for acl check
2025-10-10T14:02:26.987956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:26.987967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:26.987977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:26.987994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593184813585167:5299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:26.991648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593184813585167:5299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:27.001283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593184813585192:4447]
2025-10-10T14:02:27.009553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593184813585167:5299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:27.020642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:27.030337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:27.031254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:27.031275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:27.031319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:27.031579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:27.031765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593187530635142:4841]
2025-10-10T14:02:27.030366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593184813585167:5299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:27.030415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593184813585167:5299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:27.030432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593184813585167:5299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:27.030463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:27.034126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:27.041785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:27.042076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:27.043346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:27.043661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:27.043669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:27.043675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:27.043681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:27.043689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:27.043695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:27.043702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:27.043708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:27.043716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.043723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.043729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.043735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.043783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:27.043888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:27.043935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:27.043982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:27.044031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:27.044078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:27.044122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:27.044168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:27.044211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.044256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.044301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.044342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.044383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:27.044449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:27.044506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:27.044561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:27.044610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:27.044660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:27.044707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:27.044761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:27.044810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:27.044863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:27.044906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:27.044959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:27.045006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:27.045056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:27.045100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:27.046059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:27.046124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.046183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.046233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.046289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.046338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.046392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.046443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.046496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.046949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:27.105515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:27.148394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:27.148444Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:27.148461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:27.148483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:27.148508Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 291 [2:7559593187530635142:4841]
2025-10-10T14:02:27.148565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:27.148630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:27.148644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:27.148656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:27.148668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:27.148717Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:27.148740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:27.148763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:27.150561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.150578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.150591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.150605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.150617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:27.150887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:27.150903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.151040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.151227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.151451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.151562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:27.151637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.151653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.151665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.151677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.151723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:27.151796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:27.151967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:27.151987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:27.152117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.152135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:27.155547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 291, pipe: [1:7559593184813585192:4447]
2025-10-10T14:02:27.155675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 291
2025-10-10T14:02:27.155762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 291
2025-10-10T14:02:27.153285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:27.153307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:27.153320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:27.153332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:27.153359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:27.157392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593184813585192:4447], now have 1 active actors on pipe
2025-10-10T14:02:27.157426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593184813585109:2442], now have 1 active actors on pipe
2025-10-10T14:02:27.157448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593189108552517:5299], now have 1 active actors on pipe
2025-10-10T14:02:27.164696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:27.164739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:27.164835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:27.164877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:27.164896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:27.164908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:27.164953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:27.165003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:27.165049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:27.168868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 292 partition: 0 MaxSeqNo: 36 sessionId: src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0
2025-10-10T14:02:27.168449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:27.168487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:27.168568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:27.177398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ec8d84-e711ab89-5d3b5c74-d1bba1a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:27.245488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:27.245517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:27.245529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:27.248229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0] Write session: try to update token
2025-10-10T14:02:27.248284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:27.290664Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 2 CurrentSessionLifetimeMs: 181889 BytesRead: 29286416 MessagesRead: 13 BytesReadCompressed: 29286416 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-10-10T14:02:27.451743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:27.451775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:27.451787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:27.451796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:27.451804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:27.451837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.451859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.451880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.451898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.452055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:27.452067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:27.452076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:27.452180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:27.452206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.452216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:27.453454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:27.453497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:27.453523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:27.453548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:27.482268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:27.545380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId: src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:27.619872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:27.746526Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:27.758843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:27.758888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:27.758953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:27.758965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:27.759006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593187530635136:4841]
2025-10-10T14:02:27.759574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:27.761382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593184813585192:4447]
2025-10-10T14:02:27.761470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:27.761591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:27.761601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:27.761592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:27.790556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 292 reason: error at write: Disconnected sessionId: src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0
2025-10-10T14:02:27.790916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 292 sessionId: src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0 is DEAD
2025-10-10T14:02:27.793730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:27.793774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0] Write session will restart in 0.008596s
2025-10-10T14:02:27.793866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0] Write session: Do CDS request
2025-10-10T14:02:27.793893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:27.813445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:27.840009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:27.845760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 293
2025-10-10T14:02:27.846411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:27.846530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:27.846546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:27.846556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:27.855549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 293 sessionId:  describe result for acl check
2025-10-10T14:02:27.855681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:27.855692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:27.855701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:27.855719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593189108552614:5312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:27.858303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593189108552614:5312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:27.873169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593189108552639:4447]
2025-10-10T14:02:27.902660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593189108552614:5312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:27.906035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:27.910644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:27.911505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:27.911524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:27.911568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:27.911826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:27.912012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593187530635275:4850]
2025-10-10T14:02:27.914240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:27.917179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:27.917422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:27.918681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:27.918997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:27.919005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:27.919013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:27.919018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:27.919024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:27.919030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:27.919038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:27.919046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:27.919053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.919060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.919067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.919075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.919124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:27.919228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:27.919276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:27.919323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:27.919369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:27.919416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:27.919458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:27.919500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:27.919543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.919589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.919636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.919677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.919717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:27.919780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:27.919835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:27.919888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:27.919934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:27.919984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:27.920028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:27.920077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:27.920124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:27.920176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:27.920218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:27.920270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:27.920316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:27.920365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:27.920409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:27.920458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:27.920501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.920555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:27.920599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.920649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:27.920692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.920743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:27.920784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.920834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:27.923583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:27.928032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593189108552614:5312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:27.928082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593189108552614:5312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:27.928099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593189108552614:5312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:27.928132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:27.988669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:28.087711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:28.087755Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:28.087771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:28.087788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:28.087809Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 292 [2:7559593187530635275:4850]
2025-10-10T14:02:28.087863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:28.087917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:28.087931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:28.087943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:28.087954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:28.088005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:28.088025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:28.088048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:28.096716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:28.096748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:28.096760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:28.096772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:28.096783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:28.097068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:28.097083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:28.097238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:28.097398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:28.097606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:28.097710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:28.097798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593187530635270:4850]
2025-10-10T14:02:28.097812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593187530635270:4850]
2025-10-10T14:02:28.097824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593187530635270:4850]
2025-10-10T14:02:28.097837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593187530635270:4850]
2025-10-10T14:02:28.097884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:28.097963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:28.098128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:28.098144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:28.098274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593187530635270:4850]
2025-10-10T14:02:28.098293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:28.098997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:28.099015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:28.099027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:28.099038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:28.099062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:28.100123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593189108552676:5312], now have 1 active actors on pipe
2025-10-10T14:02:28.100151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593189108552639:4447], now have 1 active actors on pipe
2025-10-10T14:02:28.100170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593189108552564:2442], now have 1 active actors on pipe
2025-10-10T14:02:28.102529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 292
2025-10-10T14:02:28.102609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 292, pipe: [1:7559593189108552639:4447]
2025-10-10T14:02:28.102678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 292
2025-10-10T14:02:28.106054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:28.106091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:28.106193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:28.106230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:28.106249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:28.106259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:28.106298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:28.106346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:28.106399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:28.107997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:28.108028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:28.108105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:28.109390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce2f524f-59c6b592-d145aa20-bf180e8d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:28.108483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 293 partition: 0 MaxSeqNo: 36 sessionId: src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0
2025-10-10T14:02:28.189514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:28.189542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:28.189553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:28.194535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0] Write session: try to update token
2025-10-10T14:02:28.194590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:28.286764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:28.286803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:28.286815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:28.286826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:28.286836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:28.286869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593187530635270:4850]
2025-10-10T14:02:28.286892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593187530635270:4850]
2025-10-10T14:02:28.286914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593187530635270:4850]
2025-10-10T14:02:28.286934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593187530635270:4850]
2025-10-10T14:02:28.287085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:28.287112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:28.287122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:28.288168Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:28.289225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:28.289260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:28.289285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:28.289309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:28.445923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId: src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:28.511619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:28.759019Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:28.769984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:28.770027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:28.774023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:28.774051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:28.780838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 293 reason: error at write: Disconnected sessionId: src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0
2025-10-10T14:02:28.781196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 293 sessionId: src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0 is DEAD
2025-10-10T14:02:28.781621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:28.781656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0] Write session will restart in 0.009960s
2025-10-10T14:02:28.781776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0] Write session: Do CDS request
2025-10-10T14:02:28.781807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:28.798555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:28.803024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:28.834357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593189108552639:4447]
2025-10-10T14:02:28.834443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:28.834930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:28.834945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 294
2025-10-10T14:02:28.849601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:28.849810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:28.849827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:28.849842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:28.868131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 294 sessionId:  describe result for acl check
2025-10-10T14:02:28.868260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:28.868271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:28.868281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:28.868298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593193403520042:5322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:28.871969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593193403520042:5322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:28.906287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593193403520042:5322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:28.934727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593193403520124:4447]
2025-10-10T14:02:28.936685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593193403520042:5322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:28.936731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593193403520042:5322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:28.936748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593193403520042:5322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:28.936781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:28.942727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:28.949010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:28.949965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:28.949985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:28.950035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:28.950317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:28.950516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593191825602724:4861]
2025-10-10T14:02:28.952706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:28.956661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:28.956940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:28.958266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:28.958618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:28.958626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:28.958634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:28.958642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:28.958648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:28.958656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:28.958663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:28.958669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:28.958677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:28.958682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:28.958689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:28.958695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:28.958741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:28.958849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:28.958900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:28.958947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:28.958992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:28.959038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:28.959082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:28.959126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:28.959169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:28.959215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:28.959259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:28.959304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:28.959349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:28.959411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:28.959468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:28.959520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:28.959564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:28.959617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:28.959660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:28.959712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:28.959760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:28.959814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:28.959853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:28.959905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:28.959950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:28.960002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:28.960045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:28.960095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:28.960142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:28.960192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:28.960237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:28.960288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:28.960332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:28.960379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:28.960422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:28.960470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:28.960903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:29.090472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:29.151229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:29.151273Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:29.151288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:29.151305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:29.151329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 293 [2:7559593191825602724:4861]
2025-10-10T14:02:29.151382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:29.151442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:29.151456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:29.151469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:29.151481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:29.151528Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:29.151551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:29.151571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:29.161962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:29.161998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:29.162011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:29.162022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:29.162032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:29.162329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:29.162347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:29.162480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:29.162642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:29.162840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:29.162939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:29.163011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.163026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.163038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.163050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.163093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:29.163173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:29.163336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:29.163352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:29.163479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.163498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:29.164449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:29.164469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:29.164480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:29.164491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:29.164515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:29.165428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 293
2025-10-10T14:02:29.165530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 293
2025-10-10T14:02:29.165583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 293, pipe: [1:7559593193403520124:4447]
2025-10-10T14:02:29.169271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593193403520027:2442], now have 1 active actors on pipe
2025-10-10T14:02:29.169312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593193403520127:5322], now have 1 active actors on pipe
2025-10-10T14:02:29.169336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593193403520124:4447], now have 1 active actors on pipe
2025-10-10T14:02:29.169409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:29.169435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:29.169525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:29.169562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:29.169581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:29.169592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:29.169635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:29.169683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:29.169731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:29.173478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:29.173517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:29.173605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:29.174113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 294 partition: 0 MaxSeqNo: 36 sessionId: src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0
2025-10-10T14:02:29.178212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cc8275-ef49188-d875ea90-10f95c0a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:29.247071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0] Write session: try to update token
2025-10-10T14:02:29.247138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:29.253266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:29.253305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:29.253319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:29.407866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:29.407899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:29.407913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:29.407924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:29.407934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:29.407972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.407997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.408019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.408038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.408266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:29.408278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:29.408289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:29.408338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:29.408372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:29.408385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:29.413328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:29.413365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:29.413397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:29.413426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:29.415780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId: src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:29.430090Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:29.478607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:29.613296Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:29.654541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:29.654588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:29.654654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:29.654666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:29.654705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593191825602717:4861]
2025-10-10T14:02:29.656676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:29.656829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:29.656848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:29.660336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 294 reason: error at write: Disconnected sessionId: src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0
2025-10-10T14:02:29.660687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 294 sessionId: src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0 is DEAD
2025-10-10T14:02:29.661299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593193403520124:4447]
2025-10-10T14:02:29.661405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:29.661445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0] Write session will restart in 0.009954s
2025-10-10T14:02:29.661558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0] Write session: Do CDS request
2025-10-10T14:02:29.661587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:29.655254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:29.663476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:29.682357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:29.682392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 295
2025-10-10T14:02:29.685975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:29.686528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:29.686670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:29.686686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:29.686697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:29.688141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 295 sessionId:  describe result for acl check
2025-10-10T14:02:29.688264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:29.688274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:29.688283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:29.688301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593197698487460:5328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:29.690870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593197698487460:5328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:29.712778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593197698487460:5328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:29.738216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593197698487460:5328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:29.738269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593197698487460:5328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:29.738288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593197698487460:5328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:29.738324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:29.761405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593197698487497:4447]
2025-10-10T14:02:29.816183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:29.830512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:29.831233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:29.831245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:29.831276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:29.831513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:29.831636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593196120570159:4869]
2025-10-10T14:02:29.833843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:29.835057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:29.835282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:29.836626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:29.836950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:29.836960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:29.836969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:29.836976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:29.836984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:29.836992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:29.836999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:29.837008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:29.837015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:29.837022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:29.837030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:29.837038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:29.837088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:29.837217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:29.837263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:29.837307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:29.837348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:29.837389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:29.837430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:29.837474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:29.837515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:29.837560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:29.837602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:29.837644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:29.837686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:29.837750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:29.837826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:29.837885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:29.837938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:29.838000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:29.838045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:29.838097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:29.838146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:29.838205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:29.838247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:29.847646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:29.847766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:29.847846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:29.847900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:29.847960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:29.848018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:29.848078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:29.848128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:29.848190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:29.848241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:29.848299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:29.848349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:29.848405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:29.848883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:29.937708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:29.967072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:29.968693Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:29.968727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:29.968745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:29.968767Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 294 [2:7559593196120570159:4869]
2025-10-10T14:02:29.968817Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:29.968871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:29.968884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:29.968896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:29.968905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:29.968951Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:29.968970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:29.968990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:29.971407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:29.971422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:29.971436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:29.971447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:29.971457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:29.972236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:29.972254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:29.972380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:29.972539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:29.972746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:29.972846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:29.972901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593197698487497:4447], now have 1 active actors on pipe
2025-10-10T14:02:29.972922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593197698487452:2442], now have 1 active actors on pipe
2025-10-10T14:02:29.972941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593197698487489:5328], now have 1 active actors on pipe
2025-10-10T14:02:29.973005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593196120570151:4869]
2025-10-10T14:02:29.973020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593196120570151:4869]
2025-10-10T14:02:29.973032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593196120570151:4869]
2025-10-10T14:02:29.973043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593196120570151:4869]
2025-10-10T14:02:29.973080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:29.973176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:29.973333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:29.973349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:29.973472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593196120570151:4869]
2025-10-10T14:02:29.973492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:29.973770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:29.973798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:29.973809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:29.973819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:29.973842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:29.973856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 294
2025-10-10T14:02:29.973942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 294, pipe: [1:7559593197698487497:4447]
2025-10-10T14:02:29.974011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 294
2025-10-10T14:02:29.977223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:29.977256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:29.977361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a49da37-ff003d84-41fce22-671d5e98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:29.977398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:29.977417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:29.977428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:29.977466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:29.977515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:29.977566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:29.979889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:29.979922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:29.979996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:29.987696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 295 partition: 0 MaxSeqNo: 36 sessionId: src_id|4a49da37-ff003d84-41fce22-671d5e98_0
2025-10-10T14:02:29.990080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c41bebaa-77ab17ea-94966eff-4e7a0a62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4a49da37-ff003d84-41fce22-671d5e98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:30.053901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a49da37-ff003d84-41fce22-671d5e98_0] Write session: try to update token
2025-10-10T14:02:30.053960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a49da37-ff003d84-41fce22-671d5e98_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:30.066109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:30.066141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:30.066152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:30.178307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:30.178333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:30.178343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:30.178351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:30.178363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:30.178396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593196120570151:4869]
2025-10-10T14:02:30.178414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593196120570151:4869]
2025-10-10T14:02:30.178436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593196120570151:4869]
2025-10-10T14:02:30.178458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593196120570151:4869]
2025-10-10T14:02:30.178563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:30.178599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:30.178617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:30.178624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:30.178631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:30.178641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:30.178651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:30.178684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:30.178708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:30.178719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:30.179602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:30.221296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId: src_id|4a49da37-ff003d84-41fce22-671d5e98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:30.288619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:30.491572Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:30.497719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:30.497770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:30.503098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593197698487497:4447]
2025-10-10T14:02:30.503189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:30.503315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:30.503329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:30.506127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:30.584733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 295 reason: error at write: Disconnected sessionId: src_id|4a49da37-ff003d84-41fce22-671d5e98_0
2025-10-10T14:02:30.585361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 295 sessionId: src_id|4a49da37-ff003d84-41fce22-671d5e98_0 is DEAD
2025-10-10T14:02:30.589045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a49da37-ff003d84-41fce22-671d5e98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:30.589079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a49da37-ff003d84-41fce22-671d5e98_0] Write session will restart in 0.008187s
2025-10-10T14:02:30.589201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a49da37-ff003d84-41fce22-671d5e98_0] Write session: Do CDS request
2025-10-10T14:02:30.589235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a49da37-ff003d84-41fce22-671d5e98_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:30.611364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a49da37-ff003d84-41fce22-671d5e98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:30.618914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593201993454995:4447]
2025-10-10T14:02:30.619271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:30.619287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 296
E1010 14:02:30.620844979  106874 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:02:30.620957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:30.621090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:30.621107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:30.621116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:30.623142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 296 sessionId:  describe result for acl check
2025-10-10T14:02:30.623248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:30.623258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:30.623267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:30.623282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593201993455004:5344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:30.627970Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:02:30.632655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593201993455004:5344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:30.638428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:30.647711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593201993455004:5344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:30.651456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:30.652496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:30.652513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:30.652562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:30.652838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:30.653020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593200415537607:4879]
2025-10-10T14:02:30.655165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:30.662312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:30.662582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:30.663950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:30.664272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:30.664281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:30.664287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:30.664293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:30.664300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:30.664308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:30.664315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:30.664322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:30.664328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:30.664336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:30.664342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:30.664348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:30.664390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:30.664489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:30.664533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:30.664573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:30.664613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:30.664653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:30.664694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:30.664735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:30.664774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:30.664817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:30.664858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:30.664900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:30.664938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:30.664999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:30.665052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:30.665103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:30.667439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:30.667524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:30.667577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:30.667631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:30.667682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:30.667737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:30.667778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:30.667828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:30.667873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:30.667925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:30.667966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:30.668013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:30.668060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:30.668110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:30.668154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:30.668203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:30.668246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:30.668294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:30.668336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:30.668385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:30.668821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:30.693325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593201993455004:5344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:30.693378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593201993455004:5344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:30.693398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593201993455004:5344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:30.693433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:30.785106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:30.846909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:30.846956Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:30.846971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:30.846990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:30.847012Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 295 [2:7559593200415537607:4879]
2025-10-10T14:02:30.847063Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:30.847121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:30.847134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:30.847145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:30.847155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:30.847205Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:30.847225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:30.847247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:30.857950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:30.857986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:30.858000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:30.858016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:30.858028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:30.858317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:30.858336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:30.858481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:30.858663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:30.858887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:30.859002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:30.859074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593200415537595:4879]
2025-10-10T14:02:30.859087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593200415537595:4879]
2025-10-10T14:02:30.859101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593200415537595:4879]
2025-10-10T14:02:30.859111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593200415537595:4879]
2025-10-10T14:02:30.859156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:30.859244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:30.859419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:30.859437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:30.859569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593200415537595:4879]
2025-10-10T14:02:30.859588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:30.865147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 295, pipe: [1:7559593201993454995:4447]
2025-10-10T14:02:30.865270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 295
2025-10-10T14:02:30.865348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 295
2025-10-10T14:02:30.861479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:30.861501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:30.861512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:30.861523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:30.861548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:30.877275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593201993454995:4447], now have 1 active actors on pipe
2025-10-10T14:02:30.877332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593201993455045:5344], now have 1 active actors on pipe
2025-10-10T14:02:30.877354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593201993454916:2442], now have 1 active actors on pipe
2025-10-10T14:02:30.877427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:30.877456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:30.877562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c03776d-a570b294-82b1725c-c498fa70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:30.877601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:30.877620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:30.877630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:30.877671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:30.877722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:30.877776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:30.886563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:30.886610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:30.886696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:30.890530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a49da37-ff003d84-41fce22-671d5e98_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c03776d-a570b294-82b1725c-c498fa70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:30.889700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 296 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c03776d-a570b294-82b1725c-c498fa70_0
2025-10-10T14:02:30.948663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:30.948697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:30.948708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:30.971660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c03776d-a570b294-82b1725c-c498fa70_0] Write session: try to update token
2025-10-10T14:02:30.971732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c03776d-a570b294-82b1725c-c498fa70_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:31.153249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:31.153290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:31.153302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:31.153362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:31.153376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:31.153389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:31.153399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:31.153409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:31.153447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593200415537595:4879]
2025-10-10T14:02:31.153474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593200415537595:4879]
2025-10-10T14:02:31.153497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593200415537595:4879]
2025-10-10T14:02:31.153517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593200415537595:4879]
2025-10-10T14:02:31.153645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:31.153673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:31.153683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:31.153837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:31.153865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:31.153891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:31.153918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:31.160464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:31.293430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId: src_id|9c03776d-a570b294-82b1725c-c498fa70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:31.336869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:31.447070Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:31.448911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:31.448939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:31.454153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593201993454995:4447]
2025-10-10T14:02:31.454276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:31.454289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:31.457297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:31.461738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:31.557581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593206288422420:4447]
2025-10-10T14:02:31.636558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 296 reason: error at write: Disconnected sessionId: src_id|9c03776d-a570b294-82b1725c-c498fa70_0
2025-10-10T14:02:31.636965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 296 sessionId: src_id|9c03776d-a570b294-82b1725c-c498fa70_0 is DEAD
2025-10-10T14:02:31.642800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:31.645428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c03776d-a570b294-82b1725c-c498fa70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:31.645467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c03776d-a570b294-82b1725c-c498fa70_0] Write session will restart in 0.008545s
2025-10-10T14:02:31.645564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c03776d-a570b294-82b1725c-c498fa70_0] Write session: Do CDS request
2025-10-10T14:02:31.645595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c03776d-a570b294-82b1725c-c498fa70_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:31.657676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:31.658546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:31.658565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:31.658613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:31.658879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:31.659064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593204710505059:4885]
2025-10-10T14:02:31.661303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c03776d-a570b294-82b1725c-c498fa70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:31.660421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:31.660458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 297
2025-10-10T14:02:31.661092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:31.662898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:31.663047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:31.663064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:31.663075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:31.664455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:31.664710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:31.667133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:31.667527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:31.667546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:31.667551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:31.667559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:31.667565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:31.667572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:31.667580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:31.667587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:31.667594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:31.667600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:31.667607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:31.667613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:31.667656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:31.667758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:31.667801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:31.667844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:31.667890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:31.667935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:31.667978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:31.668021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:31.668066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:31.668110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:31.668150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:31.668190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:31.668230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:31.668291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:31.668345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:31.668393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:31.668439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:31.668487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:31.668530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:31.668579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:31.668625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:31.668673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:31.668711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:31.668762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:31.668807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:31.668858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:31.668897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:31.668947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:31.668990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:31.669035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:31.669075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:31.669186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:31.669232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:31.669281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:31.669326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:31.669376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:31.669791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:31.668559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 297 sessionId:  describe result for acl check
2025-10-10T14:02:31.668692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:31.668703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:31.668712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:31.668729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593206288422474:5356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:31.674925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593206288422474:5356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:31.719863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593206288422474:5356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:31.759829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:31.763067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593206288422474:5356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:31.763115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593206288422474:5356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:31.763133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593206288422474:5356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:31.763166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:31.790341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:31.790384Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:31.790401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:31.790421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:31.790446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 296 [2:7559593204710505059:4885]
2025-10-10T14:02:31.790500Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:31.790559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:31.790573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:31.790586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:31.790597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:31.790649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:31.790674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:31.790698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:31.792039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:31.792055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:31.792070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:31.792083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:31.792094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:31.792376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:31.792393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:31.792535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:31.792714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:31.792934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:31.793046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:31.795027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 296
2025-10-10T14:02:31.795109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 296, pipe: [1:7559593206288422420:4447]
2025-10-10T14:02:31.795180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 296
2025-10-10T14:02:31.802108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593204710505054:4885]
2025-10-10T14:02:31.802164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593204710505054:4885]
2025-10-10T14:02:31.802179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593204710505054:4885]
2025-10-10T14:02:31.802192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593204710505054:4885]
2025-10-10T14:02:31.802237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:31.802364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:31.802561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:31.802578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:31.802627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593206288422505:5356], now have 1 active actors on pipe
2025-10-10T14:02:31.802651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593206288422420:4447], now have 1 active actors on pipe
2025-10-10T14:02:31.802671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593206288422380:2442], now have 1 active actors on pipe
2025-10-10T14:02:31.802717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:31.802738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:31.802896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593204710505054:4885]
2025-10-10T14:02:31.802917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:31.802992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|639f8b17-84535c56-51662766-73bc543f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:31.803025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:31.803045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:31.803055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:31.803093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:31.803139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:31.803273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:31.803885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:31.803907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:31.803918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:31.803929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:31.803956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:31.813284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:31.813339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:31.813432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:31.816442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 297 partition: 0 MaxSeqNo: 36 sessionId: src_id|639f8b17-84535c56-51662766-73bc543f_0
2025-10-10T14:02:31.817580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c03776d-a570b294-82b1725c-c498fa70_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|639f8b17-84535c56-51662766-73bc543f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:31.897373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:31.897408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:31.897421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:31.947701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639f8b17-84535c56-51662766-73bc543f_0] Write session: try to update token
2025-10-10T14:02:31.947761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639f8b17-84535c56-51662766-73bc543f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:32.003618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:32.013041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:32.013067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:32.103950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:32.103984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:32.104000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:32.104011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:32.104023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:32.104064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593204710505054:4885]
2025-10-10T14:02:32.104091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593204710505054:4885]
2025-10-10T14:02:32.104115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593204710505054:4885]
2025-10-10T14:02:32.104135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593204710505054:4885]
2025-10-10T14:02:32.104303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:32.104314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:32.104325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:32.104376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:32.104402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:32.104413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:32.105480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:32.105521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:32.105549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:32.105587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:32.117884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:32.221051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId: src_id|639f8b17-84535c56-51662766-73bc543f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:32.274672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:32.546056Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:32.547771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:32.547799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:32.552196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:32.552227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:32.557811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:32.626097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593206288422420:4447]
2025-10-10T14:02:32.626188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:32.626414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 297 reason: error at write: Disconnected sessionId: src_id|639f8b17-84535c56-51662766-73bc543f_0
2025-10-10T14:02:32.626771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 297 sessionId: src_id|639f8b17-84535c56-51662766-73bc543f_0 is DEAD
2025-10-10T14:02:32.629911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f8b17-84535c56-51662766-73bc543f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:32.629945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f8b17-84535c56-51662766-73bc543f_0] Write session will restart in 0.006588s
2025-10-10T14:02:32.630039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f8b17-84535c56-51662766-73bc543f_0] Write session: Do CDS request
2025-10-10T14:02:32.630069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f8b17-84535c56-51662766-73bc543f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:32.649895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639f8b17-84535c56-51662766-73bc543f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:32.700471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:32.708069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:32.708963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:32.708981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:32.709031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:32.709317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:32.709500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593209005472495:4894]
2025-10-10T14:02:32.711611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:32.717572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:32.717872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:32.719217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:32.719548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:32.719557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:32.719564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:32.719572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:32.719578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:32.719585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:32.719592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:32.719599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:32.719605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:32.719611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:32.719620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:32.719627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:32.719671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:32.719774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:32.719820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:32.719862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:32.719903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:32.719944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:32.719986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:32.720029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:32.720075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:32.720119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:32.720162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:32.720206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:32.720251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:32.720316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:32.720372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:32.720421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:32.720469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:32.720520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:32.720565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:32.720616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:32.720663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:32.720714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:32.720760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:32.720806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:32.720851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:32.720900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:32.720943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:32.720993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:32.721042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:32.721093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:32.726679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:32.726787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:32.726851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:32.726907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:32.726963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:32.727019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:32.727480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:32.732795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593210583389936:4447]
2025-10-10T14:02:32.732840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:32.732853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 298
2025-10-10T14:02:32.733959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:32.734086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:32.734101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:32.734109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:32.739390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 298 sessionId:  describe result for acl check
2025-10-10T14:02:32.739514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:32.739524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:32.739541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:32.739561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593210583389940:5369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:32.742082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593210583389940:5369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:32.755572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593210583389940:5369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:32.768751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593210583389940:5369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:32.768803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593210583389940:5369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:32.768820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593210583389940:5369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:32.768852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:32.788715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:32.835983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:32.836026Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:32.836039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:32.836056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:32.836079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 297 [2:7559593209005472495:4894]
2025-10-10T14:02:32.836126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:32.836181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:32.836194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:32.836206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:32.836217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:32.836262Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:32.836282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:32.836304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:32.867917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:32.867950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:32.867962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:32.867975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:32.867985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:32.868266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:32.868281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:32.868409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:32.868571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:32.868771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:32.868873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:32.868942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:32.868957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:32.868969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:32.868980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:32.869227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:32.869239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:32.869248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:32.869260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:32.869513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:32.869601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:32.869772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:32.869790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:32.869834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593210583389885:2442], now have 1 active actors on pipe
2025-10-10T14:02:32.869871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593210583389936:4447], now have 1 active actors on pipe
2025-10-10T14:02:32.869890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593210583389969:5369], now have 1 active actors on pipe
2025-10-10T14:02:32.870012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:32.870043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:32.870224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:32.873167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 297
2025-10-10T14:02:32.873263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 297, pipe: [1:7559593210583389936:4447]
2025-10-10T14:02:32.873330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 297
2025-10-10T14:02:32.877509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:32.877549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:32.877647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30373e93-adef9863-3574c17e-8064f269_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:32.877681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:32.877699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:32.877710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:32.877747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:32.877792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:32.877839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:32.892129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:32.892176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:32.892252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:32.899278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 298 partition: 0 MaxSeqNo: 36 sessionId: src_id|30373e93-adef9863-3574c17e-8064f269_0
2025-10-10T14:02:32.905465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f8b17-84535c56-51662766-73bc543f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|30373e93-adef9863-3574c17e-8064f269_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:32.940549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:32.940584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:32.940599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:33.015180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30373e93-adef9863-3574c17e-8064f269_0] Write session: try to update token
2025-10-10T14:02:33.015241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30373e93-adef9863-3574c17e-8064f269_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:33.104089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:33.104118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:33.104131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:33.104241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:33.104256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:33.104267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:33.104277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:33.104287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:33.104320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:33.104344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:33.104368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:33.104387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:33.104482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:33.104509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:33.104534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:33.104558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:33.189334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:33.189385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:33.189396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:33.192893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:33.241872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId: src_id|30373e93-adef9863-3574c17e-8064f269_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:33.310976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:33.518216Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:33.558652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:33.558684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:33.558737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593209005472490:4894]
2025-10-10T14:02:33.558903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:33.558930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:33.561189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:33.563930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:33.562577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593210583389936:4447]
2025-10-10T14:02:33.562685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:33.562697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:33.568168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:33.659216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593214878357367:4447]
2025-10-10T14:02:33.674811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 298 reason: error at write: Disconnected sessionId: src_id|30373e93-adef9863-3574c17e-8064f269_0
2025-10-10T14:02:33.675189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 298 sessionId: src_id|30373e93-adef9863-3574c17e-8064f269_0 is DEAD
2025-10-10T14:02:33.678679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30373e93-adef9863-3574c17e-8064f269_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:33.678716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30373e93-adef9863-3574c17e-8064f269_0] Write session will restart in 0.006865s
2025-10-10T14:02:33.678814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30373e93-adef9863-3574c17e-8064f269_0] Write session: Do CDS request
2025-10-10T14:02:33.678842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30373e93-adef9863-3574c17e-8064f269_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:33.691484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:33.691522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 299
2025-10-10T14:02:33.693248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30373e93-adef9863-3574c17e-8064f269_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:33.698517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:33.698668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:33.698696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:33.698708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:33.707933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 299 sessionId:  describe result for acl check
2025-10-10T14:02:33.708074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:33.708084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:33.708099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:33.708120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593214878357402:5378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:33.711354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593214878357402:5378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:33.737267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:33.739223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:33.740077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:33.740097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:33.740139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:33.740393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:33.740594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593213300439966:4911]
2025-10-10T14:02:33.742715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:33.746982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593214878357402:5378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:33.753643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:33.753914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:33.755174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:33.755514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:33.755521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:33.755528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:33.755534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:33.755540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:33.755546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:33.755552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:33.755558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:33.755564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:33.755569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:33.755576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:33.755582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:33.755628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:33.755727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:33.755773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:33.755822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:33.755863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:33.755904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:33.755946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:33.755987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:33.756029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:33.756071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:33.756108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:33.756146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:33.756183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:33.756241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:33.756294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:33.756348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:33.756391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:33.756442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:33.756480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:33.756533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:33.756576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:33.756622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:33.756666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:33.756715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:33.756759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:33.756802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:33.756846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:33.756895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:33.756936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:33.756986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:33.757029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:33.757077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:33.757119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:33.773851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593214878357402:5378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:33.773913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593214878357402:5378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:33.773930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593214878357402:5378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:33.773964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:33.777346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:33.777422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:33.777478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:33.777922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:33.810459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:33.843959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:33.844004Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:33.844022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:33.844045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:33.844072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 298 [2:7559593213300439966:4911]
2025-10-10T14:02:33.844128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:33.844194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:33.844209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:33.844223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:33.844234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:33.844284Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:33.844307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:33.844328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:33.845618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:33.845634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:33.845647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:33.845661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:33.845674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:33.845961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:33.845978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:33.846120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:33.846297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:33.846513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:33.846622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:33.846699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:33.846714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:33.846727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:33.846740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:33.846785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:33.846866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:33.847040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:33.847058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:33.847186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:33.847205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:33.849294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:33.849321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:33.849333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:33.849345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:33.849372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:33.851705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 298
2025-10-10T14:02:33.851790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 298, pipe: [1:7559593214878357367:4447]
2025-10-10T14:02:33.851863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 298
2025-10-10T14:02:33.870662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593214878357436:5378], now have 1 active actors on pipe
2025-10-10T14:02:33.870707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593214878357367:4447], now have 1 active actors on pipe
2025-10-10T14:02:33.870729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593214878357319:2442], now have 1 active actors on pipe
2025-10-10T14:02:33.870797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:33.870822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:33.870976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98910efe-df2d616c-bcf72803-2d7c8346_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:33.871020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:33.871041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:33.871053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:33.871095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:33.871146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:33.871199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:33.881295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:33.881355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:33.881475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:33.884665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 299 partition: 0 MaxSeqNo: 36 sessionId: src_id|98910efe-df2d616c-bcf72803-2d7c8346_0
2025-10-10T14:02:33.885727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30373e93-adef9863-3574c17e-8064f269_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98910efe-df2d616c-bcf72803-2d7c8346_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:33.944573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98910efe-df2d616c-bcf72803-2d7c8346_0] Write session: try to update token
2025-10-10T14:02:33.944633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98910efe-df2d616c-bcf72803-2d7c8346_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:33.945279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:33.945313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:33.945324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:34.107467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:34.107500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:34.107512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:34.107627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:34.107640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:34.107653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:34.107664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:34.107678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:34.107714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:34.107740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:34.107762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:34.107782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:34.109607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:34.109642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:34.109667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:34.109693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:34.178677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:34.178727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:34.178739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:34.180115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:34.236357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId: src_id|98910efe-df2d616c-bcf72803-2d7c8346_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:34.274238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:34.383700Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:34.385359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:34.385378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:34.385426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593213300439960:4911]
2025-10-10T14:02:34.385591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:34.385616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:34.385728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:34.387648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:34.387680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:34.397770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:34.432289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 299 reason: error at write: Disconnected sessionId: src_id|98910efe-df2d616c-bcf72803-2d7c8346_0
2025-10-10T14:02:34.432675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 299 sessionId: src_id|98910efe-df2d616c-bcf72803-2d7c8346_0 is DEAD
2025-10-10T14:02:34.434229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98910efe-df2d616c-bcf72803-2d7c8346_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:34.434266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98910efe-df2d616c-bcf72803-2d7c8346_0] Write session will restart in 0.006057s
2025-10-10T14:02:34.434364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98910efe-df2d616c-bcf72803-2d7c8346_0] Write session: Do CDS request
2025-10-10T14:02:34.434395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98910efe-df2d616c-bcf72803-2d7c8346_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:34.461781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98910efe-df2d616c-bcf72803-2d7c8346_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:34.535820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593214878357367:4447]
2025-10-10T14:02:34.535898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:34.536076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:34.536090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 300
2025-10-10T14:02:34.539178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:34.539355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:34.539369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:34.539380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:34.540726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 300 sessionId:  describe result for acl check
2025-10-10T14:02:34.540833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:34.540843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:34.540852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:34.540870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593219173324864:5391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:34.543835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593219173324864:5391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:34.546584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:34.559116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:34.560022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:34.560051Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:34.560101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:34.560393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:34.560586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593217595407412:4914]
2025-10-10T14:02:34.562912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:34.562062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593219173324864:5391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:34.568130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:34.568379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:34.569622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:34.569996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:34.570005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:34.570012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:34.570018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:34.570025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:34.570032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:34.570039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:34.570047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:34.570053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:34.570061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:34.570067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:34.570074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:34.570120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:34.570225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:34.570270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:34.570315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:34.570358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:34.570402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:34.570446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:34.570487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:34.570530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:34.570574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:34.570619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:34.570660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:34.570701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:34.570763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:34.570823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:34.570874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:34.570925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:34.570976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:34.571022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:34.571073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:34.571119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:34.571170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:34.571214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:34.571267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:34.571315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:34.571370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:34.571418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:34.571471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:34.571519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:34.571571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:34.571617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:34.571667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:34.571709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:34.571758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:34.571801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:34.571850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:34.572264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:34.606427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593219173324864:5391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:34.606476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593219173324864:5391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:34.606493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593219173324864:5391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:34.606526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:34.637461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593219173324899:4447]
2025-10-10T14:02:34.665902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:34.708230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:34.708275Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:34.708292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:34.708313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:34.708337Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 299 [2:7559593217595407412:4914]
2025-10-10T14:02:34.708390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:34.708455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:34.708470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:34.708483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:34.708494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:34.708542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:34.708565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:34.708588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:34.731717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:34.731750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:34.731763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:34.731776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:34.731786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:34.732061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:34.732078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:34.732211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:34.732377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:34.732591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:34.732700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:34.732776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:34.732791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:34.732803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:34.732817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:34.733062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:34.733074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:34.733085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:34.733095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:34.734881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:34.734991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:34.735202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:34.735221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:34.735274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593219173324860:2442], now have 1 active actors on pipe
2025-10-10T14:02:34.735301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593219173324899:4447], now have 1 active actors on pipe
2025-10-10T14:02:34.735375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593219173324897:5391], now have 1 active actors on pipe
2025-10-10T14:02:34.735440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:34.735461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:34.735616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:34.735647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:34.735728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:34.735763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:34.735783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:34.735794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:34.735836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:34.735883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:34.736012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:34.737639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:34.734380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 299
2025-10-10T14:02:34.734477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 299, pipe: [1:7559593219173324899:4447]
2025-10-10T14:02:34.734552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 299
2025-10-10T14:02:34.743284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98910efe-df2d616c-bcf72803-2d7c8346_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:34.740776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:34.740818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:34.740897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:34.741788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 300 partition: 0 MaxSeqNo: 36 sessionId: src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0
2025-10-10T14:02:34.815686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0] Write session: try to update token
2025-10-10T14:02:34.815745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:34.948603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:34.948631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:34.948642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:34.948761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:34.948775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:34.948787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:34.948797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:34.948808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:34.948842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:34.948868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:34.948890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:34.948914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:34.954436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:34.954490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:34.954520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:34.954549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:35.041780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:35.041830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:35.041841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:35.042959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:35.048497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId: src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:35.128605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:35.391945Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:35.393806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:35.393824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:35.393870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593217595407398:4914]
2025-10-10T14:02:35.394236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:35.394264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:35.394993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:35.395569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:35.401571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:35.401867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593219173324899:4447]
2025-10-10T14:02:35.403095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:35.417494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 300 reason: status is not ok: tablet will be restarted right now sessionId: src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0
2025-10-10T14:02:35.417823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 300 sessionId: src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0 is DEAD
2025-10-10T14:02:35.425373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:35.425418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0] Write session will restart in 0.005970s
2025-10-10T14:02:35.425516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0] Write session: Do CDS request
2025-10-10T14:02:35.425548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:35.446650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:35.449368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:35.449409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 301
2025-10-10T14:02:35.462493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:35.462653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:35.462670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:35.462680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:35.465997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 301 sessionId:  describe result for acl check
2025-10-10T14:02:35.466142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:35.466153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:35.466164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:35.466181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593223468292262:5401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:35.468920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593223468292262:5401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:35.497031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593223468292262:5401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:35.506151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593223468292322:4447]
2025-10-10T14:02:35.529966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593223468292262:5401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:35.530013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593223468292262:5401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:35.530031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593223468292262:5401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:35.530064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:35.553229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:35.556642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:35.557529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:35.557546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:35.557595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:35.557861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:35.558066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593221890374875:4926]
2025-10-10T14:02:35.560147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:35.561402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:35.561639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:35.562905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:35.563223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:35.563232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:35.563238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:35.563245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:35.563252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:35.563258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:35.563265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:35.563272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:35.563278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:35.563285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:35.563292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:35.563298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:35.563346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:35.563455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:35.563503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:35.563549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:35.563593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:35.563640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:35.563684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:35.563730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:35.563774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:35.563820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:35.563866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:35.563913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:35.563955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:35.564022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:35.564080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:35.564136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:35.564185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:35.564239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:35.564284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:35.564334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:35.564382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:35.564434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:35.564479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:35.564532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:35.564576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:35.564627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:35.564671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:35.564723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:35.564769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:35.564851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:35.564900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:35.564953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:35.565001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:35.565056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:35.565100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:35.565238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:35.565671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:35.612920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:35.661718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:35.661766Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:35.661782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:35.661801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:35.661825Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 300 [2:7559593221890374875:4926]
2025-10-10T14:02:35.661877Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:35.661954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:35.661971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:35.661982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:35.661993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:35.662041Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:35.662062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:35.662425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:35.663863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:35.663882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:35.663894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:35.663907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:35.663917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:35.664171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:35.664186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:35.664306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:35.664456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:35.664642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:35.664737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:35.664810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:35.664825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:35.664837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:35.664848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:35.664882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:35.664953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:35.665104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:35.665161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:35.665283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:35.665302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:35.667343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 300, pipe: [1:7559593223468292322:4447]
2025-10-10T14:02:35.667452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 300
2025-10-10T14:02:35.667519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 300
2025-10-10T14:02:35.665955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:35.665971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:35.665982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:35.665993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:35.666017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:35.668178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593223468292322:4447], now have 1 active actors on pipe
2025-10-10T14:02:35.668208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593223468292355:5401], now have 1 active actors on pipe
2025-10-10T14:02:35.668226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593223468292247:2442], now have 1 active actors on pipe
2025-10-10T14:02:35.668269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:35.668289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:35.668376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:35.668408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:35.668429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:35.668438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:35.668477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:35.668539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:35.668595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:35.669501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:35.669528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:35.669592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:35.671018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 301 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0
2025-10-10T14:02:35.672027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98c04ffd-b8f7480c-c3f268e-43ffac37_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:35.716898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0] Write session: try to update token
2025-10-10T14:02:35.716958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:35.776335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:35.776369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:35.776416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:35.776570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:35.776582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:35.776603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:35.776681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:02:35.778151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:35.778902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:02:35.780880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:35.782190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:35.799692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:35.801276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:02:35.801721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:02:35.876785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:35.876822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:35.876837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:35.997625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId: src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:36.016383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:36.016414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:36.016430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:36.016442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:36.016453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:36.016498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:36.016527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:36.016551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:36.016575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593221890374870:4926]
2025-10-10T14:02:36.016690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:36.016719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:36.016745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:36.016755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:36.016770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:36.016773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:36.016781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:36.016825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:36.016851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:36.016861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:36.050020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:36.100571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:36.306851Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:36.309876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:36.309918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:36.318087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:36.314364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593223468292322:4447]
2025-10-10T14:02:36.314470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:36.314481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:36.370463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:36.370568Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:02:36.370919Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_5983115989678144199_v1 is DEAD
2025-10-10T14:02:36.371227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 301 reason: error at write: Disconnected sessionId: src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0
2025-10-10T14:02:36.371367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 301 sessionId: src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0 is DEAD
2025-10-10T14:02:36.373814Z :ERROR: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:02:36.374289Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:02:36.374313Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:02:36.374346Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Reconnecting session to cluster  in 0.006031s
2025-10-10T14:02:36.375252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:36.375281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0] Write session will restart in 0.006969s
2025-10-10T14:02:36.375376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0] Write session: Do CDS request
2025-10-10T14:02:36.375403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:36.390155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:36.390798Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Successfully connected. Initializing session
2025-10-10T14:02:36.392408Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592948590367493:4444] disconnected; active server actors: 1
2025-10-10T14:02:36.392450Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592948590367493:4444] client user disconnected session shared/user_1_3_5983115989678144199_v1
2025-10-10T14:02:36.392705Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:02:36.392715Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 4
2025-10-10T14:02:36.392796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:36.392809Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 302
2025-10-10T14:02:36.394294Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 4 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:02:36.394501Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 read init: from# ipv6:[::1]:40068, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:02:36.394882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:36.394980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:36.394995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:36.395002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:36.395032Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 auth for : user
2025-10-10T14:02:36.400189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 302 sessionId:  describe result for acl check
2025-10-10T14:02:36.400319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:36.400330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:36.400338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:36.400356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593227763259747:5416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:36.402971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593227763259747:5416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:36.403602Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 Handle describe topics response
2025-10-10T14:02:36.403704Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 auth is DEAD
2025-10-10T14:02:36.403764Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:02:36.418153Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:02:36.421811Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got InitResponse. ReadSessionId: shared/user_1_4_15775285217873980898_v1
2025-10-10T14:02:36.428174Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559593227763259795:5415] connected; active server actors: 1
2025-10-10T14:02:36.428673Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559593227763259795:5415] session shared/user_1_4_15775285217873980898_v1
2025-10-10T14:02:36.428717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:02:36.428765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:02:36.428799Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_4_15775285217873980898_v1" (Sender=[1:7559593227763259734:5415], Pipe=[1:7559593227763259795:5415], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:02:36.428820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:02:36.428867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:02:36.428911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_4_15775285217873980898_v1" (Sender=[1:7559593227763259734:5415], Pipe=[1:7559593227763259795:5415], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:02:36.428960Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_4_15775285217873980898_v1" sender [1:7559593227763259734:5415] lock partition 0 for ReadingSession "shared/user_1_4_15775285217873980898_v1" (Sender=[1:7559593227763259734:5415], Pipe=[1:7559593227763259795:5415], Partitions=[], ActiveFamilyCount=1) generation 1 step 4
2025-10-10T14:02:36.429001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:02:36.429026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000139s
2025-10-10T14:02:36.429865Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_4_15775285217873980898_v1" ClientId: "user" PipeClient { RawX1: 7559593227763259795 RawX2: 4503603922343207 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:02:36.429952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:02:36.437461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:36.444791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:36.449634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:36.449678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:36.449754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:36.450222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:36.450445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593226185342299:4934]
2025-10-10T14:02:36.452897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:36.456510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:36.456785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:36.458125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:36.458485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:36.458493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:36.458500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:36.458507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:36.458514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:36.458521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:36.458528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:36.458535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:36.458541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:36.455650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593227763259747:5416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:36.458548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:36.458554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:36.458561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:36.458606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:36.458711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:36.458756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:36.458799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:36.458843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:36.458892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:36.458933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:36.458973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:36.459012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:36.459701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:36.459763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:36.459821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:36.459862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:36.459922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:36.459975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:36.460021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:36.460065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:36.460116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:36.460157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:36.460202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:36.460250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:36.460299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:36.460341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:36.460389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:36.460430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:36.460475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:36.460517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:36.460562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:36.460608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:36.460653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:36.460694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:36.460741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:36.460783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:36.460828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:36.460869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:36.460916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:36.461352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:36.499341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593227763259747:5416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:36.499386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593227763259747:5416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:36.499403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593227763259747:5416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:36.499435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:36.531422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:36.579340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:36.579393Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:36.579413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:36.579435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:36.579458Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 301 [2:7559593226185342299:4934]
2025-10-10T14:02:36.579521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:36.579586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:36.579610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:36.579624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:36.579637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:36.579686Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:36.579713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:36.579735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:36.587304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:36.587335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:36.587352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:36.587368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:36.587380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:36.587678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:36.587697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:36.587851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:36.588056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:36.588314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:36.588450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:36.588525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:36.588540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:36.588554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:36.588569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:36.588604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:36.588691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:36.588882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:36.588900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:36.589025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:36.589047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:36.589236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:36.589257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:36.589268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:36.589281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:36.589313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:36.590050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593227763259714:2442], now have 1 active actors on pipe
2025-10-10T14:02:36.590092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593227763259807:5422], now have 1 active actors on pipe
2025-10-10T14:02:36.592759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 301
2025-10-10T14:02:36.592888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 301, pipe: [1:7559593227763259807:5422]
2025-10-10T14:02:36.592957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 301
2025-10-10T14:02:36.592133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593227763259843:5416], now have 1 active actors on pipe
2025-10-10T14:02:36.594306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:36.594334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:36.594366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_4_15775285217873980898_v1 on pipe: [1:7559593227763259807:5422]
2025-10-10T14:02:36.594431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:36.594446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:36.594495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:36.594517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:36.594529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:36.594602Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_4_15775285217873980898_v1
2025-10-10T14:02:36.594616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:36.594776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:36.594802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:02:36.594822Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:02:36.596158Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_4_15775285217873980898_v1:1 with generation 301
2025-10-10T14:02:36.616032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:02:36.616121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:02:36.616151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:36.616176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:36.616189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:36.616229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:36.616277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:36.616307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:02:36.616352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:02:36.616400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:36.618491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:36.618529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:36.618616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:36.617391Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1760104766000 SizeLag: 18742722 WriteTimestampEstimateMS: 1760104956585 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:02:36.617458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-10T14:02:36.617641Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 sending to client partition status
2025-10-10T14:02:36.619051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 302 partition: 0 MaxSeqNo: 36 sessionId: src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0
2025-10-10T14:02:36.621033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8d9870-9fc5165d-fb2507d0-626a36bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:36.678113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:36.678143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:36.678157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:36.732199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0] Write session: try to update token
2025-10-10T14:02:36.732268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:36.778325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:36.778359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:36.778371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:36.913486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:36.913517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:36.913531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:36.913541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:36.913551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:36.913581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:36.913606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:36.913625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:36.913643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:36.913788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:36.913802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:36.913812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:36.913910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:36.913933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:36.913956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:36.914982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:36.916311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:36.916353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:36.916379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:36.916417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:36.989315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId: src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:37.034167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:37.101976Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:37.127077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:37.127123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:37.127176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:37.127189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:37.127228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593226185342294:4934]
2025-10-10T14:02:37.130032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:37.130888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_4_15775285217873980898_v1
2025-10-10T14:02:37.130927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:37.131792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:37.131985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593227763259807:5422]
2025-10-10T14:02:37.132522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:37.132535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:37.142099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:37.142192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0] Write session will restart in 0.006802s
2025-10-10T14:02:37.142400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0] Write session: Do CDS request
2025-10-10T14:02:37.142466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:37.141161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 302 reason: error at write: Disconnected sessionId: src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0
2025-10-10T14:02:37.141526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 302 sessionId: src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0 is DEAD
2025-10-10T14:02:37.174985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:37.177680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:37.177722Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 303
2025-10-10T14:02:37.178346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:37.178479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:37.178495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:37.178506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:37.180053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 303 sessionId:  describe result for acl check
2025-10-10T14:02:37.180182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:37.180192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:37.180201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:37.180219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593232058227187:5428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:37.191339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593232058227187:5428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:37.200523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593232058227187:5428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:37.210928Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_4_15775285217873980898_v1
2025-10-10T14:02:37.220230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593232058227187:5428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:37.220282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593232058227187:5428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:37.220301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593232058227187:5428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:37.220334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:37.233408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593232058227223:5422]
2025-10-10T14:02:37.287492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:37.297321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:37.298311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:37.298331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:37.298379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:37.298662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:37.298838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593230480309758:4946]
2025-10-10T14:02:37.301015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:37.303529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:37.303711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:37.304586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:37.304823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:37.304835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:37.304839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:37.304844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:37.304849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:37.304853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:37.304857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:37.304861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:37.304865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:37.304869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:37.304874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:37.304878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:37.304911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:37.305003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:37.305038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:37.305070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:37.305101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:37.305163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:37.305215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:37.305258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:37.305301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:37.305340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:37.305375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:37.305409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:37.305441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:37.305489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:37.305530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:37.305566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:37.305599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:37.305650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:37.305682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:37.305718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:37.305750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:37.305796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:37.305833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:37.305870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:37.305901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:37.305938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:37.305982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:37.306018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:37.306051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:37.306084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:37.306113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:37.306158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:37.306188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:37.306224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:37.306254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:37.306297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:37.306606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:37.360329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:37.377931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:37.377997Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:37.378014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:37.378034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:37.378058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 302 [2:7559593230480309758:4946]
2025-10-10T14:02:37.378117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:37.378182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:37.378198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:37.378210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:37.378222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:37.378271Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:37.378294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:37.378317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:37.381268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:37.381294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:37.381307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:37.381321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:37.381333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:37.381610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:37.381627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:37.381768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:37.381944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:37.382188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:37.382298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:37.382378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.382391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.382404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.382416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.382460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:37.382536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:37.382707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:37.382726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:37.382856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.382877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:37.385411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 302, pipe: [1:7559593232058227223:5422]
2025-10-10T14:02:37.385535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 302
2025-10-10T14:02:37.385603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 302
2025-10-10T14:02:37.383646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:37.383663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:37.383675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:37.383685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:37.383709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:37.386729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593232058227223:5422], now have 1 active actors on pipe
2025-10-10T14:02:37.386766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593232058227219:5428], now have 1 active actors on pipe
2025-10-10T14:02:37.386793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593232058227174:2442], now have 1 active actors on pipe
2025-10-10T14:02:37.387521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:37.387551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:37.387656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b097a4f-e57db9c-dd714125-d00da041_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:37.387692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:37.387711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:37.387721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:37.387759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:37.387804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:37.387852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:37.388583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:37.388607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:37.388667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:37.389005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 303 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b097a4f-e57db9c-dd714125-d00da041_0
2025-10-10T14:02:37.392498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|123b38b3-eeb6dd8a-8d14a126-72e2caba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b097a4f-e57db9c-dd714125-d00da041_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:37.482767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:37.482797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:37.482809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:37.495793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b097a4f-e57db9c-dd714125-d00da041_0] Write session: try to update token
2025-10-10T14:02:37.495852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b097a4f-e57db9c-dd714125-d00da041_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:37.632160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:37.632194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:37.632205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:37.632265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:37.632280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:37.632292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:37.632303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:37.632312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:37.632348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.632375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.632397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.632417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.632630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:37.632663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:37.632674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:37.633299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:37.633368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:37.633403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:37.633442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:37.642066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:37.710982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId: src_id|6b097a4f-e57db9c-dd714125-d00da041_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:37.767245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:37.866087Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:37.892224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:37.892267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:37.892329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:37.892343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:37.892382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593230480309752:4946]
2025-10-10T14:02:37.894560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593232058227223:5422]
2025-10-10T14:02:37.894652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:37.894663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:37.898191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 303 reason: error at write: Disconnected sessionId: src_id|6b097a4f-e57db9c-dd714125-d00da041_0
2025-10-10T14:02:37.898519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 303 sessionId: src_id|6b097a4f-e57db9c-dd714125-d00da041_0 is DEAD
2025-10-10T14:02:37.901291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:37.901766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b097a4f-e57db9c-dd714125-d00da041_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:37.901803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b097a4f-e57db9c-dd714125-d00da041_0] Write session will restart in 0.009331s
2025-10-10T14:02:37.901900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b097a4f-e57db9c-dd714125-d00da041_0] Write session: Do CDS request
2025-10-10T14:02:37.901930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b097a4f-e57db9c-dd714125-d00da041_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:37.893191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:37.904616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:37.916448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b097a4f-e57db9c-dd714125-d00da041_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:37.917504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:37.917550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 304
2025-10-10T14:02:37.918032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:37.918172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:37.918188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:37.918200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:37.919800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 304 sessionId:  describe result for acl check
2025-10-10T14:02:37.919933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:37.919944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:37.919955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:37.919974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593232058227337:5435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:37.923180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593232058227337:5435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:37.940327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593232058227337:5435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:37.955256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593232058227337:5435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:37.955316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593232058227337:5435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:37.955336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593232058227337:5435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:37.955376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:37.993363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593232058227424:5422]
2025-10-10T14:02:38.037064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:38.046541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:38.047467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:38.047486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:38.047530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:38.047818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:38.048013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593234775277215:4955]
2025-10-10T14:02:38.050545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:38.051803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:38.052156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:38.053633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:38.054044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:38.054056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:38.054067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:38.054075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:38.054084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:38.054092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:38.054100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:38.054108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:38.054116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.054124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.054133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.054141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.054196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:38.054325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:38.054386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:38.054441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:38.054495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:38.054553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:38.054605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:38.054661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:38.054714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.054768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.054820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.054869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.054917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:38.054995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:38.055064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:38.055127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:38.055185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:38.055250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:38.055305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:38.055367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:38.055425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:38.055490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:38.055542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:38.055604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:38.055661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:38.055724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:38.055777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:38.055838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:38.055894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.055954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.056006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.056069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.056121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.056181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.056233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.056295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.056797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:38.128869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:38.144014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:38.144062Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:38.144080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:38.144102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:38.144126Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 303 [2:7559593234775277215:4955]
2025-10-10T14:02:38.144181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:38.144248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:38.144263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:38.144274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:38.144285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:38.144334Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:38.144357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:38.144382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:38.151296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.151328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.151344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.151360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.151372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:38.151686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:38.151705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.151825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.151945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.152156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.152260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:38.152321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.152336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.152345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.152354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.152390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:38.152427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:38.152459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:38.152473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:38.152474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:38.152487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:38.152653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:38.152678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:38.152723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593232058227329:2442], now have 1 active actors on pipe
2025-10-10T14:02:38.152746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593232058227372:5435], now have 1 active actors on pipe
2025-10-10T14:02:38.152849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593232058227424:5422], now have 1 active actors on pipe
2025-10-10T14:02:38.152867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.152890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:38.153119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:38.152959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 303
2025-10-10T14:02:38.153095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 303
2025-10-10T14:02:38.153173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 303, pipe: [1:7559593232058227424:5422]
2025-10-10T14:02:38.153907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:38.153947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:38.154042Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:38.154079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:38.154100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:38.154110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:38.154152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:38.154199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:38.154249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:38.162314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:38.162361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:38.162452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:38.164798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 304 partition: 0 MaxSeqNo: 36 sessionId: src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0
2025-10-10T14:02:38.167814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b097a4f-e57db9c-dd714125-d00da041_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:38.218395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0] Write session: try to update token
2025-10-10T14:02:38.218461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:38.247159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:38.247184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:38.247193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:38.372657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:38.372692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:38.372704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:38.372712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:38.372721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:38.372755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.372779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.372800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.372818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.373044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:38.373056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:38.373065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:38.373111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:38.373149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.373159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:38.373270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:38.373312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:38.373340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:38.373368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:38.374247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:38.424936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId: src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:38.490812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:38.581354Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:38.597698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:38.597743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:38.597808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:38.597820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:38.597861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593234775277209:4955]
2025-10-10T14:02:38.598338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:38.599266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:38.604360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593232058227424:5422]
2025-10-10T14:02:38.604540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:38.604797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:38.704232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593236353194815:5422]
2025-10-10T14:02:38.704331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 304 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0
2025-10-10T14:02:38.704697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 304 sessionId: src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0 is DEAD
2025-10-10T14:02:38.709351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:38.709397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0] Write session will restart in 0.009826s
2025-10-10T14:02:38.709499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0] Write session: Do CDS request
2025-10-10T14:02:38.709530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:38.735710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:38.757451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:38.757490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 305
2025-10-10T14:02:38.757917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:38.758072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:38.758090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:38.758101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:38.764265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 305 sessionId:  describe result for acl check
2025-10-10T14:02:38.764422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:38.764433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:38.764444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:38.764462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593236353194848:5447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:38.772044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593236353194848:5447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:38.801792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593236353194848:5447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:38.822411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:38.826591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:38.827523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:38.827541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:38.827583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:38.827844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:38.828050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593234775277371:4963]
2025-10-10T14:02:38.830973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:38.834579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593236353194848:5447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:38.834638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593236353194848:5447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:38.834658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593236353194848:5447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:38.834690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:38.836882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:38.837247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:38.840590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:38.841086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:38.841098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:38.841106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:38.841114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:38.841121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:38.841148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:38.841156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:38.841164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:38.841172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.841181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.841190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.841197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.841248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:38.841368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:38.841421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:38.841476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:38.841528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:38.841581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:38.841630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:38.841682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:38.841734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.841786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.841841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.841891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.841943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:38.845804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:38.847182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:38.847290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:38.847363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:38.847429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:38.847485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:38.847551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:38.847610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:38.847687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:38.847746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:38.847811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:38.847869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:38.847932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:38.847993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:38.848059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:38.848117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.848179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.848230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.848294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.848348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.848408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.848462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.848526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.849041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:38.924336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:38.943607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:38.943651Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:38.943671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:38.943692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:38.943718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 304 [2:7559593234775277371:4963]
2025-10-10T14:02:38.943781Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:38.943843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:38.943859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:38.943872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:38.943884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:38.943933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:38.943956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:38.943979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:38.946657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.946691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.946708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.946725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.946739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:38.947055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:38.947075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:38.947236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:38.947450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:38.947703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:38.947832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:38.947909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593234775277366:4963]
2025-10-10T14:02:38.947925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593234775277366:4963]
2025-10-10T14:02:38.947939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593234775277366:4963]
2025-10-10T14:02:38.947954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593234775277366:4963]
2025-10-10T14:02:38.948003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:38.948091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:38.948295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:38.948312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:38.948443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593234775277366:4963]
2025-10-10T14:02:38.948467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:38.949265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:38.949279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:38.949292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:38.949304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:38.949328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:38.950580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593236353194919:5447], now have 1 active actors on pipe
2025-10-10T14:02:38.950608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593236353194795:2442], now have 1 active actors on pipe
2025-10-10T14:02:38.950632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593236353194815:5422], now have 1 active actors on pipe
2025-10-10T14:02:38.951231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 304
2025-10-10T14:02:38.951331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 304
2025-10-10T14:02:38.951405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 304, pipe: [1:7559593236353194815:5422]
2025-10-10T14:02:38.952167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:38.952200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:38.952288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:38.952323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:38.952340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:38.952350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:38.952384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:38.952428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:38.952479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:38.953675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:38.953707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:38.953776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:38.954488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 305 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0
2025-10-10T14:02:38.957479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94f36d8f-62e1fa98-55d0c916-b1314e80_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:38.981506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0] Write session: try to update token
2025-10-10T14:02:38.981566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:39.055858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:39.061516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:39.061550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:39.061563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:39.061575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:39.061622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593234775277366:4963]
2025-10-10T14:02:39.061666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593234775277366:4963]
2025-10-10T14:02:39.061692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593234775277366:4963]
2025-10-10T14:02:39.061715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593234775277366:4963]
2025-10-10T14:02:39.061897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:39.061915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:39.061927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:39.061944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:39.061982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:39.061982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:39.062022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:39.062030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:39.062032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:39.062061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:39.069002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:39.150859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId: src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:39.175953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:39.232767Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:39.263955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:39.264009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:39.267393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:39.267430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:39.267878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:39.268713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:39.268911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593236353194815:5422]
2025-10-10T14:02:39.278389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 305 reason: error at write: Disconnected sessionId: src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0
2025-10-10T14:02:39.278766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 305 sessionId: src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0 is DEAD
2025-10-10T14:02:39.281604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:39.281682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0] Write session will restart in 0.007840s
2025-10-10T14:02:39.281882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0] Write session: Do CDS request
2025-10-10T14:02:39.281948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:39.294746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:39.294787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 306
2025-10-10T14:02:39.295779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:39.296401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:39.296541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:39.296560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:39.296570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:39.298188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 306 sessionId:  describe result for acl check
2025-10-10T14:02:39.298318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:39.298329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:39.298339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:39.298357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593240648162265:5456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:39.303744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593240648162265:5456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:39.320810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593240648162265:5456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:39.339524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593240648162265:5456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:39.339575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593240648162265:5456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:39.339593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593240648162265:5456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:39.339624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:39.369270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593240648162373:5422]
2025-10-10T14:02:39.371604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:39.382233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:39.383202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:39.383243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:39.383293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:39.383599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:39.383812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593239070244822:4969]
2025-10-10T14:02:39.386888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:39.390235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:39.390525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:39.391932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:39.392322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:39.392331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:39.392339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:39.392348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:39.392355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:39.392362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:39.392371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:39.392378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:39.392387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:39.392394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:39.392401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:39.392409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:39.392466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:39.392588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:39.392641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:39.392693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:39.392743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:39.392793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:39.392842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:39.392893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:39.392945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:39.392996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:39.393046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:39.393096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:39.393705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:39.393789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:39.393856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:39.393918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:39.393973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:39.394048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:39.394099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:39.394157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:39.394212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:39.394268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:39.394317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:39.394373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:39.394426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:39.394487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:39.394541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:39.394602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:39.394658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:39.394719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:39.394769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:39.394832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:39.394886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:39.394944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:39.394996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:39.395056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:39.395607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:39.439634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:39.485884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:39.485935Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:39.485952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:39.485972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:39.486013Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 305 [2:7559593239070244822:4969]
2025-10-10T14:02:39.486068Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:39.486135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:39.486153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:39.486166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:39.486178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:39.486225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:39.486248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:39.486271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:39.487569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:39.487586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:39.487600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:39.487613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:39.487624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:39.487908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:39.487925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:39.488072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:39.488257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:39.488489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:39.488604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:39.488696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593239070244815:4969]
2025-10-10T14:02:39.488717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593239070244815:4969]
2025-10-10T14:02:39.488731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593239070244815:4969]
2025-10-10T14:02:39.488744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593239070244815:4969]
2025-10-10T14:02:39.488786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:39.488868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:39.489047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:39.489063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:39.489335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593239070244815:4969]
2025-10-10T14:02:39.489369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:39.489488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593240648162251:2442], now have 1 active actors on pipe
2025-10-10T14:02:39.489512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593240648162373:5422], now have 1 active actors on pipe
2025-10-10T14:02:39.489551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593240648162322:5456], now have 1 active actors on pipe
2025-10-10T14:02:39.489634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:39.489651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:39.489662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:39.489673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:39.489700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:39.491699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 305
2025-10-10T14:02:39.491795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 305, pipe: [1:7559593240648162373:5422]
2025-10-10T14:02:39.491872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 305
2025-10-10T14:02:39.497302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:39.497356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:39.497454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:39.497492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:39.497512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:39.497522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:39.497565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:39.497616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:39.497666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:39.509335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:39.509385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:39.509480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:39.514954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 306 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0
2025-10-10T14:02:39.516094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ac0e893-49eab71e-298276a2-d9e0b5b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:39.573687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0] Write session: try to update token
2025-10-10T14:02:39.573750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:39.589375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:39.589408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:39.589420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:39.850814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId: src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:39.920413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:39.920449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:39.920462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:39.920522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:39.920537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:39.920551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:39.920564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:39.920577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:39.920614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593239070244815:4969]
2025-10-10T14:02:39.920643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593239070244815:4969]
2025-10-10T14:02:39.920670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593239070244815:4969]
2025-10-10T14:02:39.920694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593239070244815:4969]
2025-10-10T14:02:39.920851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:39.920879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:39.920892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:39.922039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:39.922169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:39.922209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:39.922238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:39.922279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:39.978845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:40.161773Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:40.164526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:40.164558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:40.168614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:40.168776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593240648162373:5422]
2025-10-10T14:02:40.168854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:40.168865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:40.169406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:40.213807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:40.213888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0] Write session will restart in 0.009826s
2025-10-10T14:02:40.214058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0] Write session: Do CDS request
2025-10-10T14:02:40.214106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:40.211055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 306 reason: error at write: Disconnected sessionId: src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0
2025-10-10T14:02:40.211419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 306 sessionId: src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0 is DEAD
2025-10-10T14:02:40.242694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:40.245275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:40.245309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 307
2025-10-10T14:02:40.245668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:40.245789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:40.245806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:40.245819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:40.250489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 307 sessionId:  describe result for acl check
2025-10-10T14:02:40.250613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:40.250625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:40.250633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:40.250649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593244943129775:5469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:40.260336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593244943129775:5469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:40.275756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593244943129813:5422]
2025-10-10T14:02:40.280325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593244943129775:5469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:40.308460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:40.322277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593244943129775:5469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:40.322321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593244943129775:5469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:40.322338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593244943129775:5469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:40.322368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:40.321792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:40.322777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:40.322796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:40.322844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:40.323125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:40.323312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593243365212264:4978]
2025-10-10T14:02:40.326708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:40.333809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:40.334126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:40.335733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:40.336082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:40.336090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:40.336098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:40.336106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:40.336113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:40.336120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:40.336128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:40.336136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:40.336144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:40.336152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:40.336159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:40.336168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:40.336222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:40.336337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:40.336391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:40.336444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:40.336494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:40.336547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:40.336598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:40.336650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:40.336704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:40.336752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:40.336803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:40.336853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:40.336897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:40.336972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:40.337037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:40.337099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:40.337173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:40.337230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:40.337277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:40.337336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:40.337388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:40.337446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:40.337495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:40.337553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:40.337604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:40.337664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:40.337712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:40.337771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:40.337825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:40.337885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:40.337936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:40.337995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:40.338070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:40.338130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:40.338178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:40.338241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:40.338732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:40.411527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:40.473755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:40.473809Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:40.473823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:40.473841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:40.473867Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 306 [2:7559593243365212264:4978]
2025-10-10T14:02:40.473926Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:40.473991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:40.474007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:40.474036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:40.474047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:40.474098Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:40.474123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:40.474147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:40.533937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:40.533963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:40.533973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:40.533985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:40.533996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:40.534304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:40.534319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:40.534444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:40.534599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:40.534804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:40.534907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:40.534979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:40.534993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:40.535005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:40.535018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:40.535062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:40.535138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:40.535306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:40.535321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:40.535454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:40.535473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:40.536270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:40.536285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:40.536296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:40.536307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:40.536333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:40.539138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593244943129720:2442], now have 1 active actors on pipe
2025-10-10T14:02:40.539177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593244943129847:5469], now have 1 active actors on pipe
2025-10-10T14:02:40.539202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593244943129813:5422], now have 1 active actors on pipe
2025-10-10T14:02:40.539813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 306
2025-10-10T14:02:40.539942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 306
2025-10-10T14:02:40.540008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 306, pipe: [1:7559593244943129813:5422]
2025-10-10T14:02:40.541800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 307 partition: 0 MaxSeqNo: 36 sessionId: src_id|5a5fda7e-89e9199-73100c05-8484fa21_0
2025-10-10T14:02:40.540500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:40.540546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:40.540629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a5fda7e-89e9199-73100c05-8484fa21_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:40.540666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:40.540686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:40.540697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:40.540735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:40.540783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:40.540832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:40.541373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:40.541394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:40.541473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:40.548063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e9b8c7-9a3cff4f-37319b2e-d7fd3a9b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5a5fda7e-89e9199-73100c05-8484fa21_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:40.573850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:40.573883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:40.573896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:40.664985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a5fda7e-89e9199-73100c05-8484fa21_0] Write session: try to update token
2025-10-10T14:02:40.665088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a5fda7e-89e9199-73100c05-8484fa21_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:40.677371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:40.677404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:40.677416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:40.965078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:40.965113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:40.965140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:40.965199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:40.965215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:40.965229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:40.965241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:40.965252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:40.965291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:40.965320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:40.965345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:40.965367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:40.965593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:40.965622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:40.965636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:40.967027Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:40.969592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:40.969627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:40.969656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:40.969687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:41.013268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId: src_id|5a5fda7e-89e9199-73100c05-8484fa21_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:41.064553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:41.162528Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:41.179787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:41.179836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:41.179896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:41.179911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:41.179967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593243365212258:4978]
2025-10-10T14:02:41.182786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:41.182925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:41.182938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:41.184370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593244943129813:5422]
2025-10-10T14:02:41.180861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:41.194262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:41.286072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593249238097258:5422]
2025-10-10T14:02:41.300520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 307 reason: error at write: Disconnected sessionId: src_id|5a5fda7e-89e9199-73100c05-8484fa21_0
2025-10-10T14:02:41.302116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a5fda7e-89e9199-73100c05-8484fa21_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:41.302205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a5fda7e-89e9199-73100c05-8484fa21_0] Write session will restart in 0.006206s
2025-10-10T14:02:41.302398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a5fda7e-89e9199-73100c05-8484fa21_0] Write session: Do CDS request
2025-10-10T14:02:41.302457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a5fda7e-89e9199-73100c05-8484fa21_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:41.300901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 307 sessionId: src_id|5a5fda7e-89e9199-73100c05-8484fa21_0 is DEAD
2025-10-10T14:02:41.337247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:41.337277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 308
2025-10-10T14:02:41.338260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a5fda7e-89e9199-73100c05-8484fa21_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:41.341778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:41.341938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:41.341955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:41.341967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:41.349712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 308 sessionId:  describe result for acl check
2025-10-10T14:02:41.349846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:41.349857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:41.349867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:41.352932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:41.349884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593249238097303:5481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:41.352742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593249238097303:5481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:41.368153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593249238097303:5481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:41.373426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:41.374373Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:41.374393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:41.374440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:41.374726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:41.374926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593247660179727:4990]
2025-10-10T14:02:41.377909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:41.379614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:41.379878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:41.381342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:41.381712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:41.381721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:41.381729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:41.381737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:41.381747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:41.381754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:41.381761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:41.381769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:41.381777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:41.381784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:41.381792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:41.381799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:41.381850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:41.381967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:41.382021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:41.382088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:41.382136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:41.382188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:41.382239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:41.382286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:41.382336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:41.382388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:41.382438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:41.382489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:41.382538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:41.382610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:41.382679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:41.382739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:41.382791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:41.382847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:41.382897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:41.382954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:41.383028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:41.383091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:41.383139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:41.383193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:41.383243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:41.383320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:41.383374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:41.383433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:41.383486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:41.383543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:41.383593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:41.387496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593249238097303:5481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:41.387547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593249238097303:5481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:41.387567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593249238097303:5481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:41.387610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:41.383652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:41.383709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:41.383764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:41.383830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:41.383891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:41.384380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:41.419869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:41.470657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:41.470704Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:41.470728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:41.470750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:41.470777Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 307 [2:7559593247660179727:4990]
2025-10-10T14:02:41.470841Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:41.470904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:41.470920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:41.470935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:41.470949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:41.471000Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:41.471023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:41.471048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:41.472350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:41.472370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:41.472387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:41.472402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:41.472413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:41.472718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:41.472740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:41.472909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:41.473360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:41.473640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:41.473773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:41.473871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:41.473888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:41.473902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:41.473917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:41.473948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:41.473974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:41.473988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:41.473999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:41.474011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:41.474052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:41.474257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:41.474275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:41.474417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:41.474444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:41.474496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593249238097334:5481], now have 1 active actors on pipe
2025-10-10T14:02:41.474521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593249238097204:2442], now have 1 active actors on pipe
2025-10-10T14:02:41.474543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593249238097258:5422], now have 1 active actors on pipe
2025-10-10T14:02:41.475494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 307
2025-10-10T14:02:41.475591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 307
2025-10-10T14:02:41.475659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 307, pipe: [1:7559593249238097258:5422]
2025-10-10T14:02:41.475857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:41.476796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:41.476827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:41.476930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5aa26501-682ade40-a5601f70-aa1c173a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:41.476963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:41.476983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:41.476996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:41.477034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:41.477077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:41.477169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:41.483117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:41.483158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:41.483234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:41.485057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 308 partition: 0 MaxSeqNo: 36 sessionId: src_id|5aa26501-682ade40-a5601f70-aa1c173a_0
2025-10-10T14:02:41.485954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a5fda7e-89e9199-73100c05-8484fa21_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5aa26501-682ade40-a5601f70-aa1c173a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:41.531286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa26501-682ade40-a5601f70-aa1c173a_0] Write session: try to update token
2025-10-10T14:02:41.531359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa26501-682ade40-a5601f70-aa1c173a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:41.782853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:41.782883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:41.782896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:41.782954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:41.782972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:41.782988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:41.783000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:41.783012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:41.783051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:41.783081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:41.783107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:41.783130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:41.783340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:41.783369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:41.783381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:41.784545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:41.785277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:41.785313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:41.785345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:41.785377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:41.786117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId: src_id|5aa26501-682ade40-a5601f70-aa1c173a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:41.842840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:42.081546Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:42.094293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:42.094344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:42.094429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:42.094446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:42.094494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593247660179722:4990]
2025-10-10T14:02:42.096699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:42.096723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:42.095070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:42.102656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593249238097258:5422]
2025-10-10T14:02:42.102755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:42.106116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:42.202634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593253533064707:5422]
2025-10-10T14:02:42.209569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa26501-682ade40-a5601f70-aa1c173a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:42.209614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa26501-682ade40-a5601f70-aa1c173a_0] Write session will restart in 0.006287s
2025-10-10T14:02:42.209714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa26501-682ade40-a5601f70-aa1c173a_0] Write session: Do CDS request
2025-10-10T14:02:42.209745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa26501-682ade40-a5601f70-aa1c173a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:42.204142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 308 reason: error at write: Disconnected sessionId: src_id|5aa26501-682ade40-a5601f70-aa1c173a_0
2025-10-10T14:02:42.204523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 308 sessionId: src_id|5aa26501-682ade40-a5601f70-aa1c173a_0 is DEAD
2025-10-10T14:02:42.225931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa26501-682ade40-a5601f70-aa1c173a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:42.226650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:42.226684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 309
2025-10-10T14:02:42.227014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:42.227156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:42.227173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:42.227184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:42.235628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 309 sessionId:  describe result for acl check
2025-10-10T14:02:42.235863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:42.235885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:42.235907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:42.235932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593253533064760:5487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:42.239611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593253533064760:5487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:42.250403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593253533064760:5487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:42.266808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:42.277949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593253533064760:5487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:42.277994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593253533064760:5487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:42.278014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593253533064760:5487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:42.278046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:42.285751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:42.286858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:42.286894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:42.286952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:42.287285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:42.287500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593251955147178:4998]
2025-10-10T14:02:42.299924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:42.307651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:42.307973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:42.309528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:42.309932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:42.309944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:42.309952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:42.309961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:42.309970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:42.309979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:42.309988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:42.309996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:42.310004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.310012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.310020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.310028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.310112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:42.310256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:42.310323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:42.310382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:42.310437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:42.310495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:42.310548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:42.310599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:42.310650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.310701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.310751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.310803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.310883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:42.310969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:42.311035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:42.311566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:42.311631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:42.311691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:42.311741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:42.311799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:42.311853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:42.311915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:42.311964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:42.312023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:42.312077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:42.312140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:42.312192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:42.312247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:42.312302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.312366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.312416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.312473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.312525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.312586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.312638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.312698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.313254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:42.359612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:42.398859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 308, pipe: [1:7559593253533064707:5422]
2025-10-10T14:02:42.398962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 308
2025-10-10T14:02:42.399043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 308
2025-10-10T14:02:42.395138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:42.395185Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:42.395203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:42.395221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:42.395243Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 308 [2:7559593251955147178:4998]
2025-10-10T14:02:42.395298Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:42.395353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:42.395366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:42.395378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:42.395390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:42.395436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:42.395457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:42.395480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:42.396869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.396887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.396902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.396917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.396929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:42.397224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:42.397241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.397388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.397580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.397816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.397936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:42.398018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593253533064707:5422], now have 1 active actors on pipe
2025-10-10T14:02:42.398043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593253533064666:2442], now have 1 active actors on pipe
2025-10-10T14:02:42.398081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593253533064796:5487], now have 1 active actors on pipe
2025-10-10T14:02:42.398104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.398121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.398134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.398148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.398189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:42.398232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:42.398249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:42.398262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:42.398267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:42.398274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:42.398454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:42.398471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:42.398592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.398622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:42.398668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:42.399880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:42.399905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:42.399973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30d894c5-dc2bea26-737caa1-a770d059_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:42.400002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:42.400019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:42.400029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:42.400061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:42.400099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:42.400143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:42.400991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:42.401010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:42.401083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:42.401440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 309 partition: 0 MaxSeqNo: 36 sessionId: src_id|30d894c5-dc2bea26-737caa1-a770d059_0
2025-10-10T14:02:42.403019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa26501-682ade40-a5601f70-aa1c173a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|30d894c5-dc2bea26-737caa1-a770d059_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:42.472979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:42.473012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:42.473047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.473230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:42.473245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:02:42.488326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30d894c5-dc2bea26-737caa1-a770d059_0] Write session: try to update token
2025-10-10T14:02:42.488368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30d894c5-dc2bea26-737caa1-a770d059_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:42.486071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:02:42.490946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:42.493134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:42.507924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:42.510754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:02:42.511277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:42.511298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:42.511309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:42.511358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:02:42.592000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:42.592037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:42.592051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:42.592061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:42.592072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:42.592112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.592140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.592168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.592193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593251955147172:4998]
2025-10-10T14:02:42.592284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:42.592317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:42.592346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:42.592383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:42.592645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:42.592683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.592696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:42.605841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:42.633228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId: src_id|30d894c5-dc2bea26-737caa1-a770d059_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:42.674970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:42.760325Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:42.773864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:42.773900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:42.774898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:42.776604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:42.782287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 309 reason: status is not ok: tablet will be restarted right now sessionId: src_id|30d894c5-dc2bea26-737caa1-a770d059_0
2025-10-10T14:02:42.783916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 309 sessionId: src_id|30d894c5-dc2bea26-737caa1-a770d059_0 is DEAD
2025-10-10T14:02:42.785616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d894c5-dc2bea26-737caa1-a770d059_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:42.785681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d894c5-dc2bea26-737caa1-a770d059_0] Write session will restart in 0.007338s
2025-10-10T14:02:42.785837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d894c5-dc2bea26-737caa1-a770d059_0] Write session: Do CDS request
2025-10-10T14:02:42.785888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d894c5-dc2bea26-737caa1-a770d059_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:42.804589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593253533064707:5422]
2025-10-10T14:02:42.804674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:42.813841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30d894c5-dc2bea26-737caa1-a770d059_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:42.817806Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:42.817838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 310
2025-10-10T14:02:42.818274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:42.818394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:42.818411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:42.818420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:42.820392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 310 sessionId:  describe result for acl check
2025-10-10T14:02:42.820495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:42.820507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:42.820516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:42.820532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593253533064849:5500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:42.825989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593253533064849:5500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:42.842190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593253533064849:5500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:42.856990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593253533064849:5500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:42.857027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593253533064849:5500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:42.857044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593253533064849:5500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:42.857076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:42.893637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:42.898342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:42.899158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:42.899186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:42.899227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:42.899474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:42.899662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593251955147344:5008]
2025-10-10T14:02:42.902066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:42.906160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:42.906383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:42.907842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:42.908276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:42.908293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:42.908301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:42.908308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:42.908315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:42.908322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:42.908328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:42.908336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:42.908343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.908350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.908356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.908364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.908412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:42.908524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:42.908576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:42.908630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:42.908683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:42.908736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:42.908790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:42.908842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:42.908894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.908945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.908994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.909045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.909088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:42.909173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:42.909239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:42.909300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:42.905651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593253533064973:5422]
2025-10-10T14:02:42.909354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:42.909414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:42.909463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:42.909522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:42.909576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:42.909636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:42.909685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:42.909744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:42.909796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:42.909855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:42.909905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:42.909964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:42.910017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.910083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.910135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.910193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.910246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.910305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.910355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.910412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.910855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:42.949821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:42.994239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:42.994295Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:42.994315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:42.994337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:42.994363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 309 [2:7559593251955147344:5008]
2025-10-10T14:02:42.994427Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:42.994485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:42.994500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:42.994513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:42.994527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:42.994574Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:42.994597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:42.994620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:42.995831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.995848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.995862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.995878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.995889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:42.996162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:42.996184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:42.996346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:42.996553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:42.996804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:42.996932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:42.997001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:42.997026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:42.997045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:42.997058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:42.997091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:42.997919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:42.998142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:42.998166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:42.998308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:42.998345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:42.999198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:42.999220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:42.999233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:42.999245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:42.999269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:42.999844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593253533064839:2442], now have 1 active actors on pipe
2025-10-10T14:02:42.999881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593253533064973:5422], now have 1 active actors on pipe
2025-10-10T14:02:42.999903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593253533064897:5500], now have 1 active actors on pipe
2025-10-10T14:02:43.001450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 309
2025-10-10T14:02:43.001553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 309, pipe: [1:7559593253533064973:5422]
2025-10-10T14:02:43.001626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 309
2025-10-10T14:02:43.002843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:43.002878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:43.002952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:43.002991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:43.003008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:43.003019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:43.003064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:43.003104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:43.003168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:43.003998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:43.004029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:43.004103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:43.004399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 310 partition: 0 MaxSeqNo: 36 sessionId: src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0
2025-10-10T14:02:43.005159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30d894c5-dc2bea26-737caa1-a770d059_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:43.059735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:43.059775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:43.059816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:43.059939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:02:43.061373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:43.063147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:02:43.064323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:43.081564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:43.083157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:43.084693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:02:43.099632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0] Write session: try to update token
2025-10-10T14:02:43.099693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:43.125203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:43.125232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:43.125245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:43.125307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:02:43.231388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:43.231425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:43.231438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:43.231499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:43.231519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:43.231535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:43.231549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:43.231563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:43.231608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:43.231638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:43.231677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:43.231706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593251955147339:5008]
2025-10-10T14:02:43.231851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:43.231871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:43.231895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:43.231898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:43.231910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:43.231939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:43.231980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:43.233755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:43.281352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId: src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:43.310439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:43.409096Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:43.411170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:43.411207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:43.413028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:43.413197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593253533064973:5422]
2025-10-10T14:02:43.413281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:43.413293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:43.418634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:43.500009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 310 reason: error at write: Disconnected sessionId: src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0
2025-10-10T14:02:43.500336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 310 sessionId: src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0 is DEAD
2025-10-10T14:02:43.501503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:43.501548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0] Write session will restart in 0.006854s
2025-10-10T14:02:43.501653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0] Write session: Do CDS request
2025-10-10T14:02:43.501684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:43.509872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593257828032343:5422]
2025-10-10T14:02:43.517307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:43.517477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:43.517503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 311
2025-10-10T14:02:43.521307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:43.521485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:43.521504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:43.521516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:43.523280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 311 sessionId:  describe result for acl check
2025-10-10T14:02:43.523411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:43.523424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:43.523435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:43.523454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593257828032373:5508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:43.526792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593257828032373:5508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:43.541720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:43.543034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593257828032373:5508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:43.548237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:43.549191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:43.549213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:43.549266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:43.549582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:43.549807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593256250114808:5018]
2025-10-10T14:02:43.551707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593257828032373:5508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:43.551742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593257828032373:5508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:43.551760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593257828032373:5508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:43.551790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:43.551548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:43.553937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:43.554198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:43.555179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:43.555484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:43.555493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:43.555501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:43.555510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:43.555518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:43.555527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:43.555533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:43.555541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:43.555548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:43.555555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:43.555563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:43.555569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:43.555622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:43.555741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:43.555794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:43.555845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:43.555896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:43.555946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:43.555993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:43.556043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:43.556092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:43.556143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:43.556188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:43.556237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:43.556278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:43.556353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:43.556416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:43.556482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:43.556535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:43.556595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:43.556649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:43.556709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:43.556768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:43.556827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:43.557079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:43.557140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:43.557190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:43.557234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:43.557268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:43.557333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:43.557372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:43.557424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:43.557462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:43.557513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:43.557552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:43.557594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:43.557638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:43.557679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:43.558056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:43.589895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:43.623280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:43.623335Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:43.623356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:43.623380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:43.623407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 310 [2:7559593256250114808:5018]
2025-10-10T14:02:43.623473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:43.623536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:43.623553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:43.623566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:43.623579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:43.623629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:43.623653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:43.623677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:43.625645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:43.625669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:43.625683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:43.625698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:43.625710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:43.626020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:43.626041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:43.626228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:43.626455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:43.626738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:43.626873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:43.626952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:43.626969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:43.627746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 310
2025-10-10T14:02:43.626985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:43.627848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 310
2025-10-10T14:02:43.627925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 310, pipe: [1:7559593257828032343:5422]
2025-10-10T14:02:43.627000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:43.627050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:43.627152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593257828032421:5508], now have 1 active actors on pipe
2025-10-10T14:02:43.627178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593257828032293:2442], now have 1 active actors on pipe
2025-10-10T14:02:43.627203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593257828032343:5422], now have 1 active actors on pipe
2025-10-10T14:02:43.627244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:43.627452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:43.627472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:43.627605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:43.627627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:43.628478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:43.628493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:43.628501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:43.628509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:43.628528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:43.629217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:43.629249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:43.629342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:43.629375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:43.629405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:43.629417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:43.629453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:43.629500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:43.629551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:43.632981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:43.633025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:43.633196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:43.634387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60cd233-3ffaad56-f38090b0-8c7e3ffa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:43.633579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 311 partition: 0 MaxSeqNo: 36 sessionId: src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0
2025-10-10T14:02:43.676692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0] Write session: try to update token
2025-10-10T14:02:43.676755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:43.836729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:43.836761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:43.836776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:43.836892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:43.836906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:43.836921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:43.836934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:43.836946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:43.836982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:43.837011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:43.837035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:43.837058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:43.837456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:43.837491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:43.837524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:43.837552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:43.863088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId: src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:43.918499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:43.918553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:43.918567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:43.919990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:43.929432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:44.078938Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:44.089600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:44.089639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:44.089688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593256250114802:5018]
2025-10-10T14:02:44.089846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:44.089873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:44.093764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:44.094658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:44.094683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:44.094410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:44.191059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:44.191138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0] Write session will restart in 0.009789s
2025-10-10T14:02:44.191348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0] Write session: Do CDS request
2025-10-10T14:02:44.191426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:44.189848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:44.189993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593257828032343:5422]
2025-10-10T14:02:44.190070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 311 reason: error at write: Disconnected sessionId: src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0
2025-10-10T14:02:44.190466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 311 sessionId: src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0 is DEAD
2025-10-10T14:02:44.210533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:44.232478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:44.232506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 312
2025-10-10T14:02:44.238058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:44.238219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:44.238236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:44.238245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:44.240519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 312 sessionId:  describe result for acl check
2025-10-10T14:02:44.240626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:44.240637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:44.240647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:44.240664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593262122999861:5520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:44.242021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:44.243594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593262122999861:5520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:44.250930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:44.251758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:44.251778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:44.251819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:44.252091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:44.252281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593260545082252:5027]
2025-10-10T14:02:44.254570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:44.259042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593262122999861:5520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:44.260340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:44.260597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:44.261901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:44.262238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:44.262245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:44.262252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:44.262258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:44.262265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:44.262272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:44.262278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:44.262284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:44.262290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.262298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.262304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.262311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.262356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:44.262449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:44.262494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:44.262535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:44.262576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:44.262619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:44.262659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:44.262699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:44.262739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.262780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.262819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.262860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.262894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:44.262955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:44.263007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:44.263064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:44.263115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:44.263165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:44.263209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:44.263257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:44.263299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:44.263349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:44.263390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:44.263436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:44.263478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:44.263527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:44.263567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:44.263616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:44.263660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.263712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.263753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.263802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.263846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.263904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.263956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.264028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.264436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:44.291739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593262122999895:5422]
2025-10-10T14:02:44.298923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593262122999861:5520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:44.298960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593262122999861:5520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:44.298979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593262122999861:5520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:44.299007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:44.324463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:44.359356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:44.359401Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:44.359419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:44.359440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:44.359466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 311 [2:7559593260545082252:5027]
2025-10-10T14:02:44.359518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:44.359577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:44.359593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:44.359604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:44.359616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:44.359663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:44.359685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:44.359706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:44.361915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.361937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.361951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.361963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.361972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:44.362265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:44.362281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.362423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.362593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.362809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.362930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:44.363001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593260545082247:5027]
2025-10-10T14:02:44.363016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593260545082247:5027]
2025-10-10T14:02:44.363030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593260545082247:5027]
2025-10-10T14:02:44.363042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593260545082247:5027]
2025-10-10T14:02:44.363084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:44.363159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:44.363352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:44.363371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:44.363500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593260545082247:5027]
2025-10-10T14:02:44.363520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:44.366552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 311
2025-10-10T14:02:44.366640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 311
2025-10-10T14:02:44.366697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 311, pipe: [1:7559593262122999895:5422]
2025-10-10T14:02:44.364533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:44.364549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:44.364560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:44.364569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:44.364591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:44.368009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593262122999793:2442], now have 1 active actors on pipe
2025-10-10T14:02:44.368041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593262122999899:5520], now have 1 active actors on pipe
2025-10-10T14:02:44.368065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593262122999895:5422], now have 1 active actors on pipe
2025-10-10T14:02:44.368126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:44.368147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:44.368226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:44.368259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:44.368278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:44.368288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:44.368324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:44.368373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:44.368418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:44.369690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:44.369716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:44.369786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:44.370207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 312 partition: 0 MaxSeqNo: 36 sessionId: src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0
2025-10-10T14:02:44.371115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29237f94-4bf8bbc-3b7266f1-d3e72ae9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:44.461290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:44.461336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:44.461348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:44.494872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0] Write session: try to update token
2025-10-10T14:02:44.494932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:44.574256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:44.574293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:44.574306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:44.574317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:44.574326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:44.574360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593260545082247:5027]
2025-10-10T14:02:44.574387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593260545082247:5027]
2025-10-10T14:02:44.574411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593260545082247:5027]
2025-10-10T14:02:44.574432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593260545082247:5027]
2025-10-10T14:02:44.574530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:44.574556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:44.574581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:44.574608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:44.576939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:44.576954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:44.576966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:44.577014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:44.577039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.577049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:44.583449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:44.705480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId: src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:44.752950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:44.834366Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:44.843476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:44.843517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:44.848943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593262122999895:5422]
2025-10-10T14:02:44.849033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:44.849181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:44.849195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:44.859475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:44.916284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:44.916369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0] Write session will restart in 0.006580s
2025-10-10T14:02:44.916557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0] Write session: Do CDS request
2025-10-10T14:02:44.916621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:44.911793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 312 reason: error at write: Disconnected sessionId: src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0
2025-10-10T14:02:44.912188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 312 sessionId: src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0 is DEAD
2025-10-10T14:02:44.930670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:44.930703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 313
2025-10-10T14:02:44.934069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
E1010 14:02:44.939134993  190983 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:02:44.940795Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:02:44.941912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:44.942069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:44.942084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:44.942094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:44.942187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593262123000017:5422]
2025-10-10T14:02:44.945563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 313 sessionId:  describe result for acl check
2025-10-10T14:02:44.945682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:44.945692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:44.945701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:44.945719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593262123000028:5530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:44.948278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593262123000028:5530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:44.967191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593262123000028:5530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:44.977622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:44.985887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:44.986805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:44.986825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:44.986870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:44.987139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:44.987541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593260545082429:5033]
2025-10-10T14:02:44.989992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:44.991519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:44.991794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:44.993113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:44.993488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:44.993496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:44.993504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:44.993511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:44.993518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:44.993524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:44.993531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:44.993538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:44.993545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.993552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.993561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.993568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.993619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:44.993739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:44.993796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:44.993848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:44.993894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:44.993944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:44.993994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:44.994041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:44.994090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.994160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.994211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.994261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.994304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:44.994372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:44.994433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:44.994495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:44.994565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:44.994622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:44.994670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:44.994720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:44.994771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:44.994828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:44.994882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:44.994940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:44.994989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:44.995044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:44.995090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:44.995144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:44.995195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.995253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:44.995299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.995357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:44.995404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.995462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:44.995509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.995566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:44.996035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:44.999711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593262123000028:5530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:44.999757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593262123000028:5530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:44.999775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593262123000028:5530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:44.999806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:45.037535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:45.051497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:45.051540Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:45.051561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:45.051582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:45.051608Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 312 [2:7559593260545082429:5033]
2025-10-10T14:02:45.051673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:45.051733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:45.051749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:45.051763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:45.051774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:45.051822Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:45.051844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:45.051867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:45.053218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.053234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:45.053249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:45.053264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:45.053277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:45.053557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:45.053577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.053735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:45.053964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:45.054233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:45.054371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:45.054442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.054459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.054473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.054489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.054524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:45.054613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:45.054811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:45.054831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:45.054957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.054979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:45.055249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:45.055262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:45.055276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:45.055288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:45.055312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:45.056017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593262122999936:2442], now have 1 active actors on pipe
2025-10-10T14:02:45.056051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593262123000017:5422], now have 1 active actors on pipe
2025-10-10T14:02:45.056075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593262123000074:5530], now have 1 active actors on pipe
2025-10-10T14:02:45.061404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 312
2025-10-10T14:02:45.061539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 312, pipe: [1:7559593262123000017:5422]
2025-10-10T14:02:45.061619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 312
2025-10-10T14:02:45.065326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:45.065370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:45.065461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:45.065499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:45.065521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:45.065533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:45.065573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:45.065617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:45.065664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:45.068407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 313 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0
2025-10-10T14:02:45.067989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:45.068024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:45.068102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:45.070430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43100d7f-17fe0d15-5bf0ec16-ba648093_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:45.116118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0] Write session: try to update token
2025-10-10T14:02:45.116180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:45.152408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:45.152435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:45.152450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:45.265581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:45.265612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:45.265653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.265775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:45.265788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:45.265800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:45.265861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:02:45.267235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:45.268511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId: src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:45.282510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:02:45.285006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:45.286432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:45.287665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:45.290919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:02:45.291761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:02:45.308391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:45.335707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:45.335755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:45.335796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:45.335811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:45.335825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:45.335838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:45.335852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:45.335893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.335920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.335945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.335968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593260545082424:5033]
2025-10-10T14:02:45.336149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:45.336187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.336199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:45.337293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:45.337347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:45.337382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:45.337415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:45.337655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:45.480280Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:45.482353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:02:45.484163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:45.486919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:45.487185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593262123000017:5422]
2025-10-10T14:02:45.570244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:45.570288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0] Write session will restart in 0.009326s
2025-10-10T14:02:45.570390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0] Write session: Do CDS request
2025-10-10T14:02:45.570430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:45.567956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:45.567986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:45.568142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 313 reason: error at write: Disconnected sessionId: src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0
2025-10-10T14:02:45.568449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 313 sessionId: src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0 is DEAD
2025-10-10T14:02:45.588085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:45.588285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593266417967485:5422]
2025-10-10T14:02:45.593373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:45.593395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 314
2025-10-10T14:02:45.597554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:45.601534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:45.601713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:45.601731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:45.601738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:45.603363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 314 sessionId:  describe result for acl check
2025-10-10T14:02:45.603486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:45.603498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:45.603509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:45.603526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593266417967490:5535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:45.606616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593266417967490:5535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:45.608386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:45.609402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:45.609422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:45.609474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:45.609767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:45.609980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593264840049877:5042]
2025-10-10T14:02:45.612675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:45.614021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:45.614278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:45.615322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:45.615588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:45.615600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:45.615605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:45.615611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:45.615615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:45.615620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:45.615625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:45.615631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:45.615636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.615641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:45.615645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:45.615650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:45.615687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:45.615777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:45.615817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:45.615854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:45.615890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:45.615932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:45.615971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:45.616008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:45.616047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.616085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:45.616126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:45.616164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:45.616192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:45.616246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:45.616291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:45.616338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:45.616379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:45.616424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:45.616460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:45.616501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:45.616539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:45.616577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:45.616617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:45.616664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:45.616634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593266417967490:5535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:45.616718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:45.616779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:45.616820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:45.616861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:45.616901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.616944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.616981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:45.617023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:45.617061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:45.617103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:45.617191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:45.617261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:45.617737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:45.630946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593266417967490:5535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:45.630984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593266417967490:5535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:45.631003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593266417967490:5535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:45.631032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:45.680685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:45.703318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:45.703368Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:45.703390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:45.703413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:45.703437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 313 [2:7559593264840049877:5042]
2025-10-10T14:02:45.703499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:45.703561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:45.703576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:45.703588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:45.703600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:45.703650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:45.703672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:45.703695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:45.705478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.705497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:45.705513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:45.705528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:45.705541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:45.705837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:45.705856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.706020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:45.706271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:45.706532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:45.706630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 313
2025-10-10T14:02:45.706669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:45.706707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 313, pipe: [1:7559593266417967485:5422]
2025-10-10T14:02:45.706763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593266417967522:5535], now have 1 active actors on pipe
2025-10-10T14:02:45.706775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 313
2025-10-10T14:02:45.706795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593266417967485:5422], now have 1 active actors on pipe
2025-10-10T14:02:45.706825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593266417967388:2442], now have 1 active actors on pipe
2025-10-10T14:02:45.706858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:45.706879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:45.706894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:45.706909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:45.706941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:45.706970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:45.706985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:45.706994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:45.707002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:45.707028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:45.707232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:45.707257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:45.707318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:45.707345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:45.707720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:45.707760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:45.707764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:45.707832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25ae3a15-efe141a8-103000bc-498380f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:45.707899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:45.707921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:45.707933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:45.707969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:45.708013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:45.708162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:45.709239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:45.709279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:45.709361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:45.712731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3d0013-b02961ee-ab65262e-ac81c8fa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25ae3a15-efe141a8-103000bc-498380f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:45.710351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 314 partition: 0 MaxSeqNo: 36 sessionId: src_id|25ae3a15-efe141a8-103000bc-498380f_0
2025-10-10T14:02:45.763900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae3a15-efe141a8-103000bc-498380f_0] Write session: try to update token
2025-10-10T14:02:45.763959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae3a15-efe141a8-103000bc-498380f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:45.805437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:45.805464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:45.805476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:45.863625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:45.863684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:45.863716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:45.863736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:45.863758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:45.863825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:45.863872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:45.863926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:45.863972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:45.864152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:45.864213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:45.864267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:45.864305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:45.881182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:45.881232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:45.881245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:45.882393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:45.950981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId: src_id|25ae3a15-efe141a8-103000bc-498380f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:45.973291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:46.074359Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:46.077623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:46.077650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:46.077695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593264840049872:5042]
2025-10-10T14:02:46.077837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:46.077862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:46.078009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:46.078559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593266417967485:5422]
2025-10-10T14:02:46.078633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:46.078752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:46.078775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:46.082280Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:46.110007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 314 reason: error at write: Disconnected sessionId: src_id|25ae3a15-efe141a8-103000bc-498380f_0
2025-10-10T14:02:46.110892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae3a15-efe141a8-103000bc-498380f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:46.110954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae3a15-efe141a8-103000bc-498380f_0] Write session will restart in 0.008844s
2025-10-10T14:02:46.111122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae3a15-efe141a8-103000bc-498380f_0] Write session: Do CDS request
2025-10-10T14:02:46.111165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae3a15-efe141a8-103000bc-498380f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:46.110343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 314 sessionId: src_id|25ae3a15-efe141a8-103000bc-498380f_0 is DEAD
2025-10-10T14:02:46.126623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae3a15-efe141a8-103000bc-498380f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:46.127092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:46.127121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 315
2025-10-10T14:02:46.127937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:46.128028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:46.128038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:46.128046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:46.130222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 315 sessionId:  describe result for acl check
2025-10-10T14:02:46.130349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:46.130360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:46.130370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:46.130386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593270712934881:5549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:46.133323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593270712934881:5549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:46.155846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593270712934881:5549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:46.174070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593270712934881:5549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:46.174118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593270712934881:5549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:46.174140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593270712934881:5549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:46.174195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:46.178719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593270712934996:5422]
2025-10-10T14:02:46.181521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:46.197690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:46.198434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:46.198455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:46.198486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:46.198743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:46.198950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593269135017326:5050]
2025-10-10T14:02:46.200707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:46.204044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:46.204308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:46.205697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:46.206055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:46.206073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:46.206080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:46.206088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:46.206097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:46.206105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:46.206112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:46.206120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:46.206127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.206135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.206157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.206165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.206214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:46.206327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:46.206382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:46.206436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:46.206486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:46.206538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:46.206578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:46.206628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:46.206690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.206747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.206799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.206854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.206903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:46.206984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:46.207054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:46.207120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:46.207210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:46.207280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:46.207333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:46.207394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:46.207454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:46.207514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:46.207571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:46.207632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:46.207686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:46.207745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:46.207798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:46.207860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:46.207919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.207985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.208040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.208106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.208161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.208223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.208272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.208330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.208812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:46.256072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:46.271377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:46.271424Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:46.271443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:46.271463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:46.271487Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 314 [2:7559593269135017326:5050]
2025-10-10T14:02:46.271546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:46.271603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:46.271620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:46.271636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:46.271648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:46.271695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:46.271716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:46.271738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:46.288866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.288896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.288909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.288921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.288932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:46.290312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 314
2025-10-10T14:02:46.290409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 314
2025-10-10T14:02:46.290467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 314, pipe: [1:7559593270712934996:5422]
2025-10-10T14:02:46.289241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:46.289263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.289400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.289581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.289821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.289932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:46.290013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593270712934866:2442], now have 1 active actors on pipe
2025-10-10T14:02:46.290036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593270712934992:5549], now have 1 active actors on pipe
2025-10-10T14:02:46.290056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593270712934996:5422], now have 1 active actors on pipe
2025-10-10T14:02:46.290081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.290096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.290109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.290123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.290178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:46.290270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:46.290447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:46.290466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:46.290589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.290612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:46.290637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:46.290652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:46.290665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:46.290676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:46.290697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:46.295270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:46.295310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:46.295392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|741dec63-ff402bd8-5ee33995-6c544318_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:46.295427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:46.295456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:46.295467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:46.295502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:46.295545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:46.295593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:46.298978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:46.299018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:46.299098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:46.299528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 315 partition: 0 MaxSeqNo: 36 sessionId: src_id|741dec63-ff402bd8-5ee33995-6c544318_0
2025-10-10T14:02:46.303719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae3a15-efe141a8-103000bc-498380f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|741dec63-ff402bd8-5ee33995-6c544318_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:46.359630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741dec63-ff402bd8-5ee33995-6c544318_0] Write session: try to update token
2025-10-10T14:02:46.359685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741dec63-ff402bd8-5ee33995-6c544318_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:46.373247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:46.373279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:46.373290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:46.561804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:46.561835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:46.561847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:46.561966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:46.561980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:46.561994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:46.562005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:46.562015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:46.562052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.562078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.562103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.562127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.563513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:46.563549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:46.563582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:46.563615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:46.597156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId: src_id|741dec63-ff402bd8-5ee33995-6c544318_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:46.597452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:46.597503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.597516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:46.598809Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:46.638887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:46.758633Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:46.760475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:46.760498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:46.760548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593269135017318:5050]
2025-10-10T14:02:46.760710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:46.760740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:46.761105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:46.766689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:46.766859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:46.766874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:46.763502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:46.772816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593270712934996:5422]
2025-10-10T14:02:46.792978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 315 reason: error at write: Disconnected sessionId: src_id|741dec63-ff402bd8-5ee33995-6c544318_0
2025-10-10T14:02:46.793467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 315 sessionId: src_id|741dec63-ff402bd8-5ee33995-6c544318_0 is DEAD
2025-10-10T14:02:46.794989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741dec63-ff402bd8-5ee33995-6c544318_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:46.795052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741dec63-ff402bd8-5ee33995-6c544318_0] Write session will restart in 0.007213s
2025-10-10T14:02:46.795260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741dec63-ff402bd8-5ee33995-6c544318_0] Write session: Do CDS request
2025-10-10T14:02:46.795334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741dec63-ff402bd8-5ee33995-6c544318_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:46.808990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|741dec63-ff402bd8-5ee33995-6c544318_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:46.817987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:46.818017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 316
2025-10-10T14:02:46.826190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:46.826350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:46.826367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:46.826380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:46.834569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 316 sessionId:  describe result for acl check
2025-10-10T14:02:46.834708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:46.834719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:46.834731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:46.834749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593270712935043:5557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:46.843927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593270712935043:5557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:46.877573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593270712935093:5422]
2025-10-10T14:02:46.901795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593270712935043:5557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:46.950804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:46.948692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593270712935043:5557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:46.948737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593270712935043:5557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:46.948756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593270712935043:5557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:46.948791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:46.953805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:46.954874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:46.954903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:46.954955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:46.955252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:46.955463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593269135017505:5061]
2025-10-10T14:02:46.957909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:46.960430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:46.960679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:46.962153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:46.962544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:46.962553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:46.962561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:46.962570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:46.962578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:46.962587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:46.962595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:46.962603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:46.962612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.962620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.962628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.962636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.962690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:46.962813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:46.962867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:46.962921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:46.962970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:46.963023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:46.963073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:46.963124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:46.963175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.963232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.963286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.963339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.963384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:46.963459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:46.963527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:46.963589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:46.963647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:46.963707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:46.963758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:46.963817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:46.963870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:46.963932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:46.963982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:46.964038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:46.964090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:46.964149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:46.964200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:46.964259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:46.964313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.964375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:46.964427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.964486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:46.964538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.964594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:46.964643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.964700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:46.973367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:47.023475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:47.040956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:47.041010Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:47.041035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:47.041062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:47.041092Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 315 [2:7559593269135017505:5061]
2025-10-10T14:02:47.041186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:47.041252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:47.041271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:47.041289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:47.041302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:47.041358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:47.041383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:47.041406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:47.042855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.042873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:47.042889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:47.042905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:47.042918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:47.043200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:47.043221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.043386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:47.043608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:47.043874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:47.044010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:47.044083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.044099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.044114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.044127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.044171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:47.044260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:47.044460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:47.044479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:47.044602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.044625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:47.045448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:47.045463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:47.045474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:47.045485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:47.045508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:47.046035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593270712935028:2442], now have 1 active actors on pipe
2025-10-10T14:02:47.046073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593270712935093:5422], now have 1 active actors on pipe
2025-10-10T14:02:47.046097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593270712935174:5557], now have 1 active actors on pipe
2025-10-10T14:02:47.049428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 315
2025-10-10T14:02:47.049533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 315, pipe: [1:7559593270712935093:5422]
2025-10-10T14:02:47.049613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 315
2025-10-10T14:02:47.053571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:47.053616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:47.053703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:47.053739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:47.053759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:47.053771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:47.053808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:47.053853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:47.053901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:47.059576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:47.059619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:47.059705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:47.060262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 316 partition: 0 MaxSeqNo: 36 sessionId: src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0
2025-10-10T14:02:47.061194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|741dec63-ff402bd8-5ee33995-6c544318_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:47.103404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0] Write session: try to update token
2025-10-10T14:02:47.103465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:47.188916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:47.188948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:47.188983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.189107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:47.189119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:47.189149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:47.189274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:02:47.189292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:47.198744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:02:47.210841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:47.211729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:47.212571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:47.225726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:02:47.265855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:02:47.266016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:47.266035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:47.266052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:47.266064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:47.266077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:47.266121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.266151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.266194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.266220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593269135017499:5061]
2025-10-10T14:02:47.266375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:47.266404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.266417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:47.267476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:47.269345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:47.269411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:47.269452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:47.269484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:47.296443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId: src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:47.317337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:47.422801Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:47.424554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:47.424585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:47.425388Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:47.426390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:47.427815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:47.428093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593270712935093:5422]
2025-10-10T14:02:47.487083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 316 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0
2025-10-10T14:02:47.487453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 316 sessionId: src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0 is DEAD
2025-10-10T14:02:47.493344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:47.493389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0] Write session will restart in 0.008620s
2025-10-10T14:02:47.493491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0] Write session: Do CDS request
2025-10-10T14:02:47.493521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:47.517611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:47.517638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 317
2025-10-10T14:02:47.518098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:47.520128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:47.520267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:47.520286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:47.520299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:47.524310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 317 sessionId:  describe result for acl check
2025-10-10T14:02:47.524441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:47.524453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:47.524464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:47.524482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593275007902562:5564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:47.542016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593275007902583:5422]
2025-10-10T14:02:47.542069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593275007902562:5564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:47.556829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593275007902562:5564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:47.570271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593275007902562:5564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:47.570310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593275007902562:5564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:47.571877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593275007902562:5564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:47.571930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:47.579734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:47.583421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:47.584410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:47.584430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:47.584475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:47.584760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:47.584966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593273429984944:5063]
2025-10-10T14:02:47.591661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:47.594252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:47.594532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:47.595928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:47.596270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:47.596278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:47.596285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:47.596294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:47.596302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:47.596310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:47.596319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:47.596327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:47.596335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.596343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:47.596351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:47.596359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:47.596411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:47.596534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:47.596590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:47.596643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:47.596693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:47.596746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:47.596798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:47.596850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:47.596900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.596956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:47.597007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:47.597057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:47.597102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:47.599849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:47.599941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:47.600014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:47.600074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:47.600137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:47.600193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:47.600252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:47.600318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:47.600380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:47.600439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:47.600504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:47.600563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:47.600628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:47.600683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:47.600744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:47.600816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.600880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.600934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:47.600997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:47.601053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:47.601111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:47.601176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:47.601249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:47.601770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:47.642975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:47.678528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:47.678567Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:47.678582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:47.678600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:47.678619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 316 [2:7559593273429984944:5063]
2025-10-10T14:02:47.678673Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:47.678721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:47.678738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:47.678750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:47.678762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:47.678807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:47.678827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:47.678850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:47.693253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.693304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:47.693320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:47.693335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:47.693346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:47.693701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:47.693719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.693860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:47.694050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:47.694308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:47.694442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:47.694517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:47.694533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:47.694546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:47.694560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:47.694598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:47.694676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:47.694867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:47.694884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:47.695012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:47.695034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:47.699936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 316, pipe: [1:7559593275007902583:5422]
2025-10-10T14:02:47.700048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 316
2025-10-10T14:02:47.700118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 316
2025-10-10T14:02:47.697729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:47.697749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:47.697761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:47.697773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:47.697798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:47.701854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593275007902631:5564], now have 1 active actors on pipe
2025-10-10T14:02:47.701899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593275007902497:2442], now have 1 active actors on pipe
2025-10-10T14:02:47.701924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593275007902583:5422], now have 1 active actors on pipe
2025-10-10T14:02:47.701981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:47.702007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:47.702099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:47.702132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:47.702153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:47.702163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:47.702216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:47.702261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:47.702315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:47.714899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:47.714947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:47.716149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:47.717617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 317 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0
2025-10-10T14:02:47.718501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6083f0a9-fc8bc67d-3294d777-e304ab8d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:47.762035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0] Write session: try to update token
2025-10-10T14:02:47.762095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:47.782272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:47.782308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:47.782322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:47.900818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:47.900849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:47.900860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:47.900868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:47.900877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:47.900911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:47.900934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:47.900957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:47.900975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:47.901143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:47.901155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:47.901164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:47.901294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:47.901328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:47.901340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:47.901665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:47.901705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:47.901730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:47.901755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:47.902497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:47.963576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId: src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:47.992281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:48.136202Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:48.168145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:48.168190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:48.168261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:48.168275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:48.168319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593273429984939:5063]
2025-10-10T14:02:48.168863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:48.169609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:48.169633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:48.171721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:48.215265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:48.215410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593275007902583:5422]
2025-10-10T14:02:48.215490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 317 reason: error at write: Disconnected sessionId: src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0
2025-10-10T14:02:48.215842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 317 sessionId: src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0 is DEAD
2025-10-10T14:02:48.217377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:48.217440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0] Write session will restart in 0.006213s
2025-10-10T14:02:48.217588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0] Write session: Do CDS request
2025-10-10T14:02:48.217635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:48.237973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:48.250779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:48.250807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 318
2025-10-10T14:02:48.251721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:48.251839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:48.251854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:48.251863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:48.253808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 318 sessionId:  describe result for acl check
2025-10-10T14:02:48.253914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:48.253924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:48.253933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:48.253952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593279302869995:5576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:48.256450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593279302869995:5576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:48.277715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593279302869995:5576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:48.296220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593279302869995:5576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:48.296264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593279302869995:5576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:48.296280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593279302869995:5576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:48.296312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:48.314312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593279302870121:5422]
2025-10-10T14:02:48.329082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:48.357353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:48.358490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:48.358511Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:48.358564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:48.358884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:48.359086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593277724952435:5073]
2025-10-10T14:02:48.371105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:48.377926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:48.378257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:48.379621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:48.379962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:48.379970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:48.379977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:48.379983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:48.379991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:48.379998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:48.380004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:48.380011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:48.380017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:48.380023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:48.380030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:48.380037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:48.380087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:48.380190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:48.380238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:48.380285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:48.380331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:48.380379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:48.380423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:48.380470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:48.380516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:48.380564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:48.380606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:48.380651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:48.380692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:48.380757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:48.380814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:48.380868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:48.380914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:48.380966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:48.381010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:48.381061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:48.381105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:48.381985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:48.382047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:48.382103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:48.382150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:48.382217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:48.382262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:48.382315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:48.382387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:48.382444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:48.382491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:48.382548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:48.382593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:48.382643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:48.382703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:48.382755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:48.383216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:48.453411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:48.484067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:48.484121Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:48.484139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:48.484159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:48.484186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 317 [2:7559593277724952435:5073]
2025-10-10T14:02:48.484248Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:48.484327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:48.484343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:48.484355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:48.484366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:48.484424Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:48.484448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:48.484471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:48.486316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:48.486333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:48.486348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:48.486360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:48.486373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:48.487830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:48.487859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:48.488004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:48.488183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:48.488411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:48.488520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:48.488565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593279302870116:5576], now have 1 active actors on pipe
2025-10-10T14:02:48.488590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593279302870121:5422], now have 1 active actors on pipe
2025-10-10T14:02:48.488613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593279302869985:2442], now have 1 active actors on pipe
2025-10-10T14:02:48.488686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:48.488700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:48.488714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:48.488727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:48.488772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:48.488856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:48.489029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:48.489048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:48.489209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:48.489229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:48.489922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:48.489939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:48.489951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:48.489961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:48.489985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:48.490172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 317
2025-10-10T14:02:48.490318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 317
2025-10-10T14:02:48.491070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:48.490380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 317, pipe: [1:7559593279302870121:5422]
2025-10-10T14:02:48.491100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:48.491182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:48.491215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:48.491233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:48.491243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:48.491280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:48.491341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:48.491390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:48.495431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:48.495465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:48.495546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:48.495988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 318 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0
2025-10-10T14:02:48.497441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac10fe0f-6e1e58aa-3353d22e-3a9ad64d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:48.575264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0] Write session: try to update token
2025-10-10T14:02:48.575330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:48.586288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:48.586320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:48.586332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:48.799631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:48.799667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:48.799682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:48.799695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:48.799707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:48.799745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:48.799771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:48.799796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:48.799818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:48.799984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:48.799997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:48.800010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:48.800119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:48.800145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:48.800156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:48.801260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:48.801293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:48.801319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:48.801346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:48.813356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:48.913488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId: src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:48.952732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:49.070152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:49.138241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:49.138291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:49.138357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:49.138371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:49.138415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593277724952418:5073]
2025-10-10T14:02:49.138633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:49.140875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:49.141560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593279302870121:5422]
2025-10-10T14:02:49.141632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:49.141752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:49.141764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:49.147469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 318 reason: error at write: Disconnected sessionId: src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0
2025-10-10T14:02:49.148871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 318 sessionId: src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0 is DEAD
2025-10-10T14:02:49.159404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:49.159449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0] Write session will restart in 0.007992s
2025-10-10T14:02:49.159551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0] Write session: Do CDS request
2025-10-10T14:02:49.159579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:49.190973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:49.196705Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:49.196738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 319
2025-10-10T14:02:49.202019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:49.202157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:49.202172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:49.202184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:49.203793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 319 sessionId:  describe result for acl check
2025-10-10T14:02:49.203896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:49.203906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:49.203915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:49.203934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593283597837471:5585] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:49.206413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593283597837471:5585] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:49.249267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593283597837523:5422]
2025-10-10T14:02:49.254935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593283597837471:5585] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:49.281395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593283597837471:5585] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:49.281442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593283597837471:5585] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:49.281461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593283597837471:5585] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:49.281497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:49.298758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:49.310666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:49.311617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:49.311635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:49.311682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:49.311968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:49.312156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593282019919889:5084]
2025-10-10T14:02:49.314823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:49.316021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:49.316249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:49.317580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:49.317924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:49.317934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:49.317942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:49.317951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:49.317960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:49.317967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:49.317974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:49.317983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:49.317989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:49.317997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:49.318005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:49.318012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:49.318062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:49.318178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:49.318248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:49.318302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:49.318358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:49.318409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:49.318460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:49.318513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:49.318563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:49.318614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:49.318664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:49.318710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:49.318751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:49.318822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:49.318883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:49.318944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:49.318997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:49.319056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:49.319105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:49.319158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:49.319211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:49.319270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:49.319319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:49.319379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:49.319430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:49.319487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:49.319537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:49.319593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:49.319644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:49.319700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:49.319746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:49.319806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:49.319857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:49.319914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:49.319961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:49.320018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:49.320492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:49.377789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:49.434963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:49.435009Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:49.435026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:49.435045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:49.435069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 318 [2:7559593282019919889:5084]
2025-10-10T14:02:49.435126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:49.435182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:49.435197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:49.435209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:49.435220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:49.435422Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:49.435449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:49.435469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:49.496111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:49.496380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:49.496397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:49.496407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:49.496417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:49.496687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:49.496718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:49.496847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:49.497026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:49.497266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:49.497382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:49.497450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.497465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.497478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.497490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.497520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:49.497603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:49.497606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:49.497620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:49.497630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:49.497642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:49.497789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:49.497805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:49.497849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593283597837444:2442], now have 1 active actors on pipe
2025-10-10T14:02:49.497872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593283597837523:5422], now have 1 active actors on pipe
2025-10-10T14:02:49.497894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593283597837591:5585], now have 1 active actors on pipe
2025-10-10T14:02:49.497999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.498031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:49.501654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:49.502740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 318
2025-10-10T14:02:49.502823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 318, pipe: [1:7559593283597837523:5422]
2025-10-10T14:02:49.502900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 318
2025-10-10T14:02:49.505545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:49.505587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:49.505688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:49.505727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:49.505745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:49.505754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:49.505795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:49.505841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:49.505896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:49.513344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:49.513388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:49.513474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:49.516103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 319 partition: 0 MaxSeqNo: 36 sessionId: src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0
2025-10-10T14:02:49.526164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6d1f4b-4ac2cd8d-761742ae-af159c2e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:49.528673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:49.528708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:49.528719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:49.592906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0] Write session: try to update token
2025-10-10T14:02:49.592964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:49.675374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:49.675404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:49.675415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:49.675521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:49.675535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:49.675549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:49.675560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:49.675571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:49.675603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.675624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.675639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.675654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.677189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:49.677241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:49.677291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:49.677337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:49.712523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:49.712583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:49.712595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:49.718138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:49.752482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId: src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:49.774729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:49.896082Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:49.899326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:49.899354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:49.899399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593282019919884:5084]
2025-10-10T14:02:49.899536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:49.899561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:49.901333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:49.903150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:49.907564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:49.907766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593283597837523:5422]
2025-10-10T14:02:49.907841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:49.951213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 319 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0
2025-10-10T14:02:49.951506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 319 sessionId: src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0 is DEAD
2025-10-10T14:02:49.953486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:49.953525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0] Write session will restart in 0.007823s
2025-10-10T14:02:49.953626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0] Write session: Do CDS request
2025-10-10T14:02:49.953657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:49.967640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:49.977373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:49.977401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 320
2025-10-10T14:02:49.977908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:49.978036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:49.978052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:49.978063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:49.981664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 320 sessionId:  describe result for acl check
2025-10-10T14:02:49.981787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:49.981799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:49.981809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:49.981826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593283597837698:5600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:49.984475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593283597837698:5600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:50.007659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593287892805056:5422]
2025-10-10T14:02:50.010942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593283597837698:5600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:50.012208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:50.013937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:50.014897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:50.014916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:50.014973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:50.015249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:50.015729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593286314887363:5094]
2025-10-10T14:02:50.018338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:50.019662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:50.019895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:50.021228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:50.021588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:50.021609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:50.021618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:50.021625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:50.021633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:50.021640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:50.021648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:50.021656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:50.021664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.021672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.021679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.021686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.021734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:50.021847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:50.021902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:50.021954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:50.022002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:50.022052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:50.022100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:50.022151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:50.022199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.022268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.022318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.022364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.022409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:50.022480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:50.022543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:50.022604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:50.022652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:50.022709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:50.022758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:50.022813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:50.022864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:50.022921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:50.023153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:50.023214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:50.023263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:50.023319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:50.023366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:50.023439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:50.023496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.023552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.023601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.023655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.023705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.023762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.023810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.023865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.024339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:50.024176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593283597837698:5600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:50.024213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593283597837698:5600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:50.024231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593283597837698:5600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:50.024260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:50.068620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:50.084306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:50.084355Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:50.084372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:50.084394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:50.084418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 319 [2:7559593286314887363:5094]
2025-10-10T14:02:50.084477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:50.084540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:50.084556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:50.084569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:50.084582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:50.084636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:50.084659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:50.084681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:50.115873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.115902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.115913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.115925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.115935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:50.116204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:50.116221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.116343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.116492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.116685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.116790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:50.116859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.116872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.116885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.116896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.116943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:50.117022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:50.117141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:50.117160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:50.117174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:50.117186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:50.118147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 319
2025-10-10T14:02:50.118251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 319, pipe: [1:7559593287892805056:5422]
2025-10-10T14:02:50.118322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 319
2025-10-10T14:02:50.123179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:50.123217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:50.123395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593287892805056:5422], now have 1 active actors on pipe
2025-10-10T14:02:50.123419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593287892805070:5600], now have 1 active actors on pipe
2025-10-10T14:02:50.123441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593283597837626:2442], now have 1 active actors on pipe
2025-10-10T14:02:50.123511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:50.123534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:50.123572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.123613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:50.123755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|250f0de1-c681995b-b73ae112-516be98a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:50.123789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:50.123811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:50.123805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:50.123822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:50.123864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:50.123908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:50.123990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:50.125293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:50.125331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:50.125425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:50.130072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 320 partition: 0 MaxSeqNo: 36 sessionId: src_id|250f0de1-c681995b-b73ae112-516be98a_0
2025-10-10T14:02:50.133381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6af47c-a1a2b6b8-dd9dd7ed-e5366d09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|250f0de1-c681995b-b73ae112-516be98a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:50.185163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:50.185195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:50.185208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:50.240102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250f0de1-c681995b-b73ae112-516be98a_0] Write session: try to update token
2025-10-10T14:02:50.240160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250f0de1-c681995b-b73ae112-516be98a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:50.402539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:50.402575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:50.402588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:50.402645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:50.402661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:50.402674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:50.402685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:50.402695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:50.402733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.402760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.402783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.402806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.403012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:50.403045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.403056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:50.404029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:50.405432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:50.405473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:50.405504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:50.405531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:50.447311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId: src_id|250f0de1-c681995b-b73ae112-516be98a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:50.505267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:50.642320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:50.669888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:50.669934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:50.669999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:50.670011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:50.670051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593286314887358:5094]
2025-10-10T14:02:50.670593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:50.671619Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:50.676577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593287892805056:5422]
2025-10-10T14:02:50.676760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:50.679298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:50.683696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 320 reason: status is not ok: tablet will be restarted right now sessionId: src_id|250f0de1-c681995b-b73ae112-516be98a_0
2025-10-10T14:02:50.706607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250f0de1-c681995b-b73ae112-516be98a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:50.706675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250f0de1-c681995b-b73ae112-516be98a_0] Write session will restart in 0.008413s
2025-10-10T14:02:50.706865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250f0de1-c681995b-b73ae112-516be98a_0] Write session: Do CDS request
2025-10-10T14:02:50.706923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250f0de1-c681995b-b73ae112-516be98a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:50.705561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 320 sessionId: src_id|250f0de1-c681995b-b73ae112-516be98a_0 is DEAD
2025-10-10T14:02:50.720249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:50.720279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 321
2025-10-10T14:02:50.721302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|250f0de1-c681995b-b73ae112-516be98a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:50.727969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:50.728129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:50.728152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:50.728163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:50.731933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 321 sessionId:  describe result for acl check
2025-10-10T14:02:50.732053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:50.732065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:50.732075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:50.732093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593287892805122:5606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:50.734986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593287892805122:5606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:50.771674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593287892805160:5422]
2025-10-10T14:02:50.779495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593287892805122:5606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:50.826556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593287892805122:5606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:50.826602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593287892805122:5606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:50.826621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593287892805122:5606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:50.826652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:50.881603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:50.882150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:50.882896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:50.882917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:50.882962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:50.883217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:50.883404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593286314887528:5103]
2025-10-10T14:02:50.886129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:50.887705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:50.887922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:50.889176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:50.889494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:50.889506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:50.889514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:50.889522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:50.889528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:50.889533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:50.889539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:50.889546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:50.889553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.889560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.889566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.889572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.889617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:50.889721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:50.889769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:50.889817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:50.889860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:50.889902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:50.889944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:50.889988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:50.890039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.890085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.890128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.890169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.890211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:50.890292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:50.890349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:50.890403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:50.890450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:50.890503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:50.890548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:50.890601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:50.890651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:50.890703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:50.890747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:50.890796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:50.890841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:50.890893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:50.890937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:50.890987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:50.891032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.891082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.891125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.891173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.891221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.891271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.891312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.891359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.891778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:50.920400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:50.963481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:50.963530Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:50.963547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:50.963568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:50.963593Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 320 [2:7559593286314887528:5103]
2025-10-10T14:02:50.963650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:50.963713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:50.963729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:50.963740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:50.963752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:50.963798Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:50.963820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:50.963841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:50.979792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 320, pipe: [1:7559593287892805160:5422]
2025-10-10T14:02:50.978238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.978294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.979894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 320
2025-10-10T14:02:50.978310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.979969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 320
2025-10-10T14:02:50.978323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.978334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:50.978633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:50.978651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:50.978792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:50.978968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:50.979176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:50.979286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:50.979376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593287892805160:5422], now have 1 active actors on pipe
2025-10-10T14:02:50.979399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593287892805107:2442], now have 1 active actors on pipe
2025-10-10T14:02:50.979423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593287892805219:5606], now have 1 active actors on pipe
2025-10-10T14:02:50.979449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:50.979463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:50.979478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:50.979489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:50.979536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:50.979623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:50.979806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:50.979824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:50.979952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:50.979973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:50.980295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:50.980310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:50.980321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:50.980333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:50.980358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:50.983587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:50.983627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:50.983711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:50.983747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:50.983766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:50.983794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:50.983832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:50.983877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:50.983924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:50.984721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:50.984749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:50.984810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:50.985215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 321 partition: 0 MaxSeqNo: 36 sessionId: src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0
2025-10-10T14:02:50.986122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|250f0de1-c681995b-b73ae112-516be98a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:51.060147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0] Write session: try to update token
2025-10-10T14:02:51.060209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:51.062049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:51.062078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:51.062090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:51.195146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:51.195179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:51.195190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:51.195249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:51.195263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:51.195277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:51.195287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:51.195297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:51.195332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:51.195356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:51.195377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:51.195395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:51.195579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:51.195611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:51.195621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:51.196631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:51.197426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:51.197471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:51.197497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:51.197523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:51.287165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId: src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:51.310284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:51.502153Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:51.530904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:51.530952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:51.531017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:51.531030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:51.531072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593286314887523:5103]
2025-10-10T14:02:51.531908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:51.534910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:51.535522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593287892805160:5422]
2025-10-10T14:02:51.535599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:51.535710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:51.535721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:51.557362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:51.557406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0] Write session will restart in 0.009004s
2025-10-10T14:02:51.557509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0] Write session: Do CDS request
2025-10-10T14:02:51.557538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:51.555665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 321 reason: error at write: Disconnected sessionId: src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0
2025-10-10T14:02:51.556035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 321 sessionId: src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0 is DEAD
2025-10-10T14:02:51.577498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:51.633998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593292187772697:5422]
2025-10-10T14:02:51.634034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:51.634043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 322
2025-10-10T14:02:51.634378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:51.634452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:51.634462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:51.634470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:51.636601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 322 sessionId:  describe result for acl check
2025-10-10T14:02:51.636719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:51.636730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:51.636740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:51.636756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593292187772709:5621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:51.639548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593292187772709:5621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:51.661640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593292187772709:5621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:51.663348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:51.670473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:51.671381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:51.671412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:51.671459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:51.671742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:51.671937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593290609854997:5113]
2025-10-10T14:02:51.674215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:51.676183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:51.676412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:51.677776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:51.678094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:51.678108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:51.678115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:51.678121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:51.678128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:51.678135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:51.678141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:51.678147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:51.678153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:51.678159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:51.678165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:51.678171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:51.678210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:51.678316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:51.678356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:51.678396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:51.678438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:51.678479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:51.678516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:51.678554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:51.678592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:51.678632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:51.678668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:51.678707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:51.678743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:51.678799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:51.678847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:51.678896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:51.678939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:51.678988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:51.679025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:51.679069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:51.679112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:51.679159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:51.679199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:51.679248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:51.679292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:51.679337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:51.679375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:51.679422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:51.679467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:51.679513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:51.679552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:51.679598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:51.679636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:51.679682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:51.679721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:51.679764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:51.680140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:51.682783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593292187772709:5621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:51.682824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593292187772709:5621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:51.682841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593292187772709:5621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:51.682875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:51.753700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:51.774634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:51.774681Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:51.774695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:51.774714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:51.774737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 321 [2:7559593290609854997:5113]
2025-10-10T14:02:51.774787Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:51.774845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:51.774860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:51.774873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:51.774885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:51.774933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:51.774955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:51.774975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:51.777111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:51.777535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:51.777556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:51.777568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:51.777577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:51.777892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:51.777909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:51.778037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:51.778200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:51.778439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:51.778547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:51.779025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:51.779045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:51.779058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:51.779069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:51.779110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:51.779211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593292187772754:5621], now have 1 active actors on pipe
2025-10-10T14:02:51.779243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:51.779416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:51.779436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:51.779469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593292187772697:5422], now have 1 active actors on pipe
2025-10-10T14:02:51.779492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593292187772609:2442], now have 1 active actors on pipe
2025-10-10T14:02:51.779610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:51.779629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:51.780765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:51.780785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:51.780797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:51.780808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:51.780835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:51.784416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 321
2025-10-10T14:02:51.784524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 321
2025-10-10T14:02:51.784581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 321, pipe: [1:7559593292187772697:5422]
2025-10-10T14:02:51.789294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:51.789342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:51.789428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3861cceb-caa10661-25003766-2b79af1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:51.789466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:51.789494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:51.789504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:51.789543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:51.789598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:51.789660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:51.797254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:51.797297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:51.797382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:51.797779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 322 partition: 0 MaxSeqNo: 36 sessionId: src_id|3861cceb-caa10661-25003766-2b79af1b_0
2025-10-10T14:02:51.798600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e987af2c-38da83f3-5b3758d4-d188e2ef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3861cceb-caa10661-25003766-2b79af1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:51.852656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3861cceb-caa10661-25003766-2b79af1b_0] Write session: try to update token
2025-10-10T14:02:51.852716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3861cceb-caa10661-25003766-2b79af1b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:52.065114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:52.065171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:52.065184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:52.065257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:52.065272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:52.065286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:52.065298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:52.065309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:52.065346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:52.065373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:52.065398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:52.065423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:52.065643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:52.065670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:52.065682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:52.066827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:52.069340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:52.069392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:52.069422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:52.069454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:52.076984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId: src_id|3861cceb-caa10661-25003766-2b79af1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:52.126766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:52.467212Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:52.497037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:52.505309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:52.505447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:52.505462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:52.505509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593290609854992:5113]
2025-10-10T14:02:52.506160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:52.510063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:52.507520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593292187772697:5422]
2025-10-10T14:02:52.507605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:52.507843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:52.507856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:52.609402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593296482740174:5422]
2025-10-10T14:02:52.627377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 322 reason: error at write: Disconnected sessionId: src_id|3861cceb-caa10661-25003766-2b79af1b_0
2025-10-10T14:02:52.627752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 322 sessionId: src_id|3861cceb-caa10661-25003766-2b79af1b_0 is DEAD
2025-10-10T14:02:52.637403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3861cceb-caa10661-25003766-2b79af1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:52.637471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3861cceb-caa10661-25003766-2b79af1b_0] Write session will restart in 0.006405s
2025-10-10T14:02:52.637616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3861cceb-caa10661-25003766-2b79af1b_0] Write session: Do CDS request
2025-10-10T14:02:52.637666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3861cceb-caa10661-25003766-2b79af1b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:52.645929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:52.649717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:52.649748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 323
2025-10-10T14:02:52.653982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3861cceb-caa10661-25003766-2b79af1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:52.657709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:52.657873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:52.657892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:52.657904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:52.657838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:52.658848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:52.658867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:52.658918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:52.659201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:52.659389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593294904822479:5124]
2025-10-10T14:02:52.662175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:52.659580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 323 sessionId:  describe result for acl check
2025-10-10T14:02:52.659705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:52.659715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:52.659725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:52.659743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593296482740209:5631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:52.662317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593296482740209:5631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:52.666614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:52.666881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:52.668175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:52.668519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:52.668528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:52.668534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:52.668541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:52.668547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:52.668553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:52.668559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:52.668566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:52.668573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:52.668579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:52.668587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:52.668594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:52.668642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:52.668752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:52.668804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:52.668850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:52.668894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:52.668941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:52.668986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:52.669029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:52.669072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:52.669120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:52.669188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:52.669234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:52.669277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:52.669339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:52.669397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:52.669447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:52.669493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:52.669544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:52.669589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:52.669638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:52.669682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:52.669733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:52.669778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:52.669829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:52.669875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:52.669926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:52.669968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:52.670015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:52.670061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:52.670111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:52.670156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:52.670206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:52.670251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:52.670319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:52.670361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:52.670412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:52.670847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:52.707824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593296482740209:5631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:52.743225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593296482740209:5631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:52.743267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593296482740209:5631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:52.743284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593296482740209:5631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:52.743315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:52.763999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:52.869703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:52.869757Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:52.869776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:52.869796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:52.869821Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 322 [2:7559593294904822479:5124]
2025-10-10T14:02:52.869878Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:52.869942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:52.869958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:52.869970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:52.869981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:52.870027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:52.870051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:52.870071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:52.872255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:52.872267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:52.872281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:52.872294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:52.872303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:52.872543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:52.872554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:52.872664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:52.872840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:52.873052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:52.873175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:52.873268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:52.873284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:52.873306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:52.873319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:52.873356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:52.873469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:52.873516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:52.873527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:52.873537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:52.873546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:52.873647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:52.873663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:52.873830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593296482740174:5422], now have 1 active actors on pipe
2025-10-10T14:02:52.873852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593296482740242:5631], now have 1 active actors on pipe
2025-10-10T14:02:52.873874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593296482740086:2442], now have 1 active actors on pipe
2025-10-10T14:02:52.873892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:52.873920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:52.875454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 322, pipe: [1:7559593296482740174:5422]
2025-10-10T14:02:52.875561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 322
2025-10-10T14:02:52.875629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 322
2025-10-10T14:02:52.875767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:52.884035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:52.884078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:52.884187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:52.884244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:52.884265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:52.884277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:52.884317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:52.884367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:52.884426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:52.899591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:52.899637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:52.899727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:52.900196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 323 partition: 0 MaxSeqNo: 36 sessionId: src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0
2025-10-10T14:02:52.902410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3861cceb-caa10661-25003766-2b79af1b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:52.973225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:52.973259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:52.973274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:52.999229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0] Write session: try to update token
2025-10-10T14:02:52.999288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:53.159226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:53.159262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:53.159276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:53.159286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:53.159296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:53.159330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:53.159355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:53.159377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:53.159397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:53.159555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:53.159567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:53.159576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:53.161365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:53.161400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:53.161427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:53.161455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:53.204497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:53.204548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:53.204558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:53.213733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:53.230598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId: src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:53.288182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:53.483646Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:53.492091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:53.492122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:53.492169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593294904822473:5124]
2025-10-10T14:02:53.492318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:53.492342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:53.492955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:53.492981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:53.497310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593296482740174:5422]
2025-10-10T14:02:53.497412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:02:53.518558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 323 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0
2025-10-10T14:02:53.518933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 323 sessionId: src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0 is DEAD
2025-10-10T14:02:53.525318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:02:53.525355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0] Write session will restart in 0.009245s
2025-10-10T14:02:53.525448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0] Write session: Do CDS request
2025-10-10T14:02:53.525475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:53.540858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:53.577031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:53.577444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:53.577462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 324
2025-10-10T14:02:53.580252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:53.580366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:53.580381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:53.580391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:53.596848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 324 sessionId:  describe result for acl check
2025-10-10T14:02:53.596969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:53.596983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:53.596992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:53.597009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593300777707616:5643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:53.599644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593300777707616:5643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:53.603413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593300777707629:5422]
2025-10-10T14:02:53.629942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:02:53.629991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 7
2025-10-10T14:02:53.646780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593300777707616:5643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:53.668136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:53.670926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:53.671812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:53.671830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:53.671881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:53.672152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:53.672341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593299199789970:5134]
2025-10-10T14:02:53.674382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:53.675463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:53.675688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:53.676856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:53.677365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:53.677374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:53.677381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:53.677386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:53.677393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:53.677400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:53.677408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:53.677415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:53.677421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:53.677426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:53.677432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:53.677439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:53.677485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:53.677588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:53.677637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:53.677680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:53.677722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:53.677765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:53.677807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:53.677852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:53.677894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:53.677942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:53.677985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:53.678030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:53.678069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:53.678134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:53.678190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:53.678245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:53.678290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:53.678380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:53.678423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:53.678477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:53.678521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:53.678573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:53.678614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:53.678665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:53.678708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:53.678755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:53.678795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:53.678846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:53.678891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:53.678940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:53.678982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:53.679033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:53.679076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:53.679124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:53.679167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:53.679216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:53.679632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:53.686601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593300777707616:5643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:53.686640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593300777707616:5643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:53.686660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593300777707616:5643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:53.686694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:53.727932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:53.817941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:53.817985Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:53.818004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:53.818024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:53.818049Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 323 [2:7559593299199789970:5134]
2025-10-10T14:02:53.818105Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:53.818168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:53.818183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:53.818193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:53.818204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:53.818252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:53.818276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:53.818299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:53.819923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:53.819941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:53.819956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:53.819970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:53.819982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:53.820283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:53.820303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:53.820458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:53.820663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:53.820899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:53.821009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:53.821083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593299199789965:5134]
2025-10-10T14:02:53.821100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593299199789965:5134]
2025-10-10T14:02:53.821112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593299199789965:5134]
2025-10-10T14:02:53.821140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593299199789965:5134]
2025-10-10T14:02:53.821182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:53.821266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:53.821445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:53.821461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:53.821585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593299199789965:5134]
2025-10-10T14:02:53.821604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:53.822663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:53.822679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:53.822689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:53.822699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:53.822721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:53.825272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 323, pipe: [1:7559593300777707629:5422]
2025-10-10T14:02:53.825373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 323
2025-10-10T14:02:53.825611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 323
2025-10-10T14:02:53.825691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593300777707591:2442], now have 1 active actors on pipe
2025-10-10T14:02:53.825719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593300777707629:5422], now have 1 active actors on pipe
2025-10-10T14:02:53.825740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593300777707735:5643], now have 1 active actors on pipe
2025-10-10T14:02:53.825782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:53.825802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:53.825872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:53.825905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:53.825922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:53.825930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:53.825967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:53.826013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:53.826057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:53.826620Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:02:53.826787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:53.826803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:53.826858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:53.828844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef181ffe-abaa43ff-3dfa5183-e2a39f35_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:53.827651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 7 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:02:53.827783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:02:53.827954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 324 partition: 0 MaxSeqNo: 36 sessionId: src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0
2025-10-10T14:02:53.915043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0] Write session: try to update token
2025-10-10T14:02:53.915108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:53.922694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:53.922730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:53.922744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:54.077682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:54.077712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:54.077725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:54.077779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:54.077793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:54.077805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:54.077816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:54.077827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:54.077865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593299199789965:5134]
2025-10-10T14:02:54.077892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593299199789965:5134]
2025-10-10T14:02:54.077916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593299199789965:5134]
2025-10-10T14:02:54.077940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593299199789965:5134]
2025-10-10T14:02:54.078083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:54.078112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:54.078124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:54.079211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:54.081383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:54.081418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:54.081454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:54.081494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:54.214850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId: src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:54.282669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:54.340179Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:54.342320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:54.342374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:54.346926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593300777707629:5422]
2025-10-10T14:02:54.347025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:54.347037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:54.349292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:54.350128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:54.446576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593305072675094:5422]
2025-10-10T14:02:54.563060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 324 reason: error at write: Disconnected sessionId: src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0
2025-10-10T14:02:54.563406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 324 sessionId: src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0 is DEAD
2025-10-10T14:02:54.569840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:54.569886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0] Write session will restart in 0.007172s
2025-10-10T14:02:54.569989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0] Write session: Do CDS request
2025-10-10T14:02:54.570021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:54.575755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:54.588837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:54.589909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:54.589942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 325
2025-10-10T14:02:54.590396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:54.590504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:54.590518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:54.590529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:54.591909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 325 sessionId:  describe result for acl check
2025-10-10T14:02:54.592024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:54.592032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:54.592040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:54.592055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593305072675186:5653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:54.594253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593305072675186:5653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:54.594119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:54.594957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:54.594977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:54.595026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:54.595284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:54.595466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593303494757437:5146]
2025-10-10T14:02:54.601602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:54.605432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593305072675186:5653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:54.606868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:54.607119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:54.608402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:54.608734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:54.608742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:54.608749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:54.608755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:54.608761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:54.608768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:54.608777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:54.608784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:54.608791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:54.608798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:54.608807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:54.608813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:54.608860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:54.608968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:54.609018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:54.609067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:54.609113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:54.609190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:54.609235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:54.609279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:54.609326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:54.609372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:54.609414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:54.609457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:54.609498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:54.609563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:54.609619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:54.609673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:54.609719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:54.609772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:54.609814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:54.609870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:54.609916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:54.609966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:54.610010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:54.610061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:54.610105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:54.610156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:54.610200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:54.610253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:54.610298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:54.610369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:54.610416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:54.610471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:54.610515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:54.610569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:54.610611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:54.610661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:54.621271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:54.639304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593305072675186:5653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:54.639351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593305072675186:5653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:54.639370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593305072675186:5653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:54.639401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:54.695325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:54.736660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:54.745242Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:54.745278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:54.745300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:54.745326Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 324 [2:7559593303494757437:5146]
2025-10-10T14:02:54.745388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:54.745446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:54.745462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:54.745476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:54.745488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:54.745542Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:54.745565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:54.745590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:54.842526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:54.842564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:54.842577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:54.842592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:54.842604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:54.842898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:54.842915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:54.843053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:54.843228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:54.843441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:54.843551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:54.843631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:54.843647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:54.843659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:54.843674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:54.843718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:54.843798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:54.843972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:54.843990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:54.844126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:54.844144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:54.847219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 324, pipe: [1:7559593305072675094:5422]
2025-10-10T14:02:54.847316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 324
2025-10-10T14:02:54.847398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 324
2025-10-10T14:02:54.844922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:54.844940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:54.844951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:54.844962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:54.844986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:54.848703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593305072675222:5653], now have 1 active actors on pipe
2025-10-10T14:02:54.848745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593305072675094:5422], now have 1 active actors on pipe
2025-10-10T14:02:54.848765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593305072675072:2442], now have 1 active actors on pipe
2025-10-10T14:02:54.848808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:54.848820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:54.848830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:54.848925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:54.848948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:54.849028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|872aa3c4-f4d031f-5d576990-14e191f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:54.849054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:54.849072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:54.849081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:54.849117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:54.849166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:54.849218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:54.855519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:54.855566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:54.855652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:54.856224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 325 partition: 0 MaxSeqNo: 36 sessionId: src_id|872aa3c4-f4d031f-5d576990-14e191f4_0
2025-10-10T14:02:54.857205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98e8c28f-94d7440b-e74f07a0-f8c574ba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|872aa3c4-f4d031f-5d576990-14e191f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:54.953015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:54.953041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:54.953052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:54.967066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|872aa3c4-f4d031f-5d576990-14e191f4_0] Write session: try to update token
2025-10-10T14:02:54.967132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|872aa3c4-f4d031f-5d576990-14e191f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:55.182326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:55.182382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:55.182395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:55.182405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:55.182416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:55.182451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:55.182476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:55.182496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:55.182517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:55.182669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:55.182680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:55.182690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:55.182783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:55.182807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:55.182817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:55.183798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:55.185945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:55.185985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:55.186016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:55.186053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:55.276009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId: src_id|872aa3c4-f4d031f-5d576990-14e191f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:55.336926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1010 14:02:55.723421903  112398 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:02:55.726905Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:02:55.740464Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:55.790212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:55.790271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:55.790337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:55.790352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:55.790417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593303494757432:5146]
2025-10-10T14:02:55.790876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:55.795096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:55.795129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:55.803163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:55.861823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593305072675094:5422]
2025-10-10T14:02:55.861941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:55.862420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 325 reason: error at write: Disconnected sessionId: src_id|872aa3c4-f4d031f-5d576990-14e191f4_0
2025-10-10T14:02:55.862830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 325 sessionId: src_id|872aa3c4-f4d031f-5d576990-14e191f4_0 is DEAD
2025-10-10T14:02:55.865576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872aa3c4-f4d031f-5d576990-14e191f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:55.865613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872aa3c4-f4d031f-5d576990-14e191f4_0] Write session will restart in 0.008151s
2025-10-10T14:02:55.865712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872aa3c4-f4d031f-5d576990-14e191f4_0] Write session: Do CDS request
2025-10-10T14:02:55.865742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872aa3c4-f4d031f-5d576990-14e191f4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:55.881024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|872aa3c4-f4d031f-5d576990-14e191f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:55.934678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593305072675186:5653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:55.949941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:55.949974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 326
2025-10-10T14:02:55.955450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:55.955590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:55.955605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:55.955615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:55.957432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 326 sessionId:  describe result for acl check
2025-10-10T14:02:55.957564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:55.957574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:55.957584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:55.957600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:55.960196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:55.960760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593309367642644:5422]
2025-10-10T14:02:56.041776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:56.054152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:56.053628Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2830: SessionId: ydb://session/3?node_id=1&id=ZDg1NGIwNzMtNTcwN2QzMTQtMjQyNjdmZGYtMmMyNGEyYQ==, ActorId: [1:7559593309367642642:5672], ActorState: ExecuteState, TraceId: 01k776x3na7v9s67hps1b0gnxa, Create QueryResponse for error on request, msg: tx has deferred effects, but locks are broken
2025-10-10T14:02:56.056711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:56.057573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:56.057590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:56.057635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:56.057893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:56.058085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593312084692211:5156]
2025-10-10T14:02:56.060250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:56.066015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=ABORTED
2025-10-10T14:02:56.066063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:56.065783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:56.069053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:56.066052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:56.067255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:56.067568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:56.067576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:56.067581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:56.067587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:56.067595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:56.067602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:56.067609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:56.067616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:56.067622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.067629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.067636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.067642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.067682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:56.067787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:56.067832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:56.067874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:56.067915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:56.067959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:56.068002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:56.068043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:56.068085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.068127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.068169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.068209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.068247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:56.068307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:56.068359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:56.068410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:56.068457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:56.068510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:56.068552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:56.068603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:56.068646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:56.068696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:56.068735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:56.068786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:56.068829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:56.068882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:56.068923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:56.068977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:56.069019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.069069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.069109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.072171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.072250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.072311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.072357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.072410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.072875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:56.095281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:56.111534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:56.130385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:56.130428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:56.130446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593309367642636:5669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:56.130481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:56.148306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:56.148356Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:56.148372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:56.148392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:56.148416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 325 [2:7559593312084692211:5156]
2025-10-10T14:02:56.148472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:56.148542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:56.148558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:56.148570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:56.148581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:56.148632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:56.148655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:56.148676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:56.205269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.205326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.205341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.205356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.205368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:56.205754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:56.205776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.205921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.206107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.206359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.206488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:56.206573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.206590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.206603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.206618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.206666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:56.206757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:56.206939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:56.206957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:56.207099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.207120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:56.209215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:56.209244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:56.209256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:56.209267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:56.209296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:56.210621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593313662610074:5669], now have 1 active actors on pipe
2025-10-10T14:02:56.210649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593309367642581:2442], now have 1 active actors on pipe
2025-10-10T14:02:56.210669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593309367642644:5422], now have 1 active actors on pipe
2025-10-10T14:02:56.214990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 325
2025-10-10T14:02:56.215082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 325
2025-10-10T14:02:56.215151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 325, pipe: [1:7559593309367642644:5422]
2025-10-10T14:02:56.220210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:56.220255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:56.220359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:56.220398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:56.220417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:56.220429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:56.220482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:56.220531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:56.220582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:56.224842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:56.224883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:56.224967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:56.233557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 326 partition: 0 MaxSeqNo: 36 sessionId: src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0
2025-10-10T14:02:56.237969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872aa3c4-f4d031f-5d576990-14e191f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:56.248003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:56.248030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:56.248044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:56.299806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:56.299841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:56.299879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.300009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:02:56.301802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:02:56.303075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:56.304222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:56.305255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:56.325531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:56.334828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:02:56.335160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:02:56.345353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0] Write session: try to update token
2025-10-10T14:02:56.345420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:56.353362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:56.353388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:56.353401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:56.512944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:56.512976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:56.512988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:56.513043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:56.513059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:56.513073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:56.513086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:56.513099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:56.513159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.513190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.513219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.513246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593312084692206:5156]
2025-10-10T14:02:56.513396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:56.513425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.513438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:56.514807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:56.517708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:56.517754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:56.517785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:56.517818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:56.713586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId: src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:56.753401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:56.780231Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:56.782517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:56.782566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:56.783340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:56.784279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:56.784308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:56.788637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:56.789032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593309367642644:5422]
2025-10-10T14:02:56.837532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 326 reason: error at write: Disconnected sessionId: src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0
2025-10-10T14:02:56.837836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 326 sessionId: src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0 is DEAD
2025-10-10T14:02:56.841286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:56.841351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0] Write session will restart in 0.006325s
2025-10-10T14:02:56.841511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0] Write session: Do CDS request
2025-10-10T14:02:56.841567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:56.852173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:56.852198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 327
2025-10-10T14:02:56.857943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:56.860188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:56.860366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:56.860383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:56.860393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:56.862768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 327 sessionId:  describe result for acl check
2025-10-10T14:02:56.862881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:56.862891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:56.862900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:56.862917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593313662610178:5685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:56.866878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593313662610178:5685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:56.884165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593313662610249:5422]
2025-10-10T14:02:56.885476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593313662610178:5685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:56.893607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593313662610178:5685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:56.893648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593313662610178:5685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:56.893667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593313662610178:5685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:56.893695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:56.904610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:56.909380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:56.910366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:56.910397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:56.910446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:56.910747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:56.910943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593312084692400:5166]
2025-10-10T14:02:56.913980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:56.916135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:56.916399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:56.917865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:56.918231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:56.918240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:56.918248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:56.918256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:56.918263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:56.918271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:56.918279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:56.918286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:56.918294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.918302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.918309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.918317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.918371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:56.918505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:56.918560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:56.918609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:56.918664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:56.918715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:56.918767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:56.918819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:56.918869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.918920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.918971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.919023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.919067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:56.919140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:56.919204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:56.919269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:56.919324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:56.919382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:56.919434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:56.919492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:56.919544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:56.919603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:56.919651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:56.919710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:56.919761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:56.919821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:56.919871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:56.919931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:56.919986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.920048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:56.920099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.920158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:56.920213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.920269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:56.920320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.920378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:56.920872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:56.966563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:56.981223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:56.981275Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:56.981295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:56.981314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:56.981339Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 326 [2:7559593312084692400:5166]
2025-10-10T14:02:56.981401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:56.981466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:56.981482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:56.981496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:56.981510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:56.981561Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:56.981582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:56.981605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:57.051137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.051163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:57.051172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:57.051182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:57.051192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:57.051473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:57.051491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.051624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:57.051780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:57.051989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:57.052104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:57.052176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593312084692395:5166]
2025-10-10T14:02:57.052189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593312084692395:5166]
2025-10-10T14:02:57.052201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593312084692395:5166]
2025-10-10T14:02:57.052213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593312084692395:5166]
2025-10-10T14:02:57.052253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:57.052334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:57.052514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:57.052531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:57.052657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593312084692395:5166]
2025-10-10T14:02:57.052676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:57.053587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:57.053605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:57.053617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:57.053629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:57.053652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:57.055768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593313662610260:5685], now have 1 active actors on pipe
2025-10-10T14:02:57.055803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593313662610249:5422], now have 1 active actors on pipe
2025-10-10T14:02:57.055825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593313662610105:2442], now have 1 active actors on pipe
2025-10-10T14:02:57.058264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 326
2025-10-10T14:02:57.058351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 326, pipe: [1:7559593313662610249:5422]
2025-10-10T14:02:57.058438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 326
2025-10-10T14:02:57.059366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:57.059427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:57.059530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:57.059565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:57.059592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:57.059611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:57.059651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:57.059695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:57.059751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:57.065258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:57.065308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:57.065397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:57.065901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 327 partition: 0 MaxSeqNo: 36 sessionId: src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0
2025-10-10T14:02:57.072250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebb754eb-72a26e25-4f5a663d-cf065d73_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:57.088477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:57.088503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:57.088517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:57.162100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0] Write session: try to update token
2025-10-10T14:02:57.162162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:57.254530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:57.254559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:57.254572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:57.254625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:57.254641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:57.254658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:57.254670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:57.254682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:57.254720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593312084692395:5166]
2025-10-10T14:02:57.254749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593312084692395:5166]
2025-10-10T14:02:57.254775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593312084692395:5166]
2025-10-10T14:02:57.254798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593312084692395:5166]
2025-10-10T14:02:57.254925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:57.254958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.254972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:57.255857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:57.257317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:57.257365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:57.257396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:57.257424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:57.415038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId: src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:57.417845Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:57.445804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:57.445830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:57.491093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 327 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0
2025-10-10T14:02:57.491426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 327 sessionId: src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0 is DEAD
2025-10-10T14:02:57.495761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:02:57.495820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0] Write session will restart in 0.007502s
2025-10-10T14:02:57.495954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0] Write session: Do CDS request
2025-10-10T14:02:57.495996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:57.518361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:57.520924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593313662610249:5422]
2025-10-10T14:02:57.520979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:57.521075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:57.521084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 328
2025-10-10T14:02:57.523985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:57.524091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:57.524101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:57.524110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:57.531524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:57.528770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 328 sessionId:  describe result for acl check
2025-10-10T14:02:57.528892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:57.528903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:57.528912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:57.528929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593317957577708:5697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:57.531677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593317957577708:5697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:57.540171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:57.541174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:57.541197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:57.541247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:57.541550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:57.541774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593316379659861:5176]
2025-10-10T14:02:57.544096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:57.551513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593317957577708:5697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:57.558085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:57.558413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:57.559934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:57.560302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:57.560310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:57.560318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:57.560325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:57.560333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:57.560341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:57.560349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:57.560356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:57.560363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.560372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:57.560379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:57.560386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:57.560438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:57.560556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:57.560607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:57.560658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:57.560705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:57.560755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:57.560807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:57.560858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:57.560907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.560958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:57.561009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:57.561056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:57.561110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:57.569466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:57.569577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:57.569649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:57.569704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:57.569768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:57.569822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:57.569883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:57.569937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:57.569996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:57.570048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:57.570103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:57.570152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:57.570210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:57.570258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:57.570336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:57.570411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.570471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.570520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:57.570583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:57.570638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:57.570699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:57.570750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:57.570810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:57.571303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:57.575051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593317957577708:5697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:57.575095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593317957577708:5697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:57.575116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593317957577708:5697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:57.575149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:57.615931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:57.625560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593317957577745:5422]
2025-10-10T14:02:57.682386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:57.682443Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:57.682460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:57.682477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:57.682502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 327 [2:7559593316379659861:5176]
2025-10-10T14:02:57.682554Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:57.682614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:57.682627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:57.682638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:57.682649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:57.682696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:57.682717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:57.682738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:57.685061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.685093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:57.685106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:57.685118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:57.686904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:57.687314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:57.687344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.687486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:57.687690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:57.687922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:57.688038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:57.688118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:57.688135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:57.688149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:57.688163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:57.688206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:57.688285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:57.688456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:57.688473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:57.688603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:57.688621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:57.689304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:57.689320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:57.689335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:57.689348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:57.689376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:57.692336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593317957577743:5697], now have 1 active actors on pipe
2025-10-10T14:02:57.692366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593317957577745:5422], now have 1 active actors on pipe
2025-10-10T14:02:57.692389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593317957577704:2442], now have 1 active actors on pipe
2025-10-10T14:02:57.692440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:57.692464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:57.692552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:57.692594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:57.692613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:57.692624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:57.692661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:57.692705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:57.692761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:57.691773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 327
2025-10-10T14:02:57.691856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 327, pipe: [1:7559593317957577745:5422]
2025-10-10T14:02:57.691932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 327
2025-10-10T14:02:57.697120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 328 partition: 0 MaxSeqNo: 36 sessionId: src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0
2025-10-10T14:02:57.697879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746934b1-9b84c088-9f8286a9-5c12fb16_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:57.696591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:57.696633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:57.696722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:57.789276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:57.789314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:57.789326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:57.797451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0] Write session: try to update token
2025-10-10T14:02:57.797605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:57.920980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:57.921000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:57.921008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:57.921049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:57.921060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:57.921070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:57.921079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:57.921087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:57.921110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:57.921143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:57.921160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:57.921175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:57.921696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:57.921734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:57.921765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:57.921793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:57.961729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:57.961771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:57.961783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:57.969386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:58.133703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId: src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:58.167092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:58.237620Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:58.253269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:58.253308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:58.253365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593316379659855:5176]
2025-10-10T14:02:58.253551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:58.253580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:58.253908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:58.255653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:58.255796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:58.255805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:58.256055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593317957577745:5422]
2025-10-10T14:02:58.255235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:58.268951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 328 reason: error at write: Disconnected sessionId: src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0
2025-10-10T14:02:58.270537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:58.270608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0] Write session will restart in 0.008293s
2025-10-10T14:02:58.270803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0] Write session: Do CDS request
2025-10-10T14:02:58.270865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:58.269636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 328 sessionId: src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0 is DEAD
2025-10-10T14:02:58.295101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:58.295145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 329
2025-10-10T14:02:58.298127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:58.298890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:58.299050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:58.299068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:58.299079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:58.300953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 329 sessionId:  describe result for acl check
2025-10-10T14:02:58.301078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:58.301090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:58.301099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:58.301118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593322252545099:5706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:58.306470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593322252545099:5706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:58.330511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593322252545099:5706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:58.346057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593322252545099:5706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:58.346102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593322252545099:5706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:58.346125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593322252545099:5706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:58.346164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:58.357698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593322252545133:5422]
2025-10-10T14:02:58.488804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:58.496692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:58.497710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:58.497730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:58.497780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:58.498069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:58.498271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593320674627352:5187]
2025-10-10T14:02:58.500805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:58.509072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:58.509378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:58.510934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:58.511309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:58.511319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:58.511328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:58.511336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:58.511345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:58.511352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:58.511359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:58.511366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:58.511373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:58.511381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:58.511390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:58.511399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:58.511456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:58.511584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:58.511640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:58.511697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:58.511752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:58.511808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:58.511863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:58.511920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:58.511976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:58.512031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:58.512084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:58.512134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:58.512183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:58.512262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:58.512336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:58.512401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:58.512460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:58.512525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:58.512583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:58.512648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:58.512708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:58.512770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:58.512825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:58.512885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:58.512942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:58.513002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:58.513056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:58.513121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:58.525069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:58.525201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:58.525266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:58.525334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:58.525395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:58.525463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:58.525524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:58.525589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:58.526129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:58.574318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:58.620719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:58.620771Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:58.620793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:58.620815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:58.620841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 328 [2:7559593320674627352:5187]
2025-10-10T14:02:58.620923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:58.620991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:58.621008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:58.621022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:58.621037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:58.621091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:58.621115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:58.621165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:58.720149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 328
2025-10-10T14:02:58.720233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 328, pipe: [1:7559593322252545133:5422]
2025-10-10T14:02:58.720309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 328
2025-10-10T14:02:58.713734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:58.713760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:58.713773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:58.713785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:58.713796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:58.714090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:58.714109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:58.714256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:58.714458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:58.714696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:58.714827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:58.714898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:58.714913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:58.714928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:58.714942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:58.714988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:58.715073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:58.715273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:58.715292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:58.715417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:58.715439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:58.717567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:58.717586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:58.717598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:58.717611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:58.717642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:58.722629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593322252545131:5706], now have 1 active actors on pipe
2025-10-10T14:02:58.722683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593322252545133:5422], now have 1 active actors on pipe
2025-10-10T14:02:58.722711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593322252545087:2442], now have 1 active actors on pipe
2025-10-10T14:02:58.722750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:58.722762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:58.722775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:58.722870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:58.722898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:58.723017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:58.723048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:58.723067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:58.723080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:58.723122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:58.723159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:58.723217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:58.727015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 329 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0
2025-10-10T14:02:58.729880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6f339-a2bd6d2a-205c801c-1557cb9e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:58.726326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:58.726379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:58.726499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:58.788212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:02:58.788246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:58.788285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:58.788417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:02:58.790141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:02:58.791275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:58.792410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:58.793701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:02:58.821887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:02:58.829666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:02:58.830025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:58.830042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:58.830054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:58.830113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:02:58.843386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0] Write session: try to update token
2025-10-10T14:02:58.843452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:59.078239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId: src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:02:59.089775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:59.089803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:59.089815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:59.089879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:59.089893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:59.089908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:59.089919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:59.089930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:59.089974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:59.090002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:59.090025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:59.090049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593320674627346:5187]
2025-10-10T14:02:59.090184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:59.090210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:59.090222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:59.091359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:59.097723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:59.097764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:59.097794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:59.097823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:02:59.230235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:02:59.439416Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:02:59.444971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:59.445022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:59.447252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593322252545133:5422]
2025-10-10T14:02:59.447326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:02:59.447446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:02:59.447457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:02:59.456237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:02:59.511663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:02:59.511711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0] Write session will restart in 0.007131s
2025-10-10T14:02:59.511820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0] Write session: Do CDS request
2025-10-10T14:02:59.511854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:02:59.510944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 329 reason: error at write: Disconnected sessionId: src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0
2025-10-10T14:02:59.521594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 329 sessionId: src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0 is DEAD
2025-10-10T14:02:59.525742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:59.563497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593326547512670:5422]
2025-10-10T14:02:59.563644Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:02:59.563657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 330
2025-10-10T14:02:59.564241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:02:59.564347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:02:59.564362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:02:59.564372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:02:59.572563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 330 sessionId:  describe result for acl check
2025-10-10T14:02:59.572687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:02:59.572696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:02:59.572705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:02:59.572723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593326547512683:5720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:02:59.575467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593326547512683:5720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:02:59.615779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593326547512683:5720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:02:59.620766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:02:59.621656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:02:59.622370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:02:59.622387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:02:59.622429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:02:59.622677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:02:59.622856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593324969594829:5197]
2025-10-10T14:02:59.624921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:02:59.629194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:02:59.629440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:02:59.630813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:02:59.635565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:59.635586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:59.635593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:59.635599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:59.635606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:59.635612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:59.635621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:59.635628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:59.635636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:59.635642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:59.635649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:59.635656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:59.635710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:59.635819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:59.635867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:59.635910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:59.635953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:59.635997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:59.636052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:59.636092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:59.636132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:59.636176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:59.636217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:59.636256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:59.636296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:59.636356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:02:59.636412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:59.636468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:02:59.636512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:59.636561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:02:59.636605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:59.636653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:02:59.636700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:59.636748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:02:59.636805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:59.636855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:02:59.636901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:59.636953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:02:59.636996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:59.637044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:02:59.637089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:59.637155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:59.637195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:59.637241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:59.637285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:59.637333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:59.637376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:59.637421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:59.637823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:02:59.647028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593326547512683:5720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:02:59.647068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593326547512683:5720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:02:59.647086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593326547512683:5720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:02:59.647131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:02:59.684571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:02:59.724040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:02:59.724087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:02:59.724104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:02:59.724121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:02:59.724145Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 329 [2:7559593324969594829:5197]
2025-10-10T14:02:59.724197Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:02:59.724258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:02:59.724273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:59.724285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:59.724296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:59.724346Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:02:59.724368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:02:59.724390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:02:59.726113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:59.726135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:59.726150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:59.726164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:59.726175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:02:59.726503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:02:59.726521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:59.726663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:02:59.726837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:02:59.727052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:02:59.727158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:02:59.727231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593324969594823:5197]
2025-10-10T14:02:59.727248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593324969594823:5197]
2025-10-10T14:02:59.727260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593324969594823:5197]
2025-10-10T14:02:59.727273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593324969594823:5197]
2025-10-10T14:02:59.727318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:02:59.727397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:02:59.727567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:02:59.727583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:02:59.727714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593324969594823:5197]
2025-10-10T14:02:59.727733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:02:59.730887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 329
2025-10-10T14:02:59.730959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 329, pipe: [1:7559593326547512670:5422]
2025-10-10T14:02:59.731027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 329
2025-10-10T14:02:59.728764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:02:59.728782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:02:59.728792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:02:59.728804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:02:59.728828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:02:59.743059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593326547512736:5720], now have 1 active actors on pipe
2025-10-10T14:02:59.743110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593326547512670:5422], now have 1 active actors on pipe
2025-10-10T14:02:59.743132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593326547512587:2442], now have 1 active actors on pipe
2025-10-10T14:02:59.743199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:59.743225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:59.743328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:02:59.743377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:59.743398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:59.743408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:02:59.743449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:59.743495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:02:59.743547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:59.744555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:02:59.744592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:02:59.744660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:02:59.745091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 330 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0
2025-10-10T14:02:59.746093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4811f07-313e5b0a-2f2a31d6-1d701c34_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:02:59.825537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:59.825567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:59.825580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:59.854190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0] Write session: try to update token
2025-10-10T14:02:59.854249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:02:59.969913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:02:59.969944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:02:59.969956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:02:59.970017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:02:59.970032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:02:59.970044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:02:59.970056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:02:59.970067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:02:59.970102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593324969594823:5197]
2025-10-10T14:02:59.970128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593324969594823:5197]
2025-10-10T14:02:59.970151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593324969594823:5197]
2025-10-10T14:02:59.970172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593324969594823:5197]
2025-10-10T14:02:59.970314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:02:59.970342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:02:59.970353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:02:59.971363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:02:59.973257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:02:59.973295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:02:59.973325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:02:59.973355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:00.131313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId: src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:00.180392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:00.419645Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:00.441178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:00.441228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:00.448417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:00.448578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:00.448590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:00.465799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593326547512670:5422]
2025-10-10T14:03:00.477766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:00.477804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0] Write session will restart in 0.008787s
2025-10-10T14:03:00.477904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0] Write session: Do CDS request
2025-10-10T14:03:00.477932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:00.476927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 330 reason: error at write: Disconnected sessionId: src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0
2025-10-10T14:03:00.477292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 330 sessionId: src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0 is DEAD
2025-10-10T14:03:00.498783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:00.533711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:00.533746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 331
2025-10-10T14:03:00.535166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:00.535288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:00.535305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:00.535315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:00.537111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 331 sessionId:  describe result for acl check
2025-10-10T14:03:00.537259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:00.537270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:00.537282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:00.537305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593330842480082:5727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:00.540100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593330842480082:5727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:00.556638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593330842480082:5727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:00.573530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:00.580414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593330842480108:5422]
2025-10-10T14:03:00.588643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593330842480082:5727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:00.588685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593330842480082:5727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:00.588704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593330842480082:5727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:00.588737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:00.712165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:00.723011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:00.724000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:00.724022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:00.724075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:00.724381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:00.724575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593329264562315:5201]
2025-10-10T14:03:00.726897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:00.733925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:00.734303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:00.735811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:00.736167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:00.736177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:00.736182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:00.736189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:00.736195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:00.736202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:00.736208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:00.736218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:00.736225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:00.736232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:00.736240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:00.736248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:00.736298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:00.736406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:00.736455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:00.736499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:00.736546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:00.736592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:00.736635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:00.736677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:00.736721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:00.736766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:00.736810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:00.736852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:00.736898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:00.736965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:00.737024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:00.737077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:00.737433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:00.737498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:00.737546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:00.737597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:00.737645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:00.737712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:00.737765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:00.737816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:00.737861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:00.737914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:00.737960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:00.738011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:00.738073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:00.738125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:00.738170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:00.738234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:00.738280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:00.738333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:00.738380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:00.738430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:00.738877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:00.794018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:00.870330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:00.870378Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:00.870394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:00.870413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:00.870439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 330 [2:7559593329264562315:5201]
2025-10-10T14:03:00.870518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:00.870582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:00.870599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:00.870611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:00.870621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:00.870674Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:00.870698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:00.870722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:00.872033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:00.872050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:00.872063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:00.872077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:00.872089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:00.877370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 330
2025-10-10T14:03:00.877495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 330
2025-10-10T14:03:00.877562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 330, pipe: [1:7559593330842480108:5422]
2025-10-10T14:03:00.882911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:00.882947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:00.883087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:00.883263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:00.883495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:00.883611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:00.883659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593330842480070:2442], now have 1 active actors on pipe
2025-10-10T14:03:00.883685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593330842480113:5727], now have 1 active actors on pipe
2025-10-10T14:03:00.883707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593330842480108:5422], now have 1 active actors on pipe
2025-10-10T14:03:00.883780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:00.883803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:00.883885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:00.883900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:00.883912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:00.883924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:00.883967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:00.884011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:00.884028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:00.884039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:00.884050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:00.884070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:00.884103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:00.884122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:00.884134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:00.884170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:00.884215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:00.884263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:00.884446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:00.884464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:00.884608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:00.884660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:00.884688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:00.885228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:00.901262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:00.901315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:00.901407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:00.901816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 331 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0
2025-10-10T14:03:00.904531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb2a07f2-26d5d12e-71dc9f93-aa51ce36_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:00.973156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:00.973187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:00.973201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:00.988073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0] Write session: try to update token
2025-10-10T14:03:00.988137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:01.228664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:01.228697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:01.228712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:01.228723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:01.228733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:01.228772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:01.228800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:01.228826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:01.228848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:01.229013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:01.229025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:01.229038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:01.229253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:01.229281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:01.229310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:01.229339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:01.233268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:01.233322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:01.233333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:01.234622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:01.273466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId: src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:01.325775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:01.572286Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:01.582879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:01.582930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:01.582998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:01.583013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:01.583057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593329264562310:5201]
2025-10-10T14:03:01.583612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:01.584622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:01.589697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:01.593286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:01.593437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593330842480108:5422]
2025-10-10T14:03:01.611879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 331 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0
2025-10-10T14:03:01.612225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 331 sessionId: src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0 is DEAD
2025-10-10T14:03:01.613671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:01.613702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0] Write session will restart in 0.006337s
2025-10-10T14:03:01.613805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0] Write session: Do CDS request
2025-10-10T14:03:01.613833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:01.634479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:01.639836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:01.639880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 332
2025-10-10T14:03:01.646808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:01.646953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:01.646968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:01.646980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:01.654354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 332 sessionId:  describe result for acl check
2025-10-10T14:03:01.654484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:01.654512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:01.654521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:01.654539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593335137447585:5739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:01.657119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593335137447585:5739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:01.696308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593335137447585:5739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:01.696369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593335137447606:5422]
2025-10-10T14:03:01.707231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593335137447585:5739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:01.707279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593335137447585:5739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:01.707298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593335137447585:5739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:01.707333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:01.824128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:01.829514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:01.830522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:01.830544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:01.830594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:01.830866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:01.831055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593333559529803:5210]
2025-10-10T14:03:01.833394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:01.838873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:01.839131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:01.840505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:01.840851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:01.840860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:01.840869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:01.840876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:01.840882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:01.840889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:01.840898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:01.840906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:01.840912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:01.840919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:01.840925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:01.840931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:01.840978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:01.841088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:01.841156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:01.841205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:01.841248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:01.841293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:01.841334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:01.841380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:01.841424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:01.841467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:01.841509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:01.841553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:01.841597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:01.841662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:01.841719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:01.841772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:01.841818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:01.841865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:01.841906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:01.841954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:01.841997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:01.842043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:01.842084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:01.842133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:01.842178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:01.842225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:01.842267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:01.842316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:01.842363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:01.842412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:01.842454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:01.842517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:01.842559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:01.842609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:01.842650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:01.842698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:01.843108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:01.930547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:01.958935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:01.958984Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:01.959001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:01.959021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:01.959047Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 331 [2:7559593333559529803:5210]
2025-10-10T14:03:01.959104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:01.959167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:01.959183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:01.959195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:01.959206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:01.959257Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:01.959280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:01.959303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:01.973950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:01.973985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:01.974000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:01.974014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:01.974026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:01.974353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:01.974372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:01.974543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:01.974735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:01.974971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:01.975089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:01.975171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:01.975187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:01.975201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:01.975214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:01.975250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:01.975339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:01.975524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:01.975542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:01.975680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:01.975700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:01.976167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:01.976180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:01.976195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:01.976206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:01.976228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:01.978140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 331
2025-10-10T14:03:01.978246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 331
2025-10-10T14:03:01.978308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 331, pipe: [1:7559593335137447606:5422]
2025-10-10T14:03:01.981248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593335137447573:2442], now have 1 active actors on pipe
2025-10-10T14:03:01.981300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593335137447616:5739], now have 1 active actors on pipe
2025-10-10T14:03:01.981325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593335137447606:5422], now have 1 active actors on pipe
2025-10-10T14:03:01.981407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:01.981430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:01.981516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de128b20-f71cba53-e3de160-742a705c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:01.981552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:01.981572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:01.981584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:01.981624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:01.981960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:01.982021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:01.983444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:01.983475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:01.983545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:01.986329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 332 partition: 0 MaxSeqNo: 36 sessionId: src_id|de128b20-f71cba53-e3de160-742a705c_0
2025-10-10T14:03:01.989516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0bde14c-42c8d1ad-cb0edf8f-4300a639_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de128b20-f71cba53-e3de160-742a705c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:02.052649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de128b20-f71cba53-e3de160-742a705c_0] Write session: try to update token
2025-10-10T14:03:02.052713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de128b20-f71cba53-e3de160-742a705c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:02.061272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:02.061306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:02.061319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:02.401004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:02.401041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:02.401053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:02.401184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:02.401200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:02.401213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:02.401224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:02.401236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:02.401273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:02.401303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:02.401328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:02.401352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:02.401474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:02.401509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:02.401540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:02.401577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:02.432519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId: src_id|de128b20-f71cba53-e3de160-742a705c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:02.449925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:02.467274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:02.467298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:02.494784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:02.532415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:02.845715Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:02.848966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:02.849000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:02.849049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593333559529798:5210]
2025-10-10T14:03:02.849238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:02.849263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:02.849739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:02.850649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:02.854450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593335137447606:5422]
2025-10-10T14:03:02.854556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:02.854672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:02.869089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 332 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de128b20-f71cba53-e3de160-742a705c_0
2025-10-10T14:03:02.869421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 332 sessionId: src_id|de128b20-f71cba53-e3de160-742a705c_0 is DEAD
2025-10-10T14:03:02.873713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de128b20-f71cba53-e3de160-742a705c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:02.873750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de128b20-f71cba53-e3de160-742a705c_0] Write session will restart in 0.007706s
2025-10-10T14:03:02.873850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de128b20-f71cba53-e3de160-742a705c_0] Write session: Do CDS request
2025-10-10T14:03:02.873880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de128b20-f71cba53-e3de160-742a705c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:02.896923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de128b20-f71cba53-e3de160-742a705c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:02.901086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:02.901155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 333
2025-10-10T14:03:02.901539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:02.901681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:02.901697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:02.901707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:02.907519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 333 sessionId:  describe result for acl check
2025-10-10T14:03:02.907758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:02.907783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:02.907806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:02.907844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593339432415110:5755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:02.919904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593339432415110:5755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:02.943857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593339432415110:5755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:02.957286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593339432415177:5422]
2025-10-10T14:03:02.962122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593339432415110:5755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:02.962173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593339432415110:5755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:02.962191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593339432415110:5755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:02.962227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:03.021149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:03.026642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:03.027656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:03.027676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:03.027725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:03.028017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:03.028221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593342149464596:5229]
2025-10-10T14:03:03.030955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:03.032154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:03.032482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:03.033841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:03.034192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:03.034200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:03.034208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:03.034217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:03.034225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:03.034233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:03.034241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:03.034248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:03.034256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.034263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.034271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.034278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.034336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:03.034456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:03.034511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:03.034583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:03.034636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:03.034689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:03.035274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:03.035339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:03.035393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.035449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.035499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.035550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.035599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:03.035671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:03.035742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:03.035809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:03.035865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:03.035925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:03.035975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:03.036032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:03.036086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:03.036146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:03.036198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:03.036257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:03.036312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:03.036371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:03.036424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:03.036484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:03.036540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.036602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.036653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.036713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.036766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.036825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.036874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.036934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.037449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:03.068189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:03.083826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:03.083877Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:03.083897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:03.083919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:03.083945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 332 [2:7559593342149464596:5229]
2025-10-10T14:03:03.084010Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:03.084068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:03.084082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:03.084095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:03.084108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:03.084159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:03.084182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:03.084204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:03.085735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.085762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.085778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.085794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.085808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:03.086098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:03.086118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.086276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.086483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.086760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.086894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:03.086970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593342149464591:5229]
2025-10-10T14:03:03.086987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593342149464591:5229]
2025-10-10T14:03:03.087001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593342149464591:5229]
2025-10-10T14:03:03.087015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593342149464591:5229]
2025-10-10T14:03:03.087063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:03.087151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:03.087353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:03.087371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:03.087504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593342149464591:5229]
2025-10-10T14:03:03.087526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:03.087802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:03.087817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:03.087830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:03.087841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:03.087865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:03.089563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593339432415094:2442], now have 1 active actors on pipe
2025-10-10T14:03:03.089605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593339432415182:5755], now have 1 active actors on pipe
2025-10-10T14:03:03.089631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593339432415177:5422], now have 1 active actors on pipe
2025-10-10T14:03:03.091137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:03.091172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:03.091251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b35f87c7-c8b30192-4559620c-8581bf49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:03.091283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:03.091301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:03.091312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:03.091347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:03.091392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:03.091438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:03.090064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 332
2025-10-10T14:03:03.090167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 332
2025-10-10T14:03:03.090231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 332, pipe: [1:7559593339432415177:5422]
2025-10-10T14:03:03.092330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:03.092358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:03.092425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:03.093585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de128b20-f71cba53-e3de160-742a705c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b35f87c7-c8b30192-4559620c-8581bf49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:03.092773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 333 partition: 0 MaxSeqNo: 36 sessionId: src_id|b35f87c7-c8b30192-4559620c-8581bf49_0
2025-10-10T14:03:03.138363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35f87c7-c8b30192-4559620c-8581bf49_0] Write session: try to update token
2025-10-10T14:03:03.138434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35f87c7-c8b30192-4559620c-8581bf49_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:03.198936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:03.198970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:03.198984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:03.199040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:03.199056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:03.199069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:03.199082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:03.199094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:03.199131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593342149464591:5229]
2025-10-10T14:03:03.199159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593342149464591:5229]
2025-10-10T14:03:03.199186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593342149464591:5229]
2025-10-10T14:03:03.199210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593342149464591:5229]
2025-10-10T14:03:03.199362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:03.199403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.199416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:03.200596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:03.201306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:03.201349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:03.201380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:03.201413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:03.294453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId: src_id|b35f87c7-c8b30192-4559620c-8581bf49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:03.325012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:03.377920Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:03.379739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:03.379780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:03.386399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:03.388783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:03.389037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:03.389333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593339432415177:5422]
2025-10-10T14:03:03.405299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 333 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b35f87c7-c8b30192-4559620c-8581bf49_0
2025-10-10T14:03:03.405699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 333 sessionId: src_id|b35f87c7-c8b30192-4559620c-8581bf49_0 is DEAD
2025-10-10T14:03:03.413352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35f87c7-c8b30192-4559620c-8581bf49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:03.413399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35f87c7-c8b30192-4559620c-8581bf49_0] Write session will restart in 0.005443s
2025-10-10T14:03:03.413501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35f87c7-c8b30192-4559620c-8581bf49_0] Write session: Do CDS request
2025-10-10T14:03:03.413531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35f87c7-c8b30192-4559620c-8581bf49_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:03.426679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35f87c7-c8b30192-4559620c-8581bf49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:03.429513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:03.429548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 334
2025-10-10T14:03:03.429996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:03.430129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:03.430148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:03.430160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:03.431646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 334 sessionId:  describe result for acl check
2025-10-10T14:03:03.431774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:03.431787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:03.431797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:03.431814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593343727382578:5761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:03.434768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593343727382578:5761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:03.455702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593343727382578:5761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:03.470423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593343727382578:5761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:03.470474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593343727382578:5761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:03.470493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593343727382578:5761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:03.470525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:03.489380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593343727382620:5422]
2025-10-10T14:03:03.569021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:03.593798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:03.594733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:03.594753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:03.594800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:03.595084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:03.595282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593342149464767:5231]
2025-10-10T14:03:03.604758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:03.613479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:03.613757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:03.614992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:03.615349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:03.615355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:03.615362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:03.615368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:03.615374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:03.615381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:03.615388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:03.615394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:03.615400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.615406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.615412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.615419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.615464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:03.615566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:03.615610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:03.615652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:03.615692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:03.615735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:03.615775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:03.615813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:03.615855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.615896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.615936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.615977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.616018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:03.616082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:03.616140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:03.616189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:03.616235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:03.616287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:03.616332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:03.616384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:03.616429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:03.616481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:03.616526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:03.616576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:03.616621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:03.616671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:03.616715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:03.616762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:03.616808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.616858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.616899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.616950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.616995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.617044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.617084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.618203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.618707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:03.666802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:03.703124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:03.703176Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:03.703194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:03.703215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:03.703241Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 333 [2:7559593342149464767:5231]
2025-10-10T14:03:03.703297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:03.703366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:03.703381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:03.703395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:03.703407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:03.703479Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:03.703500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:03.703525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:03.732700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.741253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.741293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.741305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.741318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:03.741693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:03.741715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.741868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:03.742049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:03.742272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:03.742383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:03.742468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.742484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.742498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.742510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.742574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:03.742677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:03.742864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:03.742881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:03.743021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.743043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:03.745761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:03.745780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:03.745791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:03.745801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:03.745827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:03.755032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593343727382609:5761], now have 1 active actors on pipe
2025-10-10T14:03:03.755070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593343727382564:2442], now have 1 active actors on pipe
2025-10-10T14:03:03.755091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593343727382620:5422], now have 1 active actors on pipe
2025-10-10T14:03:03.755776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:03.755804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:03.755894Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:03.755930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:03.755952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:03.755962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:03.756000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:03.756049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:03.756099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:03.754852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 333
2025-10-10T14:03:03.754959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 333
2025-10-10T14:03:03.755037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 333, pipe: [1:7559593343727382620:5422]
2025-10-10T14:03:03.766460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:03.766504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:03.766602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:03.770370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35f87c7-c8b30192-4559620c-8581bf49_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:03.769519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 334 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0
2025-10-10T14:03:03.812351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:03.812381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:03.812395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:03.812451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:03.812466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:03.812505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.812601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:03.816814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:03.818626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:03.819843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:03.821371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:03.831851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:03.838497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0] Write session: try to update token
2025-10-10T14:03:03.838572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:03.850555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:03.851098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:03.925606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:03.925637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:03.925647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:03.990736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:03.990769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:03.990783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:03.990791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:03.990801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:03.990843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.990867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.990887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.990907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593342149464761:5231]
2025-10-10T14:03:03.991050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:03.991077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:03.991086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:04.001286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:04.001327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:04.001357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:04.001385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:04.027253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:04.160628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId: src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:04.189005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:04.225160Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:04.228101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:04.228138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:04.230631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:04.230659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:04.229843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:04.240317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 334 reason: error at write: Disconnected sessionId: src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0
2025-10-10T14:03:04.249878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 334 sessionId: src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0 is DEAD
2025-10-10T14:03:04.253878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:04.253918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0] Write session will restart in 0.006550s
2025-10-10T14:03:04.254026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0] Write session: Do CDS request
2025-10-10T14:03:04.254058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:04.271147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:04.281488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:04.281675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593343727382620:5422]
2025-10-10T14:03:04.281881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:04.281895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 335
2025-10-10T14:03:04.287624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:04.287792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:04.287810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:04.287822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:04.290084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 335 sessionId:  describe result for acl check
2025-10-10T14:03:04.290238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:04.290251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:04.290260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:04.290278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593348022350070:5773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:04.306398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593348022350070:5773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:04.342628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593348022350070:5773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:04.416509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593348022350144:5422]
2025-10-10T14:03:04.431576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593348022350070:5773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:04.431625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593348022350070:5773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:04.431646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593348022350070:5773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:04.431688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:04.504093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:04.510306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:04.511413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:04.511437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:04.511491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:04.511855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:04.512081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593346444432236:5241]
2025-10-10T14:03:04.514891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:04.521826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:04.522125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:04.523654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:04.524056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:04.524118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:04.524127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:04.524135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:04.524144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:04.524152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:04.524160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:04.524168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:04.524177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:04.524186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:04.524194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:04.524201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:04.524259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:04.524388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:04.524443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:04.524498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:04.524553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:04.524608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:04.524662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:04.524716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:04.524770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:04.524827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:04.524880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:04.524932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:04.524979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:04.525059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:04.525154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:04.525222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:04.525285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:04.525375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:04.525437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:04.525503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:04.525561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:04.525623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:04.525673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:04.525736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:04.525790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:04.525851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:04.525902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:04.525963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:04.526014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:04.526073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:04.526122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:04.526181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:04.526253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:04.526315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:04.526364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:04.526423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:04.526928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:04.725479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:04.792977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:04.805522Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:04.805566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:04.805591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:04.805619Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 334 [2:7559593346444432236:5241]
2025-10-10T14:03:04.805689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:04.805756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:04.805774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:04.805789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:04.805801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:04.805860Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:04.805885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:04.805910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:04.815356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:04.815398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:04.815419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:04.815436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:04.815449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:04.815826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:04.815853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:04.816037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:04.816283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:04.816568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:04.816722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:04.816829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593348022350169:5773], now have 1 active actors on pipe
2025-10-10T14:03:04.816857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593348022350144:5422], now have 1 active actors on pipe
2025-10-10T14:03:04.816881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593348022350063:2442], now have 1 active actors on pipe
2025-10-10T14:03:04.816908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593346444432231:5241]
2025-10-10T14:03:04.816924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593346444432231:5241]
2025-10-10T14:03:04.816939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593346444432231:5241]
2025-10-10T14:03:04.816954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593346444432231:5241]
2025-10-10T14:03:04.817001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:04.817094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:04.817324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:04.817342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:04.817486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593346444432231:5241]
2025-10-10T14:03:04.817509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:04.819414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 334
2025-10-10T14:03:04.819529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 334
2025-10-10T14:03:04.819599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 334, pipe: [1:7559593348022350144:5422]
2025-10-10T14:03:04.819481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:04.819512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:04.819529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:04.819545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:04.819579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:04.820840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:04.820886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:04.820972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:04.821005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:04.821024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:04.821036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:04.821076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:04.821143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:04.821202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:04.825087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:04.825150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:04.825233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:04.827227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 335 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0
2025-10-10T14:03:04.832442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9173fa-cfd55d66-d4653467-dc431cc7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:04.888613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0] Write session: try to update token
2025-10-10T14:03:04.888679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:04.908502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:04.908547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:04.908564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:05.008023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:05.008062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:05.008082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:05.008098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:05.008111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:05.008151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593346444432231:5241]
2025-10-10T14:03:05.008185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593346444432231:5241]
2025-10-10T14:03:05.008215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593346444432231:5241]
2025-10-10T14:03:05.008244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593346444432231:5241]
2025-10-10T14:03:05.008417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:05.008449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:05.008463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:05.009694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:05.009754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:05.009785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:05.009816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:05.030031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:05.180781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId: src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:05.282710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:05.440532Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:05.455215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:05.455268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:05.462496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593348022350144:5422]
2025-10-10T14:03:05.462602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:05.462752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:05.462765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:05.468354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 335 reason: error at write: Disconnected sessionId: src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0
2025-10-10T14:03:05.481670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 335 sessionId: src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0 is DEAD
2025-10-10T14:03:05.486051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:05.486087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0] Write session will restart in 0.008864s
2025-10-10T14:03:05.486191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0] Write session: Do CDS request
2025-10-10T14:03:05.486224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:05.503069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:05.501861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:05.504836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:05.504865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 336
2025-10-10T14:03:05.510108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:05.510363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:05.510391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:05.510408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:05.513365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 336 sessionId:  describe result for acl check
2025-10-10T14:03:05.513485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:05.513495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:05.513504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:05.513520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593352317317584:5784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:05.517040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593352317317584:5784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:05.531129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593352317317584:5784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:05.551269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593352317317584:5784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:05.551312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593352317317584:5784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:05.551333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593352317317584:5784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:05.551368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:05.563809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593352317317633:5422]
2025-10-10T14:03:05.682229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:05.689437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:05.690281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:05.690313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:05.690359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:05.690659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:05.690836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593350739399749:5252]
2025-10-10T14:03:05.692868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:05.699033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:05.699284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:05.700541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:05.700859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:05.700867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:05.700874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:05.700880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:05.700886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:05.700893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:05.700899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:05.700906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:05.700911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:05.700918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:05.700924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:05.700931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:05.700976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:05.701076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:05.701140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:05.701188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:05.701231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:05.701273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:05.701314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:05.701352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:05.701395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:05.701441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:05.701481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:05.701523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:05.701562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:05.701626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:05.701681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:05.701731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:05.701777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:05.701827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:05.701866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:05.701911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:05.701955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:05.702005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:05.702044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:05.702091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:05.702136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:05.702185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:05.702230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:05.713220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:05.713346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:05.713425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:05.713472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:05.713529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:05.713576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:05.713629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:05.713675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:05.713727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:05.714208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:05.904884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:05.940818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:05.940864Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:05.940882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:05.940901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:05.940926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 335 [2:7559593350739399749:5252]
2025-10-10T14:03:05.940982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:05.941037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:05.941053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:05.941066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:05.941077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:05.941435Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:05.941465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:05.941486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:05.944162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:05.944179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:05.944194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:05.944209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:05.944220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:05.946368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 335, pipe: [1:7559593352317317633:5422]
2025-10-10T14:03:05.946468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 335
2025-10-10T14:03:05.946539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 335
2025-10-10T14:03:05.945686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:05.945716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:05.945875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:05.946069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:05.946333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:05.946464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:05.946547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593352317317633:5422], now have 1 active actors on pipe
2025-10-10T14:03:05.946571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593352317317622:5784], now have 1 active actors on pipe
2025-10-10T14:03:05.946610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593352317317570:2442], now have 1 active actors on pipe
2025-10-10T14:03:05.946636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:05.946651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:05.946665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:05.946679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:05.946722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:05.947433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:05.947452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:05.947465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:05.947478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:05.947908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:05.948117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:05.948134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:05.948306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:05.948329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:05.948383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:05.948414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:05.948520Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:05.948547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:05.948565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:05.948576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:05.948609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:05.948646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:05.948728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:05.949077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:05.951199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:05.951230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:05.951300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:05.952634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 336 partition: 0 MaxSeqNo: 36 sessionId: src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0
2025-10-10T14:03:05.954022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4d5911-d0820d0c-d9ea9e64-e11ebd96_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:05.993283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0] Write session: try to update token
2025-10-10T14:03:05.993336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:06.155226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:06.155260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:06.155271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:06.155376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:06.155388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:06.155402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:06.155412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:06.155423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:06.155457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:06.155482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:06.155507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:06.155528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:06.156399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:06.156436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:06.156467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:06.156497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:06.172918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId: src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:06.177829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:06.177877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:06.177888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:06.178901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:06.209694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:06.364500Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:06.366260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:06.366283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:06.366328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593350739399744:5252]
2025-10-10T14:03:06.366478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:06.366505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:06.366847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:06.372323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593352317317633:5422]
2025-10-10T14:03:06.372456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:06.368767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:06.373052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:06.395172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 336 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0
2025-10-10T14:03:06.395490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 336 sessionId: src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0 is DEAD
2025-10-10T14:03:06.401785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:06.401826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0] Write session will restart in 0.009652s
2025-10-10T14:03:06.401966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0] Write session: Do CDS request
2025-10-10T14:03:06.401999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:06.425939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:06.425929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:06.425955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 337
2025-10-10T14:03:06.426541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:06.426696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:06.426714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:06.426725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:06.428084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 337 sessionId:  describe result for acl check
2025-10-10T14:03:06.428187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:06.428199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:06.428208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:06.428225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593356612285097:5801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:06.430788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593356612285097:5801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:06.453108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593356612285097:5801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:06.470025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593356612285141:5422]
2025-10-10T14:03:06.476224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593356612285097:5801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:06.476277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593356612285097:5801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:06.476295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593356612285097:5801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:06.476329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:06.544321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:06.550158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:06.550997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:06.551013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:06.551057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:06.551313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:06.551488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593355034367243:5269]
2025-10-10T14:03:06.554298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:06.555503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:06.555729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:06.556910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:06.557229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:06.557237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:06.557244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:06.557251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:06.557257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:06.557263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:06.557270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:06.557277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:06.557283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:06.557289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:06.557296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:06.557303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:06.557347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:06.557450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:06.557499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:06.557546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:06.557588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:06.557631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:06.557672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:06.557717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:06.557757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:06.557801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:06.557841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:06.557884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:06.557924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:06.557984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:06.558039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:06.558094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:06.558145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:06.558194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:06.558239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:06.558289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:06.558334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:06.558385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:06.558426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:06.558479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:06.558525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:06.558575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:06.558636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:06.558686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:06.558731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:06.558781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:06.558822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:06.558871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:06.558914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:06.558960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:06.559003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:06.559054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:06.559472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
E1010 14:03:06.582898905  107741 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:03:06.585297Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:03:06.591368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:06.609412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:06.609456Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:06.609473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:06.609493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:06.609516Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 336 [2:7559593355034367243:5269]
2025-10-10T14:03:06.609570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:06.609634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:06.609648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:06.609660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:06.609671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:06.609718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:06.609741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:06.609765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:06.611682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:06.611698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:06.611713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:06.611726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:06.611737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:06.612028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:06.612043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:06.612175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:06.612455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 336, pipe: [1:7559593356612285141:5422]
2025-10-10T14:03:06.612564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 336
2025-10-10T14:03:06.612628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 336
2025-10-10T14:03:06.624139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:06.624420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:06.624535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:06.624652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593356612285141:5422], now have 1 active actors on pipe
2025-10-10T14:03:06.624679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593356612285151:5801], now have 1 active actors on pipe
2025-10-10T14:03:06.624701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593356612285088:2442], now have 1 active actors on pipe
2025-10-10T14:03:06.624754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:06.624777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:06.624836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.624850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.624862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.624874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.624912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:06.624998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:06.625202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:06.625218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:06.625286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:06.625322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:06.625340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:06.625350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:06.625389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:06.625432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:06.625574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.625597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:06.625646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:06.626367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:06.626387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:06.626398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:06.626409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:06.626434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:06.627215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:06.627239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:06.627310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:06.631927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 337 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0
2025-10-10T14:03:06.635742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f11f27a-c219761a-23aea40d-c981b0dd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:06.679691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0] Write session: try to update token
2025-10-10T14:03:06.679745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:06.752887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:06.752924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:06.752940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:06.752952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:06.752963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:06.753002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.753030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.753057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.753080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.753271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:06.753284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:06.753295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:06.753400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:06.753427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:06.753439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:06.754491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:06.758155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:06.758236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:06.758295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:06.758357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:06.819855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId: src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:06.847676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:06.914812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:06.926163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:06.926212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:06.926286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:06.926301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:06.926345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593355034367238:5269]
2025-10-10T14:03:06.929421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:06.930486Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:06.933272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:06.933438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593356612285141:5422]
2025-10-10T14:03:06.933518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:06.941193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 337 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0
2025-10-10T14:03:06.941541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 337 sessionId: src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0 is DEAD
2025-10-10T14:03:06.943492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:06.943527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0] Write session will restart in 0.008824s
2025-10-10T14:03:06.943627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0] Write session: Do CDS request
2025-10-10T14:03:06.943659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:06.964500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:06.964795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:06.964816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 338
2025-10-10T14:03:06.965176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:06.965270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:06.965281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:06.965288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:06.967119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 338 sessionId:  describe result for acl check
2025-10-10T14:03:06.967239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:06.967253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:06.967263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:06.967281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593356612285287:5807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:06.973487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593356612285287:5807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:06.981211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593356612285287:5807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:06.996299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593356612285287:5807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:06.996340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593356612285287:5807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:06.996358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593356612285287:5807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:06.996390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:07.033896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593360907252682:5422]
2025-10-10T14:03:07.074214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:07.075939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:07.076790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:07.076808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:07.076851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:07.077103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:07.077326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593359329334715:5272]
2025-10-10T14:03:07.080275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:07.081752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:07.081993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:07.083338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:07.083676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:07.083685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:07.083693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:07.083700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:07.083709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:07.083717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:07.083726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:07.083733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:07.083741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.083748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.083756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.083763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.083813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:07.083935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:07.083988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:07.084039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:07.084091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:07.084158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:07.084207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:07.084257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:07.084307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.084359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.084406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.084454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.084496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:07.084568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:07.084631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:07.084689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:07.084742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:07.084800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:07.084850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:07.084909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:07.084964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:07.085023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:07.085069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:07.085144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:07.085198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:07.085258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:07.085306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:07.085364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:07.085416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.085471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.085519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.085578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.085632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.085691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.085739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.085800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.086281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:07.122950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:07.148180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:07.153227Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:07.153272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:07.153293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:07.153319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 337 [2:7559593359329334715:5272]
2025-10-10T14:03:07.153393Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:07.153463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:07.153479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:07.153492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:07.153504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:07.153557Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:07.153580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:07.153602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:07.154978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.155009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.155025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.155041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.155054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:07.155389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:07.155412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.155577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.155801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.156070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.156202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:07.156279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.156299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.156313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.156325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.156370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:07.156460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:07.156656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:07.156674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:07.156800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.156823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:07.159154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 337
2025-10-10T14:03:07.159264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 337, pipe: [1:7559593360907252682:5422]
2025-10-10T14:03:07.159354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 337
2025-10-10T14:03:07.158000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:07.158019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:07.158032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:07.158044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:07.158069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:07.165232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593356612285271:2442], now have 1 active actors on pipe
2025-10-10T14:03:07.165285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593360907252682:5422], now have 1 active actors on pipe
2025-10-10T14:03:07.165312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593356612285315:5807], now have 1 active actors on pipe
2025-10-10T14:03:07.165397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:07.165421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:07.165509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:07.165542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:07.165562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:07.165572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:07.165609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:07.165652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:07.165702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:07.174684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:07.174730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:07.174818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:07.176755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 338 partition: 0 MaxSeqNo: 36 sessionId: src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0
2025-10-10T14:03:07.179909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c9aed70-ecf5bab2-525b545f-8ff16be5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:07.233505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0] Write session: try to update token
2025-10-10T14:03:07.233563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:07.336972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:07.337010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:07.337023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:07.337159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:07.337175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:07.337190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:07.337202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:07.337214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:07.337251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.337280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.337304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.337327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.337695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:07.337741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:07.337768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:07.337796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:07.365156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:07.365217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.365242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:07.377400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:07.495272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId: src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:07.546121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:07.591901Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:07.610347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:07.610381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:07.610430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593359329334710:5272]
2025-10-10T14:03:07.610587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:07.610613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:07.610817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:07.616298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:07.613094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:07.613140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:07.623551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:07.623735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593360907252682:5422]
2025-10-10T14:03:07.623834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 338 reason: error at write: Disconnected sessionId: src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0
2025-10-10T14:03:07.624203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 338 sessionId: src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0 is DEAD
2025-10-10T14:03:07.629399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:07.629443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0] Write session will restart in 0.007368s
2025-10-10T14:03:07.629549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0] Write session: Do CDS request
2025-10-10T14:03:07.629578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:07.647020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:07.654971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:07.655005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 339
2025-10-10T14:03:07.657531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:07.657663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:07.657678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:07.657688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:07.660342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 339 sessionId:  describe result for acl check
2025-10-10T14:03:07.660476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:07.660486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:07.660494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:07.660510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593360907252773:5819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:07.663716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593360907252773:5819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:07.675217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593360907252773:5819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:07.699100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593360907252773:5819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:07.699141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593360907252773:5819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:07.699157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593360907252773:5819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:07.699186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:07.721627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593360907252815:5422]
2025-10-10T14:03:07.886850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:07.892671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:07.893523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:07.893554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:07.893601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:07.893860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:07.894033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593359329334900:5281]
2025-10-10T14:03:07.896253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:07.899180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:07.899401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:07.900752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:07.901066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:07.901075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:07.901083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:07.901090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:07.901098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:07.901104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:07.901111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:07.901117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:07.901146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.901155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.901162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.901168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.901213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:07.901311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:07.901356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:07.901406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:07.901446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:07.901491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:07.901533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:07.901579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:07.901625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.901668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.901728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.901771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.901811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:07.901875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:07.901928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:07.901978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:07.902023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:07.902076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:07.902120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:07.902179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:07.902225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:07.902273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:07.902316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:07.902366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:07.902411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:07.902461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:07.902504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:07.902556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:07.902601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.902667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.902710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.902762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.902806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.902855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.902900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.902949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.903353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:07.962520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:07.995190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:07.995228Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:07.995243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:07.995273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:07.995295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 338 [2:7559593359329334900:5281]
2025-10-10T14:03:07.995343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:07.995396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:07.995409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:07.995420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:07.995432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:07.995480Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:07.995502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:07.995521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:07.997969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.997994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.998005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.998017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.998027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:07.998267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:07.998285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:07.998408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:07.998562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:07.998772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:07.998873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:07.998952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593360907252762:2442], now have 1 active actors on pipe
2025-10-10T14:03:07.998972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593360907252805:5819], now have 1 active actors on pipe
2025-10-10T14:03:07.998990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593360907252815:5422], now have 1 active actors on pipe
2025-10-10T14:03:07.999022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593359329334889:5281]
2025-10-10T14:03:07.999035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593359329334889:5281]
2025-10-10T14:03:07.999046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593359329334889:5281]
2025-10-10T14:03:07.999056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593359329334889:5281]
2025-10-10T14:03:07.999118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:07.999129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:07.999138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:07.999147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:08.001407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 338
2025-10-10T14:03:08.001509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 338
2025-10-10T14:03:08.001563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 338, pipe: [1:7559593360907252815:5422]
2025-10-10T14:03:08.005405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:08.005534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:08.005707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:08.005730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:08.005813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:08.005836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:08.005987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593359329334889:5281]
2025-10-10T14:03:08.006022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:08.006094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8948b435-4a1ec-12f0104c-1240abd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:08.006126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:08.006144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:08.006153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:08.006188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:08.006230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:08.006354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:08.006516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:08.011089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 339 partition: 0 MaxSeqNo: 36 sessionId: src_id|8948b435-4a1ec-12f0104c-1240abd1_0
2025-10-10T14:03:08.010692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:08.010724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:08.010794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:08.017376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457fd5e4-9972d2ff-69f96ce2-939ef651_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8948b435-4a1ec-12f0104c-1240abd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:08.093277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:08.093318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:08.093334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:08.141495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8948b435-4a1ec-12f0104c-1240abd1_0] Write session: try to update token
2025-10-10T14:03:08.141560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8948b435-4a1ec-12f0104c-1240abd1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:08.218566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:08.218602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:08.218616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:08.218687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:08.218702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:08.218719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:08.218732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:08.218744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:08.218782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593359329334889:5281]
2025-10-10T14:03:08.218813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593359329334889:5281]
2025-10-10T14:03:08.218842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593359329334889:5281]
2025-10-10T14:03:08.218866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593359329334889:5281]
2025-10-10T14:03:08.219075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:08.219134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:08.219159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:08.219315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:08.219357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:08.219387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:08.219424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:08.233078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:08.318992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId: src_id|8948b435-4a1ec-12f0104c-1240abd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:08.350166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:08.401107Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:08.414031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:08.414077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:08.423351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:08.423379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:08.426386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593360907252815:5422]
2025-10-10T14:03:08.426022Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:08.426482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:08.485192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8948b435-4a1ec-12f0104c-1240abd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:08.485235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8948b435-4a1ec-12f0104c-1240abd1_0] Write session will restart in 0.007425s
2025-10-10T14:03:08.485340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8948b435-4a1ec-12f0104c-1240abd1_0] Write session: Do CDS request
2025-10-10T14:03:08.485374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8948b435-4a1ec-12f0104c-1240abd1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:08.483860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 339 reason: error at write: Disconnected sessionId: src_id|8948b435-4a1ec-12f0104c-1240abd1_0
2025-10-10T14:03:08.484162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 339 sessionId: src_id|8948b435-4a1ec-12f0104c-1240abd1_0 is DEAD
2025-10-10T14:03:08.501681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:08.501712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 340
2025-10-10T14:03:08.502679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8948b435-4a1ec-12f0104c-1240abd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:08.503283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:08.503442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:08.503460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:08.503472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:08.505178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 340 sessionId:  describe result for acl check
2025-10-10T14:03:08.505305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:08.505318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:08.505329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:08.505347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593365202220291:5829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:08.509567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593365202220291:5829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:08.528227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593365202220333:5422]
2025-10-10T14:03:08.535165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593365202220291:5829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:08.591476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593365202220291:5829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:08.591518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593365202220291:5829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:08.591535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593365202220291:5829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:08.591568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:08.624138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:08.632325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:08.633626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:08.633657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:08.633711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:08.634061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:08.634267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593363624302391:5292]
2025-10-10T14:03:08.636535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:08.638438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:08.638721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:08.640006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:08.640341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:08.640349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:08.640357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:08.640366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:08.640374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:08.640380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:08.640389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:08.640399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:08.640406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:08.640414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:08.640421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:08.640429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:08.640480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:08.640589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:08.640666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:08.640712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:08.640759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:08.640804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:08.640847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:08.640896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:08.640946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:08.640994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:08.641042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:08.641088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:08.641155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:08.641222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:08.641284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:08.641342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:08.641390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:08.642453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:08.642523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:08.642606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:08.642671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:08.642728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:08.642779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:08.642832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:08.642881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:08.642937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:08.642984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:08.643035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:08.643083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:08.643134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:08.643182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:08.643236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:08.643289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:08.643342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:08.643388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:08.643440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:08.643889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:08.678261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:08.698558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:08.698610Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:08.698629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:08.698668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:08.698696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 339 [2:7559593363624302391:5292]
2025-10-10T14:03:08.698759Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:08.698826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:08.698842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:08.698855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:08.698866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:08.698915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:08.698938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:08.698962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:08.780990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 339, pipe: [1:7559593365202220333:5422]
2025-10-10T14:03:08.781089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 339
2025-10-10T14:03:08.781183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 339
2025-10-10T14:03:08.780218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:08.780247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:08.780261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:08.780273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:08.780285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:08.780568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:08.780585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:08.780713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:08.780901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:08.781154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:08.781255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:08.781340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593365202220333:5422], now have 1 active actors on pipe
2025-10-10T14:03:08.781362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593365202220262:2442], now have 1 active actors on pipe
2025-10-10T14:03:08.781383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593365202220414:5829], now have 1 active actors on pipe
2025-10-10T14:03:08.781406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593363624302386:5292]
2025-10-10T14:03:08.781420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593363624302386:5292]
2025-10-10T14:03:08.781433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593363624302386:5292]
2025-10-10T14:03:08.781445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593363624302386:5292]
2025-10-10T14:03:08.781485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:08.781563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:08.781743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:08.781761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:08.781895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593363624302386:5292]
2025-10-10T14:03:08.781913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:08.783978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:08.784000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:08.784012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:08.784025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:08.784052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:08.785037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:08.785068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:08.785169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:08.785204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:08.785222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:08.785232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:08.785273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:08.785323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:08.785370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:08.789435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:08.789477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:08.789562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:08.790036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 340 partition: 0 MaxSeqNo: 36 sessionId: src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0
2025-10-10T14:03:08.791013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8948b435-4a1ec-12f0104c-1240abd1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:08.797292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:08.797320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:08.797331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:08.827567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0] Write session: try to update token
2025-10-10T14:03:08.827633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:08.897780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:08.897807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:08.897819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:09.075040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:09.075074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:09.075086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:09.075144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:09.075157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:09.075171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:09.075181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:09.075191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:09.075228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593363624302386:5292]
2025-10-10T14:03:09.075253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593363624302386:5292]
2025-10-10T14:03:09.075274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593363624302386:5292]
2025-10-10T14:03:09.075292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593363624302386:5292]
2025-10-10T14:03:09.075404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:09.075440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:09.075446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:09.075469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:09.075472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:09.075481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:09.075498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:09.076943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:09.216441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId: src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:09.304275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:09.449874Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:09.452805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:09.452854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:09.456711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:09.458057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593365202220333:5422]
2025-10-10T14:03:09.458176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:09.458382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:09.512437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 340 reason: status is not ok: tablet will be restarted right now sessionId: src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0
2025-10-10T14:03:09.512790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 340 sessionId: src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0 is DEAD
2025-10-10T14:03:09.513764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:09.513788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0] Write session will restart in 0.006384s
2025-10-10T14:03:09.513853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0] Write session: Do CDS request
2025-10-10T14:03:09.513875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:09.526399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:09.529878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:09.529912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 341
2025-10-10T14:03:09.530457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:09.530598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:09.530623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:09.530635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:09.532242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 341 sessionId:  describe result for acl check
2025-10-10T14:03:09.532375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:09.532386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:09.532397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:09.532415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593369497187784:5842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:09.536031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593369497187784:5842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:09.546393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593369497187784:5842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:09.558193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593369497187813:5422]
2025-10-10T14:03:09.575977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593369497187784:5842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:09.576022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593369497187784:5842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:09.576041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593369497187784:5842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:09.576075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:09.650914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:09.658886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:09.659686Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:09.659698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:09.659730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:09.659935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:09.660067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593367919269880:5302]
2025-10-10T14:03:09.661665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:09.662507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:09.662819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:09.664260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:09.664608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:09.664627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:09.664635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:09.664642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:09.664650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:09.664660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:09.664668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:09.664676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:09.664683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:09.664691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:09.664700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:09.664708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:09.664757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:09.664874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:09.664927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:09.664993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:09.665044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:09.665106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:09.665182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:09.665248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:09.665307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:09.665363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:09.665418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:09.665471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:09.665518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:09.665605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:09.665672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:09.665736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:09.665792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:09.665860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:09.665921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:09.665980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:09.666035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:09.666092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:09.666288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:09.666353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:09.666410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:09.666471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:09.666526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:09.666585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:09.666643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:09.666721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:09.666777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:09.666842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:09.666898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:09.666960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:09.667014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:09.667072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:09.667471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:09.693024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:09.711055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:09.711099Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:09.711117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:09.711138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:09.711162Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 340 [2:7559593367919269880:5302]
2025-10-10T14:03:09.711216Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:09.711271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:09.711286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:09.711299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:09.711310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:09.711355Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:09.711377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:09.711399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:09.743399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:09.743432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:09.743448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:09.743459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:09.743471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:09.743724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:09.743741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:09.743882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:09.744074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:09.744302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:09.744423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:09.744489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:09.744504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:09.744518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:09.744533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:09.744573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:09.744651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:09.744838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:09.744864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:09.744986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:09.745006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:09.745239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:09.745252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:09.745263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:09.745276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:09.745300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:09.747319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593369497187813:5422], now have 1 active actors on pipe
2025-10-10T14:03:09.747358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593369497187827:5842], now have 1 active actors on pipe
2025-10-10T14:03:09.747384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593369497187776:2442], now have 1 active actors on pipe
2025-10-10T14:03:09.747963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 340, pipe: [1:7559593369497187813:5422]
2025-10-10T14:03:09.748085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 340
2025-10-10T14:03:09.748154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 340
2025-10-10T14:03:09.748924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:09.748958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:09.749035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:09.749067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:09.749086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:09.749097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:09.749153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:09.749199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:09.749259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:09.757429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:09.757471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:09.757547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:09.761498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 341 partition: 0 MaxSeqNo: 36 sessionId: src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0
2025-10-10T14:03:09.765584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33d13a9a-81192fb0-40cefd42-69f4e420_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:09.796728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:09.796766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:09.796802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:09.796925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:09.801258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:09.801845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:09.829719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:09.843718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0] Write session: try to update token
2025-10-10T14:03:09.843774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:09.856618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:09.874149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:09.922805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:09.932151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:09.932205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:09.932225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:09.932308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:10.041214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:10.041249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:10.041261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:10.041323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:10.041336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:10.041350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:10.041362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:10.041374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:10.041417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:10.041447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:10.041470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:10.041493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593367919269875:5302]
2025-10-10T14:03:10.041635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:10.041661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:10.041672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:10.042771Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:10.045647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:10.045685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:10.045715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:10.045743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:10.079954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId: src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:10.103415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:10.232727Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:10.238668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:10.238731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:10.239494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:10.247775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:10.249395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593369497187813:5422]
2025-10-10T14:03:10.249552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:10.252418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 341 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0
2025-10-10T14:03:10.252773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 341 sessionId: src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0 is DEAD
2025-10-10T14:03:10.258227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:10.258269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0] Write session will restart in 0.009740s
2025-10-10T14:03:10.258371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0] Write session: Do CDS request
2025-10-10T14:03:10.258400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:10.277051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:10.277082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 342
2025-10-10T14:03:10.277638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:10.278484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:10.278635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:10.278652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:10.278662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:10.283005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 342 sessionId:  describe result for acl check
2025-10-10T14:03:10.283267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:10.283302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:10.283326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:10.283349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593373792155286:5851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:10.286653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593373792155286:5851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:10.296543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593373792155286:5851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:10.346075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593373792155286:5851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:10.346118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593373792155286:5851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:10.346137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593373792155286:5851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:10.346170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:10.375087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593373792155376:5422]
2025-10-10T14:03:10.429017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:10.429563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:10.430365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:10.430384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:10.430432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:10.430710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:10.430913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593372214237371:5312]
2025-10-10T14:03:10.437555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:10.438886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:10.439076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:10.440023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:10.440266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:10.440278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:10.440283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:10.440289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:10.440294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:10.440299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:10.440304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:10.440308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:10.440313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:10.440319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:10.440323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:10.440328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:10.440364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:10.440481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:10.440536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:10.440587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:10.440643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:10.440686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:10.440728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:10.440769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:10.440809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:10.440862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:10.440918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:10.440962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:10.440995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:10.441054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:10.441103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:10.441180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:10.441243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:10.441316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:10.441373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:10.441436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:10.441496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:10.441565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:10.441618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:10.441693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:10.441750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:10.441813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:10.441889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:10.441959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:10.442023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:10.442086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:10.442143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:10.442203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:10.442258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:10.442318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:10.442369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:10.442433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:10.442968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:10.475708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:10.535461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:10.535509Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:10.535528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:10.535549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:10.535574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 341 [2:7559593372214237371:5312]
2025-10-10T14:03:10.535640Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:10.535703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:10.535719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:10.535732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:10.535744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:10.535793Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:10.535817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:10.535840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:10.537616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:10.537647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:10.537662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:10.537677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:10.537690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:10.537976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:10.538004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:10.538156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:10.538354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:10.538629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:10.538798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:10.538895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593373792155376:5422], now have 1 active actors on pipe
2025-10-10T14:03:10.538921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593373792155279:2442], now have 1 active actors on pipe
2025-10-10T14:03:10.538945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593373792155338:5851], now have 1 active actors on pipe
2025-10-10T14:03:10.538971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.538987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.539001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.539016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.539057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:10.539143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:10.539338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:10.539367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:10.539496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.539522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:10.539710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:10.539449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 341, pipe: [1:7559593373792155376:5422]
2025-10-10T14:03:10.539730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:10.539743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:10.539558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 341
2025-10-10T14:03:10.539757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:10.539640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 341
2025-10-10T14:03:10.539781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:10.540368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:10.540402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:10.540479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:10.540516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:10.540540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:10.540552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:10.540587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:10.540633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:10.540686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:10.545269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 342 partition: 0 MaxSeqNo: 36 sessionId: src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0
2025-10-10T14:03:10.543571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:10.543611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:10.543693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:10.549401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7754fe90-7264fbd6-1bae0c03-b4611947_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:10.628648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0] Write session: try to update token
2025-10-10T14:03:10.628703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:10.634764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:10.634801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:10.634839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.634962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:10.636339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:10.636810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:10.651016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:10.652226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:10.750590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:10.752401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:10.752770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:10.752786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:10.752798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:10.752916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:10.828669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId: src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:10.858783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:10.858819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:10.858835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:10.858848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:10.858861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:10.858906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.858934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.858961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.858987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593372214237366:5312]
2025-10-10T14:03:10.859160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:10.859174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:10.859186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:10.859231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:10.859258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:10.859270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:10.860385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:10.861619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:10.861665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:10.861694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:10.861722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:10.903062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:11.013919Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:11.020282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:11.020333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:11.022760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:11.023971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:11.024005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:11.036557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593373792155376:5422]
2025-10-10T14:03:11.036640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:11.039869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 342 reason: error at write: Disconnected sessionId: src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0
2025-10-10T14:03:11.042414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:11.040229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 342 sessionId: src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0 is DEAD
2025-10-10T14:03:11.042456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0] Write session will restart in 0.008168s
2025-10-10T14:03:11.042557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0] Write session: Do CDS request
2025-10-10T14:03:11.042588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:11.065413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:11.081663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:11.081700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 343
2025-10-10T14:03:11.087295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:11.087452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:11.087469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:11.087480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:11.090383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 343 sessionId:  describe result for acl check
2025-10-10T14:03:11.090518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:11.090529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:11.090538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:11.090555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593378087122800:5866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:11.096274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593378087122800:5866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:11.117867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593378087122800:5866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:11.137638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593378087122854:5422]
2025-10-10T14:03:11.154304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593378087122800:5866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:11.154349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593378087122800:5866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:11.154366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593378087122800:5866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:11.154401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:11.204314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:11.213951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:11.214902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:11.214921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:11.214965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:11.215247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:11.215469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593376509204862:5322]
2025-10-10T14:03:11.222073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:11.226738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:11.227007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:11.228433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:11.233597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:11.233622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:11.233629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:11.233636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:11.233644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:11.233652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:11.233660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:11.233667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:11.233675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.233683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.233692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.233700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.233757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:11.233873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:11.233929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:11.233981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:11.234029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:11.234082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:11.234131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:11.234180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:11.234245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.234295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.234357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.234407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.234453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:11.234524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:11.234584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:11.234643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:11.234693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:11.234760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:11.234810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:11.234866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:11.234915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:11.234973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:11.235018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:11.235070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:11.235115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:11.235172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:11.235218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:11.235273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:11.235324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.235378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.235424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.235474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.235522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.235578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.235620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.235678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.236153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:11.325051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:11.341345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:11.341389Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:11.341410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:11.341429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:11.341452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 342 [2:7559593376509204862:5322]
2025-10-10T14:03:11.341509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:11.341565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:11.341579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:11.341593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:11.341606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:11.341653Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:11.341676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:11.341700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:11.344366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.344386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.344401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.344417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.344429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:11.345652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 342
2025-10-10T14:03:11.345735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 342, pipe: [1:7559593378087122854:5422]
2025-10-10T14:03:11.345808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 342
2025-10-10T14:03:11.346273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:11.346305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.346451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.346651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.346920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.347050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:11.347094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593378087122887:5866], now have 1 active actors on pipe
2025-10-10T14:03:11.347119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593378087122854:5422], now have 1 active actors on pipe
2025-10-10T14:03:11.347144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593378087122778:2442], now have 1 active actors on pipe
2025-10-10T14:03:11.347745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.347767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.347783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.347797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.347833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:11.347947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:11.347973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:11.348033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:11.348232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:11.348250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:11.348414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:11.348445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:11.348463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:11.348474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:11.348508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:11.348549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:11.348590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.348612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:11.348710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:11.349292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:11.349311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:11.349323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:11.349335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:11.349358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:11.363619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:11.363665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:11.363754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:11.364250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 343 partition: 0 MaxSeqNo: 36 sessionId: src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0
2025-10-10T14:03:11.365366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573b51c4-90e7d2ec-be4ff41b-49488fef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:11.420636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0] Write session: try to update token
2025-10-10T14:03:11.420692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:11.445378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:11.445407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:11.445419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:11.621962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:11.621997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:11.622010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:11.622063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:11.622077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:11.622088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:11.622101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:11.622112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:11.622145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.622174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.622201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.622224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.622393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:11.622427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:11.622459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:11.622488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:11.645321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId: src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:11.663937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:11.663988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.664000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:11.665064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:11.690006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:11.823405Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:11.834217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:11.834254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:11.834301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593376509204857:5322]
2025-10-10T14:03:11.834453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:11.834480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:11.836697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593378087122854:5422]
2025-10-10T14:03:11.836779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:11.836903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:11.836917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:11.834865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:11.840108Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:11.844724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 343 reason: error at write: Disconnected sessionId: src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0
2025-10-10T14:03:11.845113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 343 sessionId: src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0 is DEAD
2025-10-10T14:03:11.846417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:11.846453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0] Write session will restart in 0.006127s
2025-10-10T14:03:11.846552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0] Write session: Do CDS request
2025-10-10T14:03:11.846582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:11.874408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:11.877541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:11.877593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 344
2025-10-10T14:03:11.878923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:11.879082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:11.879100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:11.879109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:11.881323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 344 sessionId:  describe result for acl check
2025-10-10T14:03:11.881440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:11.881451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:11.881460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:11.881476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593378087123013:5875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:11.884294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593378087123013:5875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:11.904134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593378087123013:5875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:11.924050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593378087123013:5875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:11.924092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593378087123013:5875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:11.924111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593378087123013:5875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:11.924143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:11.937610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593378087123155:5422]
2025-10-10T14:03:11.948336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:11.956683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:11.957724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:11.957743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:11.957789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:11.958080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:11.958270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593376509205069:5333]
2025-10-10T14:03:11.960606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:11.966982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:11.967278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:11.968519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:11.968845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:11.968855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:11.968861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:11.968868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:11.968874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:11.968881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:11.968887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:11.968894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:11.968900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.968909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.968916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.968922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.968966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:11.969067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:11.969111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:11.969170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:11.969213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:11.969255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:11.969298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:11.969341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:11.969384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.969429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.969471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.969514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.969555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:11.969618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:11.969672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:11.969720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:11.969766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:11.969816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:11.969858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:11.969904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:11.969950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:11.970003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:11.970048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:11.970096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:11.970141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:11.970189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:11.970227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:11.970275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:11.970324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.970377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:11.970420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.970470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:11.970515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.970563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:11.970605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.970654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:11.971100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:12.058903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:12.072187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:12.072235Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:12.072254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:12.072277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:12.072303Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 343 [2:7559593376509205069:5333]
2025-10-10T14:03:12.072365Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:12.072428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:12.072444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:12.072458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:12.072471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:12.072517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:12.072540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:12.072564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:12.074958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:12.074986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:12.075002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:12.075018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:12.075030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:12.075309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:12.075328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:12.075488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:12.075691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:12.075943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:12.076074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:12.076143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593376509205064:5333]
2025-10-10T14:03:12.076158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593376509205064:5333]
2025-10-10T14:03:12.076171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593376509205064:5333]
2025-10-10T14:03:12.076184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593376509205064:5333]
2025-10-10T14:03:12.076224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:12.076307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:12.076501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:12.076518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:12.076643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593376509205064:5333]
2025-10-10T14:03:12.076665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:12.081308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 343, pipe: [1:7559593378087123155:5422]
2025-10-10T14:03:12.081453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 343
2025-10-10T14:03:12.081463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 343
2025-10-10T14:03:12.077400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:12.077421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:12.077435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:12.077447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:12.077470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:12.082150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593378087123155:5422], now have 1 active actors on pipe
2025-10-10T14:03:12.082187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593378087123122:5875], now have 1 active actors on pipe
2025-10-10T14:03:12.082211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593378087122998:2442], now have 1 active actors on pipe
2025-10-10T14:03:12.082284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:12.082308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:12.082388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdf11223-19cde5f3-6742e428-781f19c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:12.082421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:12.082440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:12.082452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:12.082490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:12.082533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:12.082581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:12.087755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:12.087803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:12.087917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:12.089693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 344 partition: 0 MaxSeqNo: 36 sessionId: src_id|fdf11223-19cde5f3-6742e428-781f19c4_0
2025-10-10T14:03:12.093723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88e025ae-dc52ef35-6e9f9d72-fd727f35_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fdf11223-19cde5f3-6742e428-781f19c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:12.155442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf11223-19cde5f3-6742e428-781f19c4_0] Write session: try to update token
2025-10-10T14:03:12.155505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf11223-19cde5f3-6742e428-781f19c4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:12.175955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:12.175987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:12.176000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:12.278128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:12.278167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:12.278182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:12.278196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:12.278222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:12.278267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593376509205064:5333]
2025-10-10T14:03:12.278298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593376509205064:5333]
2025-10-10T14:03:12.278326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593376509205064:5333]
2025-10-10T14:03:12.278350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593376509205064:5333]
2025-10-10T14:03:12.278533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:12.278548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:12.278562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:12.278607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:12.278636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:12.278651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:12.278856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:12.278897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:12.278933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:12.278968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:12.297776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:12.429261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId: src_id|fdf11223-19cde5f3-6742e428-781f19c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:12.511086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:12.553059Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:12.555387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:12.555432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:12.557482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:12.557520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593378087123155:5422]
2025-10-10T14:03:12.557526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:12.557658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:12.565769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:12.640951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 344 reason: error at write: Disconnected sessionId: src_id|fdf11223-19cde5f3-6742e428-781f19c4_0
2025-10-10T14:03:12.645595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 344 sessionId: src_id|fdf11223-19cde5f3-6742e428-781f19c4_0 is DEAD
2025-10-10T14:03:12.653527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf11223-19cde5f3-6742e428-781f19c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:12.653609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf11223-19cde5f3-6742e428-781f19c4_0] Write session will restart in 0.008163s
2025-10-10T14:03:12.653759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf11223-19cde5f3-6742e428-781f19c4_0] Write session: Do CDS request
2025-10-10T14:03:12.653794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf11223-19cde5f3-6742e428-781f19c4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:12.658075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593382382090517:5422]
2025-10-10T14:03:12.674323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf11223-19cde5f3-6742e428-781f19c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:12.674409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:12.674439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 345
2025-10-10T14:03:12.677466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:12.677631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:12.677649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:12.677662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:12.682546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 345 sessionId:  describe result for acl check
2025-10-10T14:03:12.682684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:12.682696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:12.682706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:12.682724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593382382090572:5881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:12.689324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593382382090572:5881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:12.715996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593382382090572:5881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:12.737242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:12.741440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:12.742332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:12.742352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:12.742398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:12.742669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:12.742866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593380804172558:5335]
2025-10-10T14:03:12.744998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:12.752649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:12.752957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:12.754302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:12.754690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:12.754698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:12.754706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:12.754714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:12.754720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:12.769595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593382382090572:5881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:12.769637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593382382090572:5881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:12.769655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593382382090572:5881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:12.769687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:12.754727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:12.754734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:12.754758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:12.754764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:12.754770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:12.754776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:12.754783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:12.754827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:12.754932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:12.754979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:12.755026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:12.755071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:12.755117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:12.755158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:12.755201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:12.755244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:12.755289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:12.755334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:12.755375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:12.755413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:12.755472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:12.755530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:12.755578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:12.755625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:12.755676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:12.755720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:12.755771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:12.755815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:12.755868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:12.755913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:12.755963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:12.756008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:12.756061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:12.756102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:12.756152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:12.756199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:12.756249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:12.756294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:12.756344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:12.756391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:12.756444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:12.756488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:12.756539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:12.756963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:12.814462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:12.838446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:12.838491Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:12.838510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:12.838531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:12.838554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 344 [2:7559593380804172558:5335]
2025-10-10T14:03:12.838615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:12.838672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:12.838688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:12.838700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:12.838711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:12.838777Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:12.838800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:12.838820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:12.841848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:12.841876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:12.841891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:12.841906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:12.841917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:12.842237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:12.842254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:12.842403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:12.842601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:12.842866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:12.842991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:12.843067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:12.843085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:12.843099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:12.843114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:12.843165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:12.843247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:12.843433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:12.843450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:12.843598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:12.843618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:12.847152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 344
2025-10-10T14:03:12.847228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 344, pipe: [1:7559593382382090517:5422]
2025-10-10T14:03:12.847300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 344
2025-10-10T14:03:12.845028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:12.845051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:12.845064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:12.845077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:12.845101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:12.854690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593382382090647:5881], now have 1 active actors on pipe
2025-10-10T14:03:12.854757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593382382090517:5422], now have 1 active actors on pipe
2025-10-10T14:03:12.854781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593382382090478:2442], now have 1 active actors on pipe
2025-10-10T14:03:12.854846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:12.854871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:12.854975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:12.855008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:12.855028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:12.855040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:12.855077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:12.855119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:12.855170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:12.859755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:12.859801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:12.859885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:12.860454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 345 partition: 0 MaxSeqNo: 36 sessionId: src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0
2025-10-10T14:03:12.861641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdf11223-19cde5f3-6742e428-781f19c4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:12.944618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:12.944652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:12.944664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:12.993958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0] Write session: try to update token
2025-10-10T14:03:12.994031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:13.129054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:13.129084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:13.129095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:13.129167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:13.129182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:13.129195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:13.129206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:13.129215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:13.129250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:13.129277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:13.129300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:13.129323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:13.129500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:13.129528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:13.129538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:13.129558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:13.129569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:13.129581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:13.129617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:13.130814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:13.145169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId: src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:13.168137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:13.277296Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:13.294796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:13.294844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:13.294913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:13.294926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:13.294965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593380804172553:5335]
2025-10-10T14:03:13.297384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:13.297411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:13.295444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:13.296390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:13.322461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593382382090517:5422]
2025-10-10T14:03:13.322542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:13.322654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 345 reason: error at write: Disconnected sessionId: src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0
2025-10-10T14:03:13.322977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 345 sessionId: src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0 is DEAD
2025-10-10T14:03:13.325685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:13.325720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0] Write session will restart in 0.007270s
2025-10-10T14:03:13.325819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0] Write session: Do CDS request
2025-10-10T14:03:13.325847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:13.346471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:13.347410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:13.347435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 346
2025-10-10T14:03:13.347704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:13.347808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:13.347823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:13.347833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:13.349189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 346 sessionId:  describe result for acl check
2025-10-10T14:03:13.349296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:13.349306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:13.349317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:13.349334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593386677058002:5893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:13.352189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593386677058002:5893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:13.379893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593386677058002:5893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:13.417836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593386677058002:5893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:13.417874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593386677058002:5893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:13.417892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593386677058002:5893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:13.417922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:13.423169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593386677058155:5422]
2025-10-10T14:03:13.431253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:13.434253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:13.435314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:13.435333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:13.435383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:13.435843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:13.436050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593385099140053:5350]
2025-10-10T14:03:13.440723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:13.441820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:13.442047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:13.443397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:13.443716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:13.443731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:13.443740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:13.443748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:13.443756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:13.443763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:13.443770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:13.443777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:13.443784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:13.443791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:13.443799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:13.443806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:13.443855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:13.443970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:13.444022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:13.444075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:13.444129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:13.444192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:13.444257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:13.444310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:13.444369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:13.444422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:13.444469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:13.444515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:13.444557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:13.444626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:13.444716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:13.444789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:13.444838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:13.444895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:13.444941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:13.445022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:13.445090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:13.445810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:13.445879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:13.445938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:13.445992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:13.446053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:13.446114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:13.446189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:13.446247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:13.446306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:13.446354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:13.446413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:13.446475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:13.446552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:13.446623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:13.446688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:13.447227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:13.513497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:13.527948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:13.528004Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:13.528023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:13.528059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:13.528088Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 345 [2:7559593385099140053:5350]
2025-10-10T14:03:13.528162Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:13.528224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:13.528242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:13.528255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:13.528267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:13.528317Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:13.528341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:13.528363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:13.536206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 345, pipe: [1:7559593386677058155:5422]
2025-10-10T14:03:13.536351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 345
2025-10-10T14:03:13.536454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 345
2025-10-10T14:03:13.531933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:13.531966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:13.531979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:13.531994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:13.532004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:13.532303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:13.532320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:13.532471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:13.532673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:13.532920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:13.533039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:13.533119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.533156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.533171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.533185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.533228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:13.533315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:13.533494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:13.533511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:13.533643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.533660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:13.533981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:13.533994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:13.534006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:13.534016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:13.534040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:13.542091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593386677058155:5422], now have 1 active actors on pipe
2025-10-10T14:03:13.542136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593386677058150:5893], now have 1 active actors on pipe
2025-10-10T14:03:13.542159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593386677057992:2442], now have 1 active actors on pipe
2025-10-10T14:03:13.542219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:13.542245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:13.542347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:13.542402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:13.542420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:13.542431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:13.542473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:13.542521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:13.542574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:13.544214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:13.544249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:13.544321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:13.544733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 346 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0
2025-10-10T14:03:13.549362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f0cbd8b-65c498bd-8a24fdf9-73093999_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:13.583800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0] Write session: try to update token
2025-10-10T14:03:13.583861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:13.761932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:13.761965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:13.761977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:13.762029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:13.762044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:13.762056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:13.762066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:13.762077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:13.762113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.762141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.762168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.762190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.762385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:13.762411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:13.762423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:13.763548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:13.765680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:13.765721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:13.765751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:13.765780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:13.809255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId: src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:13.877524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:13.914235Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:13.924579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:13.924634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:13.924701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:13.924717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:13.924761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593385099140048:5350]
2025-10-10T14:03:13.924983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:13.926612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:13.926635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:13.933298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:13.933452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593386677058155:5422]
2025-10-10T14:03:13.934278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:13.997676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 346 reason: error at write: Disconnected sessionId: src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0
2025-10-10T14:03:13.998024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 346 sessionId: src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0 is DEAD
2025-10-10T14:03:14.005356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:14.005404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0] Write session will restart in 0.007407s
2025-10-10T14:03:14.005536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0] Write session: Do CDS request
2025-10-10T14:03:14.005567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:14.022425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:14.024034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:14.024068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 347
2025-10-10T14:03:14.026052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:14.026195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:14.026211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:14.026222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:14.030028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 347 sessionId:  describe result for acl check
2025-10-10T14:03:14.030164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:14.030175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:14.030184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:14.030200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593390972025558:5902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:14.035644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593390972025558:5902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:14.037635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593390972025584:5422]
2025-10-10T14:03:14.056832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593390972025558:5902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:14.074789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593390972025558:5902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:14.074831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593390972025558:5902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:14.074850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593390972025558:5902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:14.074882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:14.075419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:14.084142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:14.085043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:14.085079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:14.085145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:14.085439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:14.085645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593389394107534:5356]
2025-10-10T14:03:14.088049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:14.089148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:14.089382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:14.090727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:14.091119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:14.091139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:14.091148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:14.091155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:14.091163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:14.091172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:14.091180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:14.091188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:14.091196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.091203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.091210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.091217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.091269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:14.091390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:14.091447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:14.091500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:14.091548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:14.091598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:14.091650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:14.091698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:14.091747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.091796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.091848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.091900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.091946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:14.092020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:14.092087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:14.092151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:14.092204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:14.092263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:14.092314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:14.092371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:14.092423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:14.092497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:14.092548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:14.092610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:14.092662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:14.092721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:14.092770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:14.092827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:14.092881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.092942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.092990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.093050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.093100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.094176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.094248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.094309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.094834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:14.136664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:14.187272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:14.187322Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:14.187341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:14.187364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:14.187389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 346 [2:7559593389394107534:5356]
2025-10-10T14:03:14.187444Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:14.187507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:14.187524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:14.187537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:14.187550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:14.187602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:14.187625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:14.187648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:14.188818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.188837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.188853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.188867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.188877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:14.189558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:14.189578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.190434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 346
2025-10-10T14:03:14.190526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 346, pipe: [1:7559593390972025584:5422]
2025-10-10T14:03:14.190617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 346
2025-10-10T14:03:14.189738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.189960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.190210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.190336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:14.190426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593386677058190:2442], now have 1 active actors on pipe
2025-10-10T14:03:14.190454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593390972025584:5422], now have 1 active actors on pipe
2025-10-10T14:03:14.190479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593390972025649:5902], now have 1 active actors on pipe
2025-10-10T14:03:14.190505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593389394107527:5356]
2025-10-10T14:03:14.190520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593389394107527:5356]
2025-10-10T14:03:14.190546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593389394107527:5356]
2025-10-10T14:03:14.190559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593389394107527:5356]
2025-10-10T14:03:14.190601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:14.190684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:14.190882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:14.190897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:14.191020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593389394107527:5356]
2025-10-10T14:03:14.191040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:14.191385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:14.191400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:14.191412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:14.191427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:14.191460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:14.194356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:14.194396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:14.194479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:14.194512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:14.194535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:14.194547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:14.194583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:14.194627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:14.194675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:14.200845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:14.200886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:14.200975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:14.202321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9926c60-1e7f916-dac50e62-1f2664d6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:14.201424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 347 partition: 0 MaxSeqNo: 36 sessionId: src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0
2025-10-10T14:03:14.244974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0] Write session: try to update token
2025-10-10T14:03:14.245035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:14.334656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:14.334692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:14.334705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:14.338461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:14.338502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:14.338517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:14.338528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:14.338540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:14.338581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593389394107527:5356]
2025-10-10T14:03:14.338612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593389394107527:5356]
2025-10-10T14:03:14.338636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593389394107527:5356]
2025-10-10T14:03:14.338661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593389394107527:5356]
2025-10-10T14:03:14.338856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:14.338855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:14.338883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.338895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:14.338896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:14.338950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:14.338986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:14.349890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:14.394153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId: src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:14.426652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:14.529740Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:14.532588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:14.532622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:14.538166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:14.541330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:14.541615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593390972025584:5422]
2025-10-10T14:03:14.541763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:14.606042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 347 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0
2025-10-10T14:03:14.606388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 347 sessionId: src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0 is DEAD
2025-10-10T14:03:14.609603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:14.609667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0] Write session will restart in 0.006480s
2025-10-10T14:03:14.609821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0] Write session: Do CDS request
2025-10-10T14:03:14.609869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:14.622713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:14.625381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:14.625411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 348
2025-10-10T14:03:14.628928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:14.629076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:14.629092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:14.629102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:14.630531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 348 sessionId:  describe result for acl check
2025-10-10T14:03:14.630641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:14.630653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:14.630662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:14.630681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593390972025710:5914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:14.633671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593390972025710:5914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:14.642640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593390972025733:5422]
2025-10-10T14:03:14.674504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593390972025710:5914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:14.704059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593390972025710:5914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:14.704106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593390972025710:5914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:14.704122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593390972025710:5914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:14.704151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:14.709295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:14.720109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:14.721027Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:14.721046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:14.721090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:14.721388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:14.721595Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593389394107731:5364]
2025-10-10T14:03:14.723859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:14.730548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:14.730836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:14.732215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:14.732552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:14.732560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:14.732569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:14.732576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:14.732583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:14.732590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:14.732598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:14.732607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:14.732614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.732622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.732629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.732636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.732685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:14.732797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:14.732848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:14.732898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:14.732941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:14.732992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:14.733039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:14.733088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:14.733158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.733210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.733260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.733310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.733352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:14.733423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:14.733484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:14.733540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:14.733590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:14.733649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:14.733695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:14.733749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:14.733803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:14.733862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:14.733910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:14.733963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:14.734011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:14.734066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:14.734114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:14.734171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:14.734223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.734294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.734346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.734400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.734451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.734505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.734551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.734603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.735071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:14.789983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:14.821230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:14.821277Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:14.821294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:14.821315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:14.821339Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 347 [2:7559593389394107731:5364]
2025-10-10T14:03:14.821400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:14.821455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:14.821469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:14.821482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:14.821492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:14.821543Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:14.821565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:14.821586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:14.857288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.857321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.857337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.857352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.857364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:14.857661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:14.857683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:14.857843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:14.858041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:14.858298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:14.858426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:14.858502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593389394107726:5364]
2025-10-10T14:03:14.858518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593389394107726:5364]
2025-10-10T14:03:14.858533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593389394107726:5364]
2025-10-10T14:03:14.858547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593389394107726:5364]
2025-10-10T14:03:14.858582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:14.858667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:14.858880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:14.858899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:14.859031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593389394107726:5364]
2025-10-10T14:03:14.859059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:14.860156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:14.860185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:14.860200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:14.860212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:14.860242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:14.860777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593390972025685:2442], now have 1 active actors on pipe
2025-10-10T14:03:14.860812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593390972025733:5422], now have 1 active actors on pipe
2025-10-10T14:03:14.860838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593390972025848:5914], now have 1 active actors on pipe
2025-10-10T14:03:14.862904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 347, pipe: [1:7559593390972025733:5422]
2025-10-10T14:03:14.863014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 347
2025-10-10T14:03:14.863372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 347
2025-10-10T14:03:14.877271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:14.877318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:14.877421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:14.877459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:14.877479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:14.877490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:14.877528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:14.877575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:14.877625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:14.886304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:14.886345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:14.886428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:14.890433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 348 partition: 0 MaxSeqNo: 36 sessionId: src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0
2025-10-10T14:03:14.897349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cd57fa-607afb29-862a6948-c631e8cf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:14.925388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:14.925420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:14.925432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:14.952817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0] Write session: try to update token
2025-10-10T14:03:14.952876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:15.133879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:15.133918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:15.133932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:15.133991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:15.134009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:15.134024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:15.134034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:15.134046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:15.134084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593389394107726:5364]
2025-10-10T14:03:15.134115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593389394107726:5364]
2025-10-10T14:03:15.134142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593389394107726:5364]
2025-10-10T14:03:15.134166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593389394107726:5364]
2025-10-10T14:03:15.134317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:15.134346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:15.134359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:15.137365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:15.137409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:15.137438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:15.137466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:15.154391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:15.298909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId: src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:15.344843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:15.450297Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:15.452489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:15.452537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:15.455029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:15.455990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:15.456016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:15.461350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593390972025733:5422]
2025-10-10T14:03:15.461435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:15.565307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593395266993274:5422]
2025-10-10T14:03:15.572663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 348 reason: error at write: Disconnected sessionId: src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0
2025-10-10T14:03:15.575147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:15.575227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0] Write session will restart in 0.009889s
2025-10-10T14:03:15.575432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0] Write session: Do CDS request
2025-10-10T14:03:15.575506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:15.572974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 348 sessionId: src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0 is DEAD
2025-10-10T14:03:15.595100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:15.597379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:15.597411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 349
2025-10-10T14:03:15.597694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:15.597811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:15.597827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:15.597838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:15.599584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 349 sessionId:  describe result for acl check
2025-10-10T14:03:15.599698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:15.599709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:15.599719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:15.599737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593395266993333:5924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:15.602507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593395266993333:5924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:15.618185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593395266993333:5924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:15.620548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:15.635146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:15.635248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593395266993333:5924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:15.635295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593395266993333:5924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:15.635315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593395266993333:5924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:15.635349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:15.636109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:15.636144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:15.636190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:15.636482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:15.636686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593393689075227:5375]
2025-10-10T14:03:15.639614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:15.641514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:15.641822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:15.643288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:15.643702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:15.643725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:15.643734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:15.643741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:15.643750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:15.643757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:15.643764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:15.643772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:15.643779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:15.643788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:15.643796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:15.643803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:15.643862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:15.644002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:15.644059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:15.644117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:15.644171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:15.644229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:15.644284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:15.644339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:15.644403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:15.644457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:15.644514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:15.644568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:15.644623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:15.644700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:15.644770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:15.644832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:15.644890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:15.644956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:15.645011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:15.645078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:15.645887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:15.645975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:15.646036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:15.646099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:15.646156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:15.646220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:15.646274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:15.646335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:15.648412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:15.648504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:15.648567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:15.648637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:15.648698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:15.648761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:15.648818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:15.648885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:15.649494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:15.684047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:15.700353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:15.700612Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:15.700634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:15.700656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:15.700680Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 348 [2:7559593393689075227:5375]
2025-10-10T14:03:15.700734Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:15.700796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:15.700810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:15.700823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:15.700834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:15.700885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:15.700907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:15.700929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:15.704218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 348, pipe: [1:7559593395266993274:5422]
2025-10-10T14:03:15.704330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 348
2025-10-10T14:03:15.704418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 348
2025-10-10T14:03:15.702758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:15.702788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:15.702819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:15.702834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:15.702847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:15.703194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:15.703213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:15.703360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:15.703547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:15.703772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:15.703886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:15.703982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593395266993274:5422], now have 1 active actors on pipe
2025-10-10T14:03:15.704006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593395266993366:5924], now have 1 active actors on pipe
2025-10-10T14:03:15.704028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593395266993199:2442], now have 1 active actors on pipe
2025-10-10T14:03:15.704052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:15.704067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:15.704080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:15.704094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:15.704140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:15.704224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:15.704403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:15.704421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:15.704559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:15.704580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:15.704804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:15.704816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:15.704827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:15.704838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:15.704860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:15.705909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:15.705935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:15.706029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a7f36ab-8370f9aa-325dd319-25566793_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:15.706073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:15.706091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:15.706101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:15.706144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:15.706190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:15.706238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:15.711363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:15.711407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:15.711484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:15.715100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 349 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a7f36ab-8370f9aa-325dd319-25566793_0
2025-10-10T14:03:15.716026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2be99039-19ec8ea-77da0500-a8ba0c50_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a7f36ab-8370f9aa-325dd319-25566793_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:15.740318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7f36ab-8370f9aa-325dd319-25566793_0] Write session: try to update token
2025-10-10T14:03:15.740378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7f36ab-8370f9aa-325dd319-25566793_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:15.842166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:15.842198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:15.842210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:15.842326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:15.842340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:15.842354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:15.842365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:15.842376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:15.842411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:15.842441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:15.842464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:15.842485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:15.842735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:15.842762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:15.842790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:15.842833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:15.874367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:15.874416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:15.874429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:15.875529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:16.044015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId: src_id|3a7f36ab-8370f9aa-325dd319-25566793_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:16.081927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:16.175447Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:16.206018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:16.206054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:16.206104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593393689075222:5375]
2025-10-10T14:03:16.206302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:16.206410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:16.206433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:16.207191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:16.216953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:16.221475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593395266993274:5422]
2025-10-10T14:03:16.221680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:16.313864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593399561960752:5422]
2025-10-10T14:03:16.331800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 349 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3a7f36ab-8370f9aa-325dd319-25566793_0
2025-10-10T14:03:16.332160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 349 sessionId: src_id|3a7f36ab-8370f9aa-325dd319-25566793_0 is DEAD
2025-10-10T14:03:16.333742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7f36ab-8370f9aa-325dd319-25566793_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:16.333810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7f36ab-8370f9aa-325dd319-25566793_0] Write session will restart in 0.009879s
2025-10-10T14:03:16.333965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7f36ab-8370f9aa-325dd319-25566793_0] Write session: Do CDS request
2025-10-10T14:03:16.334028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7f36ab-8370f9aa-325dd319-25566793_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:16.350755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7f36ab-8370f9aa-325dd319-25566793_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:16.353461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:16.353497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 350
2025-10-10T14:03:16.353871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:16.353997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:16.354014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:16.354024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:16.362526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 350 sessionId:  describe result for acl check
2025-10-10T14:03:16.362664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:16.362674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:16.362685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:16.362703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593399561960817:5932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:16.365646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593399561960817:5932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:16.388825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:16.384513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593399561960817:5932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:16.404332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593399561960817:5932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:16.404373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593399561960817:5932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:16.404401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593399561960817:5932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:16.404433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:16.412492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:16.413383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:16.413413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:16.413454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:16.413725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:16.413905Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593397984042725:5385]
2025-10-10T14:03:16.416110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:16.421169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:16.421423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:16.422685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:16.423052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:16.423060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:16.423066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:16.423073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:16.423079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:16.423086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:16.423092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:16.423099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:16.423105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:16.423112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:16.423119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:16.423125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:16.423176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:16.423283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:16.423330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:16.423376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:16.423425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:16.423468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:16.423513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:16.423560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:16.423605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:16.423653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:16.423700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:16.423747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:16.423786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:16.423850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:16.423903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:16.423954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:16.424001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:16.424054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:16.424098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:16.425759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:16.425824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:16.425883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:16.425942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:16.425993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:16.426037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:16.426089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:16.426130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:16.426184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:16.426229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:16.426280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:16.426322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:16.426373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:16.426433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:16.426484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:16.426525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:16.426573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:16.427011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:16.495660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:16.523875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:16.523927Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:16.523942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:16.523960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:16.523982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 349 [2:7559593397984042725:5385]
2025-10-10T14:03:16.524033Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:16.524094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:16.524108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:16.524119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:16.524130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:16.524177Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:16.524197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:16.524219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:16.526468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:16.526496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:16.526508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:16.526521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:16.526532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:16.526797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:16.526811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:16.526956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:16.527125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:16.527327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:16.527426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:16.527510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593399561960700:2442], now have 1 active actors on pipe
2025-10-10T14:03:16.527532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593399561960868:5932], now have 1 active actors on pipe
2025-10-10T14:03:16.527552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593399561960752:5422], now have 1 active actors on pipe
2025-10-10T14:03:16.527577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.527591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.527602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.527616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.527659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:16.527715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:16.527735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:16.527748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:16.527758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:16.527769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:16.527897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:16.527912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:16.528039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.528068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:16.528107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:16.532635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:16.532672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:16.532752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|936eb071-9e119d-f20eb308-ed876977_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:16.532786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:16.532805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:16.532815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:16.532852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:16.532899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:16.532943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:16.530107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 349, pipe: [1:7559593399561960752:5422]
2025-10-10T14:03:16.530230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 349
2025-10-10T14:03:16.530330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 349
2025-10-10T14:03:16.533824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:16.533849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:16.533913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:16.535481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a7f36ab-8370f9aa-325dd319-25566793_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|936eb071-9e119d-f20eb308-ed876977_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:16.534285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 350 partition: 0 MaxSeqNo: 36 sessionId: src_id|936eb071-9e119d-f20eb308-ed876977_0
2025-10-10T14:03:16.572465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|936eb071-9e119d-f20eb308-ed876977_0] Write session: try to update token
2025-10-10T14:03:16.572527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|936eb071-9e119d-f20eb308-ed876977_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:16.614318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:16.614356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:16.614398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.614535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:16.617304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:16.630945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:16.632231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:16.641633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:16.642956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:16.644675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:16.645874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:16.645900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:16.645915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:16.645979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:16.739014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId: src_id|936eb071-9e119d-f20eb308-ed876977_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:16.768357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:16.768389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:16.768402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:16.768457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:16.768471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:16.768483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:16.768493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:16.768504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:16.768545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.768570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.768592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.768612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593397984042719:5385]
2025-10-10T14:03:16.768745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:16.768769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:16.768779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:16.769739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:16.769771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:16.769796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:16.769820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:16.789755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:16.825849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:17.057966Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:17.095882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:17.095933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:17.097147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:17.101276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:17.101427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:17.103896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593399561960752:5422]
2025-10-10T14:03:17.166023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|936eb071-9e119d-f20eb308-ed876977_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:17.166068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|936eb071-9e119d-f20eb308-ed876977_0] Write session will restart in 0.009820s
2025-10-10T14:03:17.166170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|936eb071-9e119d-f20eb308-ed876977_0] Write session: Do CDS request
2025-10-10T14:03:17.166198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|936eb071-9e119d-f20eb308-ed876977_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:17.164892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 350 reason: status is not ok: tablet will be restarted right now sessionId: src_id|936eb071-9e119d-f20eb308-ed876977_0
2025-10-10T14:03:17.165285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 350 sessionId: src_id|936eb071-9e119d-f20eb308-ed876977_0 is DEAD
2025-10-10T14:03:17.185347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|936eb071-9e119d-f20eb308-ed876977_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:17.190364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:17.190434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 351
2025-10-10T14:03:17.191277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:17.191416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:17.191433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:17.191445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:17.194296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 351 sessionId:  describe result for acl check
2025-10-10T14:03:17.194430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:17.194442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:17.194450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:17.194467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593403856928271:5948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:17.197090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593403856928271:5948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:17.209337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593403856928300:5422]
2025-10-10T14:03:17.240684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593403856928271:5948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:17.263668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593403856928271:5948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:17.263717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593403856928271:5948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:17.263735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593403856928271:5948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:17.263768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:17.278636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:17.279731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:17.280546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:17.280565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:17.280612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:17.280882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:17.281080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593402279010236:5396]
2025-10-10T14:03:17.283178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:17.284260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:17.284516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:17.285872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:17.286228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:17.286236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:17.286244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:17.286250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:17.286257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:17.286265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:17.286272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:17.286280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:17.286287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:17.286293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:17.286317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:17.286325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:17.286373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:17.286485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:17.286534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:17.286584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:17.286630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:17.286678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:17.286722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:17.286767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:17.286818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:17.286884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:17.286929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:17.286980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:17.287025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:17.287092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:17.287169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:17.287234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:17.287285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:17.287339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:17.287385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:17.287438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:17.287490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:17.287546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:17.287590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:17.287645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:17.287697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:17.287756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:17.287808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:17.287863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:17.287919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:17.287973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:17.288016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:17.288071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:17.288121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:17.288174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:17.288218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:17.288271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:17.288717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:17.394434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:17.438536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:17.438730Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:17.438751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:17.438773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:17.438798Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 350 [2:7559593402279010236:5396]
2025-10-10T14:03:17.438864Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:17.438932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:17.438946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:17.438958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:17.438971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:17.439022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:17.439047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:17.439082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:17.445262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:17.445280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:17.445294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:17.445309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:17.445320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:17.445638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:17.445666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:17.445821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:17.446115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:17.446395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:17.446513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:17.446597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593402279010231:5396]
2025-10-10T14:03:17.446614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593402279010231:5396]
2025-10-10T14:03:17.446629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593402279010231:5396]
2025-10-10T14:03:17.446641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593402279010231:5396]
2025-10-10T14:03:17.446685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:17.446771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:17.446972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:17.446999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:17.447264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593402279010231:5396]
2025-10-10T14:03:17.447309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:17.450558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 350
2025-10-10T14:03:17.450640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 350, pipe: [1:7559593403856928300:5422]
2025-10-10T14:03:17.450714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 350
2025-10-10T14:03:17.448350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:17.448372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:17.448383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:17.448395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:17.448420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:17.453545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593403856928394:5948], now have 1 active actors on pipe
2025-10-10T14:03:17.453591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593403856928300:5422], now have 1 active actors on pipe
2025-10-10T14:03:17.453615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593403856928225:2442], now have 1 active actors on pipe
2025-10-10T14:03:17.453703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:17.453727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:17.453814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:17.453852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:17.453871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:17.453883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:17.453939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:17.453989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:17.454036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:17.457760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:17.457800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:17.457892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:17.462149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 351 partition: 0 MaxSeqNo: 36 sessionId: src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0
2025-10-10T14:03:17.463493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|936eb071-9e119d-f20eb308-ed876977_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:17.525318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0] Write session: try to update token
2025-10-10T14:03:17.525379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:17.545313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:17.545348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:17.545369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:17.713761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:17.713795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:17.713808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:17.713870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:17.713887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:17.713899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:17.713910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:17.713921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:17.713958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593402279010231:5396]
2025-10-10T14:03:17.713984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593402279010231:5396]
2025-10-10T14:03:17.714007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593402279010231:5396]
2025-10-10T14:03:17.714027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593402279010231:5396]
2025-10-10T14:03:17.714174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:17.714197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:17.714208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:17.715320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:17.722830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:17.722891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:17.722929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:17.722957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:17.817079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId: src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:17.855593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:18.072190Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:18.122711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:18.122754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:18.126465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:18.127129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:18.127153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:18.200735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593403856928300:5422]
2025-10-10T14:03:18.200812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:18.200971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 351 reason: error at write: Disconnected sessionId: src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0
2025-10-10T14:03:18.201327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 351 sessionId: src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0 is DEAD
2025-10-10T14:03:18.210656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:18.210690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0] Write session will restart in 0.007071s
2025-10-10T14:03:18.210795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0] Write session: Do CDS request
2025-10-10T14:03:18.210825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:18.228664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:18.228304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:18.228342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 352
2025-10-10T14:03:18.231965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:18.232132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:18.232151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:18.232162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:18.235307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 352 sessionId:  describe result for acl check
2025-10-10T14:03:18.235452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:18.235463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:18.235474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:18.235493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593408151895847:5961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:18.238785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593408151895847:5961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:18.270455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593408151895847:5961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:18.303707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:18.298776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593408151895847:5961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:18.298825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593408151895847:5961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:18.298844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593408151895847:5961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:18.298895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:18.302455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593408151895918:5422]
2025-10-10T14:03:18.322342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:18.323339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:18.323359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:18.323405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:18.323661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:18.323845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593406573977756:5406]
2025-10-10T14:03:18.326203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:18.327529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:18.327765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:18.329371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:18.329760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:18.329769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:18.329776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:18.329783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:18.329789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:18.329796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:18.329803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:18.329809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:18.329817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:18.329824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:18.329831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:18.329840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:18.329895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:18.330019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:18.330070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:18.330123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:18.330178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:18.330232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:18.330276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:18.330319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:18.330361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:18.330407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:18.330449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:18.330491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:18.330533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:18.330598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:18.330650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:18.330702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:18.330752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:18.330811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:18.330881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:18.330946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:18.331004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:18.331067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:18.331122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:18.331177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:18.331225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:18.331275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:18.331320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:18.331371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:18.331423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:18.331479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:18.331528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:18.331581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:18.331626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:18.331675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:18.331720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:18.331774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:18.332199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:18.376125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:18.412668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:18.412720Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:18.412738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:18.412756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:18.412780Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 351 [2:7559593406573977756:5406]
2025-10-10T14:03:18.412833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:18.412894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:18.412911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:18.412923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:18.412934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:18.412982Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:18.413007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:18.413028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:18.423380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:18.423415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:18.423428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:18.423442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:18.423452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:18.423720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:18.423737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:18.423864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:18.424028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:18.424235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:18.424337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:18.424407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:18.424422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:18.424434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:18.424446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:18.424587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:18.424599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:18.424612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:18.424622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:18.425840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:18.425968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:18.426161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:18.426181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:18.426240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593408151895915:5961], now have 1 active actors on pipe
2025-10-10T14:03:18.426267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593408151895781:2442], now have 1 active actors on pipe
2025-10-10T14:03:18.426289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593408151895918:5422], now have 1 active actors on pipe
2025-10-10T14:03:18.426452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:18.426496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:18.426954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:18.429426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 351
2025-10-10T14:03:18.429525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 351
2025-10-10T14:03:18.429600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 351, pipe: [1:7559593408151895918:5422]
2025-10-10T14:03:18.433332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:18.433395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:18.433509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:18.433567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:18.433593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:18.433608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:18.433657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:18.433707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:18.433757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:18.441452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:18.441500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:18.441593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:18.449581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 352 partition: 0 MaxSeqNo: 36 sessionId: src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0
2025-10-10T14:03:18.450484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5469e6a1-7594c8c0-cb483808-6563a64a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:18.509267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:18.509299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:18.509311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:18.558690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0] Write session: try to update token
2025-10-10T14:03:18.558751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:18.700253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:18.700291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:18.700306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:18.700317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:18.700328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:18.700372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:18.700402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:18.700429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:18.700450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:18.700620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:18.700639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:18.700652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:18.700763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:18.700788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:18.700799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:18.701406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:18.701441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:18.701469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:18.701498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:18.702657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:18.808588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId: src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:18.854170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:19.075222Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:19.095734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:19.095788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:19.095861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:19.095877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:19.095925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593406573977750:5406]
2025-10-10T14:03:19.099075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:19.099234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593408151895918:5422]
2025-10-10T14:03:19.099312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:19.099325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:19.097844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:19.101205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:19.201292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593412446863327:5422]
2025-10-10T14:03:19.211660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 352 reason: error at write: Disconnected sessionId: src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0
2025-10-10T14:03:19.212120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 352 sessionId: src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0 is DEAD
2025-10-10T14:03:19.217475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:19.217547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0] Write session will restart in 0.009637s
2025-10-10T14:03:19.217715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0] Write session: Do CDS request
2025-10-10T14:03:19.217766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:19.238288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:19.241464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:19.241497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 353
2025-10-10T14:03:19.245550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:19.245740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:19.245767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:19.245781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:19.250524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 353 sessionId:  describe result for acl check
2025-10-10T14:03:19.251261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:19.251274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:19.251284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:19.251301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593412446863388:5971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:19.254119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593412446863388:5971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:19.268582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593412446863388:5971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:19.278273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:19.285429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593412446863388:5971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:19.285471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593412446863388:5971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:19.285490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593412446863388:5971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:19.285520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:19.285889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:19.286831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:19.286851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:19.286914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:19.287226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:19.287434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593410868945264:5415]
2025-10-10T14:03:19.289671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:19.294281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:19.294544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:19.295836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:19.296179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:19.296188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:19.296195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:19.296203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:19.296210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:19.296217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:19.296223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:19.296230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:19.296238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:19.296244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:19.296252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:19.296259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:19.296306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:19.296414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:19.296461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:19.296509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:19.296553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:19.296600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:19.296645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:19.296689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:19.296732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:19.296777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:19.296819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:19.296863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:19.296904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:19.296968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:19.297022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:19.297072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:19.297120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:19.299229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:19.299306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:19.299360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:19.299415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:19.299473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:19.299519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:19.299579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:19.299630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:19.299687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:19.299736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:19.299794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:19.299845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:19.299900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:19.299948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:19.300004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:19.300052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:19.300108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:19.300152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:19.300207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:19.300660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:19.336601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:19.350867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:19.350934Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:19.350950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:19.350971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:19.350996Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 352 [2:7559593410868945264:5415]
2025-10-10T14:03:19.351051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:19.351114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:19.351129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:19.351144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:19.351155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:19.351204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:19.351225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:19.351246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:19.380087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:19.380117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:19.380126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:19.380134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:19.380142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:19.380389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:19.380403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:19.380523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:19.380670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:19.380857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:19.380955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:19.381022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.381035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.381045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.381056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.381099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:19.381620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:19.381639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:19.381650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:19.381661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:19.382915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:19.383135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:19.383157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:19.383207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593412446863438:5971], now have 1 active actors on pipe
2025-10-10T14:03:19.383234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593412446863327:5422], now have 1 active actors on pipe
2025-10-10T14:03:19.383254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593412446863251:2442], now have 1 active actors on pipe
2025-10-10T14:03:19.383380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.383417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:19.384048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:19.386710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 352
2025-10-10T14:03:19.386800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 352, pipe: [1:7559593412446863327:5422]
2025-10-10T14:03:19.386878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 352
2025-10-10T14:03:19.387816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:19.387854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:19.387953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|215298ae-54394eaf-b0557add-38ba10a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:19.387992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:19.388011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:19.388021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:19.388060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:19.388107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:19.388155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:19.390189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:19.390235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:19.390314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:19.391607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 353 partition: 0 MaxSeqNo: 36 sessionId: src_id|215298ae-54394eaf-b0557add-38ba10a5_0
2025-10-10T14:03:19.393414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617eac39-40ed93f8-ee270902-f1bd8ecc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|215298ae-54394eaf-b0557add-38ba10a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:19.446252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|215298ae-54394eaf-b0557add-38ba10a5_0] Write session: try to update token
2025-10-10T14:03:19.446311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|215298ae-54394eaf-b0557add-38ba10a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:19.453023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:19.453058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:19.453069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:19.628965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId: src_id|215298ae-54394eaf-b0557add-38ba10a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:19.667656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:19.667685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:19.667697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:19.667754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:19.667768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:19.667781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:19.667791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:19.667801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:19.667836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.667862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.667885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.667903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.669311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:19.669342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:19.669370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:19.669399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:19.714607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:19.714667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:19.714679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:19.715800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:19.720010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:19.882685Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:19.886503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:19.886537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:19.886586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593410868945259:5415]
2025-10-10T14:03:19.886739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:19.886764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:19.886921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:19.888619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:19.888646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:19.893384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593412446863327:5422]
2025-10-10T14:03:19.893477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:19.897675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:19.906510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 353 reason: error at write: Disconnected sessionId: src_id|215298ae-54394eaf-b0557add-38ba10a5_0
2025-10-10T14:03:19.906869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 353 sessionId: src_id|215298ae-54394eaf-b0557add-38ba10a5_0 is DEAD
2025-10-10T14:03:19.913400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|215298ae-54394eaf-b0557add-38ba10a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:19.913452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|215298ae-54394eaf-b0557add-38ba10a5_0] Write session will restart in 0.008856s
2025-10-10T14:03:19.913553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|215298ae-54394eaf-b0557add-38ba10a5_0] Write session: Do CDS request
2025-10-10T14:03:19.913584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|215298ae-54394eaf-b0557add-38ba10a5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:19.964995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|215298ae-54394eaf-b0557add-38ba10a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:19.966803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:19.966836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 354
2025-10-10T14:03:19.967375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:19.967485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:19.967504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:19.967515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:19.968902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 354 sessionId:  describe result for acl check
2025-10-10T14:03:19.969024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:19.969034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:19.969043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:19.969059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593412446863473:5976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:19.971573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593412446863473:5976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:19.992693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593412446863473:5976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:20.003929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593416741830804:5422]
2025-10-10T14:03:20.038661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593412446863473:5976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:20.038716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593412446863473:5976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:20.038737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593412446863473:5976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:20.038779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:20.140557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:20.149863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:20.150752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:20.150773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:20.150821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:20.151130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:20.151349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593415163912760:5425]
2025-10-10T14:03:20.160366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:20.164307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:20.164614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:20.180078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:20.180641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:20.180651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:20.180659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:20.180666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:20.180673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:20.180680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:20.180688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:20.180696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:20.180703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:20.180710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:20.180717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:20.180725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:20.180775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:20.180890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:20.180944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:20.180998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:20.181049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:20.181098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:20.181167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:20.181219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:20.181266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:20.181315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:20.181364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:20.181414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:20.181462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:20.181530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:20.181599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:20.181661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:20.181712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:20.181769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:20.181817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:20.181875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:20.181926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:20.181987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:20.182038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:20.182096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:20.182150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:20.182205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:20.182256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:20.182311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:20.182364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:20.182420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:20.182470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:20.182526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:20.182573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:20.182629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:20.182675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:20.182729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:20.183241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:20.240445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
E1010 14:03:20.267444194  106882 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:03:20.272320Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:03:20.270849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:20.270893Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:20.270922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:20.270940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:20.270965Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 353 [2:7559593415163912760:5425]
2025-10-10T14:03:20.271018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:20.271075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:20.271088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:20.271099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:20.271111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:20.271161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:20.271183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:20.271204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:20.301513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:20.301540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:20.301549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:20.301557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:20.301566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:20.301825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:20.301838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:20.301950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:20.302085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:20.302258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:20.302353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:20.302425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.302439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.302450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.302461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.302502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:20.302578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:20.302731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:20.302746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:20.302872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.302888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:20.303613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:20.303632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:20.303643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:20.303653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:20.303676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:20.306831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593416741830838:5976], now have 1 active actors on pipe
2025-10-10T14:03:20.306865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593416741830804:5422], now have 1 active actors on pipe
2025-10-10T14:03:20.306885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593412446863456:2442], now have 1 active actors on pipe
2025-10-10T14:03:20.309326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 353
2025-10-10T14:03:20.309409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 353, pipe: [1:7559593416741830804:5422]
2025-10-10T14:03:20.309487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 353
2025-10-10T14:03:20.309959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:20.309995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:20.310089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:20.310126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:20.310145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:20.310155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:20.310196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:20.310244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:20.310294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:20.310973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:20.310998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:20.311059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:20.311389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 354 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0
2025-10-10T14:03:20.314486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|215298ae-54394eaf-b0557add-38ba10a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:20.373880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0] Write session: try to update token
2025-10-10T14:03:20.373938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:20.377254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:20.377288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:20.377300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:20.407362Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:20.407399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:20.407440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.407574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:20.409266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:20.415438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:20.416557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:20.417647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:20.419872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:20.421448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:20.421830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:20.485275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:20.485311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:20.485322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:20.588795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:20.588827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:20.588839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:20.588898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:20.588911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:20.588923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:20.588933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:20.588943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:20.588983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.589011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.589033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.589054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593415163912753:5425]
2025-10-10T14:03:20.589211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:20.589237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:20.589240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:20.589248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:20.589270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:20.589305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:20.589338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:20.590264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:20.655404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId: src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:20.720861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:20.846248Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:20.847955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:20.847990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:20.849760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:20.849898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:20.849910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:20.853290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593416741830804:5422]
2025-10-10T14:03:20.849718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:20.925215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 354 reason: error at write: Disconnected sessionId: src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0
2025-10-10T14:03:20.925598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 354 sessionId: src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0 is DEAD
2025-10-10T14:03:20.929176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:20.929212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0] Write session will restart in 0.005160s
2025-10-10T14:03:20.929311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0] Write session: Do CDS request
2025-10-10T14:03:20.929343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:20.941515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:20.941552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 355
2025-10-10T14:03:20.944177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:20.945603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:20.945807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:20.945829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:20.945841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:20.948923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 355 sessionId:  describe result for acl check
2025-10-10T14:03:20.949073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:20.949086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:20.949097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:20.949117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593416741831053:5992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:20.963094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593416741831076:5422]
2025-10-10T14:03:20.963164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593416741831053:5992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:20.992382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593416741831053:5992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:21.023785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593416741831053:5992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:21.023835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593416741831053:5992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:21.023852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593416741831053:5992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:21.023883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:21.025691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:21.026770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:21.027570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:21.027587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:21.027632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:21.027882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:21.028066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593419458880255:5436]
2025-10-10T14:03:21.030219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:21.031934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:21.032154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:21.033381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:21.033706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:21.033714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:21.033722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:21.033729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:21.033736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:21.033744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:21.033751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:21.033756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:21.033763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.033771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.033777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.033785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.033833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:21.033946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:21.033995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:21.034039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:21.034083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:21.034133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:21.034175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:21.034220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:21.034264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.034312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.034358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.034402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.034446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:21.034509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:21.034568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:21.034623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:21.034669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:21.034721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:21.034770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:21.034822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:21.034875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:21.034953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:21.034999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:21.035053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:21.035103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:21.035154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:21.035200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:21.035250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:21.035302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.035364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.035418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.035482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.035535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.035599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.035649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.035704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.036137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:21.127677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:21.147055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:21.147105Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:21.147122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:21.147143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:21.147169Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 354 [2:7559593419458880255:5436]
2025-10-10T14:03:21.147236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:21.147302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:21.147321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:21.147333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:21.147345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:21.147396Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:21.147429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:21.147452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:21.152357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 354
2025-10-10T14:03:21.152458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 354, pipe: [1:7559593416741831076:5422]
2025-10-10T14:03:21.152532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 354
2025-10-10T14:03:21.149845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.149875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.149890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.149903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.149914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:21.150212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:21.150230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.150370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.150540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.150754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.150858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:21.150950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.150967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.150979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.150992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.151028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:21.151111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:21.151273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:21.151285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:21.151292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:21.151304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:21.151305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:21.151319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:21.151447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.151484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:21.151535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593416741831076:5422], now have 1 active actors on pipe
2025-10-10T14:03:21.151558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593421036798459:5992], now have 1 active actors on pipe
2025-10-10T14:03:21.151581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593416741830992:2442], now have 1 active actors on pipe
2025-10-10T14:03:21.151690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:21.157183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:21.157230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:21.157316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:21.157355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:21.157375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:21.157387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:21.157425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:21.157471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:21.157518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:21.173719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 355 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0
2025-10-10T14:03:21.174553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4a9182b-636ed46-16bae1-d2b6a1ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:21.173194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:21.173238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:21.173318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:21.218980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0] Write session: try to update token
2025-10-10T14:03:21.219036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:21.318401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:21.318430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:21.318441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:21.318546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:21.318561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:21.318575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:21.318586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:21.318597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:21.318638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.318675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.318702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.318726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.318871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:21.318919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:21.318975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:21.319023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:21.329605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:21.329660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.329672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:21.330714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:21.361811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId: src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:21.396681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:21.475802Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:21.484682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:21.484708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:21.484740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593419458880250:5436]
2025-10-10T14:03:21.484844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:21.484863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:21.484929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:21.485526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:21.489686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593416741831076:5422]
2025-10-10T14:03:21.489790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:21.496249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:21.516298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 355 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0
2025-10-10T14:03:21.521442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:21.521487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0] Write session will restart in 0.006953s
2025-10-10T14:03:21.516638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 355 sessionId: src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0 is DEAD
2025-10-10T14:03:21.521605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0] Write session: Do CDS request
2025-10-10T14:03:21.521640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:21.538033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:21.552586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:21.552623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 356
2025-10-10T14:03:21.559359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:21.559513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:21.559529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:21.559541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:21.561167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 356 sessionId:  describe result for acl check
2025-10-10T14:03:21.561299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:21.561312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:21.561321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:21.561338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593421036798513:6001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:21.563961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593421036798513:6001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:21.589840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593421036798521:5422]
2025-10-10T14:03:21.603479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593421036798513:6001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:21.638341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593421036798513:6001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:21.638390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593421036798513:6001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:21.638409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593421036798513:6001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:21.638442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:21.681265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:21.692993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:21.693928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:21.693947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:21.693992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:21.694301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:21.694528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593419458880481:5446]
2025-10-10T14:03:21.696648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:21.709578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:21.709906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:21.711281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:21.711670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:21.711678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:21.711685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:21.711693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:21.711701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:21.711709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:21.711716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:21.711724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:21.711731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.711738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.711744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.711752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.711801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:21.711915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:21.711965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:21.712014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:21.712061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:21.712111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:21.712158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:21.712206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:21.712251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.712295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.712341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.712388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.712436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:21.712502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:21.712563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:21.712617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:21.712663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:21.712718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:21.712762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:21.712815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:21.712864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:21.712917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:21.712961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:21.713012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:21.713055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:21.713107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:21.717361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:21.717484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:21.717551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.717613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.717666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.717726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.717772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.717832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.717881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.717938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.718420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:21.768860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:21.828444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:21.828497Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:21.828514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:21.828536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:21.828562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 355 [2:7559593419458880481:5446]
2025-10-10T14:03:21.828617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:21.828705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:21.828720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:21.828732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:21.828744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:21.828795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:21.828818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:21.828842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:21.831727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.831755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.831768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.831781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.831794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:21.832093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:21.832109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:21.832254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:21.832436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:21.832693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:21.832810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:21.832892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:21.832906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:21.832921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:21.832933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:21.832978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:21.833060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:21.833256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:21.833277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:21.833442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:21.833467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:21.834220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:21.834238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:21.834249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:21.834262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:21.834290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:21.845332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 355, pipe: [1:7559593421036798521:5422]
2025-10-10T14:03:21.845464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 355
2025-10-10T14:03:21.845540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 355
2025-10-10T14:03:21.849308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593421036798521:5422], now have 1 active actors on pipe
2025-10-10T14:03:21.849366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593421036798600:6001], now have 1 active actors on pipe
2025-10-10T14:03:21.849390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593421036798499:2442], now have 1 active actors on pipe
2025-10-10T14:03:21.849483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:21.849508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:21.849603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7045211f-2520fd9b-33fab151-962da3f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:21.849642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:21.849661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:21.849673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:21.849717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:21.849768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:21.849818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:21.857091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:21.857155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:21.857245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:21.858651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 356 partition: 0 MaxSeqNo: 36 sessionId: src_id|7045211f-2520fd9b-33fab151-962da3f2_0
2025-10-10T14:03:21.864268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8d33d63-1b13a990-2e3f92e7-c0ceb4c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7045211f-2520fd9b-33fab151-962da3f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:21.909781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7045211f-2520fd9b-33fab151-962da3f2_0] Write session: try to update token
2025-10-10T14:03:21.909839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7045211f-2520fd9b-33fab151-962da3f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:22.035129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:22.035169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:22.035181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:22.035240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:22.035255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:22.035268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:22.035279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:22.035289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:22.035325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:22.035352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:22.035376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:22.035397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:22.035604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:22.035630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:22.035642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:22.035919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:22.035962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:22.035992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:22.036024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:22.036725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:22.066596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId: src_id|7045211f-2520fd9b-33fab151-962da3f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:22.124913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:22.250843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:22.266261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:22.266318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:22.266396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:22.266412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:22.266457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593419458880474:5446]
2025-10-10T14:03:22.267693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:22.268226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:22.269361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593421036798521:5422]
2025-10-10T14:03:22.269523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:22.269540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:22.290277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:22.290428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 356 reason: error at write: Disconnected sessionId: src_id|7045211f-2520fd9b-33fab151-962da3f2_0
2025-10-10T14:03:22.290751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 356 sessionId: src_id|7045211f-2520fd9b-33fab151-962da3f2_0 is DEAD
2025-10-10T14:03:22.297586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045211f-2520fd9b-33fab151-962da3f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:22.297651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045211f-2520fd9b-33fab151-962da3f2_0] Write session will restart in 0.008731s
2025-10-10T14:03:22.297808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045211f-2520fd9b-33fab151-962da3f2_0] Write session: Do CDS request
2025-10-10T14:03:22.297853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045211f-2520fd9b-33fab151-962da3f2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:22.330101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7045211f-2520fd9b-33fab151-962da3f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:22.354796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:22.354831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 357
2025-10-10T14:03:22.361330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:22.361491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:22.361507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:22.361520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:22.365871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 357 sessionId:  describe result for acl check
2025-10-10T14:03:22.366004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:22.366015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:22.366024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:22.366041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593425331766044:6013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:22.368734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593425331766044:6013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:22.373320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593425331766048:5422]
2025-10-10T14:03:22.409953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593425331766044:6013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:22.440288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593425331766044:6013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:22.440328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593425331766044:6013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:22.440345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593425331766044:6013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:22.440374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:22.455727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:22.470749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:22.471763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:22.471784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:22.471832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:22.472122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:22.472327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593423753847979:5455]
2025-10-10T14:03:22.475034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:22.478181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:22.478437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:22.479806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:22.480150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:22.480158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:22.480164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:22.480169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:22.480176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:22.480183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:22.480189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:22.480197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:22.480202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:22.480210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:22.480216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:22.480221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:22.480269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:22.480372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:22.480419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:22.480465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:22.480510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:22.480554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:22.480595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:22.480636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:22.480677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:22.480721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:22.480762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:22.480803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:22.480845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:22.480908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:22.480968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:22.481021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:22.481070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:22.481118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:22.485277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:22.485379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:22.485439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:22.485498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:22.485550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:22.485604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:22.485732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:22.485879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:22.485932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:22.485992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:22.486055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:22.486117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:22.486168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:22.486229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:22.486278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:22.486331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:22.486403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:22.486457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:22.487072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:22.622014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:22.643478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:22.643527Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:22.643545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:22.643565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:22.643589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 356 [2:7559593423753847979:5455]
2025-10-10T14:03:22.643643Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:22.643709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:22.643724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:22.643735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:22.643746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:22.643794Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:22.643816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:22.643838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:22.649292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:22.649323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:22.649337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:22.649349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:22.649359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:22.649694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:22.649709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:22.649848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:22.650014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:22.650218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:22.650317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:22.650393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:22.650408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:22.650420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:22.650432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:22.650476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:22.650555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:22.650726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:22.650744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:22.650872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:22.650890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:22.652970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 356
2025-10-10T14:03:22.653078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 356
2025-10-10T14:03:22.653148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 356, pipe: [1:7559593425331766048:5422]
2025-10-10T14:03:22.651875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:22.651895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:22.651907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:22.651917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:22.651940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:22.661922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593425331766021:2442], now have 1 active actors on pipe
2025-10-10T14:03:22.661967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593425331766201:6013], now have 1 active actors on pipe
2025-10-10T14:03:22.661988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593425331766048:5422], now have 1 active actors on pipe
2025-10-10T14:03:22.662062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:22.662085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:22.662170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:22.662206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:22.662224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:22.662234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:22.662271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:22.662316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:22.662357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:22.663248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:22.663276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:22.663337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:22.663678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 357 partition: 0 MaxSeqNo: 36 sessionId: src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0
2025-10-10T14:03:22.668648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045211f-2520fd9b-33fab151-962da3f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:22.731299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0] Write session: try to update token
2025-10-10T14:03:22.731363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:22.746240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:22.746272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:22.746285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:22.856468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:22.856508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:22.856523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:22.856535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:22.856546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:22.856586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:22.856617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:22.856647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:22.856671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:22.856853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:22.856894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:22.856913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:22.856928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:22.856933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:22.856940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:22.856967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:22.856993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:22.857019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:22.857031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:22.865968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:22.922413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId: src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:22.975288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:23.100216Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:23.112437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:23.122569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:23.123302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:23.123317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:23.123362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593423753847973:5455]
2025-10-10T14:03:23.123997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:23.125663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:23.125812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:23.125825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:23.127929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593425331766048:5422]
2025-10-10T14:03:23.128153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:23.183193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 357 reason: error at write: Disconnected sessionId: src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0
2025-10-10T14:03:23.183566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 357 sessionId: src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0 is DEAD
2025-10-10T14:03:23.189395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:23.189468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0] Write session will restart in 0.009687s
2025-10-10T14:03:23.189643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0] Write session: Do CDS request
2025-10-10T14:03:23.189691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:23.205287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:23.209412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:23.209442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 358
2025-10-10T14:03:23.209870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:23.209985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:23.210001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:23.210011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:23.212828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 358 sessionId:  describe result for acl check
2025-10-10T14:03:23.212962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:23.212973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:23.212984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:23.213002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593429626733599:6023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:23.215814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593429626733599:6023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:23.232623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593429626733654:5422]
2025-10-10T14:03:23.241884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593429626733599:6023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:23.261302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593429626733599:6023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:23.261349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593429626733599:6023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:23.261370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593429626733599:6023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:23.261405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:23.266694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:23.275580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:23.276300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:23.276312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:23.276343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:23.276539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:23.276663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593428048815484:5465]
2025-10-10T14:03:23.278279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:23.280642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:23.280806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:23.281841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:23.282136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:23.282142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:23.282147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:23.282151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:23.282156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:23.282162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:23.282168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:23.282174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:23.282179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.282184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.282189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.282194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.282231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:23.282327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:23.282365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:23.282405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:23.282444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:23.282482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:23.282518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:23.282560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:23.282605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.282643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.282680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.282719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.282747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:23.282799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:23.282841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:23.282882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:23.282919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:23.282960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:23.283015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:23.283059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:23.283105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:23.283147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:23.283178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:23.283215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:23.283247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:23.283285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:23.283320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:23.283360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:23.283400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.283444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.283481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.283522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.283555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.283606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.283641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.283683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.284028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:23.318700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:23.344047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:23.344095Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:23.344111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:23.344129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:23.344154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 357 [2:7559593428048815484:5465]
2025-10-10T14:03:23.344207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:23.344270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:23.344289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:23.344300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:23.344312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:23.344363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:23.344386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:23.344408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:23.376502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.376537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.376548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.376560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.376571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:23.376851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:23.376868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.376996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.377421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.377635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.377739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:23.377827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593429626733654:5422], now have 1 active actors on pipe
2025-10-10T14:03:23.377850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593429626733522:2442], now have 1 active actors on pipe
2025-10-10T14:03:23.377871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593429626733711:6023], now have 1 active actors on pipe
2025-10-10T14:03:23.377896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.377911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.377924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.377937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.377979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:23.378058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:23.378222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:23.378239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:23.378367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.378387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:23.379553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:23.378846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 357, pipe: [1:7559593429626733654:5422]
2025-10-10T14:03:23.379572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:23.379585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:23.378960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 357
2025-10-10T14:03:23.379601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:23.379632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:23.379070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 357
2025-10-10T14:03:23.384471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:23.384516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:23.384606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6916c875-bb75b6e3-bc00f143-718692d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:23.384643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:23.384663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:23.384674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:23.384715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:23.384768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:23.384812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:23.387824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:23.387868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:23.387954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:23.388480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 358 partition: 0 MaxSeqNo: 36 sessionId: src_id|6916c875-bb75b6e3-bc00f143-718692d5_0
2025-10-10T14:03:23.389360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15feb1be-daf59bc2-66292d2a-e1afc677_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6916c875-bb75b6e3-bc00f143-718692d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:23.444153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c875-bb75b6e3-bc00f143-718692d5_0] Write session: try to update token
2025-10-10T14:03:23.444209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c875-bb75b6e3-bc00f143-718692d5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:23.445055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:23.445086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:23.445097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:23.532024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:23.532061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:23.532078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:23.532091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:23.532103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:23.532140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.532168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.532194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.532219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.532318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:23.532358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:23.532387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:23.532417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:23.557151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:23.557200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.557216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:23.558679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:23.629455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:03:23.629518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-10-10T14:03:23.635854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId: src_id|6916c875-bb75b6e3-bc00f143-718692d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:23.694343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:23.713495Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:23.715348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:23.715368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:23.715414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593428048815479:5465]
2025-10-10T14:03:23.715544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:23.715629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:23.715653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:23.716932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:23.717287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593429626733654:5422]
2025-10-10T14:03:23.717370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:23.717428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-10-10T14:03:23.717534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:23.717550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:23.747661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 358 reason: error at write: Disconnected sessionId: src_id|6916c875-bb75b6e3-bc00f143-718692d5_0
2025-10-10T14:03:23.748000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 358 sessionId: src_id|6916c875-bb75b6e3-bc00f143-718692d5_0 is DEAD
2025-10-10T14:03:23.749781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c875-bb75b6e3-bc00f143-718692d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:23.749817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c875-bb75b6e3-bc00f143-718692d5_0] Write session will restart in 0.005204s
2025-10-10T14:03:23.749917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c875-bb75b6e3-bc00f143-718692d5_0] Write session: Do CDS request
2025-10-10T14:03:23.749947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c875-bb75b6e3-bc00f143-718692d5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:23.772364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c875-bb75b6e3-bc00f143-718692d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:23.820514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593429626733766:5422]
2025-10-10T14:03:23.820579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:23.820597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 359
2025-10-10T14:03:23.821362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:23.821511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:23.821533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:23.821542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:23.825935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 359 sessionId:  describe result for acl check
2025-10-10T14:03:23.826014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:23.826021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:23.826029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:23.826041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593429626733770:6034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:23.828672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593429626733770:6034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:23.843592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593429626733770:6034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:23.867619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593429626733770:6034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:23.867664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593429626733770:6034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:23.867682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593429626733770:6034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:23.867715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:23.936063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:23.942436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:23.943386Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:23.943405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:23.943452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:23.943738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:23.943933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593428048815686:5475]
2025-10-10T14:03:23.949826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:23.952288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:23.952564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:23.953889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:23.954216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:23.954224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:23.954231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:23.954239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:23.954247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:23.954254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:23.954263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:23.954270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:23.954278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.954286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.954293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.954300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.954349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:23.954467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:23.954519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:23.954569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:23.954617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:23.954681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:23.954730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:23.954777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:23.954825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.954875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.954924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.954972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.955028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:23.955098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:23.955158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:23.955217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:23.955271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:23.955330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:23.955377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:23.955431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:23.955482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:23.955535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:23.955582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:23.955639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:23.955692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:23.955748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:23.955797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:23.955862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:23.955958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.956052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:23.956137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.956209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:23.956265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.956322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:23.956368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.956425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:23.956917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:23.998219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:24.015756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:24.015799Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:24.015816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:24.015834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:24.015858Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 358 [2:7559593428048815686:5475]
2025-10-10T14:03:24.015916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:24.015994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:24.016006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:24.016017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:24.016024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:24.016058Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:24.016077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:24.016093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:24.056658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:24.056692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:24.056702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:24.056711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:24.056724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:24.057629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 358
2025-10-10T14:03:24.057713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 358, pipe: [1:7559593429626733766:5422]
2025-10-10T14:03:24.057810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 358
2025-10-10T14:03:24.057010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:24.057036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:24.057195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:24.057375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:24.057611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:24.057738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:24.057822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593429626733854:6034], now have 1 active actors on pipe
2025-10-10T14:03:24.057847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593429626733766:5422], now have 1 active actors on pipe
2025-10-10T14:03:24.057870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593429626733747:2442], now have 1 active actors on pipe
2025-10-10T14:03:24.057895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.057910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.057924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.057937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.057977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:24.058058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:24.058125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:24.058139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:24.058151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:24.058163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:24.058244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:24.058261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:24.058407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:24.058429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:24.058460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.058490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:24.058649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66199f38-7914b295-f6ccbd21-d66dea96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:24.058677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:24.058694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:24.058705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:24.058737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:24.058777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:24.058951Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:03:24.059058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:24.059536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:24.062537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:24.062573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:24.062661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:24.061049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 8 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:03:24.061250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:03:24.063059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 359 partition: 0 MaxSeqNo: 36 sessionId: src_id|66199f38-7914b295-f6ccbd21-d66dea96_0
2025-10-10T14:03:24.065689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6916c875-bb75b6e3-bc00f143-718692d5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66199f38-7914b295-f6ccbd21-d66dea96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:24.115357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66199f38-7914b295-f6ccbd21-d66dea96_0] Write session: try to update token
2025-10-10T14:03:24.115410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66199f38-7914b295-f6ccbd21-d66dea96_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:24.139374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:24.139407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:24.139422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:24.139479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:24.139495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:24.139540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.139671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:24.140128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:24.155205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:24.156776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:24.159206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:24.175713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:24.189940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:24.190459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:24.295023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:24.295058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:24.295071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:24.295127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:24.295144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:24.295159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:24.295173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:24.295185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:24.295228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.295257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.295284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.295311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593428048815681:5475]
2025-10-10T14:03:24.295437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:24.295468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:24.295477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:24.295495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:24.295510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:24.295510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:24.295550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:24.296642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:24.338337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId: src_id|66199f38-7914b295-f6ccbd21-d66dea96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:24.365714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:24.478772Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:24.480729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:24.480762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:24.482281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:24.482310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:24.484004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593429626733766:5422]
2025-10-10T14:03:24.484133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:24.481787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:24.528762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66199f38-7914b295-f6ccbd21-d66dea96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:24.528807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66199f38-7914b295-f6ccbd21-d66dea96_0] Write session will restart in 0.005268s
2025-10-10T14:03:24.528914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66199f38-7914b295-f6ccbd21-d66dea96_0] Write session: Do CDS request
2025-10-10T14:03:24.528946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66199f38-7914b295-f6ccbd21-d66dea96_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:24.525742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 359 reason: error at write: Disconnected sessionId: src_id|66199f38-7914b295-f6ccbd21-d66dea96_0
2025-10-10T14:03:24.526066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 359 sessionId: src_id|66199f38-7914b295-f6ccbd21-d66dea96_0 is DEAD
2025-10-10T14:03:24.547242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66199f38-7914b295-f6ccbd21-d66dea96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:24.549608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:24.549641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 360
2025-10-10T14:03:24.553404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:24.553548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:24.553564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:24.553574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:24.555550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 360 sessionId:  describe result for acl check
2025-10-10T14:03:24.555687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:24.555698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:24.555707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:24.555723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593433921701307:6044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:24.558318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593433921701307:6044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:24.578395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593433921701307:6044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:24.586148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593433921701354:5422]
2025-10-10T14:03:24.622387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593433921701307:6044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:24.622434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593433921701307:6044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:24.622452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593433921701307:6044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:24.622483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:24.663715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:24.676122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:24.677086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:24.677107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:24.677174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:24.677500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:24.677731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593432343783201:5484]
2025-10-10T14:03:24.680275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:24.681630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:24.681902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:24.683395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:24.683782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:24.683792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:24.683802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:24.683810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:24.683818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:24.683827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:24.683837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:24.683846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:24.683853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:24.683862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:24.683869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:24.683878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:24.683936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:24.684066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:24.684121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:24.684173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:24.684222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:24.684280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:24.684331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:24.684383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:24.684439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:24.684495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:24.684548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:24.684597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:24.684643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:24.684722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:24.684791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:24.684854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:24.684910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:24.684969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:24.685018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:24.685079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:24.685148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:24.685207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:24.685255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:24.685312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:24.685363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:24.685421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:24.685474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:24.685536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:24.685589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:24.685648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:24.685700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:24.685757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:24.685810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:24.685870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:24.685920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:24.685977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:24.686476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:24.730756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:24.767873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:24.767924Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:24.767938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:24.767959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:24.767986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 359 [2:7559593432343783201:5484]
2025-10-10T14:03:24.768038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:24.768098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:24.768113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:24.768125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:24.768137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:24.768185Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:24.768207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:24.768229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:24.817053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:24.817086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:24.817099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:24.817110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:24.817120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:24.817587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:24.817604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:24.817749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:24.817915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:24.818127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:24.818235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:24.818310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:24.818325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:24.818340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:24.818353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:24.818398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:24.818474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:24.818651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:24.818667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:24.818790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:24.818809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:24.819060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:24.819073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:24.819085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:24.819095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:24.819118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:24.819794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593433921701354:5422], now have 1 active actors on pipe
2025-10-10T14:03:24.819834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593433921701410:6044], now have 1 active actors on pipe
2025-10-10T14:03:24.819859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593433921701282:2442], now have 1 active actors on pipe
2025-10-10T14:03:24.820915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:24.820942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:24.821019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff491f62-b4280200-5ed38439-8122e1a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:24.821081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:24.821099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:24.821112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:24.821162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:24.821204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:24.820122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 359, pipe: [1:7559593433921701354:5422]
2025-10-10T14:03:24.820255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 359
2025-10-10T14:03:24.820335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 359
2025-10-10T14:03:24.821250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:24.822492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:24.822516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:24.822569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:24.822880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 360 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff491f62-b4280200-5ed38439-8122e1a0_0
2025-10-10T14:03:24.823742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66199f38-7914b295-f6ccbd21-d66dea96_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff491f62-b4280200-5ed38439-8122e1a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:24.858143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff491f62-b4280200-5ed38439-8122e1a0_0] Write session: try to update token
2025-10-10T14:03:24.858202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff491f62-b4280200-5ed38439-8122e1a0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:24.871353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:24.871388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:24.871428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:24.871579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:24.871601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:24.871616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:24.871682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:24.872497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:24.874316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:24.876094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:24.877635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:24.905955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:24.909612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:24.910134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:24.969397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:24.969433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:24.969446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:25.068261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:25.068295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:25.068309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:25.068321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:25.068333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:25.068374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:25.068404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:25.068431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:25.068457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593432343783196:5484]
2025-10-10T14:03:25.068610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:25.068641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:25.068651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:25.068798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:25.068829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:25.068857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:25.068886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:25.082345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:25.095341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId: src_id|ff491f62-b4280200-5ed38439-8122e1a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:25.118105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:25.233299Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:25.236000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:25.236036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:25.241714Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:25.245686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593433921701354:5422]
2025-10-10T14:03:25.245815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:25.280927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 360 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ff491f62-b4280200-5ed38439-8122e1a0_0
2025-10-10T14:03:25.281371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 360 sessionId: src_id|ff491f62-b4280200-5ed38439-8122e1a0_0 is DEAD
2025-10-10T14:03:25.285732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff491f62-b4280200-5ed38439-8122e1a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:25.285774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff491f62-b4280200-5ed38439-8122e1a0_0] Write session will restart in 0.008728s
2025-10-10T14:03:25.285878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff491f62-b4280200-5ed38439-8122e1a0_0] Write session: Do CDS request
2025-10-10T14:03:25.285908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff491f62-b4280200-5ed38439-8122e1a0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:25.300658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff491f62-b4280200-5ed38439-8122e1a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:25.303677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:25.307211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:25.307228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 361
2025-10-10T14:03:25.310119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:25.310299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:25.310317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:25.310327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:25.311880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 361 sessionId:  describe result for acl check
2025-10-10T14:03:25.311999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:25.312010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:25.312019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:25.312036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593438216668821:6056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:25.315900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593438216668821:6056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:25.328948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593438216668821:6056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:25.346395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593438216668878:5422]
2025-10-10T14:03:25.356275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593438216668821:6056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:25.356316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593438216668821:6056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:25.356333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593438216668821:6056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:25.356366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:25.416679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:25.422129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:25.423009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:25.423042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:25.423086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:25.423340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:25.423519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593436638750715:5497]
2025-10-10T14:03:25.425853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:25.427069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:25.427297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:25.428577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:25.428886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:25.428894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:25.428902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:25.428908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:25.428915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:25.428921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:25.428927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:25.428932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:25.428938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:25.428945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:25.428953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:25.428959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:25.429004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:25.429106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:25.429178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:25.429225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:25.429267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:25.429312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:25.429356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:25.429399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:25.429444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:25.429489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:25.429547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:25.429592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:25.429631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:25.429693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:25.429746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:25.429799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:25.429846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:25.429896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:25.429942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:25.429995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:25.430042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:25.430091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:25.430134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:25.430186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:25.430230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:25.430280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:25.430324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:25.430375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:25.430422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:25.430470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:25.430516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:25.430564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:25.430650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:25.430709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:25.430752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:25.430802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:25.431233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:25.459869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:25.478402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:25.485449Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:25.485488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:25.485508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:25.485532Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 360 [2:7559593436638750715:5497]
2025-10-10T14:03:25.485589Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:25.485653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:25.485669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:25.485682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:25.485693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:25.485743Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:25.485765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:25.485787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:25.524355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:25.524385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:25.524397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:25.524407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:25.524418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:25.524692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:25.524708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:25.524843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:25.525004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:25.526587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 360
2025-10-10T14:03:25.526677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 360
2025-10-10T14:03:25.526732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 360, pipe: [1:7559593438216668878:5422]
2025-10-10T14:03:25.527114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:25.527238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:25.527330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593438216668806:2442], now have 1 active actors on pipe
2025-10-10T14:03:25.527353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593438216668901:6056], now have 1 active actors on pipe
2025-10-10T14:03:25.527375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593438216668878:5422], now have 1 active actors on pipe
2025-10-10T14:03:25.527416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:25.527439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:25.527489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.527502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.527513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.527526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.527563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:25.527649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:25.527823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:25.527841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:25.527903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:25.527935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:25.527954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:25.527965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:25.528006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:25.528051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:25.528193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.528212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:25.528255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:25.529213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:25.529234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:25.529245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:25.529255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:25.529279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:25.537357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:25.537404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:25.537495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:25.538003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 361 partition: 0 MaxSeqNo: 36 sessionId: src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0
2025-10-10T14:03:25.538880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff491f62-b4280200-5ed38439-8122e1a0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:25.588842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:25.588878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:25.588918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.589048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:25.589062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:25.589075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:25.589157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:25.591089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:25.592600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:25.593626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:25.604819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0] Write session: try to update token
2025-10-10T14:03:25.604879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:25.626848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:25.627982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:25.629959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:25.630438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:25.690465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:25.690504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:25.690517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:25.758101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:25.758139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:25.758155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:25.758168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:25.758180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:25.758223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.758253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.758279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.758305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593436638750709:5497]
2025-10-10T14:03:25.758464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:25.758496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:25.758509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:25.759575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:25.761274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:25.761315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:25.761351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:25.761389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:25.786615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId: src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:25.811591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:25.926315Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:25.955239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:25.955276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:25.960610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:25.964121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:25.964388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:25.965511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593438216668878:5422]
2025-10-10T14:03:25.988965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:25.989067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0] Write session will restart in 0.009079s
2025-10-10T14:03:25.989214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0] Write session: Do CDS request
2025-10-10T14:03:25.989249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:25.988082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 361 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0
2025-10-10T14:03:25.988478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 361 sessionId: src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0 is DEAD
2025-10-10T14:03:26.003803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:26.003835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 362
2025-10-10T14:03:26.008180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:26.008839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:26.008997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:26.009015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:26.009026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:26.010767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 362 sessionId:  describe result for acl check
2025-10-10T14:03:26.010894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:26.010905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:26.010916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:26.010935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593442511636330:6064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:26.014039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593442511636330:6064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:26.051411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593442511636330:6064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:26.063000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593442511636387:5422]
2025-10-10T14:03:26.077035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593442511636330:6064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:26.077093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593442511636330:6064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:26.077116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593442511636330:6064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:26.077172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:26.141563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:26.147854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:26.148770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:26.148792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:26.148840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:26.149142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:26.149359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593440933718204:5501]
2025-10-10T14:03:26.152374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:26.153659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:26.153883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:26.155131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:26.155459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:26.155467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:26.155475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:26.155481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:26.155489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:26.155496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:26.155503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:26.155510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:26.155517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:26.155524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:26.155530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:26.155537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:26.155586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:26.155695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:26.155749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:26.155797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:26.155842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:26.155892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:26.155936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:26.155979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:26.156026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:26.156070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:26.156118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:26.156165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:26.156204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:26.156267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:26.156326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:26.156381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:26.156431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:26.156485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:26.156532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:26.156587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:26.156636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:26.156687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:26.156735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:26.156790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:26.156839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:26.156892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:26.156939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:26.156994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:26.157043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:26.157096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:26.158122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:26.158204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:26.158258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:26.158313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:26.158363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:26.158418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:26.158896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:26.264587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:26.285623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:26.285672Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:26.285689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:26.285708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:26.285731Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 361 [2:7559593440933718204:5501]
2025-10-10T14:03:26.285785Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:26.285843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:26.285859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:26.285872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:26.285884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:26.285934Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:26.285955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:26.285976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:26.288420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:26.288436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:26.288449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:26.288463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:26.288476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:26.291208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:26.291244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:26.291384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:26.291567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:26.291792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:26.291913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:26.291960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593442511636415:6064], now have 1 active actors on pipe
2025-10-10T14:03:26.291986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593442511636387:5422], now have 1 active actors on pipe
2025-10-10T14:03:26.292006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593438216669019:2442], now have 1 active actors on pipe
2025-10-10T14:03:26.292103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:26.292125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:26.292182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.292198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.292210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.292225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.292274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:26.292354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:26.292527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:26.292544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:26.292609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db4736a7-d2d78412-11ca6c77-72386d09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:26.292645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:26.292664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:26.292675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:26.292712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:26.292754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:26.292895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.292914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:26.292957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:26.290646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 361
2025-10-10T14:03:26.290735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 361, pipe: [1:7559593442511636387:5422]
2025-10-10T14:03:26.290810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 361
2025-10-10T14:03:26.294551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:26.294574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:26.294585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:26.294595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:26.294619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:26.314832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:26.314873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:26.314953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:26.317525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 362 partition: 0 MaxSeqNo: 36 sessionId: src_id|db4736a7-d2d78412-11ca6c77-72386d09_0
2025-10-10T14:03:26.321547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a2a9ac-4008a0e6-f48b6053-4cdab97c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db4736a7-d2d78412-11ca6c77-72386d09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:26.370254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4736a7-d2d78412-11ca6c77-72386d09_0] Write session: try to update token
2025-10-10T14:03:26.370315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4736a7-d2d78412-11ca6c77-72386d09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:26.580939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:26.580974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:26.580987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:26.581041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:26.581059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:26.581073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:26.581086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:26.581098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:26.581151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.581180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.581207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.581230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.581445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:26.581472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:26.581483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:26.582575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:26.585243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:26.585286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:26.585320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:26.585352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:26.601013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId: src_id|db4736a7-d2d78412-11ca6c77-72386d09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:26.646578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:26.874740Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:26.900184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:26.900227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:26.900294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:26.900308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:26.900347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593440933718198:5501]
2025-10-10T14:03:26.902166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:26.902197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:26.900729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:26.906318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:26.951475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 362 reason: error at write: Disconnected sessionId: src_id|db4736a7-d2d78412-11ca6c77-72386d09_0
2025-10-10T14:03:26.951786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 362 sessionId: src_id|db4736a7-d2d78412-11ca6c77-72386d09_0 is DEAD
2025-10-10T14:03:26.953599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4736a7-d2d78412-11ca6c77-72386d09_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 631 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 15769614 MessagesInflight: 10 }
2025-10-10T14:03:26.953689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4736a7-d2d78412-11ca6c77-72386d09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:26.953716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4736a7-d2d78412-11ca6c77-72386d09_0] Write session will restart in 0.007826s
2025-10-10T14:03:26.953882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4736a7-d2d78412-11ca6c77-72386d09_0] Write session: Do CDS request
2025-10-10T14:03:26.953933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4736a7-d2d78412-11ca6c77-72386d09_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:26.970358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db4736a7-d2d78412-11ca6c77-72386d09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:26.984107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593442511636387:5422]
2025-10-10T14:03:26.984214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:26.984297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:26.984307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 363
2025-10-10T14:03:26.984709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:26.984830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:26.984847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:26.984857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:26.986412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 363 sessionId:  describe result for acl check
2025-10-10T14:03:26.986531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:26.986547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:26.986558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:26.986574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593442511636578:6084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:26.989280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593442511636578:6084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:27.000121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593442511636578:6084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:27.016258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593442511636578:6084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:27.016304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593442511636578:6084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:27.016322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593442511636578:6084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:27.016357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:27.058716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:27.076702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:27.077695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:27.077729Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:27.077780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:27.078102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:27.078303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593445228685732:5511]
2025-10-10T14:03:27.080734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:27.085277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593446806604032:5422]
2025-10-10T14:03:27.085250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:27.085551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:27.086978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:27.087424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:27.087434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:27.087442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:27.087450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:27.087458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:27.087466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:27.087476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:27.087484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:27.087492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.087499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.087507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.087516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.087568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:27.087690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:27.087742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:27.087794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:27.087845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:27.087898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:27.087950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:27.088010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:27.088066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.088123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.088175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.088230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.088276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:27.088348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:27.088410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:27.088469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:27.088524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:27.088583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:27.088636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:27.088694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:27.088745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:27.088801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:27.088862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:27.088920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:27.088977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:27.089036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:27.089084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:27.089164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:27.089219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.089275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.089324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.089383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.089436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.089497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.089548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.089607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.090083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:27.136224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:27.149717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:27.149762Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:27.149777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:27.149799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:27.149824Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 362 [2:7559593445228685732:5511]
2025-10-10T14:03:27.149881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:27.149944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:27.149960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:27.149973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:27.149986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:27.150036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:27.150058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:27.150081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:27.171278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.171331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.171349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.171365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.171377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:27.171757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:27.171779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.171935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.172129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.172381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.172506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:27.172590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.172606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.172620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.172634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.172670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:27.172758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:27.172914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:27.172930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:27.172943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:27.172952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:27.172957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:27.172972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:27.173117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.173177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:27.173234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593446806604032:5422], now have 1 active actors on pipe
2025-10-10T14:03:27.173260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593446806603969:6084], now have 1 active actors on pipe
2025-10-10T14:03:27.173284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593442511636574:2442], now have 1 active actors on pipe
2025-10-10T14:03:27.173464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:27.173928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 362, pipe: [1:7559593446806604032:5422]
2025-10-10T14:03:27.174041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 362
2025-10-10T14:03:27.174117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 362
2025-10-10T14:03:27.178349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:27.178393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:27.178498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:27.178539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:27.178561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:27.178571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:27.178610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:27.178659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:27.178714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:27.181477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:27.181516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:27.181600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:27.189612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 363 partition: 0 MaxSeqNo: 36 sessionId: src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0
2025-10-10T14:03:27.191642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db4736a7-d2d78412-11ca6c77-72386d09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:27.239470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0] Write session: try to update token
2025-10-10T14:03:27.239530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:27.253360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:27.253391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:27.253403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:27.407065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId: src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:27.415039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:27.415088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:27.415103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:27.415116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:27.415127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:27.415166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.415194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.415221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.415258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.415470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:27.415481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:27.415494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:27.415538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:27.415564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.415574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:27.416114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:27.416154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:27.416183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:27.416217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:27.418922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:27.449962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:27.513658Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 3 CurrentSessionLifetimeMs: 242112 BytesRead: 29286416 MessagesRead: 13 BytesReadCompressed: 29286416 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-10-10T14:03:27.587855Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:27.647362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:27.647418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:27.647491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:27.647507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:27.647553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593445228685727:5511]
2025-10-10T14:03:27.648044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:27.649041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:27.650621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593446806604032:5422]
2025-10-10T14:03:27.650812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:27.652886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:27.669278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:27.669323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0] Write session will restart in 0.006733s
2025-10-10T14:03:27.669430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0] Write session: Do CDS request
2025-10-10T14:03:27.669461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:27.667777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 363 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0
2025-10-10T14:03:27.668152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 363 sessionId: src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0 is DEAD
2025-10-10T14:03:27.683128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:27.683159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 364
2025-10-10T14:03:27.685622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:27.686718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:27.686862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:27.686878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:27.686887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:27.688828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 364 sessionId:  describe result for acl check
2025-10-10T14:03:27.688965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:27.688977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:27.688988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:27.689005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593446806604090:6094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:27.692044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593446806604090:6094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:27.718981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593446806604090:6094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:27.745951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593446806604090:6094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:27.746000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593446806604090:6094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:27.746020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593446806604090:6094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:27.746054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:27.750434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593446806604205:5422]
2025-10-10T14:03:27.773631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:27.779795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:27.780772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:27.780804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:27.780858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:27.781193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:27.781398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593445228685942:5522]
2025-10-10T14:03:27.783150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:27.784134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:27.784357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:27.785533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:27.785875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:27.785894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:27.785902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:27.785909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:27.785918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:27.785925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:27.785933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:27.785941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:27.785947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.785955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.785964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.785972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.786026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:27.786148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:27.786205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:27.786260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:27.786313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:27.786368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:27.786424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:27.786468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:27.786508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.786550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.786594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.786640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.786671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:27.786728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:27.786784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:27.786830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:27.786871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:27.786915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:27.786951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:27.786996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:27.787034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:27.787091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:27.787127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:27.787168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:27.787204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:27.787244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:27.787287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:27.787340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:27.787377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.787417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.787452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.787492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.787531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.787572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.787605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.787647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.788017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:27.809981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:27.855067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:27.855134Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:27.855154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:27.855177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:27.855202Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 363 [2:7559593445228685942:5522]
2025-10-10T14:03:27.855263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:27.855326Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:27.855342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:27.855355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:27.855367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:27.855417Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:27.855440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:27.855465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:27.856866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.856883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.856898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.856914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.856927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:27.857747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:27.857779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.857941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:27.858146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:27.858392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:27.858526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:27.858620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593446806604205:5422], now have 1 active actors on pipe
2025-10-10T14:03:27.858647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593446806604192:6094], now have 1 active actors on pipe
2025-10-10T14:03:27.858671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593446806604078:2442], now have 1 active actors on pipe
2025-10-10T14:03:27.858698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:27.858712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:27.858729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:27.858743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:27.858791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:27.858875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:27.859062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:27.859094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:27.859225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:27.859247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:27.860100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 363, pipe: [1:7559593446806604205:5422]
2025-10-10T14:03:27.860229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 363
2025-10-10T14:03:27.860303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 363
2025-10-10T14:03:27.859852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:27.859878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:27.859892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:27.859905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:27.859933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:27.860862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:27.860898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:27.860990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:27.861023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:27.861057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:27.861082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:27.861150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:27.861197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:27.861265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:27.864316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:27.864359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:27.864452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:27.865503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 364 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0
2025-10-10T14:03:27.873088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc9729-49e84a34-a11bd9d5-68e0f067_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:27.910378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0] Write session: try to update token
2025-10-10T14:03:27.910436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:27.975038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:27.975069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:27.975094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:27.975149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:27.975164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:27.975176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:27.975189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:27.975200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:27.975235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:27.975263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:27.975288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:27.975311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:27.975508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:27.975533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:27.975544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:27.976723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:27.976726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:27.976766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:27.976798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:27.976830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:28.076140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId: src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:28.115520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:28.140749Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:28.164877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:28.164936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:28.165006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:28.165021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:28.165065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593445228685937:5522]
2025-10-10T14:03:28.165507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:28.168931Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:28.169467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593446806604205:5422]
2025-10-10T14:03:28.169562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:28.171964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:28.186109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 364 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0
2025-10-10T14:03:28.186422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 364 sessionId: src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0 is DEAD
2025-10-10T14:03:28.187232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:28.187304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0] Write session will restart in 0.007045s
2025-10-10T14:03:28.187471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0] Write session: Do CDS request
2025-10-10T14:03:28.187527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:28.201928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:28.201961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 365
2025-10-10T14:03:28.204534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:28.205312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:28.205597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:28.205616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:28.205628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:28.207216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 365 sessionId:  describe result for acl check
2025-10-10T14:03:28.207343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:28.207354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:28.207363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:28.207380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593451101571587:6099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:28.211656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593451101571587:6099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:28.232993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593451101571587:6099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:28.248190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593451101571587:6099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:28.248231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593451101571587:6099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:28.248249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593451101571587:6099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:28.248280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:28.273376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593451101571677:5422]
2025-10-10T14:03:28.327942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:28.337491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:28.338462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:28.338483Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:28.338533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:28.338843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:28.339036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593449523653442:5530]
2025-10-10T14:03:28.354024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:28.358296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:28.358481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:28.359530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:28.359895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:28.359913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:28.359921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:28.359929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:28.359937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:28.359945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:28.359953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:28.359960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:28.359967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:28.359975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:28.359983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:28.359990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:28.360044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:28.360163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:28.360217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:28.360275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:28.360324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:28.360375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:28.360430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:28.360481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:28.360531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:28.360582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:28.360629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:28.360681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:28.360724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:28.360794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:28.360862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:28.360924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:28.360977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:28.361037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:28.361089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:28.361174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:28.361227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:28.361291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:28.361338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:28.361396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:28.361452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:28.361571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:28.361626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:28.361682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:28.361732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:28.361786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:28.361833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:28.361893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:28.361947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:28.362011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:28.362063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:28.362123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:28.362709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:28.419546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:28.461961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:28.462016Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:28.462035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:28.462054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:28.462079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 364 [2:7559593449523653442:5530]
2025-10-10T14:03:28.462133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:28.462200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:28.462216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:28.462229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:28.462240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:28.462292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:28.462316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:28.462338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:28.464930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:28.464967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:28.464981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:28.464996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:28.465007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:28.468997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 364, pipe: [1:7559593451101571677:5422]
2025-10-10T14:03:28.469161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 364
2025-10-10T14:03:28.469262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 364
2025-10-10T14:03:28.478794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:28.478841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:28.478994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:28.479204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:28.479468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:28.479601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:28.479699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593451101571677:5422], now have 1 active actors on pipe
2025-10-10T14:03:28.479723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593451101571575:2442], now have 1 active actors on pipe
2025-10-10T14:03:28.479745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593451101571621:6099], now have 1 active actors on pipe
2025-10-10T14:03:28.479829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:28.479853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:28.479893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.479909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.479925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.479939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.479986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:28.480072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:28.480260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:28.480278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:28.480349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:28.480382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:28.480402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:28.480413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:28.480452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:28.480498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:28.480638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.480661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:28.480707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:28.480814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:28.480835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:28.480848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:28.480862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:28.480891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:28.482827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:28.482856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:28.482941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:28.489465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 365 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0
2025-10-10T14:03:28.495541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4a71c5-9b17304a-55746323-e0c0891d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:28.548280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0] Write session: try to update token
2025-10-10T14:03:28.548337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:28.615162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:28.615190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:28.615198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:28.615283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:28.615294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:28.615304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:28.615313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:28.615322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:28.615346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.615364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.615502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.615548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.616960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:28.616999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:28.617031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:28.617065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:28.742529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:28.742574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:28.742585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:28.744068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:28.765641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId: src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:28.804852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:28.922516Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:28.941470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:28.941506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:28.941555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593449523653437:5530]
2025-10-10T14:03:28.941716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:28.941741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:28.944939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:28.946123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:28.946660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593451101571677:5422]
2025-10-10T14:03:28.946749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:28.946871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:28.946882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:28.965260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:28.965345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0] Write session will restart in 0.006583s
2025-10-10T14:03:28.965534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0] Write session: Do CDS request
2025-10-10T14:03:28.965585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:28.964305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 365 reason: error at write: Disconnected sessionId: src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0
2025-10-10T14:03:28.964693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 365 sessionId: src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0 is DEAD
2025-10-10T14:03:28.981979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:28.999630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:28.999665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 366
2025-10-10T14:03:29.007581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:29.007757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:29.007774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:29.007784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:29.011990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 366 sessionId:  describe result for acl check
2025-10-10T14:03:29.012115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:29.012127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:29.012137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:29.012153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593455396539118:6111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:29.015219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593455396539118:6111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:29.022487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593455396539118:6111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:29.057254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593455396539175:5422]
2025-10-10T14:03:29.058405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593455396539118:6111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:29.058445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593455396539118:6111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:29.058463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593455396539118:6111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:29.058495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:29.105626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:29.108782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:29.109763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:29.109794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:29.109989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:29.110301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:29.110506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593453818620958:5539]
2025-10-10T14:03:29.112977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:29.114975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:29.115275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:29.116670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:29.117029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:29.117048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:29.117055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:29.117064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:29.117072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:29.117080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:29.117087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:29.117094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:29.117102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:29.117109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:29.117118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:29.117147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:29.117201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:29.117324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:29.117376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:29.117427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:29.117480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:29.117533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:29.117581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:29.117630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:29.117700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:29.117751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:29.117805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:29.117867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:29.117914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:29.117987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:29.118050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:29.118112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:29.118169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:29.118238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:29.118298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:29.118357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:29.118418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:29.118475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:29.118528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:29.118594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:29.118652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:29.118719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:29.118777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:29.118841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:29.118900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:29.118967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:29.119039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:29.119102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:29.119170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:29.119232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:29.119283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:29.119340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:29.119840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:29.213410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:29.243047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:29.248918Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:29.248961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:29.248984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:29.249012Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 365 [2:7559593453818620958:5539]
2025-10-10T14:03:29.249088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:29.249176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:29.249194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:29.249207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:29.249221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:29.249276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:29.249298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:29.249321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:29.251370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:29.251396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:29.251410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:29.251424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:29.251436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:29.251738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:29.251757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:29.251902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:29.252090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:29.252326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:29.252451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:29.252537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:29.252553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:29.252566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:29.252579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:29.252636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:29.252725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:29.252847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:29.252860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:29.252870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:29.252882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:29.252896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:29.252912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:29.253065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593451101571805:2442], now have 1 active actors on pipe
2025-10-10T14:03:29.253083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:29.253116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:29.253206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:29.253207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593455396539175:5422], now have 1 active actors on pipe
2025-10-10T14:03:29.253229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593455396539178:6111], now have 1 active actors on pipe
2025-10-10T14:03:29.255290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 365
2025-10-10T14:03:29.255389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 365
2025-10-10T14:03:29.255454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 365, pipe: [1:7559593455396539175:5422]
2025-10-10T14:03:29.256698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:29.256739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:29.256837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4da5ab8-737f88c7-98695c44-8c569726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:29.256871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:29.256889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:29.256900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:29.256940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:29.256984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:29.257037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:29.257931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:29.257960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:29.258027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:29.259294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c6545f5-d76d6fc7-57aff2bf-3a4a0d33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4da5ab8-737f88c7-98695c44-8c569726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:29.258399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 366 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4da5ab8-737f88c7-98695c44-8c569726_0
2025-10-10T14:03:29.317415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4da5ab8-737f88c7-98695c44-8c569726_0] Write session: try to update token
2025-10-10T14:03:29.317481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4da5ab8-737f88c7-98695c44-8c569726_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:29.484497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:29.484528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:29.484539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:29.484597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:29.484612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:29.484626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:29.484637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:29.484647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:29.484683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:29.484709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:29.484731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:29.484752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:29.484956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:29.484983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:29.484994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:29.485567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:29.485605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:29.485632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:29.485659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:29.494658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:29.563433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId: src_id|b4da5ab8-737f88c7-98695c44-8c569726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:29.637290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:29.958953Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:30.044807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593455396539175:5422]
2025-10-10T14:03:30.044919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:30.044931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:30.043274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:30.043328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:30.043395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:30.043407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:30.043446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593453818620953:5539]
2025-10-10T14:03:30.043776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:30.044286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:30.045163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:30.061421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 366 reason: error at write: Disconnected sessionId: src_id|b4da5ab8-737f88c7-98695c44-8c569726_0
2025-10-10T14:03:30.061726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 366 sessionId: src_id|b4da5ab8-737f88c7-98695c44-8c569726_0 is DEAD
2025-10-10T14:03:30.065623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4da5ab8-737f88c7-98695c44-8c569726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:30.065670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4da5ab8-737f88c7-98695c44-8c569726_0] Write session will restart in 0.006217s
2025-10-10T14:03:30.065775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4da5ab8-737f88c7-98695c44-8c569726_0] Write session: Do CDS request
2025-10-10T14:03:30.065806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4da5ab8-737f88c7-98695c44-8c569726_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:30.097441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4da5ab8-737f88c7-98695c44-8c569726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:30.099278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:30.099320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 367
2025-10-10T14:03:30.102510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:30.102680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:30.102697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:30.102711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:30.104235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 367 sessionId:  describe result for acl check
2025-10-10T14:03:30.104353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:30.104364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:30.104373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:30.104390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593459691506648:6122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:30.106870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593459691506648:6122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:30.117802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593459691506648:6122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:30.140309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593459691506648:6122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:30.140369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593459691506648:6122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:30.140388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593459691506648:6122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:30.140423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:30.148879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593459691506681:5422]
2025-10-10T14:03:30.253118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:30.262719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:30.263608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:30.263628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:30.263676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:30.263947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:30.264133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593458113588482:5551]
2025-10-10T14:03:30.270593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:30.272074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:30.272304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:30.273634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:30.273990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:30.273999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:30.274006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:30.274013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:30.274020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:30.274027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:30.274032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:30.274039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:30.274045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.274052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.274058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.274065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.274113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:30.274220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:30.274272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:30.274321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:30.274372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:30.274423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:30.274471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:30.274519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:30.274561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.274607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.274670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.274717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.274762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:30.274828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:30.274884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:30.274936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:30.274985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:30.275038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:30.275082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:30.275151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:30.275198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:30.275251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:30.275296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:30.275348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:30.275393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:30.275443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:30.275485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:30.275536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:30.275580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.275630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.275669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.275719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.275765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.275813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.275854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.275905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.282674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:30.346599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:30.367377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:30.367425Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:30.367443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:30.367465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:30.367488Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 366 [2:7559593458113588482:5551]
2025-10-10T14:03:30.367543Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:30.367609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:30.367625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:30.367638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:30.367651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:30.367704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:30.367726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:30.367749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:30.378626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.378660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.378678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.378693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.378706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:30.379007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:30.379024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.379207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.379408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.379657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.379778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:30.379851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593458113588477:5551]
2025-10-10T14:03:30.379868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593458113588477:5551]
2025-10-10T14:03:30.379883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593458113588477:5551]
2025-10-10T14:03:30.379897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593458113588477:5551]
2025-10-10T14:03:30.380056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:30.380069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:30.380081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:30.380092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:30.380920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 366
2025-10-10T14:03:30.381029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 366, pipe: [1:7559593459691506681:5422]
2025-10-10T14:03:30.381137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 366
2025-10-10T14:03:30.381895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:30.382025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:30.382244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:30.382261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:30.382310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593459691506633:2442], now have 1 active actors on pipe
2025-10-10T14:03:30.382336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593459691506681:5422], now have 1 active actors on pipe
2025-10-10T14:03:30.382358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593459691506678:6122], now have 1 active actors on pipe
2025-10-10T14:03:30.382425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:30.382447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:30.382593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593458113588477:5551]
2025-10-10T14:03:30.382626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:30.382705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41f64feb-2e43b64f-e11690b0-9329d06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:30.382738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:30.382758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:30.382768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:30.382806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:30.382851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:30.382979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:30.383285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:30.386407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:30.386462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:30.386547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:30.386929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 367 partition: 0 MaxSeqNo: 36 sessionId: src_id|41f64feb-2e43b64f-e11690b0-9329d06_0
2025-10-10T14:03:30.390816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4da5ab8-737f88c7-98695c44-8c569726_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41f64feb-2e43b64f-e11690b0-9329d06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:30.450648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f64feb-2e43b64f-e11690b0-9329d06_0] Write session: try to update token
2025-10-10T14:03:30.450709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f64feb-2e43b64f-e11690b0-9329d06_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:30.469209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:30.469244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:30.469256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:30.535844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:30.545242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:30.545288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:30.545302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:30.545314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:30.545358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593458113588477:5551]
2025-10-10T14:03:30.545389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593458113588477:5551]
2025-10-10T14:03:30.545417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593458113588477:5551]
2025-10-10T14:03:30.545442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593458113588477:5551]
2025-10-10T14:03:30.545641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:30.545672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.545684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:30.548468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:30.548528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:30.548560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:30.548588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:30.551950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:30.692915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId: src_id|41f64feb-2e43b64f-e11690b0-9329d06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:30.705328Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:30.739170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:30.740426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:30.750740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 367 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|41f64feb-2e43b64f-e11690b0-9329d06_0
2025-10-10T14:03:30.751090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 367 sessionId: src_id|41f64feb-2e43b64f-e11690b0-9329d06_0 is DEAD
2025-10-10T14:03:30.751873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f64feb-2e43b64f-e11690b0-9329d06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:03:30.751905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f64feb-2e43b64f-e11690b0-9329d06_0] Write session will restart in 0.009942s
2025-10-10T14:03:30.752006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f64feb-2e43b64f-e11690b0-9329d06_0] Write session: Do CDS request
2025-10-10T14:03:30.752037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f64feb-2e43b64f-e11690b0-9329d06_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:30.774598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f64feb-2e43b64f-e11690b0-9329d06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:30.838539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:30.838773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593459691506681:5422]
2025-10-10T14:03:30.838850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:30.838865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 368
2025-10-10T14:03:30.842366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:30.842514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:30.842530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:30.842540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:30.844292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 368 sessionId:  describe result for acl check
2025-10-10T14:03:30.844416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:30.844426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:30.844434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:30.844452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593459691506934:6137] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:30.850160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593459691506934:6137] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:30.858267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593459691506934:6137] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:30.902451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593459691506934:6137] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:30.902498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593459691506934:6137] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:30.902518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593459691506934:6137] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:30.902551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:30.937736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593459691507069:5422]
2025-10-10T14:03:30.945485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:30.955546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:30.956489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:30.956509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:30.956560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:30.956845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:30.957039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593458113588711:5560]
2025-10-10T14:03:30.959347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:30.962910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:30.963258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:30.964730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:30.965147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:30.965178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:30.965187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:30.965195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:30.965200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:30.965206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:30.965212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:30.965217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:30.965224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.965229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.965235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.965240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.965281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:30.965376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:30.965419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:30.965459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:30.965496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:30.965534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:30.965571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:30.965608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:30.965646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.965684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.965723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.965760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.965789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:30.965855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:30.965925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:30.966003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:30.966060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:30.966126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:30.966181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:30.966255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:30.966318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:30.966382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:30.966435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:30.966495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:30.966559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:30.966622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:30.966675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:30.966734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:30.966789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.966850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:30.966919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.966985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:30.967047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.967106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:30.967167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.967228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:30.967750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:31.100312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:31.127031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:31.127079Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:31.127095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:31.127119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:31.127144Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 367 [2:7559593458113588711:5560]
2025-10-10T14:03:31.127217Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:31.127286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:31.127301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:31.127314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:31.127327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:31.127376Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:31.127397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:31.127423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:31.128732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:31.128748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:31.128762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:31.128776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:31.128787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:31.129067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:31.129084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:31.134712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 367, pipe: [1:7559593459691507069:5422]
2025-10-10T14:03:31.134846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 367
2025-10-10T14:03:31.134933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 367
2025-10-10T14:03:31.137338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:31.137554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:31.137795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:31.137917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:31.138036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593459691507069:5422], now have 1 active actors on pipe
2025-10-10T14:03:31.138061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593459691506921:2442], now have 1 active actors on pipe
2025-10-10T14:03:31.138085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593459691507042:6137], now have 1 active actors on pipe
2025-10-10T14:03:31.138142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:31.138169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:31.138230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.138246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.138259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.138271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.138323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:31.138419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:31.138600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:31.138618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:31.138711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:31.138748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:31.138766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:31.138776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:31.138818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:31.138867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:31.139026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.139049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:31.139098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:31.140058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:31.140083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:31.140095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:31.140105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:31.140129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:31.144389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:31.144436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:31.144531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:31.145115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 368 partition: 0 MaxSeqNo: 36 sessionId: src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0
2025-10-10T14:03:31.149746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f64feb-2e43b64f-e11690b0-9329d06_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:31.199223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0] Write session: try to update token
2025-10-10T14:03:31.199293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:31.228209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:31.228248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:31.228261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:31.406674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:31.406717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:31.406730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:31.406851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:31.406866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:31.406881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:31.406894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:31.406906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:31.406944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.406973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.407001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.407026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.408527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:31.408568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:31.408602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:31.408634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:31.426566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:31.426614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:31.426627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:31.427773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:31.441334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId: src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:31.485032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:31.633312Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:31.639636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:31.639668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:31.639707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593458113588705:5560]
2025-10-10T14:03:31.639841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:31.639865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:31.640231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:31.641574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:31.643412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593459691507069:5422]
2025-10-10T14:03:31.643491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:31.643612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:31.643623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:31.690175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 368 reason: error at write: Disconnected sessionId: src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0
2025-10-10T14:03:31.690515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 368 sessionId: src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0 is DEAD
2025-10-10T14:03:31.693753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:31.693788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0] Write session will restart in 0.007423s
2025-10-10T14:03:31.693892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0] Write session: Do CDS request
2025-10-10T14:03:31.693923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:31.708468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:31.709002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:31.709036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 369
2025-10-10T14:03:31.709477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:31.709610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:31.709628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:31.709638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:31.711712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 369 sessionId:  describe result for acl check
2025-10-10T14:03:31.711859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:31.711870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:31.711880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:31.711897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593463986474443:6149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:31.714721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593463986474443:6149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:31.730173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593463986474443:6149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:31.744093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593463986474494:5422]
E1010 14:03:31.746378892  107741 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:03:31.749835Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:03:31.761009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593463986474443:6149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:31.761047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593463986474443:6149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:31.761060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593463986474443:6149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:31.761085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:31.792567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:31.799208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:31.800108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:31.800126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:31.800171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:31.800460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:31.800659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593462408556230:5572]
2025-10-10T14:03:31.803086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:31.808377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:31.808646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:31.810022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:31.810375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:31.810384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:31.810392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:31.810399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:31.810407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:31.810416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:31.810424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:31.810433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:31.810441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:31.810448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:31.810456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:31.810464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:31.810515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:31.810637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:31.810692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:31.810747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:31.810797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:31.810847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:31.810898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:31.810950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:31.811001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:31.811054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:31.811105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:31.811158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:31.811223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:31.811295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:31.811360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:31.811420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:31.811474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:31.811535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:31.811584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:31.811641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:31.811692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:31.811749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:31.811798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:31.811856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:31.811908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:31.811962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:31.812015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:31.812074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:31.812127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:31.812185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:31.812233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:31.812290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:31.812338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:31.812396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:31.812443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:31.812498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:31.812981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:31.878825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:31.894575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:31.894626Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:31.894644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:31.894664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:31.894690Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 368 [2:7559593462408556230:5572]
2025-10-10T14:03:31.894749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:31.894804Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:31.894821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:31.894833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:31.894846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:31.894893Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:31.894916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:31.894938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:31.897302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:31.897336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:31.897352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:31.897369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:31.897382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:31.897668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:31.897685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:31.897842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:31.898047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:31.898311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:31.898448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:31.898515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:31.898530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:31.898543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:31.898555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:31.898586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:31.898666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:31.898868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:31.898886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:31.899011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:31.899031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:31.900226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:31.900244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:31.900257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:31.900269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:31.900293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:31.900937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593463986474534:6149], now have 1 active actors on pipe
2025-10-10T14:03:31.900965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593463986474408:2442], now have 1 active actors on pipe
2025-10-10T14:03:31.900989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593463986474494:5422], now have 1 active actors on pipe
2025-10-10T14:03:31.901228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 368
2025-10-10T14:03:31.901330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 368
2025-10-10T14:03:31.901402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 368, pipe: [1:7559593463986474494:5422]
2025-10-10T14:03:31.904201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:31.904246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:31.904348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:31.904386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:31.904406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:31.904416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:31.904458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:31.904509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:31.904562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:31.908900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:31.908945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:31.909011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:31.909459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 369 partition: 0 MaxSeqNo: 36 sessionId: src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0
2025-10-10T14:03:31.913752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9cbc10-9f66719a-ff921505-bba6173a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:31.988706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0] Write session: try to update token
2025-10-10T14:03:31.988767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:31.997323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:31.997358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:31.997371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:32.153050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:32.153093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:32.153110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:32.153139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:32.153152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:32.153195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:32.153225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:32.153253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:32.153278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:32.153481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:32.153495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:32.153508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:32.153626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:32.153651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:32.153676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:32.155230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:32.156260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:32.156301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:32.156329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:32.156357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:32.159657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId: src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:32.190340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:32.340242Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:32.367073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:32.367127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:32.367227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:32.367242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:32.367286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593462408556225:5572]
2025-10-10T14:03:32.367538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:32.367858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:32.370597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593463986474494:5422]
2025-10-10T14:03:32.370784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:32.501009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:32.501193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 369 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0
2025-10-10T14:03:32.501576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 369 sessionId: src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0 is DEAD
2025-10-10T14:03:32.505980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:32.506051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0] Write session will restart in 0.005903s
2025-10-10T14:03:32.506220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0] Write session: Do CDS request
2025-10-10T14:03:32.506270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:32.520381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:32.531166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593468281441987:5422]
2025-10-10T14:03:32.531393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:32.531406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 370
2025-10-10T14:03:32.534235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:32.534382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:32.534399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:32.534422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:32.538756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 370 sessionId:  describe result for acl check
2025-10-10T14:03:32.538864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:32.538874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:32.538882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:32.538901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593468281442004:6160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:32.544684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593468281442004:6160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:32.574935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593468281442004:6160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:32.607860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:32.610302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593468281442004:6160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:32.610347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593468281442004:6160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:32.610367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593468281442004:6160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:32.610396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:32.628034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:32.629235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:32.629273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:32.629331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:32.629682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:32.629846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593466703523749:5580]
2025-10-10T14:03:32.631254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:32.632316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:32.632494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:32.633436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:32.633672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:32.633678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:32.633683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:32.633687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:32.633691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:32.633695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:32.633700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:32.633705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:32.633709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:32.633713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:32.633718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:32.633722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:32.633753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:32.633833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:32.633867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:32.633901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:32.633935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:32.633967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:32.634000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:32.634035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:32.634077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:32.634122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:32.634165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:32.634208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:32.634249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:32.634313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:32.634371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:32.634422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:32.634467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:32.634517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:32.634559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:32.634612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:32.634656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:32.634707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:32.634753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:32.634802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:32.634849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:32.634901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:32.634946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:32.634998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:32.635044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:32.635095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:32.635135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:32.635205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:32.635251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:32.635305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:32.635349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:32.635401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:32.635833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:32.679529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:32.699051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:32.701507Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:32.701537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:32.701556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:32.701578Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 369 [2:7559593466703523749:5580]
2025-10-10T14:03:32.701632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:32.701687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:32.701702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:32.701714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:32.701726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:32.701778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:32.701799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:32.701821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:32.703222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:32.703239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:32.703252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:32.703265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:32.703275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:32.707060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:32.707095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:32.707267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:32.705199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 369
2025-10-10T14:03:32.705298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 369, pipe: [1:7559593468281441987:5422]
2025-10-10T14:03:32.705380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 369
2025-10-10T14:03:32.707626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:32.707873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:32.707995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:32.708100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593468281441950:2442], now have 1 active actors on pipe
2025-10-10T14:03:32.708129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593468281441987:5422], now have 1 active actors on pipe
2025-10-10T14:03:32.708150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593468281442129:6160], now have 1 active actors on pipe
2025-10-10T14:03:32.708241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:32.708264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:32.708311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593466703523742:5580]
2025-10-10T14:03:32.708327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593466703523742:5580]
2025-10-10T14:03:32.708340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593466703523742:5580]
2025-10-10T14:03:32.708355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593466703523742:5580]
2025-10-10T14:03:32.708397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:32.708490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:32.708674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:32.708693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:32.708770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:32.708807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:32.708826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:32.708838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:32.708882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:32.708930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:32.709091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593466703523742:5580]
2025-10-10T14:03:32.709117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:32.709194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:32.710022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:32.710043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:32.710055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:32.710068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:32.710097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:32.723765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:32.723819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:32.723918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:32.729826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 370 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0
2025-10-10T14:03:32.735068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fbac1ef-9602d964-8ce35c95-9fe40415_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:32.770914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0] Write session: try to update token
2025-10-10T14:03:32.770976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:32.802503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:32.802543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:32.802556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:32.973161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:32.973206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:32.973221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:32.973287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:32.973305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:32.973321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:32.973335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:32.973346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:32.973386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593466703523742:5580]
2025-10-10T14:03:32.973415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593466703523742:5580]
2025-10-10T14:03:32.973442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593466703523742:5580]
2025-10-10T14:03:32.973466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593466703523742:5580]
2025-10-10T14:03:32.973630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:32.973658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:32.973672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:32.974409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:32.974446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:32.974477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:32.974506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:32.974760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:33.000458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId: src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:33.022233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:33.175405Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:33.186440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:33.186488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:33.190954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593468281441987:5422]
2025-10-10T14:03:33.191062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:33.191074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:33.197307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:33.211876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 370 reason: error at write: Disconnected sessionId: src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0
2025-10-10T14:03:33.212887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:33.212921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0] Write session will restart in 0.006862s
2025-10-10T14:03:33.213020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0] Write session: Do CDS request
2025-10-10T14:03:33.213048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:33.223359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 370 sessionId: src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0 is DEAD
2025-10-10T14:03:33.226393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:33.234643Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:33.227328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:33.227359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 371
2025-10-10T14:03:33.228875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:33.229007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:33.229024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:33.229036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:33.238490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 371 sessionId:  describe result for acl check
2025-10-10T14:03:33.238633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:33.238644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:33.238655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:33.238674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593472576409475:6170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:33.246580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593472576409475:6170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:33.262065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593472576409475:6170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:33.297001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593472576409514:5422]
2025-10-10T14:03:33.312417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593472576409475:6170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:33.312468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593472576409475:6170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:33.312490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593472576409475:6170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:33.312527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:33.380597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:33.382708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:33.383491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:33.383518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:33.383566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:33.383842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:33.384034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593470998491269:5591]
2025-10-10T14:03:33.386143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:33.387628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:33.387876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:33.390405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:33.390856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:33.390865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:33.390874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:33.390882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:33.390889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:33.390897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:33.390906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:33.390914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:33.390922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:33.390930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:33.390938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:33.390946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:33.391001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:33.391146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:33.391217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:33.391272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:33.391327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:33.391379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:33.391429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:33.391481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:33.391533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:33.391587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:33.391637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:33.391686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:33.391732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:33.391804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:33.391871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:33.391933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:33.391990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:33.392054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:33.392110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:33.392173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:33.392231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:33.392311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:33.392365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:33.392431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:33.392481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:33.392540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:33.392588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:33.392646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:33.392701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:33.392765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:33.392815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:33.392877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:33.392930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:33.392992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:33.393046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:33.393106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:33.394864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:33.428198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:33.474773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:33.474822Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:33.474842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:33.474862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:33.474886Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 370 [2:7559593470998491269:5591]
2025-10-10T14:03:33.474946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:33.475007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:33.475022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:33.475035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:33.475046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:33.475093Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:33.475114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:33.475136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:33.478112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:33.478142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:33.478158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:33.478174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:33.478187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:33.478502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:33.478524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:33.478688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:33.478903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:33.479163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:33.479313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:33.479389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593470998491264:5591]
2025-10-10T14:03:33.479406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593470998491264:5591]
2025-10-10T14:03:33.479421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593470998491264:5591]
2025-10-10T14:03:33.479437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593470998491264:5591]
2025-10-10T14:03:33.479485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:33.479571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:33.479772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:33.479791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:33.479922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593470998491264:5591]
2025-10-10T14:03:33.479943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:33.481582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:33.481611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:33.481624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:33.481637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:33.481664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:33.482666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 370
2025-10-10T14:03:33.482778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 370
2025-10-10T14:03:33.482837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 370, pipe: [1:7559593472576409514:5422]
2025-10-10T14:03:33.483722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593472576409462:2442], now have 1 active actors on pipe
2025-10-10T14:03:33.483780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593472576409546:6170], now have 1 active actors on pipe
2025-10-10T14:03:33.483805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593472576409514:5422], now have 1 active actors on pipe
2025-10-10T14:03:33.484094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:33.484122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:33.484202Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:33.484236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:33.484256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:33.484266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:33.484301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:33.484347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:33.484394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:33.486570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:33.486602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:33.486687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:33.487051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 371 partition: 0 MaxSeqNo: 36 sessionId: src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0
2025-10-10T14:03:33.489433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0978dd9-6b3bb265-83169f46-72b71b99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:33.551227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0] Write session: try to update token
2025-10-10T14:03:33.551287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:33.577505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:33.577542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:33.577556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:33.704606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:33.704642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:33.704657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:33.704669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:33.704681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:33.704715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593470998491264:5591]
2025-10-10T14:03:33.704739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593470998491264:5591]
2025-10-10T14:03:33.704768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593470998491264:5591]
2025-10-10T14:03:33.704789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593470998491264:5591]
2025-10-10T14:03:33.704952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:33.704971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:33.704981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:33.705024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:33.705048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:33.705061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:33.706407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:33.709064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:33.709117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:33.709170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:33.709202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:33.789364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId: src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:33.844073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:33.892967Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:33.895595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:33.895640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:33.898783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:33.899421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:33.899550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:33.899562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:33.938888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:33.938969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0] Write session will restart in 0.008174s
2025-10-10T14:03:33.939206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0] Write session: Do CDS request
2025-10-10T14:03:33.939277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:33.938136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 371 reason: error at write: Disconnected sessionId: src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0
2025-10-10T14:03:33.938431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 371 sessionId: src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0 is DEAD
2025-10-10T14:03:33.962086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593472576409514:5422]
2025-10-10T14:03:33.962199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:33.962212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 372
2025-10-10T14:03:33.967702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:33.968427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:33.968571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:33.968589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:33.968600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:33.970270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 372 sessionId:  describe result for acl check
2025-10-10T14:03:33.970391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:33.970401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:33.970411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:33.970427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593472576409715:6182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:33.973976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593472576409715:6182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:33.988586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593472576409715:6182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:34.013332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593472576409715:6182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:34.013376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593472576409715:6182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:34.013394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593472576409715:6182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:34.013424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:34.061823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593476871377182:5422]
2025-10-10T14:03:34.063532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:34.072342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:34.073343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:34.073372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:34.073423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:34.073731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:34.073934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593475293458791:5600]
2025-10-10T14:03:34.076362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:34.078209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:34.078503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:34.079927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:34.080344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:34.080354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:34.080362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:34.080369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:34.080379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:34.080385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:34.080393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:34.080401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:34.080409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.080417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.080425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.080434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.080485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:34.080611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:34.080667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:34.080720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:34.080770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:34.080821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:34.080872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:34.080930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:34.080979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.081033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.081081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.081696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.081761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:34.081841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:34.081915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:34.081985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:34.082048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:34.082107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:34.082158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:34.082232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:34.082288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:34.082344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:34.082392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:34.082448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:34.082502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:34.082558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:34.082608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:34.082674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:34.082731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.082793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.082850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.082918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.082969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.083026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.083074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.083132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.083639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:34.117549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:34.169471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:34.169516Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:34.169536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:34.169556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:34.169581Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 371 [2:7559593475293458791:5600]
2025-10-10T14:03:34.169638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:34.169695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:34.169711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:34.169724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:34.169736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:34.169786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:34.169809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:34.169831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:34.172029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.172062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.172144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.172160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.172171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:34.172460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:34.172490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.172639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.172855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.173105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.173252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:34.173334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.173356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.173371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.173385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.173422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:34.173508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593472576409697:2442], now have 1 active actors on pipe
2025-10-10T14:03:34.173538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593476871377108:6182], now have 1 active actors on pipe
2025-10-10T14:03:34.173560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593476871377182:5422], now have 1 active actors on pipe
2025-10-10T14:03:34.173596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:34.173811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:34.173837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:34.174130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:34.174154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:34.174166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:34.174182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:34.174348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.174383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:34.174543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:34.174171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 371
2025-10-10T14:03:34.174292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 371
2025-10-10T14:03:34.174351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 371, pipe: [1:7559593476871377182:5422]
2025-10-10T14:03:34.181438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:34.181484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:34.181572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:34.181607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:34.181626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:34.181638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:34.181675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:34.181720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:34.181768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:34.184731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:34.184761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:34.184839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:34.185596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 372 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0
2025-10-10T14:03:34.187682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9718415a-f46d26e3-f4f1ac77-a4fc41aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:34.214435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0] Write session: try to update token
2025-10-10T14:03:34.214490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:34.273775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:34.273807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:34.273821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:34.273834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:34.273846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:34.273881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.273907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.273932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.273954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.274117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:34.274131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:34.274142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:34.274598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:34.274637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:34.274665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:34.274693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:34.301201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:34.301256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.301270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:34.302901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:34.343444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId: src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:34.384229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:34.461580Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:34.475024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:34.475056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:34.475102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593475293458786:5600]
2025-10-10T14:03:34.475275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:34.475303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:34.477172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:34.477309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:34.477322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:34.481327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593476871377182:5422]
2025-10-10T14:03:34.475638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:34.476364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:34.486872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 372 reason: error at write: Disconnected sessionId: src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0
2025-10-10T14:03:34.487189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 372 sessionId: src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0 is DEAD
2025-10-10T14:03:34.490310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:34.490386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0] Write session will restart in 0.007320s
2025-10-10T14:03:34.490610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0] Write session: Do CDS request
2025-10-10T14:03:34.490668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:34.519930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:34.519961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 373
2025-10-10T14:03:34.521061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:34.521761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:34.521903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:34.521919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:34.521930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:34.523394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 373 sessionId:  describe result for acl check
2025-10-10T14:03:34.523512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:34.523524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:34.523533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:34.523550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593476871377232:6190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:34.526393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593476871377232:6190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:34.537579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593476871377232:6190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:34.555315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593476871377232:6190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:34.555357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593476871377232:6190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:34.555374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593476871377232:6190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:34.555406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:34.581260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593476871377408:5422]
2025-10-10T14:03:34.584955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:34.595968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:34.597085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:34.597115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:34.597183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:34.597516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:34.597723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593475293458997:5605]
2025-10-10T14:03:34.600532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:34.603668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:34.603930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:34.605338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:34.605699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:34.605707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:34.605715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:34.605723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:34.605732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:34.605739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:34.605747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:34.605756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:34.605771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.605780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.605788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.605796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.605847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:34.605966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:34.606020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:34.606072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:34.606123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:34.606193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:34.606245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:34.606297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:34.606346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.606408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.606458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.606506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.606551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:34.606622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:34.606687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:34.606754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:34.606816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:34.606878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:34.606929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:34.606988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:34.607041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:34.607100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:34.607151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:34.607210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:34.607278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:34.607334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:34.607385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:34.607440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:34.607494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.607550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.607598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.607661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.607712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.607769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.607816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.607871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.608370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:34.639621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:34.654997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:34.655051Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:34.655071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:34.655092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:34.655117Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 372 [2:7559593475293458997:5605]
2025-10-10T14:03:34.655179Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:34.655262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:34.655279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:34.655292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:34.655305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:34.655356Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:34.655377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:34.655401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:34.698835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.698868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.698881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.698894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.698906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:34.699184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:34.699201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.699370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:34.699559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:34.699785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:34.699910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:34.699993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593476871377340:6190], now have 1 active actors on pipe
2025-10-10T14:03:34.700031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593476871377217:2442], now have 1 active actors on pipe
2025-10-10T14:03:34.700055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593476871377408:5422], now have 1 active actors on pipe
2025-10-10T14:03:34.700080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:34.700096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:34.700108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:34.700121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:34.700160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:34.700242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:34.700410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:34.700425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:34.700431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:34.700436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:34.700447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:34.700450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:34.700575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:34.700607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:34.700841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:34.703617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:34.703657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:34.703750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26ff4aa-e66d5381-dd4addb1-17063118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:34.703783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:34.703801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:34.703812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:34.703847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:34.703886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:34.702762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 372
2025-10-10T14:03:34.702857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 372
2025-10-10T14:03:34.702931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 372, pipe: [1:7559593476871377408:5422]
2025-10-10T14:03:34.703937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:34.707876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:34.707921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:34.708002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:34.709220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 373 partition: 0 MaxSeqNo: 36 sessionId: src_id|26ff4aa-e66d5381-dd4addb1-17063118_0
2025-10-10T14:03:34.713349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9324d29-9c1358ea-a8edbf55-a292ffd6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|26ff4aa-e66d5381-dd4addb1-17063118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:34.756967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:34.756999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:34.757007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:34.799749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff4aa-e66d5381-dd4addb1-17063118_0] Write session: try to update token
2025-10-10T14:03:34.799817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff4aa-e66d5381-dd4addb1-17063118_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:34.824012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:34.824052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:34.824069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:34.824082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:34.824096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:34.824141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:34.824169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:34.824198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:34.824224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:34.824473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:34.824505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:34.824516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:34.825654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:34.829721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:34.829758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:34.829788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:34.829820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:34.968262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId: src_id|26ff4aa-e66d5381-dd4addb1-17063118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:35.008607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:35.020721Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:35.051140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:35.051193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:35.051385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:35.051399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:35.051443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593475293458992:5605]
2025-10-10T14:03:35.052792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:35.053932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:35.057446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:35.057475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:35.061295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:35.061472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593476871377408:5422]
2025-10-10T14:03:35.119894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 373 reason: error at write: Disconnected sessionId: src_id|26ff4aa-e66d5381-dd4addb1-17063118_0
2025-10-10T14:03:35.121843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff4aa-e66d5381-dd4addb1-17063118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:35.121890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff4aa-e66d5381-dd4addb1-17063118_0] Write session will restart in 0.007898s
2025-10-10T14:03:35.121991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff4aa-e66d5381-dd4addb1-17063118_0] Write session: Do CDS request
2025-10-10T14:03:35.122018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff4aa-e66d5381-dd4addb1-17063118_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:35.120238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 373 sessionId: src_id|26ff4aa-e66d5381-dd4addb1-17063118_0 is DEAD
2025-10-10T14:03:35.141523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:35.141559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 374
2025-10-10T14:03:35.144311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff4aa-e66d5381-dd4addb1-17063118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:35.145047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:35.145208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:35.145226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:35.145236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:35.149628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 374 sessionId:  describe result for acl check
2025-10-10T14:03:35.149780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:35.149791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:35.149802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:35.149821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593481166344752:6197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:35.152651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593481166344752:6197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:35.157725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593481166344758:5422]
2025-10-10T14:03:35.186228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593481166344752:6197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:35.203057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593481166344752:6197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:35.203100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593481166344752:6197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:35.203129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593481166344752:6197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:35.203162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:35.276019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:35.283770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:35.284690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:35.284720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:35.284763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:35.285038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:35.285266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593479588426518:5614]
2025-10-10T14:03:35.287668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:35.288874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:35.289120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:35.290438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:35.290752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:35.290759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:35.290767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:35.290774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:35.290780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:35.290788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:35.290794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:35.290800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:35.290806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:35.290815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:35.290822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:35.290829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:35.290872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:35.290974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:35.291023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:35.291071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:35.291114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:35.291160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:35.291202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:35.291243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:35.291310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:35.291356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:35.291398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:35.291441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:35.291479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:35.291545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:35.291601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:35.291653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:35.291700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:35.291752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:35.291794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:35.291840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:35.291883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:35.291935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:35.291980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:35.292031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:35.292074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:35.292125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:35.292169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:35.292221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:35.292268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:35.292321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:35.292369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:35.292422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:35.292467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:35.292521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:35.292567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:35.292616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:35.293042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:35.338484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:35.366368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:35.366412Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:35.366428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:35.366446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:35.366471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 373 [2:7559593479588426518:5614]
2025-10-10T14:03:35.366535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:35.366598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:35.366613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:35.366624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:35.366635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:35.366683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:35.366705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:35.366727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:35.368449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:35.368466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:35.368480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:35.368494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:35.368504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:35.369392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 373
2025-10-10T14:03:35.369510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 373, pipe: [1:7559593481166344758:5422]
2025-10-10T14:03:35.369589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 373
2025-10-10T14:03:35.370051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:35.370079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:35.370207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:35.370369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:35.370575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:35.370715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:35.370758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593481166344734:2442], now have 1 active actors on pipe
2025-10-10T14:03:35.370779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593481166344758:5422], now have 1 active actors on pipe
2025-10-10T14:03:35.370799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593481166344826:6197], now have 1 active actors on pipe
2025-10-10T14:03:35.370864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:35.370884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:35.370960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.370974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.370986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.370999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.371039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:35.371140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:35.371173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:35.371189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:35.371199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:35.371235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:35.371292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:35.371354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:35.371523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:35.371541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:35.371679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:35.371728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.371749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:35.372560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:35.372579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:35.372589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:35.372600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:35.372624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:35.382174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:35.382242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:35.382331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:35.382887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 374 partition: 0 MaxSeqNo: 36 sessionId: src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0
2025-10-10T14:03:35.383800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ff4aa-e66d5381-dd4addb1-17063118_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:35.449381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0] Write session: try to update token
2025-10-10T14:03:35.449443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:35.539467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:35.539506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:35.539520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:35.539638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:35.539654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:35.539667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:35.539680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:35.539693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:35.539727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.539756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.539783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.539806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.541358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:35.541401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:35.541432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:35.541467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:35.633461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:35.633513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:35.633523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:35.634580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:35.709381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId: src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:35.762743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:35.844582Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:35.847224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:35.847248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:35.847304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593479588426510:5614]
2025-10-10T14:03:35.847451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:35.847475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:35.849259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:35.849406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593481166344758:5422]
2025-10-10T14:03:35.849483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:35.849495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:35.847767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:35.851310Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:35.865393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 374 reason: error at write: Disconnected sessionId: src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0
2025-10-10T14:03:35.865756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 374 sessionId: src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0 is DEAD
2025-10-10T14:03:35.869751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:35.869785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0] Write session will restart in 0.009751s
2025-10-10T14:03:35.869882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0] Write session: Do CDS request
2025-10-10T14:03:35.869912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:35.889271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:35.902383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:35.902417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 375
2025-10-10T14:03:35.903623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:35.903747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:35.903762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:35.903772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:35.905289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 375 sessionId:  describe result for acl check
2025-10-10T14:03:35.905413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:35.905424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:35.905433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:35.905449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593481166344987:6209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:35.908091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593481166344987:6209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:35.945744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593481166344987:6209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:35.954262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593481166345017:5422]
2025-10-10T14:03:35.970855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593481166344987:6209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:35.970900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593481166344987:6209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:35.970918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593481166344987:6209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:35.970948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:36.064814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:36.078195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:36.079040Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:36.079056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:36.079099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:36.079365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:36.079539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593483883394050:5623]
2025-10-10T14:03:36.081824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:36.084384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:36.084633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:36.085829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:36.086144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:36.086153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:36.086160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:36.086166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:36.086172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:36.086178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:36.086185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:36.086191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:36.086196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.086204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.086211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.086217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.086263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:36.086359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:36.086407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:36.086453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:36.086498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:36.086544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:36.086585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:36.086630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:36.086674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.086718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.086760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.086801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.086838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:36.086900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:36.086955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:36.087009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:36.087071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:36.087119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:36.087158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:36.087208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:36.087254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:36.087319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:36.087363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:36.087413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:36.087456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:36.087508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:36.087548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:36.087599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:36.087644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.087694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.087735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.087788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.087833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.087889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.087930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.087982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.089981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:36.127093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:36.186688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:36.186733Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:36.186750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:36.186769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:36.186793Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 374 [2:7559593483883394050:5623]
2025-10-10T14:03:36.186849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:36.186916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:36.186931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:36.186942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:36.186954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:36.187008Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:36.187031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:36.187053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:36.192635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.192670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.192684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.192697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.192707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:36.192990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:36.193015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.193168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.193352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.194142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.194276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:36.194372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.194387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.194400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.194413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.194445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:36.194531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:36.194703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:36.194718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:36.194882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.194903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:36.195288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:36.195301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:36.195312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:36.195323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:36.195348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:36.197266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 374
2025-10-10T14:03:36.197355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 374
2025-10-10T14:03:36.197425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 374, pipe: [1:7559593481166345017:5422]
2025-10-10T14:03:36.200805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593481166345017:5422], now have 1 active actors on pipe
2025-10-10T14:03:36.200855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593481166345022:6209], now have 1 active actors on pipe
2025-10-10T14:03:36.200888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593481166344978:2442], now have 1 active actors on pipe
2025-10-10T14:03:36.200965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:36.200999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:36.201082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:36.201119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:36.201152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:36.201162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:36.201210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:36.201257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:36.201340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:36.202555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:36.202586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:36.202655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:36.205490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 375 partition: 0 MaxSeqNo: 36 sessionId: src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0
2025-10-10T14:03:36.209427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d8f3bd6-f6cc1d05-53a2b70f-edfae73e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:36.235708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0] Write session: try to update token
2025-10-10T14:03:36.235772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:36.318818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:36.318849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:36.318891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.319017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:36.319031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:36.319043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:36.319113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:36.320862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:36.322757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:36.334079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:36.335254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:36.336364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:36.361198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:36.361668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:36.389272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId: src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:36.427217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:36.427256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:36.427269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:36.481524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:36.486318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:36.486366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:36.486413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:36.486427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:36.486444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:36.486455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:36.486466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:36.486506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.486529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.486553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.486573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593483883394045:5623]
2025-10-10T14:03:36.486758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:36.486787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.486799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:36.487837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:36.489289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:36.489322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:36.489353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:36.489382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:36.652167Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:36.654862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:03:36.657156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:36.657278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:36.658520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593481166345017:5422]
2025-10-10T14:03:36.761699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593485461312572:5422]
2025-10-10T14:03:36.782398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:36.782433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:36.782611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 375 reason: error at write: Disconnected sessionId: src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0
2025-10-10T14:03:36.785906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:36.785950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0] Write session will restart in 0.009909s
2025-10-10T14:03:36.786063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0] Write session: Do CDS request
2025-10-10T14:03:36.786094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:36.790239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 375 sessionId: src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0 is DEAD
2025-10-10T14:03:36.806395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:36.818052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:36.818106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 376
2025-10-10T14:03:36.818755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:36.818969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:36.819001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:36.819022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:36.838297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 376 sessionId:  describe result for acl check
2025-10-10T14:03:36.838462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:36.838471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:36.838482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:36.838499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593485461312676:6221] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:36.841058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593485461312676:6221] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:36.861765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:36.875463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:36.876266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:36.876282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:36.876323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:36.876559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:36.876731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593483883394276:5628]
2025-10-10T14:03:36.875776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593485461312676:6221] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:36.878917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:36.885495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:36.885795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:36.887045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:36.887372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:36.887380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:36.887386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:36.887393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:36.887399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:36.887405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:36.887410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:36.887416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:36.887421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.887428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.887452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.887458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.887501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:36.887600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:36.887644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:36.887687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:36.887727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:36.887771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:36.887813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:36.887854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:36.887892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.887938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.887978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.888020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.888060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:36.888116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:36.888168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:36.888217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:36.888260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:36.888307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:36.888348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:36.888394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:36.888436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:36.888485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:36.888525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:36.888574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:36.888634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:36.888680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:36.888720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:36.888770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:36.888814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.888862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.888902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.888950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.888989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.889034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.889073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.889121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.889718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:36.910412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593485461312676:6221] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:36.910454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593485461312676:6221] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:36.910471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593485461312676:6221] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:36.910507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:36.953372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:37.005459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 375
2025-10-10T14:03:37.005549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 375, pipe: [1:7559593485461312572:5422]
2025-10-10T14:03:36.997789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:37.005619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 375
2025-10-10T14:03:36.997836Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:36.997851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:36.997871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:36.997898Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 375 [2:7559593483883394276:5628]
2025-10-10T14:03:36.997950Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:36.998015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:36.998032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:36.998042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:36.998054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:36.998105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:36.998126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:36.998150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:36.999792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:36.999810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:36.999823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:36.999837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:36.999849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:37.000126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:37.000142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:37.000279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:37.000451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:37.000664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:37.000773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:37.000852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.000866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.000879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.000890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.000945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:37.001004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:37.001020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:37.001024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:37.001032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:37.001044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:37.006881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:37.006915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:37.007078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593485461312712:6221], now have 1 active actors on pipe
2025-10-10T14:03:37.007099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593485461312572:5422], now have 1 active actors on pipe
2025-10-10T14:03:37.007116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593485461312505:2442], now have 1 active actors on pipe
2025-10-10T14:03:37.007159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:37.007177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:37.007228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.007261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:37.007352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:37.007397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:37.007428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:37.007444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:37.007453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:37.007487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:37.007529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:37.007613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:37.019060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:37.019103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:37.019186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:37.019716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 376 partition: 0 MaxSeqNo: 36 sessionId: src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0
2025-10-10T14:03:37.021681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b84a5a7d-8bd7c830-d1e39eaa-1033d7f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:37.101277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:37.101310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:37.101321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:37.104014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0] Write session: try to update token
2025-10-10T14:03:37.104070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:37.252125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:37.252162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:37.252172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:37.252232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:37.252243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:37.252256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:37.252266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:37.252276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:37.252313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.252338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.252359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.252377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.252574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:37.252598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:37.252608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:37.253029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:37.253064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:37.253089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:37.253114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:37.273395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:37.369790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId: src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:37.457046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:37.477837Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:37.490926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:37.490975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:37.491043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:37.491060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:37.491104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593483883394270:5628]
2025-10-10T14:03:37.491395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:37.491815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:37.493350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:37.522123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:37.522182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0] Write session will restart in 0.007971s
2025-10-10T14:03:37.522296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0] Write session: Do CDS request
2025-10-10T14:03:37.522328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:37.520929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 376 reason: status is not ok: tablet will be restarted right now sessionId: src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0
2025-10-10T14:03:37.521484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 376 sessionId: src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0 is DEAD
2025-10-10T14:03:37.545923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:37.569642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593485461312572:5422]
2025-10-10T14:03:37.569720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:37.569892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:37.569905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 377
2025-10-10T14:03:37.570299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:37.570409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:37.570425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:37.570434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:37.571855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 377 sessionId:  describe result for acl check
2025-10-10T14:03:37.571971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:37.571981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:37.571989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:37.572006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593489756280072:6233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:37.574621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593489756280072:6233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:37.607091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593489756280072:6233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:37.647219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593489756280072:6233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:37.647263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593489756280072:6233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:37.647280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593489756280072:6233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:37.647326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:37.673248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593489756280238:5422]
2025-10-10T14:03:37.681320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:37.694487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:37.695349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:37.695366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:37.695413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:37.695676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:37.695857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593488178361794:5643]
2025-10-10T14:03:37.698248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:37.699722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:37.699963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:37.701272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:37.701613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:37.701621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:37.701628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:37.701634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:37.701641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:37.701649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:37.701655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:37.701662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:37.701668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:37.701674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:37.701679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:37.701687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:37.701734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:37.701835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:37.701885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:37.701928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:37.701976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:37.702020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:37.702066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:37.702112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:37.702156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:37.702201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:37.702246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:37.702290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:37.702330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:37.702397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:37.702456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:37.702508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:37.702559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:37.702612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:37.702658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:37.702706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:37.702751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:37.702800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:37.702842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:37.702897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:37.702940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:37.702990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:37.703034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:37.703085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:37.703131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:37.709249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:37.709340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:37.709416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:37.709466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:37.709516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:37.709560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:37.709609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:37.710064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:37.761701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:37.786220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:37.786264Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:37.786279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:37.786297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:37.786319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 376 [2:7559593488178361794:5643]
2025-10-10T14:03:37.786369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:37.786428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:37.786443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:37.786455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:37.786465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:37.786516Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:37.786539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:37.786560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:37.787914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:37.787928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:37.787941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:37.787954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:37.787965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:37.788224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:37.788240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:37.788370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:37.788540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:37.788749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:37.788854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:37.788920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:37.788935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:37.788946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:37.788958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:37.789000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:37.789073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:37.789288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:37.789299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:37.789309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:37.789319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:37.792625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 376
2025-10-10T14:03:37.792718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 376, pipe: [1:7559593489756280238:5422]
2025-10-10T14:03:37.792786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 376
2025-10-10T14:03:37.793355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:37.793388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:37.793559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593489756280213:6233], now have 1 active actors on pipe
2025-10-10T14:03:37.793584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593489756280238:5422], now have 1 active actors on pipe
2025-10-10T14:03:37.793605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593489756280067:2442], now have 1 active actors on pipe
2025-10-10T14:03:37.793629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:37.793664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:37.794008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:37.802631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:37.802682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:37.802790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:37.802830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:37.802849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:37.802861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:37.802902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:37.802957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:37.803010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:37.803824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:37.803853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:37.803912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:37.804257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 377 partition: 0 MaxSeqNo: 36 sessionId: src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0
2025-10-10T14:03:37.805163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|667cf753-e1b4ebbd-ee983018-a3706bd7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:37.889259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:37.889292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:37.889304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:37.897920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0] Write session: try to update token
2025-10-10T14:03:37.897975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:38.004023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:38.004064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:38.004078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:38.004089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:38.004100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:38.004139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:38.004165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:38.004188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:38.004208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:38.004436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:38.004450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:38.004459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:38.004512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:38.004538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:38.004549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:38.005374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:38.005405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:38.005432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:38.005459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:38.008130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:38.154157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId: src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:38.177579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:38.231936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:38.270700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:38.270749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:38.270814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:38.270828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:38.270868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593488178361788:5643]
2025-10-10T14:03:38.271631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:38.272324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:38.273443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:38.273470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:38.277468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593489756280238:5422]
2025-10-10T14:03:38.277700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:38.295252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 377 reason: error at write: Disconnected sessionId: src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0
2025-10-10T14:03:38.295629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 377 sessionId: src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0 is DEAD
2025-10-10T14:03:38.300170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:38.300210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0] Write session will restart in 0.009247s
2025-10-10T14:03:38.300307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0] Write session: Do CDS request
2025-10-10T14:03:38.300335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:38.316042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:38.316073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 378
2025-10-10T14:03:38.316993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:38.317651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:38.317775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:38.317790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:38.317800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:38.319149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 378 sessionId:  describe result for acl check
2025-10-10T14:03:38.319260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:38.319268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:38.319278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:38.319295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593494051247600:6242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:38.322631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593494051247600:6242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:38.352700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593494051247600:6242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:38.377379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593494051247671:5422]
2025-10-10T14:03:38.381625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593494051247600:6242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:38.381670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593494051247600:6242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:38.381687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593494051247600:6242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:38.381718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:38.444909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:38.450666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:38.451608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:38.451626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:38.451673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:38.451961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:38.452149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593492473329312:5648]
2025-10-10T14:03:38.454626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:38.459208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:38.459509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:38.460961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:38.461343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:38.461354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:38.461362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:38.461371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:38.461378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:38.461386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:38.461393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:38.461400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:38.461407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:38.461414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:38.461421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:38.461429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:38.461475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:38.461589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:38.461642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:38.461690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:38.461738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:38.461789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:38.461837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:38.461885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:38.461937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:38.461987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:38.462035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:38.462080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:38.462124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:38.462193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:38.462256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:38.462309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:38.462360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:38.462413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:38.462461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:38.462517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:38.462567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:38.462625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:38.462669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:38.462722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:38.462771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:38.462823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:38.462868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:38.462926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:38.462971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:38.463021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:38.463063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:38.463102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:38.463136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:38.463173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:38.463209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:38.463259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:38.465224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:38.510829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:38.536414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:38.536463Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:38.536480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:38.536500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:38.536524Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 377 [2:7559593492473329312:5648]
2025-10-10T14:03:38.536584Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:38.536655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:38.536670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:38.536682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:38.536694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:38.536744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:38.536767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:38.536789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:38.538591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:38.538617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:38.538631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:38.538643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:38.538653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:38.538945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:38.538962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:38.539107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:38.539284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:38.539520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:38.539628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:38.539710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593492473329306:5648]
2025-10-10T14:03:38.539723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593492473329306:5648]
2025-10-10T14:03:38.539734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593492473329306:5648]
2025-10-10T14:03:38.539746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593492473329306:5648]
2025-10-10T14:03:38.539794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:38.539871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:38.540041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:38.540057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:38.540189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593492473329306:5648]
2025-10-10T14:03:38.540209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:38.543192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 377, pipe: [1:7559593494051247671:5422]
2025-10-10T14:03:38.543311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 377
2025-10-10T14:03:38.543401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 377
2025-10-10T14:03:38.540933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:38.540956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:38.540967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:38.540979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:38.541003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:38.544155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593494051247585:2442], now have 1 active actors on pipe
2025-10-10T14:03:38.544183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593494051247671:5422], now have 1 active actors on pipe
2025-10-10T14:03:38.544203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593494051247682:6242], now have 1 active actors on pipe
2025-10-10T14:03:38.546962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:38.546991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:38.547085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:38.547123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:38.547144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:38.547155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:38.547194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:38.547241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:38.547295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:38.553850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:38.553891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:38.553968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:38.555354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49d81911-180e6e7b-6702afb6-3ba26b32_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:38.554404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 378 partition: 0 MaxSeqNo: 36 sessionId: src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0
2025-10-10T14:03:38.610184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0] Write session: try to update token
2025-10-10T14:03:38.610250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:38.632661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:38.632696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:38.632709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:38.703495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:38.703529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:38.703542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:38.703553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:38.703563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:38.703600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593492473329306:5648]
2025-10-10T14:03:38.703627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593492473329306:5648]
2025-10-10T14:03:38.703651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593492473329306:5648]
2025-10-10T14:03:38.703670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593492473329306:5648]
2025-10-10T14:03:38.703826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:38.703858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:38.703869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:38.704920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:38.706284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:38.706326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:38.706357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:38.706385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:38.842297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId: src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:38.885400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:38.975993Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:38.982324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:38.982366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:38.986191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:38.986324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593494051247671:5422]
2025-10-10T14:03:38.986404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:38.986414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:38.992614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:38.992695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0] Write session will restart in 0.009491s
2025-10-10T14:03:38.992925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0] Write session: Do CDS request
2025-10-10T14:03:38.992989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:38.991281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 378 reason: error at write: Disconnected sessionId: src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0
2025-10-10T14:03:38.991696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 378 sessionId: src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0 is DEAD
2025-10-10T14:03:39.011816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:39.043472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:39.064942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:39.064973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 379
2025-10-10T14:03:39.067724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:39.067844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:39.067859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:39.067869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:39.069456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 379 sessionId:  describe result for acl check
2025-10-10T14:03:39.069572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:39.069582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:39.069591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:39.069609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593498346215139:6252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:39.072236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593498346215139:6252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:39.098291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593498346215176:5422]
2025-10-10T14:03:39.103514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593498346215139:6252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:39.155700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593498346215139:6252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:39.155745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593498346215139:6252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:39.155762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593498346215139:6252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:39.155794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:39.213776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:39.220257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:39.221114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:39.221150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:39.221196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:39.221458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:39.221702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593496768296838:5657]
2025-10-10T14:03:39.223831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:39.225048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:39.225280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:39.226524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:39.226844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:39.226853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:39.226860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:39.226866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:39.226872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:39.226879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:39.226886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:39.226893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:39.226900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.226907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.226913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.226920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.226962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:39.227057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:39.227101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:39.227144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:39.227184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:39.227226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:39.227265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:39.227306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:39.227360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.227405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.227446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.227486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.227522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:39.227581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:39.227633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:39.227682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:39.227725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:39.227774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:39.227814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:39.227862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:39.228061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:39.228115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:39.228166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:39.228216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:39.228263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:39.228312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:39.228358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:39.228409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:39.228455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.228505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.228548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.228599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.228642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.228694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.228739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.228787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.229258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:39.266733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:39.322049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:39.322098Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:39.322114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:39.322134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:39.322159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 378 [2:7559593496768296838:5657]
2025-10-10T14:03:39.322211Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:39.322272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:39.322287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:39.322298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:39.322308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:39.322354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:39.322377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:39.322400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:39.333721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.333750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.333765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.333779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.333791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:39.334070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:39.334087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.334224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.334398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.334615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.334723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:39.334803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.334816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.334831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.334845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.334892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:39.334976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:39.335146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:39.335164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:39.335305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.335326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:39.339703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 378
2025-10-10T14:03:39.339778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 378, pipe: [1:7559593498346215176:5422]
2025-10-10T14:03:39.339842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 378
2025-10-10T14:03:39.337048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:39.337074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:39.337086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:39.337099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:39.337150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:39.340053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593498346215257:6252], now have 1 active actors on pipe
2025-10-10T14:03:39.340083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593498346215176:5422], now have 1 active actors on pipe
2025-10-10T14:03:39.340102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593494051247819:2442], now have 1 active actors on pipe
2025-10-10T14:03:39.340586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:39.340617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:39.340707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:39.340743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:39.340762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:39.340772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:39.340813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:39.340861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:39.340912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:39.343899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:39.343933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:39.344005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:39.344371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 379 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0
2025-10-10T14:03:39.345165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a256df-9f1ccba8-4c773348-d0a632b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:39.398738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0] Write session: try to update token
2025-10-10T14:03:39.398794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:39.518382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:39.518417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:39.518431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:39.518494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:39.518511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:39.518526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:39.518540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:39.518553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:39.518593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.518625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.518653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.518678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.518908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:39.518916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:39.518949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.518953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:39.518962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:39.518983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:39.519021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:39.520312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:39.653378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId: src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:39.745402Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:39.755002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:39.767779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:39.767813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:39.767863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593496768296832:5657]
2025-10-10T14:03:39.768206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:39.771555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:39.771736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:39.771757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:39.792047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593498346215176:5422]
2025-10-10T14:03:39.824047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:39.824125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0] Write session will restart in 0.007707s
2025-10-10T14:03:39.824279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0] Write session: Do CDS request
2025-10-10T14:03:39.824325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:39.821394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 379 reason: error at write: Disconnected sessionId: src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0
2025-10-10T14:03:39.821718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 379 sessionId: src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0 is DEAD
2025-10-10T14:03:39.839860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:39.837665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:39.837701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 380
2025-10-10T14:03:39.840546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:39.840666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:39.840681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:39.840690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:39.842018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 380 sessionId:  describe result for acl check
2025-10-10T14:03:39.842140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:39.842150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:39.842159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:39.842175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593498346215374:6263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:39.845024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593498346215374:6263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:39.861115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593498346215374:6263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:39.887478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593498346215374:6263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:39.887524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593498346215374:6263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:39.887543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593498346215374:6263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:39.887575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:39.894113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593498346215550:5422]
2025-10-10T14:03:39.909161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:39.918998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:39.920026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:39.920045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:39.920091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:39.920388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:39.920599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593496768297069:5666]
2025-10-10T14:03:39.923114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:39.926844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:39.927146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:39.928681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:39.929096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:39.929108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:39.929117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:39.929151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:39.929160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:39.929168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:39.929177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:39.929185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:39.929192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.929199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.929208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.929216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.929271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:39.929399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:39.929454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:39.929508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:39.929563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:39.929616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:39.929671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:39.929743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:39.929800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.929854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.929905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.929960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.930008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:39.930084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:39.930157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:39.930222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:39.930277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:39.930338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:39.930393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:39.930453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:39.930509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:39.930570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:39.930622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:39.930679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:39.930732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:39.930794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:39.930842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:39.930901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:39.930957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.931014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:39.931063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.931123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:39.931175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.931238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:39.931287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.931347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:39.931885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:40.044574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:40.061019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:40.061068Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:40.061089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:40.061112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:40.061152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 379 [2:7559593496768297069:5666]
2025-10-10T14:03:40.061217Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:40.061280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:40.061295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:40.061309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:40.061322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:40.061374Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:40.061397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:40.061420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:40.063491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.063521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:40.063537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:40.063552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:40.063565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:40.063853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:40.063869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.064032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:40.064249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:40.064509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:40.064639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:40.064709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.064724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.064738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.064754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.064786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:40.064870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:40.065020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:40.065036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:40.065050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:40.065058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:40.065063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:40.065075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:40.065223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.065257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:40.065307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593498346215539:6263], now have 1 active actors on pipe
2025-10-10T14:03:40.065333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593498346215550:5422], now have 1 active actors on pipe
2025-10-10T14:03:40.065358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593498346215346:2442], now have 1 active actors on pipe
2025-10-10T14:03:40.065601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:40.067760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 379
2025-10-10T14:03:40.067836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 379, pipe: [1:7559593498346215550:5422]
2025-10-10T14:03:40.067905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 379
2025-10-10T14:03:40.068796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:40.068853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:40.068972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9111de58-ecceb5be-a169d27a-b7001911_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:40.069028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:40.069047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:40.069060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:40.069111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:40.069212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:40.069278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:40.074379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:40.074420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:40.074865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:40.078852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff286ba4-cfbe3e16-bbcd3696-f1631b98_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9111de58-ecceb5be-a169d27a-b7001911_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:40.076704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 380 partition: 0 MaxSeqNo: 36 sessionId: src_id|9111de58-ecceb5be-a169d27a-b7001911_0
2025-10-10T14:03:40.132605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9111de58-ecceb5be-a169d27a-b7001911_0] Write session: try to update token
2025-10-10T14:03:40.132665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9111de58-ecceb5be-a169d27a-b7001911_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:40.281953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:40.281990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:40.282004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:40.282061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:40.282078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:40.282091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:40.282104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:40.282116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:40.282154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.282182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.282208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.282232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.282449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:40.282476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.282489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:40.283726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:40.285945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:40.285991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:40.286025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:40.286056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:40.345253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId: src_id|9111de58-ecceb5be-a169d27a-b7001911_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:40.386422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:40.440577Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:40.453018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:40.453074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:40.453278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:40.453296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:40.453334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593496768297064:5666]
2025-10-10T14:03:40.453676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:40.453938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:40.459282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:40.459472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:40.460222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593498346215550:5422]
2025-10-10T14:03:40.468577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 380 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9111de58-ecceb5be-a169d27a-b7001911_0
2025-10-10T14:03:40.468920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 380 sessionId: src_id|9111de58-ecceb5be-a169d27a-b7001911_0 is DEAD
2025-10-10T14:03:40.477372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9111de58-ecceb5be-a169d27a-b7001911_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:40.477418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9111de58-ecceb5be-a169d27a-b7001911_0] Write session will restart in 0.008396s
2025-10-10T14:03:40.477518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9111de58-ecceb5be-a169d27a-b7001911_0] Write session: Do CDS request
2025-10-10T14:03:40.477547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9111de58-ecceb5be-a169d27a-b7001911_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:40.498164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:40.498227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 381
2025-10-10T14:03:40.502000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9111de58-ecceb5be-a169d27a-b7001911_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:40.505697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:40.505883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:40.505901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:40.505914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:40.508973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 381 sessionId:  describe result for acl check
2025-10-10T14:03:40.509121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:40.509147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:40.509157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:40.509176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593502641182903:6269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:40.511887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593502641182903:6269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:40.530662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593502641182903:6269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:40.549071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593502641182903:6269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:40.549120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593502641182903:6269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:40.549158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593502641182903:6269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:40.549189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:40.559666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593502641183002:5422]
2025-10-10T14:03:40.642172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:40.648969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:40.649948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:40.649969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:40.650022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:40.650317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:40.650504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593501063264598:5677]
2025-10-10T14:03:40.653236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:40.655615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:40.655884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:40.667938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:40.668445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:40.668454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:40.668460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:40.668466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:40.668473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:40.668479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:40.668487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:40.668494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:40.668501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.668507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:40.668514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:40.668522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:40.668570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:40.668682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:40.668729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:40.668774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:40.668816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:40.668859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:40.668905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:40.668949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:40.670576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.670657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:40.670711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:40.670764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:40.670815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:40.670893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:40.670967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:40.671028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:40.671102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:40.671164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:40.671214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:40.671274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:40.671328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:40.671401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:40.671452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:40.671525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:40.671579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:40.671641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:40.671701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:40.671764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:40.671822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.671883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.671938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:40.672005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:40.672063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:40.672125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:40.672180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:40.672241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:40.672771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:40.706445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:40.724144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:40.724194Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:40.724211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:40.724230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:40.724252Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 380 [2:7559593501063264598:5677]
2025-10-10T14:03:40.724307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:40.724364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:40.724378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:40.724391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:40.724401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:40.724445Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:40.724465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:40.724485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:40.727086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.727120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:40.727142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:40.727158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:40.727169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:40.727720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 380
2025-10-10T14:03:40.727795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 380, pipe: [1:7559593502641183002:5422]
2025-10-10T14:03:40.727859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 380
2025-10-10T14:03:40.727483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:40.727512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.727654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:40.727841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:40.728073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:40.728188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:40.728280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593502641182973:6269], now have 1 active actors on pipe
2025-10-10T14:03:40.728303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593502641183002:5422], now have 1 active actors on pipe
2025-10-10T14:03:40.728327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593502641182888:2442], now have 1 active actors on pipe
2025-10-10T14:03:40.728354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:40.728377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:40.728390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:40.728403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:40.728437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:40.728449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:40.728458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:40.728466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:40.728475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:40.728543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:40.728723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:40.728750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:40.728808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:40.728834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:40.728972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:40.729005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:40.729015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:40.729076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:40.729109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:40.729148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:40.729158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:40.729193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:40.729236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:40.729372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:40.733035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:40.733072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:40.733163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:40.736336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 381 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0
2025-10-10T14:03:40.741378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9111de58-ecceb5be-a169d27a-b7001911_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:40.794034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0] Write session: try to update token
2025-10-10T14:03:40.794095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:40.822393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:40.822429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:40.822442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:40.984660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:40.984695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:40.984709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:40.984767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:40.984784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:40.984798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:40.984810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:40.984822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:40.984860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:40.984891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:40.984919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:40.984941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:40.985114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:40.985179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:40.985210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:40.985241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:40.985845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:40.985885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:40.985898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:40.993396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:41.075786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId: src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:41.117944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:41.178275Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:41.203678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:41.203735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:41.203812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:41.203829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:41.203877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593501063264593:5677]
2025-10-10T14:03:41.209311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:41.210818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:41.210843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:41.210048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:41.218792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 381 reason: error at write: Disconnected sessionId: src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0
2025-10-10T14:03:41.219124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 381 sessionId: src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0 is DEAD
2025-10-10T14:03:41.223996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:41.224041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0] Write session will restart in 0.009884s
2025-10-10T14:03:41.224140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0] Write session: Do CDS request
2025-10-10T14:03:41.224166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:41.248492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593502641183002:5422]
2025-10-10T14:03:41.250002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:41.248639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:41.261257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:41.261293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 382
2025-10-10T14:03:41.269299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:41.269465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:41.269480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:41.269491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:41.274280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 382 sessionId:  describe result for acl check
2025-10-10T14:03:41.274415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:41.274426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:41.274435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:41.274452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593506936150453:6284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:41.277018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593506936150453:6284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:41.297612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593506936150453:6284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:41.320367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593506936150453:6284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:41.320413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593506936150453:6284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:41.320431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593506936150453:6284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:41.320461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:41.348829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593506936150600:5422]
2025-10-10T14:03:41.384871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:41.386458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:41.387073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:41.387086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:41.387120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:41.387303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:41.387451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593505358232130:5686]
2025-10-10T14:03:41.388759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:41.390522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:41.390734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:41.391958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:41.392262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:41.392286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:41.392293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:41.392299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:41.392306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:41.392312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:41.392320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:41.392327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:41.392333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:41.392338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:41.392344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:41.392349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:41.392391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:41.392491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:41.392536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:41.392582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:41.392625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:41.392666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:41.392706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:41.392747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:41.392789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:41.392829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:41.392870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:41.392911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:41.392947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:41.393006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:41.393059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:41.393109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:41.393175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:41.393225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:41.393266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:41.393315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:41.393359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:41.393409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:41.393447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:41.393493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:41.393536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:41.393584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:41.393623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:41.393669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:41.393711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:41.393761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:41.393800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:41.393847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:41.393886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:41.393931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:41.393970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:41.394017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:41.394402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:41.424312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:41.438981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:41.439028Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:41.439043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:41.439062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:41.439085Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 381 [2:7559593505358232130:5686]
2025-10-10T14:03:41.439136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:41.439194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:41.439207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:41.439219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:41.439229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:41.439276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:41.439297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:41.439317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:41.441692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:41.441716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:41.441729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:41.441741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:41.441752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:41.442037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:41.442052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:41.442178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:41.442338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:41.442535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:41.442636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:41.442707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.442721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.442733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.442745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.442789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:41.442862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:41.443019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:41.443035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:41.443156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.443173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:41.444379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:41.444399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:41.444411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:41.444423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:41.444446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:41.447306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593506936150442:2442], now have 1 active actors on pipe
2025-10-10T14:03:41.447340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593506936150544:6284], now have 1 active actors on pipe
2025-10-10T14:03:41.447358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593506936150600:5422], now have 1 active actors on pipe
2025-10-10T14:03:41.447436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:41.447457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:41.447533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:41.447565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:41.447582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:41.447592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:41.447631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:41.447672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:41.447714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:41.445990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 381
2025-10-10T14:03:41.446088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 381
2025-10-10T14:03:41.446144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 381, pipe: [1:7559593506936150600:5422]
2025-10-10T14:03:41.449189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:41.449221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:41.449290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:41.449627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 382 partition: 0 MaxSeqNo: 36 sessionId: src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0
2025-10-10T14:03:41.457427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d36c9e0-92eb64a2-50179347-1d28bbcb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:41.540036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:41.540064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:41.540075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:41.555004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0] Write session: try to update token
2025-10-10T14:03:41.555061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:41.738916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:41.738953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:41.738965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:41.739024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:41.739037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:41.739051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:41.739060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:41.739071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:41.739107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.739132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.739154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.739175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.739366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:41.739410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:41.739423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:41.740443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:41.741301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:41.741343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:41.741371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:41.741397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:41.814535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId: src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:41.838348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:41.894734Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:41.912943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:41.912990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:41.913056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:41.913069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:41.913106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593505358232124:5686]
2025-10-10T14:03:41.913483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:41.913817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:41.916614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:41.916900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:41.921272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593506936150600:5422]
2025-10-10T14:03:41.931831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 382 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0
2025-10-10T14:03:41.932184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 382 sessionId: src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0 is DEAD
2025-10-10T14:03:41.937351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:41.937395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0] Write session will restart in 0.009128s
2025-10-10T14:03:41.937500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0] Write session: Do CDS request
2025-10-10T14:03:41.937530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:41.962497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:41.962194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:41.962225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 383
2025-10-10T14:03:41.964070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:41.964202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:41.964216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:41.964224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:41.965563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 383 sessionId:  describe result for acl check
2025-10-10T14:03:41.965679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:41.965690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:41.965699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:41.965717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593506936150684:6292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:41.967859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593506936150684:6292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:41.981100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593506936150684:6292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:42.008663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593506936150684:6292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:42.008707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593506936150684:6292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:42.008723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593506936150684:6292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:42.008753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:42.029304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593511231118079:5422]
2025-10-10T14:03:42.077074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:42.086877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:42.087750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:42.087769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:42.087817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:42.088104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:42.088293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593509653199648:5691]
2025-10-10T14:03:42.090933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:42.093506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:42.093762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:42.094854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:42.095170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:42.095176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:42.095181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:42.095186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:42.095190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:42.095194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:42.095198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:42.095203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:42.095207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.095213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.095217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.095221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.095254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:42.095331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:42.095366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:42.095418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:42.095458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:42.095490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:42.095532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:42.095574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:42.095616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.095663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.095705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.095747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.095793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:42.095861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:42.095919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:42.095968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:42.096016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:42.096059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:42.096088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:42.096124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:42.096157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:42.096191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:42.096221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:42.096255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:42.096285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:42.096320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:42.096350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:42.096382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:42.096413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.096466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.096501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.096549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.096592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.096630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.096657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.096693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.096999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:42.150898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:42.170653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:42.170700Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:42.170715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:42.170733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:42.170756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 382 [2:7559593509653199648:5691]
2025-10-10T14:03:42.170804Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:42.170857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:42.170871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:42.170883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:42.170894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:42.170941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:42.170963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:42.170985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:42.173545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.173571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.173583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.173594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.173604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:42.177398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 382
2025-10-10T14:03:42.177487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 382, pipe: [1:7559593511231118079:5422]
2025-10-10T14:03:42.177555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 382
2025-10-10T14:03:42.173878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:42.173900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.174029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.174193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.174406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.174509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:42.174580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.174594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.174606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.174617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.174658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:42.174733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:42.174890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:42.174906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:42.175028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.175045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:42.175269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:42.175279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:42.175288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:42.175299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:42.175320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:42.176130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593506936150668:2442], now have 1 active actors on pipe
2025-10-10T14:03:42.176154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593511231118079:5422], now have 1 active actors on pipe
2025-10-10T14:03:42.176171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593511231118026:6292], now have 1 active actors on pipe
2025-10-10T14:03:42.178742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:42.178775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:42.178867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:42.178901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:42.178919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:42.178929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:42.178967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:42.179013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:42.179061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:42.185535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:42.185585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:42.185659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:42.191110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 383 partition: 0 MaxSeqNo: 36 sessionId: src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0
2025-10-10T14:03:42.192871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc5d6bd5-be10fb8b-db732cc9-b1579972_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:42.264623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0] Write session: try to update token
2025-10-10T14:03:42.264686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:42.363567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:42.363605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:42.363618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:42.363685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:42.363700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:42.363714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:42.363725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:42.363736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:42.363778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.363808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.363832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.363855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.364083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:42.364112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.364124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:42.365652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:42.365697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:42.365727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:42.365755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:42.372705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:42.488337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId: src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:42.550157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:42.689040Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:42.718637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:42.718688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:42.718751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:42.718764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:42.718802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593509653199640:5691]
2025-10-10T14:03:42.723671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:42.725740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:42.730919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593511231118079:5422]
2025-10-10T14:03:42.731028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:42.752114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 383 reason: status is not ok: tablet will be restarted right now sessionId: src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0
2025-10-10T14:03:42.752875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:42.752908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0] Write session will restart in 0.009717s
2025-10-10T14:03:42.753012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0] Write session: Do CDS request
2025-10-10T14:03:42.753040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:42.757338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 383 sessionId: src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0 is DEAD
2025-10-10T14:03:42.771121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:42.788242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:42.788472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:42.788486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 384
2025-10-10T14:03:42.797114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:42.797307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:42.797326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:42.797339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:42.799015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 384 sessionId:  describe result for acl check
2025-10-10T14:03:42.799140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:42.799151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:42.799160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:42.799176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593511231118230:6305] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:42.806010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593511231118230:6305] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:42.821388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593511231118230:6305] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:42.830722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593511231118270:5422]
2025-10-10T14:03:42.870348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593511231118230:6305] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:42.870390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593511231118230:6305] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:42.870406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593511231118230:6305] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:42.870439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:42.933887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:42.938993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:42.939914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:42.939933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:42.939978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:42.940250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:42.940431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593509653199895:5706]
2025-10-10T14:03:42.942426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:42.943647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:42.943882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:42.945046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:42.945383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:42.945403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:42.945410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:42.945416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:42.945422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:42.945428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:42.945434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:42.945440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:42.945448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.945456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.945463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.945469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.945511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:42.945606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:42.945649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:42.945689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:42.945742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:42.945781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:42.945824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:42.945865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:42.945903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.945947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.945987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.946026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.946062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:42.946118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:42.946173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:42.946238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:42.946282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:42.946328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:42.946368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:42.946414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:42.946762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:42.946818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:42.946860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:42.946907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:42.946950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:42.946997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:42.947039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:42.947115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:42.947161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.947212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:42.947254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.947303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:42.947364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.947413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:42.947472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.947523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:42.947931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:43.030318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:43.068893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:43.068947Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:43.068962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:43.068982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:43.069005Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 383 [2:7559593509653199895:5706]
2025-10-10T14:03:43.069059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:43.073459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:43.073528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:43.073541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:43.073553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:43.073615Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:43.073641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:43.073665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:43.075863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:43.075882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:43.075897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:43.075910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:43.075921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:43.076197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:43.076213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:43.076348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:43.076514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:43.076729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:43.076838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:43.076907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.076922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.076935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.076948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.077237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:43.077250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:43.077259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:43.077270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:43.078314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 383
2025-10-10T14:03:43.078399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 383
2025-10-10T14:03:43.078460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 383, pipe: [1:7559593511231118270:5422]
2025-10-10T14:03:43.078915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:43.079035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:43.079203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:43.079220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:43.079265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593511231118324:6305], now have 1 active actors on pipe
2025-10-10T14:03:43.079287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593511231118226:2442], now have 1 active actors on pipe
2025-10-10T14:03:43.079307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593511231118270:5422], now have 1 active actors on pipe
2025-10-10T14:03:43.079346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:43.079365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:43.079526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.079556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:43.079626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:43.079659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:43.079688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:43.079698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:43.079731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:43.079771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:43.079894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:43.080019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:43.082740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 384 partition: 0 MaxSeqNo: 36 sessionId: src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0
2025-10-10T14:03:43.082341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:43.082374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:43.082446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:43.087629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52566a93-3878923c-ea0d4d49-1890e9f3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:43.177403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:43.177440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:43.177454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:43.183471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0] Write session: try to update token
2025-10-10T14:03:43.183531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:43.347806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:43.347844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:43.347855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:43.347972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:43.347985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:43.347997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:43.348006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:43.348015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:43.348048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.348073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.348096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.348116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.348245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:43.348301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:43.348326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:43.348358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:43.410368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:43.410423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:43.410434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:43.411577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:43.433246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId: src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:43.475906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:43.621812Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:43.623474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:43.623494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:43.623541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593509653199890:5706]
2025-10-10T14:03:43.623701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:43.623726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:43.624825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:43.624981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593511231118270:5422]
2025-10-10T14:03:43.625078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:43.625088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:43.624050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:43.624825Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:43.667299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:43.667366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0] Write session will restart in 0.008172s
2025-10-10T14:03:43.667493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0] Write session: Do CDS request
2025-10-10T14:03:43.667554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:43.666517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 384 reason: error at write: Disconnected sessionId: src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0
2025-10-10T14:03:43.666782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 384 sessionId: src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0 is DEAD
2025-10-10T14:03:43.709701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:43.713305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:43.713348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 385
2025-10-10T14:03:43.713878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:43.714015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:43.714041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:43.714052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:43.715497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 385 sessionId:  describe result for acl check
2025-10-10T14:03:43.715656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:43.715671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:43.715681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:43.715699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593515526085784:6315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:43.718227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593515526085784:6315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:43.724999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593515526085808:5422]
2025-10-10T14:03:43.743782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593515526085784:6315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:43.767888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593515526085784:6315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:43.767940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593515526085784:6315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:43.767957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593515526085784:6315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:43.767989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:43.819736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:43.823404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:43.824427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:43.824447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:43.824494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:43.824778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:43.824965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593513948167435:5711]
2025-10-10T14:03:43.827253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:43.828573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:43.828885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:43.830167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:43.830523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:43.830533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:43.830540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:43.830547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:43.830554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:43.830561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:43.830568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:43.830575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:43.830581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:43.830587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:43.830594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:43.830601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:43.830650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:43.830756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:43.830805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:43.830854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:43.830895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:43.830938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:43.831007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:43.831052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:43.831097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:43.831143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:43.831188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:43.831232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:43.831274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:43.831339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:43.831396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:43.831464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:43.831561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:43.831620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:43.831663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:43.831715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:43.831762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:43.831818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:43.831866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:43.831914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:43.831960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:43.832010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:43.832053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:43.832103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:43.832150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:43.832205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:43.832249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:43.832302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:43.832347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:43.832395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:43.832439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:43.832488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:43.832917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:43.873395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:43.925770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:43.925817Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:43.925834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:43.925852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:43.925877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 384 [2:7559593513948167435:5711]
2025-10-10T14:03:43.925929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:43.925990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:43.926004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:43.926016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:43.926027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:43.926073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:43.926096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:43.926116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:43.928597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:43.928616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:43.928631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:43.928644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:43.928654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:43.928946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:43.928963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:43.929095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:43.929768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:43.930002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:43.930110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:43.930202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593515526085888:6315], now have 1 active actors on pipe
2025-10-10T14:03:43.930225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593515526085768:2442], now have 1 active actors on pipe
2025-10-10T14:03:43.930246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593515526085808:5422], now have 1 active actors on pipe
2025-10-10T14:03:43.930272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:43.930286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:43.930298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:43.930310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:43.930342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:43.930429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:43.930594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:43.930613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:43.930744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:43.930764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:43.930973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:43.930987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:43.930999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:43.931009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:43.931033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:43.931783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:43.931818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:43.931909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88186eb6-46184180-a502e91e-15b49b05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:43.931942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:43.931960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:43.931971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:43.932008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:43.932060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:43.932115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:43.929285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 384
2025-10-10T14:03:43.929375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 384
2025-10-10T14:03:43.929491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 384, pipe: [1:7559593515526085808:5422]
2025-10-10T14:03:43.934879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:43.934918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:43.934995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:43.936683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61216cf7-a3f57624-5deb960a-ed2fdf74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|88186eb6-46184180-a502e91e-15b49b05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:43.935845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 385 partition: 0 MaxSeqNo: 36 sessionId: src_id|88186eb6-46184180-a502e91e-15b49b05_0
2025-10-10T14:03:44.014898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88186eb6-46184180-a502e91e-15b49b05_0] Write session: try to update token
2025-10-10T14:03:44.014961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88186eb6-46184180-a502e91e-15b49b05_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:44.195365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:44.196019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:44.196039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:44.196093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:44.196102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:44.196112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:44.196118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:44.196126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:44.196153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:44.196174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:44.196187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:44.196200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:44.196347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:44.196364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:44.196371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:44.196526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:44.196554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:44.196583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:44.196610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:44.198156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:44.210686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId: src_id|88186eb6-46184180-a502e91e-15b49b05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:44.233437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:44.390030Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:44.427116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:44.427171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:44.427261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:44.427275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:44.427317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593513948167430:5711]
2025-10-10T14:03:44.427612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:44.427986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:44.433583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:44.433625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:44.435340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593515526085808:5422]
2025-10-10T14:03:44.435518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:44.441754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 385 reason: error at write: Disconnected sessionId: src_id|88186eb6-46184180-a502e91e-15b49b05_0
2025-10-10T14:03:44.442095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 385 sessionId: src_id|88186eb6-46184180-a502e91e-15b49b05_0 is DEAD
2025-10-10T14:03:44.450465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88186eb6-46184180-a502e91e-15b49b05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:44.450510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88186eb6-46184180-a502e91e-15b49b05_0] Write session will restart in 0.005129s
2025-10-10T14:03:44.450612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88186eb6-46184180-a502e91e-15b49b05_0] Write session: Do CDS request
2025-10-10T14:03:44.450644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88186eb6-46184180-a502e91e-15b49b05_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:44.465401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:44.465435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 386
2025-10-10T14:03:44.465701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88186eb6-46184180-a502e91e-15b49b05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:44.469488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:44.469792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:44.469824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:44.469840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:44.471757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 386 sessionId:  describe result for acl check
2025-10-10T14:03:44.471871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:44.471881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:44.471891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:44.471907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593519821053315:6321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:44.474594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593519821053315:6321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:44.502400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593519821053315:6321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:44.537241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593519821053356:5422]
2025-10-10T14:03:44.546571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593519821053315:6321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:44.546615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593519821053315:6321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:44.546631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593519821053315:6321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:44.546661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:44.701891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:44.709903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:44.710830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:44.710852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:44.710903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:44.711201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:44.711380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593518243134975:5726]
2025-10-10T14:03:44.713729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:44.719649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:44.719899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:44.721280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:44.721654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:44.721663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:44.721668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:44.721675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:44.721680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:44.721686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:44.721693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:44.721699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:44.721709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:44.721714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:44.721720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:44.721727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:44.721775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:44.721882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:44.721925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:44.721970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:44.722013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:44.722055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:44.722099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:44.722141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:44.722182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:44.722227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:44.722270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:44.722313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:44.722356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:44.722415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:44.722469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:44.722518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:44.722563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:44.722610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:44.722652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:44.722697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:44.722740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:44.722789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:44.722828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:44.722873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:44.722914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:44.722960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:44.723003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:44.723051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:44.723094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:44.723142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:44.723182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:44.723228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:44.723270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:44.723317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:44.723355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:44.723399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:44.723806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:44.777327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:44.876475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:44.876515Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:44.876525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:44.876538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:44.876556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 385 [2:7559593518243134975:5726]
2025-10-10T14:03:44.876593Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:44.876650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:44.876664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:44.876673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:44.876683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:44.876731Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:44.876746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:44.876763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:44.879124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:44.879153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:44.879165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:44.879179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:44.879188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:44.879484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:44.879500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:44.879632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:44.879803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:44.880010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:44.880117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:44.880197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593518243134970:5726]
2025-10-10T14:03:44.880213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593518243134970:5726]
2025-10-10T14:03:44.880224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593518243134970:5726]
2025-10-10T14:03:44.880236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593518243134970:5726]
2025-10-10T14:03:44.880280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:44.880355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:44.880512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:44.880529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:44.880668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593518243134970:5726]
2025-10-10T14:03:44.880687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:44.880898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:44.880913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:44.880925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:44.880936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:44.880964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:44.881845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593519821053356:5422], now have 1 active actors on pipe
2025-10-10T14:03:44.881880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593519821053361:6321], now have 1 active actors on pipe
2025-10-10T14:03:44.881916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593519821053306:2442], now have 1 active actors on pipe
2025-10-10T14:03:44.888691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 385, pipe: [1:7559593519821053356:5422]
2025-10-10T14:03:44.888813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 385
2025-10-10T14:03:44.888879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 385
2025-10-10T14:03:44.893262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:44.893310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:44.893414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:44.893450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:44.893469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:44.893479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:44.893532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:44.893590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:44.893640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:44.894750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:44.894774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:44.894840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:44.903866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 386 partition: 0 MaxSeqNo: 36 sessionId: src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0
2025-10-10T14:03:44.904807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88186eb6-46184180-a502e91e-15b49b05_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:44.949639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0] Write session: try to update token
2025-10-10T14:03:44.949698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:44.973645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:44.973677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:44.973690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:45.054162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:45.054203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:45.054218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:45.054227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:45.054237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:45.054273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593518243134970:5726]
2025-10-10T14:03:45.054298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593518243134970:5726]
2025-10-10T14:03:45.054320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593518243134970:5726]
2025-10-10T14:03:45.054339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593518243134970:5726]
2025-10-10T14:03:45.054487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:45.054513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:45.054524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:45.055492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:45.057548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:45.057592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:45.057619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:45.057655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:45.201258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId: src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:45.228693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:45.237772Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:45.278857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593519821053356:5422]
2025-10-10T14:03:45.279004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:45.279246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:45.279269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:45.297012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:45.297054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0] Write session will restart in 0.006413s
2025-10-10T14:03:45.297173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0] Write session: Do CDS request
2025-10-10T14:03:45.297206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:45.295036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 386 reason: error at write: Disconnected sessionId: src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0
2025-10-10T14:03:45.295386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 386 sessionId: src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0 is DEAD
E1010 14:03:45.303467567  112381 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:03:45.337406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:45.338098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:45.338139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 387
2025-10-10T14:03:45.341748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:45.341880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:45.341895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:45.341906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:45.343239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 387 sessionId:  describe result for acl check
2025-10-10T14:03:45.343362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:45.343374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:45.343384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:45.343401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593524116020884:6334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:45.345923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593524116020884:6334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:45.362458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593524116020884:6334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:45.378567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593524116020906:5422]
2025-10-10T14:03:45.383001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593524116020884:6334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:45.383044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593524116020884:6334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:45.383059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593524116020884:6334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:45.383089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:45.551995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:45.566797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:45.567851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:45.567873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:45.567920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:45.568215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:45.568428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593522538102514:5732]
2025-10-10T14:03:45.570630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:45.577844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:45.578175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:45.579502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:45.579873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:45.579882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:45.579889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:45.579897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:45.579903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:45.579910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:45.579917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:45.579923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:45.579929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:45.579935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:45.579942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:45.579949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:45.579995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:45.580100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:45.580147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:45.580189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:45.580236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:45.580279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:45.580322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:45.580366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:45.580412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:45.580488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:45.580536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:45.580582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:45.580626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:45.580690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:45.580746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:45.580798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:45.580850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:45.580904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:45.580948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:45.581000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:45.581047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:45.581098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:45.583103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:45.583197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:45.583263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:45.583327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:45.583379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:45.583440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:45.583529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:45.583584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:45.583631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:45.583683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:45.583730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:45.583781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:45.583824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:45.583879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:45.584339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:45.654343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:45.699821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:45.699875Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:45.699892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:45.699912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:45.699938Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 386 [2:7559593522538102514:5732]
2025-10-10T14:03:45.699994Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:45.700062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:45.700077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:45.700089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:45.700099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:45.700153Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:45.700177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:45.700199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
E1010 14:03:45.765283865  106874 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:03:45.769311Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:03:45.785685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:45.785718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:45.785731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:45.785745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:45.785755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:45.786039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:45.786057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:45.786196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:45.786388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:45.786601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:45.786715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:45.786788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593522538102508:5732]
2025-10-10T14:03:45.786804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593522538102508:5732]
2025-10-10T14:03:45.786816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593522538102508:5732]
2025-10-10T14:03:45.786829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593522538102508:5732]
2025-10-10T14:03:45.786876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:45.786963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:45.787130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:45.787147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:45.787276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593522538102508:5732]
2025-10-10T14:03:45.787298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:45.788037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:45.788056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:45.788069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:45.788080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:45.788102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:45.789293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593524116020906:5422], now have 1 active actors on pipe
2025-10-10T14:03:45.789326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593524116020911:6334], now have 1 active actors on pipe
2025-10-10T14:03:45.789346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593524116020857:2442], now have 1 active actors on pipe
2025-10-10T14:03:45.789773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 386
2025-10-10T14:03:45.789873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 386
2025-10-10T14:03:45.789953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 386, pipe: [1:7559593524116020906:5422]
2025-10-10T14:03:45.790244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:45.790277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:45.790366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:45.790401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:45.790418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:45.790427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:45.790464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:45.790506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:45.790553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:45.796876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:45.796919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:45.796996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:45.801197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:45.801225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:45.801237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:45.801384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 387 partition: 0 MaxSeqNo: 36 sessionId: src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0
2025-10-10T14:03:45.805736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708bd6e7-b6addc14-6287adb7-bcf1f73a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:45.877184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0] Write session: try to update token
2025-10-10T14:03:45.877267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:45.905188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:45.905218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:45.905228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:46.002781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:46.002815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:46.002830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:46.002841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:46.002851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:46.002891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593522538102508:5732]
2025-10-10T14:03:46.002915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593522538102508:5732]
2025-10-10T14:03:46.002938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593522538102508:5732]
2025-10-10T14:03:46.002959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593522538102508:5732]
2025-10-10T14:03:46.003129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:46.003160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:46.003171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:46.004343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:46.005237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:46.005273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:46.005334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:46.005365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:46.207308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId: src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:46.248541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:46.349845Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:46.374497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:46.374548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:46.382011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:46.382989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593524116020906:5422]
2025-10-10T14:03:46.383105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:46.383135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:46.388826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:46.475309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:46.475351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0] Write session will restart in 0.008140s
2025-10-10T14:03:46.472753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 387 reason: error at write: Disconnected sessionId: src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0
2025-10-10T14:03:46.475458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0] Write session: Do CDS request
2025-10-10T14:03:46.473113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 387 sessionId: src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0 is DEAD
2025-10-10T14:03:46.475485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:46.486863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593528410988443:5422]
2025-10-10T14:03:46.494327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:46.495481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:46.495528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 388
2025-10-10T14:03:46.496004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:46.496121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:46.496137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:46.496147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:46.497360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 388 sessionId:  describe result for acl check
2025-10-10T14:03:46.497477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:46.497486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:46.497496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:46.497512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593528410988455:6350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:46.500005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593528410988455:6350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:46.529736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593528410988455:6350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:46.576745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593528410988455:6350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:46.576788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593528410988455:6350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:46.576805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593528410988455:6350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:46.576836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:46.671915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:46.686175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:46.686971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:46.686986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:46.687026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:46.687272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:46.687437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593526833070054:5743]
2025-10-10T14:03:46.701801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:46.706575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:46.706836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:46.708485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:46.708864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:46.708872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:46.708880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:46.708888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:46.708895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:46.708902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:46.708909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:46.708916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:46.708922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:46.708929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:46.708936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:46.708943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:46.708989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:46.709092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:46.709166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:46.709214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:46.709261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:46.709307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:46.709349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:46.709395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:46.709441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:46.709485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:46.709531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:46.709575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:46.709616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:46.709679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:46.709734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:46.709785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:46.709833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:46.709887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:46.709931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:46.709985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:46.710031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:46.710080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:46.710122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:46.710173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:46.710217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:46.710268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:46.710313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:46.710365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:46.710412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:46.710464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:46.710508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:46.710556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:46.710602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:46.710653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:46.710693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:46.710743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:46.711175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:46.772505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:46.800443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:46.809269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:46.809310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:46.809330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:46.809352Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 387 [2:7559593526833070054:5743]
2025-10-10T14:03:46.809407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:46.809469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:46.809483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:46.809494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:46.809505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:46.809553Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:46.809575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:46.809596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:46.885422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:46.885459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:46.885474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:46.885489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:46.885502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:46.885828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:46.885850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:46.886015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:46.886214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:46.886466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:46.886596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:46.886684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593528410988443:5422], now have 1 active actors on pipe
2025-10-10T14:03:46.886707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593528410988414:2442], now have 1 active actors on pipe
2025-10-10T14:03:46.886730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593528410988579:6350], now have 1 active actors on pipe
2025-10-10T14:03:46.886758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:46.886774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:46.886788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:46.886802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:46.886851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:46.886938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:46.887142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:46.887173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:46.887308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:46.887331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:46.887958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:46.887984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:46.887995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:46.888007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:46.888031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:46.890693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 387, pipe: [1:7559593528410988443:5422]
2025-10-10T14:03:46.890807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 387
2025-10-10T14:03:46.894232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:46.894282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:46.894398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8b554e6-227c950d-782d2557-b6f5152d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:46.894442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:46.894467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:46.894479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:46.894517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:46.894562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:46.894616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:46.890893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 387
2025-10-10T14:03:46.895424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:46.895461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:46.895548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:46.895937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 388 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8b554e6-227c950d-782d2557-b6f5152d_0
2025-10-10T14:03:46.902546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a56f3f8c-8abd01dc-fb2f05ed-3231dc9c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8b554e6-227c950d-782d2557-b6f5152d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:46.911438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:46.911477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:46.911489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:47.007047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b554e6-227c950d-782d2557-b6f5152d_0] Write session: try to update token
2025-10-10T14:03:47.007111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b554e6-227c950d-782d2557-b6f5152d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:47.160627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:47.160663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:47.160675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:47.160734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:47.160751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:47.160766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:47.160784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:47.160796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:47.160834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:47.160863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:47.160892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:47.160918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:47.162404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:47.162463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:47.162475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:47.164450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:47.164499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:47.164525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:47.164553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:47.173759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:47.258604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId: src_id|b8b554e6-227c950d-782d2557-b6f5152d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:47.332592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:47.338737Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:47.380938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:47.380989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:47.381049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:47.381064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:47.381105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593526833070049:5743]
2025-10-10T14:03:47.381760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:47.385369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:47.385418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:47.383645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:47.389218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593528410988443:5422]
2025-10-10T14:03:47.389381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:47.393657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 388 reason: error at write: Disconnected sessionId: src_id|b8b554e6-227c950d-782d2557-b6f5152d_0
2025-10-10T14:03:47.393963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 388 sessionId: src_id|b8b554e6-227c950d-782d2557-b6f5152d_0 is DEAD
2025-10-10T14:03:47.398179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b554e6-227c950d-782d2557-b6f5152d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:47.398225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b554e6-227c950d-782d2557-b6f5152d_0] Write session will restart in 0.006524s
2025-10-10T14:03:47.398325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b554e6-227c950d-782d2557-b6f5152d_0] Write session: Do CDS request
2025-10-10T14:03:47.398362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b554e6-227c950d-782d2557-b6f5152d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:47.422031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b554e6-227c950d-782d2557-b6f5152d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:47.423454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:47.423487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 389
2025-10-10T14:03:47.423913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:47.424042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:47.424059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:47.424069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:47.425507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 389 sessionId:  describe result for acl check
2025-10-10T14:03:47.425633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:47.425644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:47.425654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:47.425670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593532705955994:6362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:47.428001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593532705955994:6362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:47.441593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593532705955994:6362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:47.454358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593532705955994:6362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:47.454401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593532705955994:6362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:47.454420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593532705955994:6362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:47.454452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:47.489743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593532705956074:5422]
2025-10-10T14:03:47.572659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:47.582896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:47.583815Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:47.583833Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:47.583892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:47.584157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:47.584334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593531128037599:5752]
2025-10-10T14:03:47.586628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:47.588246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:47.588478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:47.589903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:47.590280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:47.590289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:47.590296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:47.590303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:47.590310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:47.590317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:47.590324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:47.590334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:47.590340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:47.590347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:47.590355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:47.590363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:47.590413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:47.590531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:47.590581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:47.590630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:47.590679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:47.590730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:47.590776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:47.590828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:47.590872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:47.590925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:47.590972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:47.591019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:47.591058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:47.591126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:47.591188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:47.591245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:47.591296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:47.591352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:47.591398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:47.591458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:47.591507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:47.591581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:47.591629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:47.591681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:47.591729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:47.591785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:47.591832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:47.591888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:47.591936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:47.591990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:47.592036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:47.592093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:47.592141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:47.592195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:47.592242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:47.592298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:47.592752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:47.645773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:47.686290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:47.686339Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:47.686355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:47.686375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:47.686397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 388 [2:7559593531128037599:5752]
2025-10-10T14:03:47.686448Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:47.686500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:47.686514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:47.686526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:47.686536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:47.686580Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:47.686599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:47.686619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:47.688997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:47.689015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:47.689028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:47.689041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:47.689052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:47.694186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 388
2025-10-10T14:03:47.694280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 388, pipe: [1:7559593532705956074:5422]
2025-10-10T14:03:47.694354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 388
2025-10-10T14:03:47.697544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:47.697588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:47.697743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:47.697938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:47.698183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:47.698305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:47.698355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593532705955986:2442], now have 1 active actors on pipe
2025-10-10T14:03:47.698380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593532705956074:5422], now have 1 active actors on pipe
2025-10-10T14:03:47.698403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593532705956028:6362], now have 1 active actors on pipe
2025-10-10T14:03:47.698487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:47.698508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:47.698590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:47.698605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:47.698621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:47.698635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:47.698684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:47.698792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:47.698825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:47.698843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:47.698853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:47.698890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:47.698933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:47.698993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:47.699179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:47.699196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:47.699335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:47.699382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:47.699404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:47.700241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:47.700267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:47.700280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:47.700290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:47.700314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:47.702552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:47.702584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:47.702652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:47.703014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 389 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0
2025-10-10T14:03:47.704273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b554e6-227c950d-782d2557-b6f5152d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:47.756581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0] Write session: try to update token
2025-10-10T14:03:47.756639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:47.785262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:47.785298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:47.785311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:47.921982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:47.922015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:47.922029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:47.922078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:47.922093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:47.922108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:47.922120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:47.922131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:47.922167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:47.922193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:47.922217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:47.922255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:47.922449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:47.922474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:47.922484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:47.923666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:47.924482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:47.924532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:47.924561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:47.924588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:48.035432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId: src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:48.066370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:48.104363Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:48.152314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:48.152371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:48.152439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:48.152453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:48.152492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593531128037593:5752]
2025-10-10T14:03:48.157285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:48.159252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:48.161466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:48.161516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:48.161646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:48.161924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593532705956074:5422]
2025-10-10T14:03:48.182906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 389 reason: error at write: Disconnected sessionId: src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0
2025-10-10T14:03:48.183196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 389 sessionId: src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0 is DEAD
2025-10-10T14:03:48.186335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:48.186367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0] Write session will restart in 0.009502s
2025-10-10T14:03:48.186467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0] Write session: Do CDS request
2025-10-10T14:03:48.186500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:48.212616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:48.216521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:48.216583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 390
2025-10-10T14:03:48.217658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:48.217795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:48.217811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:48.217822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:48.220210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 390 sessionId:  describe result for acl check
2025-10-10T14:03:48.220340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:48.220351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:48.220362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:48.220380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593537000923524:6368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:48.223202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593537000923524:6368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:48.261237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593537000923524:6368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:48.263041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593537000923564:5422]
2025-10-10T14:03:48.291241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593537000923524:6368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:48.291282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593537000923524:6368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:48.291299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593537000923524:6368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:48.291331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:48.332872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:48.350026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:48.351030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:48.351049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:48.351096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:48.351386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:48.351594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593535423005131:5767]
2025-10-10T14:03:48.354450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:48.355651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:48.355882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:48.357302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:48.357658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:48.357668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:48.357676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:48.357682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:48.357690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:48.357698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:48.357706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:48.357714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:48.357721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:48.357728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:48.357735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:48.357741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:48.357789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:48.357902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:48.357953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:48.358000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:48.358046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:48.358094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:48.358141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:48.358185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:48.358233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:48.358314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:48.358364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:48.358411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:48.358451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:48.358518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:48.358576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:48.358628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:48.358677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:48.358732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:48.358777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:48.358830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:48.358878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:48.358932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:48.358975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:48.359028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:48.359073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:48.359129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:48.359174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:48.359227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:48.359280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:48.359334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:48.359382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:48.360690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:48.360766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:48.360829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:48.360882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:48.360938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:48.361438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:48.412799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:48.466866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:48.466916Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:48.466935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:48.466956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:48.466981Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 389 [2:7559593535423005131:5767]
2025-10-10T14:03:48.467037Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:48.467093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:48.467108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:48.467120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:48.467132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:48.467179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:48.467202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:48.467223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:48.469467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:48.469485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:48.469502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:48.469518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:48.469530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:48.469816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:48.469847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:48.470007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:48.470218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:48.470464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:48.470591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:48.470667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.470685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.470699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.470713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.470756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:48.470842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:48.471034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:48.471051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:48.471178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.471198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:48.473172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:48.473188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:48.473200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:48.473212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:48.473239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:48.474337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593537000923649:6368], now have 1 active actors on pipe
2025-10-10T14:03:48.474379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593537000923508:2442], now have 1 active actors on pipe
2025-10-10T14:03:48.474404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593537000923564:5422], now have 1 active actors on pipe
2025-10-10T14:03:48.478587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 389
2025-10-10T14:03:48.478678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 389
2025-10-10T14:03:48.478744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 389, pipe: [1:7559593537000923564:5422]
2025-10-10T14:03:48.479490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:48.479533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:48.479644Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:48.479677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:48.479716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:48.479728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:48.479766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:48.479809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:48.479862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:48.484395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b17d1a9-a09fd334-c3514f95-dfb31520_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:48.483332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 390 partition: 0 MaxSeqNo: 36 sessionId: src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0
2025-10-10T14:03:48.482870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:48.482910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:48.482985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:48.538308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0] Write session: try to update token
2025-10-10T14:03:48.538364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:48.706761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId: src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:48.720794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:48.720911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:48.720926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:48.720980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:48.720992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:48.721002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:48.721012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:48.721020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:48.721052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.721075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.721101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.721120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.721355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:48.721381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:48.721392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:48.721819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:48.721860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:48.721889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:48.721917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:48.726494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:48.751819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:48.911354Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:48.926430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:48.926484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:48.926557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:48.926573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:48.926617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593535423005125:5767]
2025-10-10T14:03:48.927113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:48.928036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:48.933033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:48.933386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:48.933631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593537000923564:5422]
2025-10-10T14:03:48.958403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 390 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0
2025-10-10T14:03:48.958734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 390 sessionId: src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0 is DEAD
2025-10-10T14:03:48.968388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:48.968437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0] Write session will restart in 0.005758s
2025-10-10T14:03:48.968538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0] Write session: Do CDS request
2025-10-10T14:03:48.968569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:49.002836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:49.002871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 391
2025-10-10T14:03:49.007194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:49.008543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:49.008693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:49.008710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:49.008720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:49.013950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 391 sessionId:  describe result for acl check
2025-10-10T14:03:49.014107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:49.014119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:49.014128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:49.014146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593541295891121:6383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:49.019913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593541295891121:6383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:49.034294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593541295891167:5422]
2025-10-10T14:03:49.042465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593541295891121:6383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:49.065260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593541295891121:6383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:49.065307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593541295891121:6383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:49.065327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593541295891121:6383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:49.065362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:49.104762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:49.111885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:49.112834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:49.112863Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:49.112911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:49.113209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:49.113414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593539717972667:5773]
2025-10-10T14:03:49.116663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:49.117911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:49.118199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:49.119611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:49.119980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:49.120000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:49.120007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:49.120015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:49.120023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:49.120030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:49.120037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:49.120046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:49.120053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.120061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.120070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.120078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.120131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:49.120255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:49.120311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:49.120363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:49.120416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:49.120470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:49.120523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:49.120574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:49.120631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.120686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.120738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.120792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.120836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:49.122642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:49.122732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:49.122804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:49.122864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:49.122926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:49.122979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:49.123042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:49.123097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:49.123159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:49.123209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:49.123271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:49.123324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:49.123385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:49.123439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:49.123502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:49.123576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.123636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.123691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.123752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.123806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.123869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.123923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.123985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.124510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:49.159188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:49.209390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:49.209441Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:49.209459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:49.209479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:49.209502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 390 [2:7559593539717972667:5773]
2025-10-10T14:03:49.209562Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:49.209620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:49.209636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:49.209649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:49.209661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:49.209707Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:49.209729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:49.209751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:49.212170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.212203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.212218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.212233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.212244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:49.212530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:49.212549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.212693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.212886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.213121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.215706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:49.215836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593541295891167:5422], now have 1 active actors on pipe
2025-10-10T14:03:49.215869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593541295891239:6383], now have 1 active actors on pipe
2025-10-10T14:03:49.215892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593537000923779:2442], now have 1 active actors on pipe
2025-10-10T14:03:49.215925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.215957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.215977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.215990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.216031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:49.216116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:49.216314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:49.216337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:49.216461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.216488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:49.216725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:49.216747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:49.216759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:49.216771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:49.216793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:49.217710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:49.217748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:49.217841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78b7dd03-db81689-84c2a676-bda60a39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:49.217927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:49.217956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:49.217967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:49.216415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 390, pipe: [1:7559593541295891167:5422]
2025-10-10T14:03:49.216531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 390
2025-10-10T14:03:49.216604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 390
2025-10-10T14:03:49.219973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:49.220034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:49.220103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:49.227668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:49.227713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:49.227795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:49.228307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 391 partition: 0 MaxSeqNo: 36 sessionId: src_id|78b7dd03-db81689-84c2a676-bda60a39_0
2025-10-10T14:03:49.229068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c9a15b-4f991ae8-61f80ddc-c51dda5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|78b7dd03-db81689-84c2a676-bda60a39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:49.263176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78b7dd03-db81689-84c2a676-bda60a39_0] Write session: try to update token
2025-10-10T14:03:49.263232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78b7dd03-db81689-84c2a676-bda60a39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:49.412000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:49.412076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:49.412089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:49.412141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:49.412155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:49.412168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:49.412179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:49.412191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:49.412228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.412250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.412272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.412294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.412498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:49.412524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.412534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:49.413066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:49.413108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:49.413150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:49.413177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:49.413653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:49.431081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId: src_id|78b7dd03-db81689-84c2a676-bda60a39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:49.454636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:49.573363Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:49.605594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:49.605641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:49.605706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:49.605718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:49.605754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593539717972662:5773]
2025-10-10T14:03:49.605937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:49.606272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:49.608684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593541295891167:5422]
2025-10-10T14:03:49.608859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:49.612680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 391 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78b7dd03-db81689-84c2a676-bda60a39_0
2025-10-10T14:03:49.613328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:49.616993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b7dd03-db81689-84c2a676-bda60a39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:49.617041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b7dd03-db81689-84c2a676-bda60a39_0] Write session will restart in 0.006262s
2025-10-10T14:03:49.617160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b7dd03-db81689-84c2a676-bda60a39_0] Write session: Do CDS request
2025-10-10T14:03:49.617189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b7dd03-db81689-84c2a676-bda60a39_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:49.628212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78b7dd03-db81689-84c2a676-bda60a39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:49.634288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 391 sessionId: src_id|78b7dd03-db81689-84c2a676-bda60a39_0 is DEAD
2025-10-10T14:03:49.640872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:49.640921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 392
2025-10-10T14:03:49.653330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:49.653509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:49.653527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:49.653539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:49.662940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 392 sessionId:  describe result for acl check
2025-10-10T14:03:49.663071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:49.663081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:49.663090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:49.663107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593541295891334:6390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:49.666203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593541295891334:6390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:49.689221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593541295891334:6390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:49.703620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593541295891356:5422]
2025-10-10T14:03:49.756192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593541295891334:6390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:49.756242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593541295891334:6390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:49.756258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593541295891334:6390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:49.756291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:49.842606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:49.843146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:49.845208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:49.845237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:49.845301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:49.845584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:49.845781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593539717972925:5783]
2025-10-10T14:03:49.848463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:49.852779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:49.853046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:49.854383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:49.854743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:49.854751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:49.854758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:49.854765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:49.854772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:49.854778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:49.854785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:49.854791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:49.854798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.854805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.854811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.854818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.854865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:49.854971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:49.855017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:49.855064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:49.855109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:49.855154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:49.855200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:49.855246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:49.855293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.855337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.855383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.855427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.855469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:49.855538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:49.855617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:49.855667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:49.855716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:49.855766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:49.855811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:49.855861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:49.855911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:49.855961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:49.856004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:49.856056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:49.856105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:49.856155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:49.856201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:49.856255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:49.856304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.856360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.856405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.856456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.856504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.856557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.856600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.856654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.857093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:49.899651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:49.926949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:49.926996Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:49.927012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:49.927032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:49.927058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 391 [2:7559593539717972925:5783]
2025-10-10T14:03:49.927111Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:49.927181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:49.927197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:49.927213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:49.927225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:49.927274Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:49.927312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:49.927334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:49.928589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.928608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.928623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.928638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.928649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:49.928923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:49.928940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:49.929081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:49.930671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 391, pipe: [1:7559593541295891356:5422]
2025-10-10T14:03:49.930767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 391
2025-10-10T14:03:49.930835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 391
2025-10-10T14:03:49.938464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:49.938722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:49.938835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:49.938958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593541295891356:5422], now have 1 active actors on pipe
2025-10-10T14:03:49.938982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593541295891423:6390], now have 1 active actors on pipe
2025-10-10T14:03:49.939004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593541295891316:2442], now have 1 active actors on pipe
2025-10-10T14:03:49.939065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:49.939089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:49.939151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:49.939167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:49.939182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:49.939194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:49.939235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:49.939320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:49.939499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:49.939517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:49.939601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|902676c2-da5237c6-f571fea6-99259877_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:49.939637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:49.939657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:49.939668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:49.939706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:49.939752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:49.939894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:49.939914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:49.939958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:49.940717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:49.940740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:49.940751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:49.940761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:49.940784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:49.945496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:49.945533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:49.945634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:49.946172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 392 partition: 0 MaxSeqNo: 36 sessionId: src_id|902676c2-da5237c6-f571fea6-99259877_0
2025-10-10T14:03:49.947072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78b7dd03-db81689-84c2a676-bda60a39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|902676c2-da5237c6-f571fea6-99259877_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:50.027663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|902676c2-da5237c6-f571fea6-99259877_0] Write session: try to update token
2025-10-10T14:03:50.027732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|902676c2-da5237c6-f571fea6-99259877_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:50.032644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:50.032682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:50.032697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:50.202427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:50.202464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:50.202476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:50.202590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:50.202604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:50.202618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:50.202630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:50.202642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:50.202675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:50.202703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:50.202729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:50.202751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:50.205326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:50.205377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:50.205415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:50.205451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:50.218358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:50.218411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:50.218423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:50.220389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:50.245244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId: src_id|902676c2-da5237c6-f571fea6-99259877_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:50.308968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:50.379533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:50.382483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:50.382518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:50.382564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593539717972920:5783]
2025-10-10T14:03:50.382719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:50.382755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:50.385307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:50.387874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:50.389353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:50.389592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593541295891356:5422]
2025-10-10T14:03:50.389734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:50.389756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:50.502949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 392 reason: error at write: Disconnected sessionId: src_id|902676c2-da5237c6-f571fea6-99259877_0
2025-10-10T14:03:50.503302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 392 sessionId: src_id|902676c2-da5237c6-f571fea6-99259877_0 is DEAD
2025-10-10T14:03:50.511187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902676c2-da5237c6-f571fea6-99259877_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:50.511259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902676c2-da5237c6-f571fea6-99259877_0] Write session will restart in 0.008657s
2025-10-10T14:03:50.511425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902676c2-da5237c6-f571fea6-99259877_0] Write session: Do CDS request
2025-10-10T14:03:50.511499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902676c2-da5237c6-f571fea6-99259877_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:50.531665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|902676c2-da5237c6-f571fea6-99259877_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:50.549477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593545590858927:5422]
2025-10-10T14:03:50.549573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:50.549587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 393
2025-10-10T14:03:50.550070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:50.550177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:50.550192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:50.550202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:50.556028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 393 sessionId:  describe result for acl check
2025-10-10T14:03:50.556155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:50.556164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:50.556173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:50.556190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593545590858940:6401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:50.558746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593545590858940:6401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:50.595756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593545590858940:6401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:50.621339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593545590858940:6401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:50.621383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593545590858940:6401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:50.621411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593545590858940:6401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:50.621439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:50.653635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:50.656498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:50.657431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:50.657449Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:50.657523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:50.657928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:50.658135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593544012940458:5790]
2025-10-10T14:03:50.660806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:50.662180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:50.662409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:50.663542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:50.663848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:50.663856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:50.663863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:50.663870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:50.663876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:50.663884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:50.663890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:50.663897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:50.663903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:50.663909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:50.663916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:50.663923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:50.663967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:50.664076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:50.664122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:50.664164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:50.664208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:50.664252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:50.664295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:50.664341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:50.664383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:50.664428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:50.664471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:50.664516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:50.664560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:50.664625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:50.664684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:50.664736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:50.664781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:50.664831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:50.664874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:50.664925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:50.664972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:50.665022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:50.665066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:50.665116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:50.667669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:50.667762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:50.667813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:50.667872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:50.667922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:50.667975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:50.668024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:50.668079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:50.668129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:50.668180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:50.668224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:50.668279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:50.668745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:50.766474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:50.811322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:50.811370Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:50.811383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:50.811400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:50.811419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 392 [2:7559593544012940458:5790]
2025-10-10T14:03:50.811466Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:50.811520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:50.811535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:50.811547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:50.811556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:50.811621Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:50.811644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:50.811665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:50.823457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:50.823493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:50.823507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:50.823520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:50.823531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:50.823829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:50.823845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:50.823984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:50.824154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:50.824369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:50.824473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:50.824545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593544012940453:5790]
2025-10-10T14:03:50.824560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593544012940453:5790]
2025-10-10T14:03:50.824571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593544012940453:5790]
2025-10-10T14:03:50.824583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593544012940453:5790]
2025-10-10T14:03:50.824628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:50.824708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:50.824880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:50.824896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:50.825027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593544012940453:5790]
2025-10-10T14:03:50.825048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:50.829344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:50.829359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:50.829372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:50.829383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:50.829410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:50.834406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593545590859079:6401], now have 1 active actors on pipe
2025-10-10T14:03:50.834455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593545590858865:2442], now have 1 active actors on pipe
2025-10-10T14:03:50.834478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593545590858927:5422], now have 1 active actors on pipe
2025-10-10T14:03:50.839518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 392, pipe: [1:7559593545590858927:5422]
2025-10-10T14:03:50.839658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 392
2025-10-10T14:03:50.840910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:50.840951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:50.841028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ea05949-6fc2914-105f71b1-6d75291e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:50.841064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:50.841083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:50.841093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:50.841154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:50.841200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:50.841248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:50.842335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:50.842367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:50.842433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:50.843233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 393 partition: 0 MaxSeqNo: 36 sessionId: src_id|2ea05949-6fc2914-105f71b1-6d75291e_0
2025-10-10T14:03:50.843944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|902676c2-da5237c6-f571fea6-99259877_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2ea05949-6fc2914-105f71b1-6d75291e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:50.888384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 392
2025-10-10T14:03:50.910288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:50.910320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:50.910332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:50.915271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea05949-6fc2914-105f71b1-6d75291e_0] Write session: try to update token
2025-10-10T14:03:50.915335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea05949-6fc2914-105f71b1-6d75291e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:51.064602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:51.064646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:51.064660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:51.064671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:51.064684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:51.064722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593544012940453:5790]
2025-10-10T14:03:51.064751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593544012940453:5790]
2025-10-10T14:03:51.064775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593544012940453:5790]
2025-10-10T14:03:51.064796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593544012940453:5790]
2025-10-10T14:03:51.064962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:51.064975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:51.064987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:51.065034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:51.065060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:51.065071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:51.065596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:51.065635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:51.065664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:51.065692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:51.078108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:51.161516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId: src_id|2ea05949-6fc2914-105f71b1-6d75291e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:51.200528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:51.383633Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:51.394707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:51.394757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:51.398776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593545590858927:5422]
2025-10-10T14:03:51.398868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:51.398878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:51.403479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:51.423408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea05949-6fc2914-105f71b1-6d75291e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:51.423474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea05949-6fc2914-105f71b1-6d75291e_0] Write session will restart in 0.007083s
2025-10-10T14:03:51.423668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea05949-6fc2914-105f71b1-6d75291e_0] Write session: Do CDS request
2025-10-10T14:03:51.423719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea05949-6fc2914-105f71b1-6d75291e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:51.422726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 393 reason: error at write: Disconnected sessionId: src_id|2ea05949-6fc2914-105f71b1-6d75291e_0
2025-10-10T14:03:51.423078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 393 sessionId: src_id|2ea05949-6fc2914-105f71b1-6d75291e_0 is DEAD
2025-10-10T14:03:51.482296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea05949-6fc2914-105f71b1-6d75291e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:51.484534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:51.485403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:51.485432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 394
2025-10-10T14:03:51.489403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:51.489567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:51.489584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:51.489594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:51.490833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 394 sessionId:  describe result for acl check
2025-10-10T14:03:51.490940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:51.490950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:51.490959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:51.490978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593549885826438:6413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:51.496897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593549885826439:5422]
2025-10-10T14:03:51.497730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593549885826438:6413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:51.518613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593549885826438:6413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:51.543793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593549885826438:6413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:51.543839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593549885826438:6413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:51.543856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593549885826438:6413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:51.543890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:51.690915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:51.697120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:51.698020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:51.698038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:51.698087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:51.698344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:51.698509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593548307908019:5802]
2025-10-10T14:03:51.700514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:51.710663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:51.710934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:51.712159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:51.716857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:51.716882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:51.716888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:51.716895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:51.716901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:51.716908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:51.716916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:51.716923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:51.716930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:51.716936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:51.716944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:51.716950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:51.717002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:51.717147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:51.717200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:51.717252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:51.717299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:51.717347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:51.717397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:51.717445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:51.717492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:51.717537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:51.717580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:51.717622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:51.717675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:51.717741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:51.717799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:51.717852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:51.717903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:51.717955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:51.717998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:51.718049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:51.718095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:51.718145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:51.718189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:51.718239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:51.718288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:51.718339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:51.718384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:51.718436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:51.718482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:51.718530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:51.718571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:51.718621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:51.718664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:51.718717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:51.718757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:51.718808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:51.719217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:51.752728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:51.767447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:51.767497Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:51.767514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:51.767532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:51.767555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 393 [2:7559593548307908019:5802]
2025-10-10T14:03:51.767606Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:51.767678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:51.767692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:51.767705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:51.767717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:51.767766Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:51.767788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:51.767811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:51.788336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:51.788368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:51.788382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:51.788395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:51.788406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:51.788690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:51.788716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:51.788852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:51.789018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:51.789243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:51.789348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:51.789435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593549885826425:2442], now have 1 active actors on pipe
2025-10-10T14:03:51.789783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 393
2025-10-10T14:03:51.789468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593549885826439:5422], now have 1 active actors on pipe
2025-10-10T14:03:51.789872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 393, pipe: [1:7559593549885826439:5422]
2025-10-10T14:03:51.789485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593549885826470:6413], now have 1 active actors on pipe
2025-10-10T14:03:51.789955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 393
2025-10-10T14:03:51.789509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:51.792536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 394 partition: 0 MaxSeqNo: 36 sessionId: src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0
2025-10-10T14:03:51.789525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:51.789536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:51.789547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:51.789584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:51.789659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:51.789821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:51.789838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:51.789963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:51.789982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:51.790261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:51.790273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:51.790283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:51.790295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:51.790319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:51.791327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:51.791352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:51.791445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:51.791481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:51.791498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:51.791512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:51.791559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:51.791613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:51.791681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:51.792195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:51.792212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:51.792267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:51.795081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ea05949-6fc2914-105f71b1-6d75291e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:51.870304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:51.870335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:51.870345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:51.872339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0] Write session: try to update token
2025-10-10T14:03:51.872391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:52.110065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:52.110101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:52.110112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:52.110172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:52.110186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:52.110199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:52.110210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:52.110220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:52.110256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:52.110279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:52.110300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:52.110319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:52.110516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:52.110542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:52.110552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:52.111520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:52.113211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:52.113244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:52.113271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:52.113297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:52.138973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId: src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:52.177055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:52.327728Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:52.359016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:52.359073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:52.359153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:52.359168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:52.359212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593548307908013:5802]
2025-10-10T14:03:52.360009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:52.360403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593549885826439:5422]
2025-10-10T14:03:52.360520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:52.360534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:52.362808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:52.364134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:52.379662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 394 reason: error at write: Disconnected sessionId: src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0
2025-10-10T14:03:52.379999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 394 sessionId: src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0 is DEAD
2025-10-10T14:03:52.387144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:52.387182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0] Write session will restart in 0.006825s
2025-10-10T14:03:52.387276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0] Write session: Do CDS request
2025-10-10T14:03:52.387304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:52.402050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:52.405269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:52.405301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 395
2025-10-10T14:03:52.413484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:52.413653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:52.413669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:52.413680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:52.418913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 395 sessionId:  describe result for acl check
2025-10-10T14:03:52.419028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:52.419038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:52.419047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:52.419065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593554180794016:6429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:52.421725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593554180794016:6429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:52.452370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593554180794016:6429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:52.462025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593554180794098:5422]
2025-10-10T14:03:52.475709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593554180794016:6429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:52.475752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593554180794016:6429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:52.475770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593554180794016:6429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:52.475802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:52.576214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:52.579103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:52.580054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:52.580073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:52.580124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:52.580418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:52.580607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593552602875543:5813]
2025-10-10T14:03:52.582832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:52.584155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:52.584398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:52.585625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:52.585966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:52.585974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:52.585981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:52.585988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:52.585994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:52.586001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:52.586007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:52.586014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:52.586021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:52.586028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:52.586035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:52.586042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:52.586090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:52.586195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:52.586244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:52.586291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:52.586339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:52.586385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:52.586428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:52.586471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:52.586515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:52.586563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:52.586611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:52.586652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:52.586694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:52.586759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:52.586817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:52.586871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:52.586918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:52.586971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:52.587017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:52.587071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:52.587118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:52.587171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:52.587218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:52.587271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:52.587322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:52.587373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:52.587416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:52.587467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:52.587514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:52.587564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:52.587606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:52.587673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:52.587721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:52.587769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:52.587814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:52.587864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:52.588302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:52.647202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:52.675022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:52.680502Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:52.680538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:52.680558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:52.680582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 394 [2:7559593552602875543:5813]
2025-10-10T14:03:52.680636Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:52.680694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:52.680709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:52.680722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:52.680732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:52.680784Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:52.680805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:52.680827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:52.738116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:52.738146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:52.738156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:52.738166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:52.738175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:52.738446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:52.738461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:52.738576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:52.738730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:52.738932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:52.739038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:52.739112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.739126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.739138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.739149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.739189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:52.739266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:52.739422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:52.739439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:52.739559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.739577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:52.742319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 394
2025-10-10T14:03:52.742405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 394
2025-10-10T14:03:52.742467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 394, pipe: [1:7559593554180794098:5422]
2025-10-10T14:03:52.740690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:52.740711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:52.740720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:52.740731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:52.740755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:52.742438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593554180794120:6429], now have 1 active actors on pipe
2025-10-10T14:03:52.742465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593554180794004:2442], now have 1 active actors on pipe
2025-10-10T14:03:52.742484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593554180794098:5422], now have 1 active actors on pipe
2025-10-10T14:03:52.745233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:52.745271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:52.745364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:52.745400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:52.745418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:52.745428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:52.745467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:52.745515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:52.745566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:52.749664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:52.749699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:52.749776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:52.753371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 395 partition: 0 MaxSeqNo: 36 sessionId: src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0
2025-10-10T14:03:52.754156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3690da14-b5dc76c9-900e5ca6-43c6f37a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:52.780131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:52.780165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:52.780176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:52.802377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:52.802412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:52.802448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.802745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:52.817406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:52.819224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:52.820443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:52.827641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:52.828770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:52.830248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:52.831083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:03:52.838716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0] Write session: try to update token
2025-10-10T14:03:52.838777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:52.885238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:52.885273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:52.885283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:52.934996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:52.935035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:52.935051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:52.935062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:52.935072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:52.935113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.935139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.935161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.935181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593552602875538:5813]
2025-10-10T14:03:52.935325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:52.935328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:52.935352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:52.935361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:52.935363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:52.935388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:52.935426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:52.936467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:53.072014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId: src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:53.105789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:53.173362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:53.175794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:53.175828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:53.180553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:53.180582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:53.186083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593554180794098:5422]
2025-10-10T14:03:53.186239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:53.188552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:53.222029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 395 reason: error at write: Disconnected sessionId: src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0
2025-10-10T14:03:53.232205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:53.232272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0] Write session will restart in 0.007246s
2025-10-10T14:03:53.232441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0] Write session: Do CDS request
2025-10-10T14:03:53.232485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:53.230087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 395 sessionId: src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0 is DEAD
2025-10-10T14:03:53.243964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:53.243995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 396
2025-10-10T14:03:53.244907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:53.245560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:53.245702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:53.245717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:53.245727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:53.250653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 396 sessionId:  describe result for acl check
2025-10-10T14:03:53.250781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:53.250790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:53.250800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:53.250817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593558475761564:6436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:53.259595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593558475761564:6436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:53.283875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593558475761624:5422]
2025-10-10T14:03:53.286879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593558475761564:6436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:53.322850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593558475761564:6436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:53.322897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593558475761564:6436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:53.322915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593558475761564:6436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:53.322948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:53.370177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:53.394014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:53.394888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:53.394906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:53.394949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:53.395207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:53.395397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593556897843104:5823]
2025-10-10T14:03:53.397777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:53.406279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:53.406571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:53.407866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:53.408200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:53.408208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:53.408214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:53.408221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:53.408228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:53.408236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:53.408244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:53.408251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:53.408257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:53.408263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:53.408270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:53.408276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:53.408323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:53.408434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:53.408482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:53.408530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:53.408576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:53.408623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:53.408665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:53.408709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:53.408755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:53.408801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:53.408846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:53.408889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:53.408934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:53.408996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:53.409053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:53.409106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:53.412382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:53.412489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:53.412556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:53.412612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:53.412665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:53.412714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:53.412760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:53.412816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:53.412869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:53.412928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:53.412973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:53.413025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:53.413070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:53.413120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:53.413175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:53.413227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:53.413270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:53.413319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:53.413362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:53.413408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:53.413817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:53.465362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:53.512745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:53.512793Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:53.512808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:53.512827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:53.512849Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 395 [2:7559593556897843104:5823]
2025-10-10T14:03:53.512899Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:53.512955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:53.512968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:53.512981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:53.512991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:53.513037Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:53.513056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:53.513076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:53.514986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:53.515012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:53.515025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:53.515038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:53.515049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:53.515325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:53.515346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:53.515484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:53.515682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:53.515912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:53.516027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:53.516111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593558475761697:6436], now have 1 active actors on pipe
2025-10-10T14:03:53.516134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593558475761624:5422], now have 1 active actors on pipe
2025-10-10T14:03:53.516154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593558475761537:2442], now have 1 active actors on pipe
2025-10-10T14:03:53.516180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:53.516195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:53.516206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:53.516217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:53.516253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:53.516332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:53.516506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:53.516524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:53.516650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:53.516669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:53.517985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:53.517999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:53.518010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:53.518022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:53.518046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:53.522631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 395
2025-10-10T14:03:53.522719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 395, pipe: [1:7559593558475761624:5422]
2025-10-10T14:03:53.522808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 395
2025-10-10T14:03:53.523290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:53.523327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:53.523422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:53.523459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:53.523480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:53.523491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:53.523531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:53.523581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:53.523632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:53.525276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:53.525308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:53.525381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:53.525862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 396 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0
2025-10-10T14:03:53.530862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b14b52b0-5801efd9-299f6f52-490dae7a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:53.613354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:53.613383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:53.613395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:53.625067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0] Write session: try to update token
2025-10-10T14:03:53.625142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:53.633241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:03:53.633308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-10-10T14:03:53.634411Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:03:53.635218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 9 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:03:53.635370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:03:53.817722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:53.817786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:53.817816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:53.817930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:53.817969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:53.817997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:53.818016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:53.818052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:53.818127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:53.818189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:53.818269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:53.818329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:53.818748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:53.818808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:53.818836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:53.819337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:53.819373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:53.819397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:53.819431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:53.823912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:53.902903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId: src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:53.955616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:54.144671Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:54.225496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:54.225545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:54.225611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:54.225624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:54.225667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593556897843098:5823]
2025-10-10T14:03:54.226143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:54.227016Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:54.231201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:54.231254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:54.238585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593558475761624:5422]
2025-10-10T14:03:54.246040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:54.272989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 396 reason: error at write: Disconnected sessionId: src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0
2025-10-10T14:03:54.281877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:54.281919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0] Write session will restart in 0.008771s
2025-10-10T14:03:54.282012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0] Write session: Do CDS request
2025-10-10T14:03:54.282041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:54.277528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 396 sessionId: src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0 is DEAD
2025-10-10T14:03:54.301896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:54.302584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:54.302615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 397
2025-10-10T14:03:54.302927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:54.303028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:54.303043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:54.303053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:54.304358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 397 sessionId:  describe result for acl check
2025-10-10T14:03:54.304461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:54.304472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:54.304481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:54.304497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593562770729136:6452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:54.307220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593562770729136:6452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:54.327506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593562770729136:6452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:54.349826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593562770729136:6452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:54.349870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593562770729136:6452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:54.349888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593562770729136:6452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:54.349920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:54.350267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593562770729238:5422]
2025-10-10T14:03:54.443220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:54.449272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:54.450144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:54.450163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:54.450208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:54.450480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:54.450665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593561192810656:5833]
2025-10-10T14:03:54.452901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:54.461463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:54.461739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:54.463120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:54.463479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:54.463486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:54.463493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:54.463500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:54.463507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:54.463514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:54.463522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:54.463529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:54.463536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:54.463541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:54.463548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:54.463554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:54.463599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:54.463721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:54.463767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:54.463812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:54.463855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:54.463894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:54.463937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:54.463979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:54.464021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:54.464065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:54.464110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:54.464154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:54.464191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:54.464254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:54.464310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:54.464363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:54.464409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:54.464465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:54.464510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:54.464564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:54.464614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:54.464667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:54.464710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:54.464761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:54.464807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:54.464856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:54.464899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:54.464951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:54.464995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:54.465050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:54.465095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:54.468028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:54.468121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:54.468196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:54.468246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:54.468302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:54.468749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:54.552781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:54.603910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:54.603953Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:54.603969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:54.603988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:54.604009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 396 [2:7559593561192810656:5833]
2025-10-10T14:03:54.604061Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:54.604123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:54.604136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:54.604149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:54.604159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:54.604205Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:54.604225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:54.604247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:54.605782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:54.605800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:54.605813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:54.605824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:54.605836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:54.606104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:54.606120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:54.606255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:54.606431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:54.606643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:54.606747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:54.606823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:54.606839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:54.606855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:54.606867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:54.612266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 396
2025-10-10T14:03:54.612348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 396, pipe: [1:7559593562770729238:5422]
2025-10-10T14:03:54.612427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 396
2025-10-10T14:03:54.615368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:54.615508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:54.615723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:54.615742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:54.615812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593562770729112:2442], now have 1 active actors on pipe
2025-10-10T14:03:54.615836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593562770729237:6452], now have 1 active actors on pipe
2025-10-10T14:03:54.615857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593562770729238:5422], now have 1 active actors on pipe
2025-10-10T14:03:54.615911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:54.615932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:54.616099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:54.616120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:54.616190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f326053-e292c2e8-306615c5-5a26f994_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:54.616224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:54.616243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:54.616254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:54.616292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:54.616400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:54.616413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:54.616426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:54.616438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:54.616463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:54.621321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:54.621587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:54.633286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:54.633336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:54.633422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:54.633905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 397 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f326053-e292c2e8-306615c5-5a26f994_0
2025-10-10T14:03:54.637703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f3ec735-d79f1932-37af2bdd-374a2277_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f326053-e292c2e8-306615c5-5a26f994_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:54.695102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f326053-e292c2e8-306615c5-5a26f994_0] Write session: try to update token
2025-10-10T14:03:54.695159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f326053-e292c2e8-306615c5-5a26f994_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:54.704351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:54.704377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:54.704388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:54.801282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:54.801311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:54.801324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:54.801335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:54.801345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:54.801380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:54.801404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:54.801427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:54.801446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:54.801641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:54.801669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:54.801681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:54.802777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:54.805219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:54.805257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:54.805288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:54.805319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:54.940826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId: src_id|2f326053-e292c2e8-306615c5-5a26f994_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:54.995925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:55.043652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:55.099594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:55.099639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:55.099712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:55.099725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:55.099765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593561192810651:5833]
2025-10-10T14:03:55.104818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:55.106266Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:55.105884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:55.106044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:55.106056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:55.109289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593562770729238:5422]
2025-10-10T14:03:55.187574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f326053-e292c2e8-306615c5-5a26f994_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:55.187659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f326053-e292c2e8-306615c5-5a26f994_0] Write session will restart in 0.006962s
2025-10-10T14:03:55.187923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f326053-e292c2e8-306615c5-5a26f994_0] Write session: Do CDS request
2025-10-10T14:03:55.187991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f326053-e292c2e8-306615c5-5a26f994_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:55.186681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 397 reason: error at write: Disconnected sessionId: src_id|2f326053-e292c2e8-306615c5-5a26f994_0
2025-10-10T14:03:55.187026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 397 sessionId: src_id|2f326053-e292c2e8-306615c5-5a26f994_0 is DEAD
2025-10-10T14:03:55.207058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:55.207088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 398
2025-10-10T14:03:55.209998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f326053-e292c2e8-306615c5-5a26f994_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:55.213254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593567065696761:5422]
2025-10-10T14:03:55.215821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:55.215964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:55.215980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:55.215991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:55.218153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 398 sessionId:  describe result for acl check
2025-10-10T14:03:55.218283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:55.218294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:55.218303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:55.218320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593567065696772:6459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:55.221021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593567065696772:6459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:55.248062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593567065696772:6459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:55.263789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593567065696772:6459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:55.263837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593567065696772:6459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:55.263854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593567065696772:6459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:55.263887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:55.289361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:55.298567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:55.299423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:55.299441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:55.299489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:55.299766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:55.299959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593565487778209:5845]
2025-10-10T14:03:55.302188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:55.308141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:55.308419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:55.309897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:55.310249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:55.310257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:55.310263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:55.310269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:55.310277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:55.310283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:55.310291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:55.310297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:55.310303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:55.310310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:55.310317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:55.310323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:55.310371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:55.310473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:55.310515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:55.310560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:55.310600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:55.310644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:55.310689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:55.310731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:55.310774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:55.310820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:55.310862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:55.310906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:55.310948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:55.311009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:55.311065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:55.311115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:55.311160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:55.311210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:55.311251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:55.311301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:55.311346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:55.311399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:55.311441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:55.311494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:55.311539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:55.311589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:55.311636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:55.311687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:55.311747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:55.311799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:55.311843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:55.311895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:55.311941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:55.311991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:55.312032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:55.312084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:55.312507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:55.349626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:55.364570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:55.364940Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:55.364962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:55.364981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:55.365003Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 397 [2:7559593565487778209:5845]
2025-10-10T14:03:55.365058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:55.365120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:55.365150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:55.365164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:55.365175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:55.365225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:55.365248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:55.365272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:55.429524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:55.429554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:55.429567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:55.429581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:55.429592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:55.429879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:55.429895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:55.430035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:55.430208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:55.430435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:55.430546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:55.430623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593565487778202:5845]
2025-10-10T14:03:55.430639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593565487778202:5845]
2025-10-10T14:03:55.430650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593565487778202:5845]
2025-10-10T14:03:55.430662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593565487778202:5845]
2025-10-10T14:03:55.430704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:55.430789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:55.430964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:55.430981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:55.431112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593565487778202:5845]
2025-10-10T14:03:55.431132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:55.431520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:55.431532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:55.431543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:55.431553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:55.431575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:55.433592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 397
2025-10-10T14:03:55.433669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 397, pipe: [1:7559593567065696761:5422]
2025-10-10T14:03:55.433746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 397
2025-10-10T14:03:55.447175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593567065696880:6459], now have 1 active actors on pipe
2025-10-10T14:03:55.447225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593567065696761:5422], now have 1 active actors on pipe
2025-10-10T14:03:55.447247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593567065696667:2442], now have 1 active actors on pipe
2025-10-10T14:03:55.447323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:55.447347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:55.447448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:55.447486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:55.447505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:55.447516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:55.447556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:55.447603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:55.447656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:55.450255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:55.450290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:55.450364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:55.450801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 398 partition: 0 MaxSeqNo: 36 sessionId: src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0
2025-10-10T14:03:55.457381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f326053-e292c2e8-306615c5-5a26f994_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:55.462701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:55.462730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:55.462743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:55.503904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0] Write session: try to update token
2025-10-10T14:03:55.503972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:55.567449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:55.567485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:55.567499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:55.567512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:55.567523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:55.567580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593565487778202:5845]
2025-10-10T14:03:55.567611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593565487778202:5845]
2025-10-10T14:03:55.567635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593565487778202:5845]
2025-10-10T14:03:55.567660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593565487778202:5845]
2025-10-10T14:03:55.567859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:55.567870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:55.567881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:55.567927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:55.567953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:55.567963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:55.569615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:55.569651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:55.569682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:55.569710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:55.578519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:55.732498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId: src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:55.767484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:55.840412Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:55.853377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:55.853425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:55.859773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:55.859612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:55.859769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:55.859781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:56.051159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 398 reason: error at write: Disconnected sessionId: src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0
2025-10-10T14:03:56.051484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 398 sessionId: src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0 is DEAD
2025-10-10T14:03:56.053903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:56.053956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0] Write session will restart in 0.007436s
2025-10-10T14:03:56.054116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0] Write session: Do CDS request
2025-10-10T14:03:56.054167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:56.068203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:56.079503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593567065696761:5422]
2025-10-10T14:03:56.079650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:56.079667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 399
2025-10-10T14:03:56.085397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:56.085550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:56.085567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:56.085577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:56.088104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 399 sessionId:  describe result for acl check
2025-10-10T14:03:56.088218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:56.088227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:56.088236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:56.088254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593571360664332:6470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:56.090811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593571360664332:6470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:56.110553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593571360664332:6470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:56.133839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593571360664332:6470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:56.133889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593571360664332:6470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:56.133907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593571360664332:6470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:56.133941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:56.177377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593571360664459:5422]
2025-10-10T14:03:56.188919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:56.202714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:56.203654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:56.203675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:56.203740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:56.204037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:56.204243Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593569782745749:5852]
2025-10-10T14:03:56.206672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:56.209427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:56.209675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:56.210998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:56.211371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:56.211379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:56.211387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:56.211394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:56.211403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:56.211410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:56.211417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:56.211425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:56.211432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.211439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.211447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.211455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.211503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:56.211618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:56.211669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:56.211718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:56.211785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:56.211836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:56.211883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:56.211933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:56.211980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.212029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.212077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.212128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.212171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:56.212243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:56.212305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:56.212365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:56.212417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:56.212474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:56.212523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:56.212579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:56.212630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:56.212685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:56.212736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:56.212793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:56.212843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:56.212898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:56.212944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:56.213001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:56.213050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.213104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.219011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.219127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.219193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.219253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.219304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.219359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.219852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:56.266174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:56.320191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:56.320238Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:56.320255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:56.320274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:56.320298Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 398 [2:7559593569782745749:5852]
2025-10-10T14:03:56.320360Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:56.320415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:56.320430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:56.320442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:56.320454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:56.320503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:56.320524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:56.320546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:56.322857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.322875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.322891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.322906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.322919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:56.323214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:56.323231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.323378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.323574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.323825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.323956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:56.324033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.324048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.324063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.324076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.324444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:56.324458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:56.324469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:56.324480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:56.326436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 398, pipe: [1:7559593571360664459:5422]
2025-10-10T14:03:56.326540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 398
2025-10-10T14:03:56.326610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 398
2025-10-10T14:03:56.326401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:56.326514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:56.326710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:56.326729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:56.326783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593571360664459:5422], now have 1 active actors on pipe
2025-10-10T14:03:56.326810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593571360664432:6470], now have 1 active actors on pipe
2025-10-10T14:03:56.326833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593567065696919:2442], now have 1 active actors on pipe
2025-10-10T14:03:56.326952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.326989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:56.327926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:56.328332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:56.328360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:56.328448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6999d949-40002879-3132a310-d1cd6871_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:56.328476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:56.328495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:56.328506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:56.328540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:56.328578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:56.328626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:56.340450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:56.340495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:56.340583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:56.345508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 399 partition: 0 MaxSeqNo: 36 sessionId: src_id|6999d949-40002879-3132a310-d1cd6871_0
2025-10-10T14:03:56.346378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|201402d1-b0c781a5-144c4040-fbdc1f1d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6999d949-40002879-3132a310-d1cd6871_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:56.396902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6999d949-40002879-3132a310-d1cd6871_0] Write session: try to update token
2025-10-10T14:03:56.396961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6999d949-40002879-3132a310-d1cd6871_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:56.487790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:56.487826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:56.487837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:56.487892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:56.487904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:56.487918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:56.487928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:56.487938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:56.487973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.487998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.488022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.488096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.488295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:56.488321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.488332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:56.489869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:56.492569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:56.492608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:56.492639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:56.492668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:56.549654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId: src_id|6999d949-40002879-3132a310-d1cd6871_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:56.575824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:56.644604Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:56.668736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:56.670965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:03:56.668785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:56.672295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593571360664459:5422]
2025-10-10T14:03:56.668857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:56.672439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:56.668870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:56.668910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593569782745736:5852]
2025-10-10T14:03:56.669220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:56.669579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:56.744595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 399 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6999d949-40002879-3132a310-d1cd6871_0
2025-10-10T14:03:56.744896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 399 sessionId: src_id|6999d949-40002879-3132a310-d1cd6871_0 is DEAD
2025-10-10T14:03:56.745472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6999d949-40002879-3132a310-d1cd6871_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:03:56.745509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6999d949-40002879-3132a310-d1cd6871_0] Write session will restart in 0.007003s
2025-10-10T14:03:56.745603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6999d949-40002879-3132a310-d1cd6871_0] Write session: Do CDS request
2025-10-10T14:03:56.745632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6999d949-40002879-3132a310-d1cd6871_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:56.760820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:56.760852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 400
2025-10-10T14:03:56.766103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6999d949-40002879-3132a310-d1cd6871_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:56.766903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:56.767042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:56.767057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:56.767068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:56.768724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 400 sessionId:  describe result for acl check
2025-10-10T14:03:56.768841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:56.768850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:56.768860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:56.768877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593571360664502:6481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:56.771540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593571360664513:5422]
2025-10-10T14:03:56.771578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593571360664502:6481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:56.783346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593571360664502:6481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:56.801985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593571360664502:6481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:56.802023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593571360664502:6481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:56.802036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593571360664502:6481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:56.802055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:56.853167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:56.862082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:56.863036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:56.863068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:56.863113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:56.863401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:56.863610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593569782746004:5864]
2025-10-10T14:03:56.866056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:56.867281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:56.867541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:56.869086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:56.869482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:56.869491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:56.869499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:56.869506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:56.869513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:56.869521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:56.869529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:56.869537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:56.869545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.869553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.869560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.869567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.869622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:56.869747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:56.869804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:56.869862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:56.869912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:56.869963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:56.870010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:56.870057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:56.870109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.870161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.870210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.870259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.870321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:56.870394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:56.870460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:56.870526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:56.870582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:56.870638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:56.870690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:56.870750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:56.870803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:56.870865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:56.870914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:56.870973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:56.871024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:56.871079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:56.871131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:56.871190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:56.871245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.871316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.871366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.871424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.871475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.871532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.871581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.871640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.872153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:56.916986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
E1010 14:03:56.974686172  106874 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:03:56.981432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:56.981480Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:56.981500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:56.981521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:56.981546Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 399 [2:7559593569782746004:5864]
2025-10-10T14:03:56.981609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:56.981672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:56.981689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:56.981702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:56.981714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:56.981763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:56.981786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:56.981809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:56.983667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.983695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.983712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.983728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.983753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:56.984053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:56.984073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:56.986384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:56.986619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:56.986875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:56.987006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:56.987281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593571360664585:6481], now have 1 active actors on pipe
2025-10-10T14:03:56.987319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593571360664513:5422], now have 1 active actors on pipe
2025-10-10T14:03:56.987342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593571360664485:2442], now have 1 active actors on pipe
2025-10-10T14:03:56.987399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:56.987429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:56.987486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593569782745999:5864]
2025-10-10T14:03:56.987501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593569782745999:5864]
2025-10-10T14:03:56.987516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593569782745999:5864]
2025-10-10T14:03:56.987528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593569782745999:5864]
2025-10-10T14:03:56.987571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:56.987667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:56.987894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:56.987913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:56.987988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcc46c95-55accca4-7cac81c1-13784045_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:56.988018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:56.988036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:56.988048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:56.988084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:56.988128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:56.988283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593569782745999:5864]
2025-10-10T14:03:56.988306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:56.988355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:56.988417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:56.988432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:56.988444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:56.988459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:56.988485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:56.985790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 399
2025-10-10T14:03:56.985886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 399, pipe: [1:7559593571360664513:5422]
2025-10-10T14:03:56.985966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 399
2025-10-10T14:03:56.989240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:56.989274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:56.989344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:56.990830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 400 partition: 0 MaxSeqNo: 36 sessionId: src_id|dcc46c95-55accca4-7cac81c1-13784045_0
2025-10-10T14:03:56.991894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6999d949-40002879-3132a310-d1cd6871_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dcc46c95-55accca4-7cac81c1-13784045_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:57.024117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc46c95-55accca4-7cac81c1-13784045_0] Write session: try to update token
2025-10-10T14:03:57.024180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc46c95-55accca4-7cac81c1-13784045_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:57.128336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:57.128367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:57.128379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:57.128437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:57.128453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:57.128465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:57.128477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:57.128488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:57.128524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593569782745999:5864]
2025-10-10T14:03:57.128550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593569782745999:5864]
2025-10-10T14:03:57.128576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593569782745999:5864]
2025-10-10T14:03:57.128599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593569782745999:5864]
2025-10-10T14:03:57.128742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:57.128771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:57.128783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:57.129875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:57.132619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:57.132659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:57.132690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:57.132720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:57.183729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId: src_id|dcc46c95-55accca4-7cac81c1-13784045_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:57.220297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:57.293846Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:57.308965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:57.310645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:57.315684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:57.315711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:57.314522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:57.440960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593571360664513:5422]
2025-10-10T14:03:57.441064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 400 reason: error at write: Disconnected sessionId: src_id|dcc46c95-55accca4-7cac81c1-13784045_0
2025-10-10T14:03:57.441431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 400 sessionId: src_id|dcc46c95-55accca4-7cac81c1-13784045_0 is DEAD
2025-10-10T14:03:57.445346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc46c95-55accca4-7cac81c1-13784045_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:57.445387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc46c95-55accca4-7cac81c1-13784045_0] Write session will restart in 0.008949s
2025-10-10T14:03:57.445486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc46c95-55accca4-7cac81c1-13784045_0] Write session: Do CDS request
2025-10-10T14:03:57.445518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc46c95-55accca4-7cac81c1-13784045_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:57.465885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc46c95-55accca4-7cac81c1-13784045_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:57.486940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:57.487153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:57.487167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 401
2025-10-10T14:03:57.487736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:57.487870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:57.487886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:57.487897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:57.489554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 401 sessionId:  describe result for acl check
2025-10-10T14:03:57.489685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:57.489694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:57.489704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:57.489722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593575655632210:6493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:57.492953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593575655632210:6493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:57.510814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593575655632210:6493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:57.532110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593575655632210:6493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:57.532161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593575655632210:6493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:57.532176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593575655632210:6493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:57.532208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:57.541313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:57.543397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593575655632271:5422]
2025-10-10T14:03:57.554051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:57.555007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:57.555028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:57.555079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:57.555376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:57.555558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593574077713539:5873]
2025-10-10T14:03:57.557972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:57.560996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:57.561283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:57.562607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:57.562967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:57.562984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:57.562992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:57.563000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:57.563008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:57.563015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:57.563024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:57.563031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:57.563039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:57.563046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:57.563054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:57.563061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:57.563109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:57.563223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:57.563271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:57.563329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:57.563386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:57.563440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:57.563494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:57.563544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:57.563591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:57.563639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:57.563684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:57.563732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:57.563970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:57.564046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:57.564110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:57.564175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:57.564234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:57.564299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:57.564347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:57.564406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:57.564458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:57.564515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:57.564564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:57.564621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:57.564674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:57.564730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:57.564779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:57.565099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:57.565178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:57.565245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:57.565302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:57.565363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:57.565420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:57.565480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:57.565530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:57.565588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:57.566055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:57.600013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:57.630114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:57.630159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:57.630177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:57.630196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:57.630219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 400 [2:7559593574077713539:5873]
2025-10-10T14:03:57.630275Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:57.630330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:57.630345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:57.630356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:57.630367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:57.630414Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:57.630434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:57.630455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:57.683322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:57.683353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:57.683365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:57.683377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:57.683387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:57.683694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:57.683712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:57.683868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:57.684031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:57.684242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:57.684353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:57.684431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593574077713532:5873]
2025-10-10T14:03:57.684447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593574077713532:5873]
2025-10-10T14:03:57.684461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593574077713532:5873]
2025-10-10T14:03:57.684474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593574077713532:5873]
2025-10-10T14:03:57.684523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:57.684604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:57.684772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:57.684789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:57.684920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593574077713532:5873]
2025-10-10T14:03:57.684940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:57.685315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:57.685331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:57.685344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:57.685357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:57.685385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:57.687501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 400
2025-10-10T14:03:57.687598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 400
2025-10-10T14:03:57.687668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 400, pipe: [1:7559593575655632271:5422]
2025-10-10T14:03:57.688559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593575655632267:6493], now have 1 active actors on pipe
2025-10-10T14:03:57.688609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593575655632198:2442], now have 1 active actors on pipe
2025-10-10T14:03:57.688633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593575655632271:5422], now have 1 active actors on pipe
2025-10-10T14:03:57.690230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:57.690282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:57.690392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:57.690431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:57.690450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:57.690461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:57.690501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:57.690549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:57.690602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:57.693835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:57.693875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:57.693960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:57.697500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 401 partition: 0 MaxSeqNo: 36 sessionId: src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0
2025-10-10T14:03:57.698968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcc46c95-55accca4-7cac81c1-13784045_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:57.725241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0] Write session: try to update token
2025-10-10T14:03:57.725299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:57.733364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:57.733394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:57.733407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:57.838760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:57.838798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:57.838813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:57.838824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:57.838835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:57.838870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593574077713532:5873]
2025-10-10T14:03:57.838893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593574077713532:5873]
2025-10-10T14:03:57.838919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593574077713532:5873]
2025-10-10T14:03:57.838942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593574077713532:5873]
2025-10-10T14:03:57.839096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:57.839110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:57.839122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:57.839166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:57.839191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:57.839204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:57.840281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:57.841352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:57.841390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:57.841424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:57.841456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:57.965069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId: src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:58.029583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:58.047216Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:58.050082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:58.050124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:58.056324Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:58.053739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:58.053768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:58.057285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:58.057425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593575655632271:5422]
2025-10-10T14:03:58.057468Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:03:58.057775Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 4 consumer shared/user session shared/user_1_4_15775285217873980898_v1 is DEAD
2025-10-10T14:03:58.058113Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559593227763259795:5415] disconnected; active server actors: 1
2025-10-10T14:03:58.058131Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559593227763259795:5415] client user disconnected session shared/user_1_4_15775285217873980898_v1
2025-10-10T14:03:58.065418Z :ERROR: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:03:58.066256Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:03:58.066326Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:03:58.066445Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Reconnecting session to cluster  in 0.005510s
2025-10-10T14:03:58.081708Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Successfully connected. Initializing session
2025-10-10T14:03:58.086032Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:03:58.086066Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 5
2025-10-10T14:03:58.086615Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 5 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:03:58.086815Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 read init: from# ipv6:[::1]:40068, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:03:58.087211Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 auth for : user
2025-10-10T14:03:58.093462Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 Handle describe topics response
2025-10-10T14:03:58.093590Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 auth is DEAD
2025-10-10T14:03:58.093658Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:03:58.094655Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:03:58.097609Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got InitResponse. ReadSessionId: shared/user_1_5_5644318080921466875_v1
2025-10-10T14:03:58.098861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 401 reason: error at write: Disconnected sessionId: src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0
2025-10-10T14:03:58.099117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 401 sessionId: src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0 is DEAD
2025-10-10T14:03:58.101593Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559593579950599617:6501] connected; active server actors: 1
2025-10-10T14:03:58.101675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:58.101741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0] Write session will restart in 0.008614s
2025-10-10T14:03:58.101919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0] Write session: Do CDS request
2025-10-10T14:03:58.101971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:58.105707Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559593579950599617:6501] session shared/user_1_5_5644318080921466875_v1
2025-10-10T14:03:58.105802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:03:58.105888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:03:58.105953Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_5_5644318080921466875_v1" (Sender=[1:7559593579950599613:6501], Pipe=[1:7559593579950599617:6501], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:03:58.106001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:03:58.106106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:03:58.106189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_5_5644318080921466875_v1" (Sender=[1:7559593579950599613:6501], Pipe=[1:7559593579950599617:6501], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:03:58.106280Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_5_5644318080921466875_v1" sender [1:7559593579950599613:6501] lock partition 0 for ReadingSession "shared/user_1_5_5644318080921466875_v1" (Sender=[1:7559593579950599613:6501], Pipe=[1:7559593579950599617:6501], Partitions=[], ActiveFamilyCount=1) generation 1 step 5
2025-10-10T14:03:58.106357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:03:58.106403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000260s
2025-10-10T14:03:58.107551Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_5_5644318080921466875_v1" ClientId: "user" PipeClient { RawX1: 7559593579950599617 RawX2: 4503603922344293 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:03:58.107631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:03:58.122388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:58.127752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:58.127799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 402
2025-10-10T14:03:58.129364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:58.129521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:58.129538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:58.129548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:58.136535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 402 sessionId:  describe result for acl check
2025-10-10T14:03:58.136679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:58.136690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:58.136700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:58.136717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593579950599650:6505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:58.140720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593579950599650:6505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:58.160801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593579950599650:6505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:58.190402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593579950599650:6505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:58.190451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593579950599650:6505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:58.190472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593579950599650:6505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:58.190503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:58.265388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:58.278076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:58.278951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:58.278971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:58.279014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:58.279295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:58.279482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593578372681095:5883]
2025-10-10T14:03:58.282126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:58.289776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:58.290047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:58.291373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:58.291731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:58.291740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:58.291749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:58.291756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:58.291764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:58.291785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:58.291793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:58.291801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:58.291809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:58.291816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:58.291825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:58.291832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:58.291883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:58.291999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:58.292052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:58.292102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:58.292149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:58.292200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:58.292249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:58.292297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:58.292344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:58.292392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:58.292442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:58.292491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:58.292534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:58.292604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:58.292668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:58.292728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:58.292776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:58.292833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:58.292880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:58.292935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:58.292984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:58.293040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:58.293090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:58.295237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:58.295325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:58.295393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:58.295446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:58.295508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:58.295565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:58.295625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:58.295676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:58.295736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:58.295807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:58.295869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:58.295920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:58.295977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:58.296477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:58.350490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:58.376710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:58.381324Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:58.381358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:58.381379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:58.381403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 401 [2:7559593578372681095:5883]
2025-10-10T14:03:58.381472Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:58.381540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:58.381555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:58.381567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:58.381578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:58.381625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:58.381647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:58.381667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:58.410711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:58.410743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:58.410755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:58.410767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:58.410777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:58.411061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:58.411079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:58.411214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:58.411387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:58.411608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:58.411730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:58.411821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.411838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.411851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.411865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.411910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:58.411996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:58.412177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:58.412195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:58.412332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.412355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:58.413093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:58.413113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:58.413141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:58.413154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:58.413180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:58.415339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 401
2025-10-10T14:03:58.415447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 401
2025-10-10T14:03:58.415546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 401, pipe: [1:7559593579950599620:6504]
2025-10-10T14:03:58.416804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593579950599604:2442], now have 1 active actors on pipe
2025-10-10T14:03:58.416841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593579950599771:6505], now have 1 active actors on pipe
2025-10-10T14:03:58.416865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593579950599620:6504], now have 1 active actors on pipe
2025-10-10T14:03:58.416930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:58.416953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:58.417008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:58.417022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:58.417054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_5_5644318080921466875_v1 on pipe: [1:7559593579950599620:6504]
2025-10-10T14:03:58.417155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e794e63a-68be5df2-a602e0f-d88809b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:58.417192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:58.417211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:58.417222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:58.417258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:58.417318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:58.417370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:58.417388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:58.417400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:58.417479Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_5_5644318080921466875_v1
2025-10-10T14:03:58.417493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:58.417655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:58.417714Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:03:58.418206Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_5_5644318080921466875_v1:1 with generation 401
2025-10-10T14:03:58.422726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:58.422767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:58.422851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:58.426303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 402 partition: 0 MaxSeqNo: 36 sessionId: src_id|e794e63a-68be5df2-a602e0f-d88809b5_0
2025-10-10T14:03:58.427312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb4d8057-256f2e9b-8503cd0a-2fa377b6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e794e63a-68be5df2-a602e0f-d88809b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:58.429710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:03:58.429790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:03:58.429815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:58.429827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:58.429840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:58.429873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:03:58.429913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:03:58.433633Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1760104766000 SizeLag: 18742722 WriteTimestampEstimateMS: 1760105038417 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:03:58.433688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-10T14:03:58.433762Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 sending to client partition status
2025-10-10T14:03:58.481522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e794e63a-68be5df2-a602e0f-d88809b5_0] Write session: try to update token
2025-10-10T14:03:58.481579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e794e63a-68be5df2-a602e0f-d88809b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:58.485155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:58.485188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:58.485200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:58.673465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:58.673495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:58.673509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:58.673521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:58.673532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:58.673566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.673592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.673618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.673641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.673816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:58.673830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:58.673841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:58.673884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:58.673916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:58.673943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:58.673945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:58.673970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:58.673974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:58.673981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:58.682254Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:58.705672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId: src_id|e794e63a-68be5df2-a602e0f-d88809b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:58.751153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:58.857463Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:58.877255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:58.877302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:58.877376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:58.877391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:58.877433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593578372681089:5883]
2025-10-10T14:03:58.877749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:58.879462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_5_5644318080921466875_v1
2025-10-10T14:03:58.879522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:58.879200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:58.879333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:58.879346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:58.885282Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_5_5644318080921466875_v1
2025-10-10T14:03:58.888532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 402 reason: error at write: Disconnected sessionId: src_id|e794e63a-68be5df2-a602e0f-d88809b5_0
2025-10-10T14:03:58.888990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 402 sessionId: src_id|e794e63a-68be5df2-a602e0f-d88809b5_0 is DEAD
2025-10-10T14:03:58.889650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e794e63a-68be5df2-a602e0f-d88809b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:58.889704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e794e63a-68be5df2-a602e0f-d88809b5_0] Write session will restart in 0.008913s
2025-10-10T14:03:58.889859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e794e63a-68be5df2-a602e0f-d88809b5_0] Write session: Do CDS request
2025-10-10T14:03:58.889904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e794e63a-68be5df2-a602e0f-d88809b5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:58.903609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593579950599620:6504]
2025-10-10T14:03:58.905089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:58.905146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 403
2025-10-10T14:03:58.905671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e794e63a-68be5df2-a602e0f-d88809b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:58.922917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:58.923085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:58.923102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:58.923113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:58.930404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 403 sessionId:  describe result for acl check
2025-10-10T14:03:58.930536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:58.930554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:58.930564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:58.930582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593579950599893:6518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:58.937444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593579950599893:6518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:58.950799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593579950599893:6518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:58.985956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593579950599893:6518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:58.986004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593579950599893:6518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:58.986023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593579950599893:6518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:58.986056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:59.005994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593584245567366:6504]
2025-10-10T14:03:59.031092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:59.032646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:59.033528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:59.033556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:59.033601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:59.033877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:59.034085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593582667648639:5892]
2025-10-10T14:03:59.035657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:59.036594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:59.036765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:59.038167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:59.038537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:59.038546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:59.038554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:59.038561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:59.038569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:59.038578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:59.038585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:59.038592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:59.038601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.038610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.038618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.038627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.038679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:59.038805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:59.038862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:59.038917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:59.038969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:59.039027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:59.039079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:59.039129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:59.039180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.039234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.039288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.039341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.039385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:59.039459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:59.039524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:59.039589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:59.039646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:59.039708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:59.039905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:59.039970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:59.040029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:59.040093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:59.040145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:59.040204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:59.040258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:59.040321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:59.040371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:59.040431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:59.040490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.040551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.040604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.040665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.040717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.040782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.040835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.040895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.041416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:59.072248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:59.134091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:59.134137Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:59.134154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:59.134175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:59.134198Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 402 [2:7559593582667648639:5892]
2025-10-10T14:03:59.134257Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:59.134317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:59.134333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:59.134346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:59.134357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:59.134407Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:59.134428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:59.134449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:59.136443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.136460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.136474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.136488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.136501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:59.136781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:59.136800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.136957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.138547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 402
2025-10-10T14:03:59.138638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 402
2025-10-10T14:03:59.138706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 402, pipe: [1:7559593584245567366:6504]
2025-10-10T14:03:59.138871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.139203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.139360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:59.139464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593579950600016:6518], now have 1 active actors on pipe
2025-10-10T14:03:59.139494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593579950599870:2442], now have 1 active actors on pipe
2025-10-10T14:03:59.139520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593584245567366:6504], now have 1 active actors on pipe
2025-10-10T14:03:59.139576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:59.139601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:59.139657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.139673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.139686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.139713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.139749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:59.139848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:59.140042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:59.140061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:59.140120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:59.140150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:59.140166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:59.140178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:59.140213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:59.140255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:59.140393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.140413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:59.140459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:59.141968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:59.141983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:59.141996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:59.142009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:59.142037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:59.151128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 403 partition: 0 MaxSeqNo: 36 sessionId: src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0
2025-10-10T14:03:59.146861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:59.146902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:59.146988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:59.153951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e794e63a-68be5df2-a602e0f-d88809b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:59.212454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0] Write session: try to update token
2025-10-10T14:03:59.212509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:59.315714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:59.315742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:59.315755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:59.315821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:03:59.315836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:59.315850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:03:59.315860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:03:59.315871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:03:59.315907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.315932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.315956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.315977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.316173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:03:59.316201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.316213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:03:59.317276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:03:59.317319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:03:59.317348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:03:59.317378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:03:59.321376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:03:59.406645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId: src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:03:59.430752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:03:59.536617Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:03:59.550215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:59.550263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:59.550327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:59.550342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:59.550386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593582667648634:5892]
2025-10-10T14:03:59.550922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:59.552040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:03:59.555295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:03:59.555340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:03:59.613363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:03:59.613594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593584245567366:6504]
2025-10-10T14:03:59.614215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 403 reason: error at write: Disconnected sessionId: src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0
2025-10-10T14:03:59.614549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 403 sessionId: src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0 is DEAD
2025-10-10T14:03:59.618133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:03:59.618170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0] Write session will restart in 0.009395s
2025-10-10T14:03:59.618269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0] Write session: Do CDS request
2025-10-10T14:03:59.618297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:03:59.653044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:59.657536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:03:59.657571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 404
2025-10-10T14:03:59.661406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:03:59.661587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:03:59.661612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:03:59.661625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:03:59.666794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 404 sessionId:  describe result for acl check
2025-10-10T14:03:59.666941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:03:59.666953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:03:59.666963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:03:59.666980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593584245567581:6528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:03:59.674475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593584245567581:6528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:03:59.687084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593584245567581:6528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:03:59.695172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:03:59.697891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593584245567581:6528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:03:59.697940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593584245567581:6528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:03:59.697959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593584245567581:6528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:03:59.697992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:03:59.703479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:03:59.704464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:03:59.704496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:03:59.704545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:03:59.704852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:03:59.705062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593582667648891:5896]
2025-10-10T14:03:59.707480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:03:59.708554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:03:59.708784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:03:59.710149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:03:59.710510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:59.710519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:59.710528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:59.710535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:59.710542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:59.710550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:59.710557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:59.710564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:59.710572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.710580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.710587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.710595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.710647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:59.710766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:59.710820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:59.710886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:59.710940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:59.710995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:59.711060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:59.711111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:59.711164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.711216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.711268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.711316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.711362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:59.711435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:03:59.711498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:59.711559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:03:59.711613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:59.711673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:03:59.711722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:59.711781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:03:59.711850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:59.711909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:03:59.711959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:59.712019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:03:59.712073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:59.712132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:03:59.712182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:59.712242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:03:59.712297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.712356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.712406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.712467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.712520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.712578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.712626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.712686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.713253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:03:59.721274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593584245567666:6504]
2025-10-10T14:03:59.743910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:03:59.759061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:03:59.759107Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:03:59.759123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:03:59.759144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:03:59.759166Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 403 [2:7559593582667648891:5896]
2025-10-10T14:03:59.759223Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:03:59.759278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:03:59.759292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:59.759305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:59.759315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:59.759363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:03:59.759384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:03:59.759407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:03:59.791603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.791635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.791652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.791665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.791678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:03:59.791988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:03:59.792006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:03:59.792166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:03:59.792376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:03:59.792641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:03:59.792783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:03:59.792861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593582667648885:5896]
2025-10-10T14:03:59.792879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593582667648885:5896]
2025-10-10T14:03:59.792894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593582667648885:5896]
2025-10-10T14:03:59.792908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593582667648885:5896]
2025-10-10T14:03:59.792955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:03:59.793046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:03:59.793279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:03:59.793297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:03:59.793439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593582667648885:5896]
2025-10-10T14:03:59.793463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:03:59.795499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 403
2025-10-10T14:03:59.795602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 403
2025-10-10T14:03:59.794109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:03:59.794133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:03:59.794145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:03:59.794158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:03:59.794185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:03:59.794678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593584245567439:2442], now have 1 active actors on pipe
2025-10-10T14:03:59.794711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593584245567660:6528], now have 1 active actors on pipe
2025-10-10T14:03:59.794744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593584245567666:6504], now have 1 active actors on pipe
2025-10-10T14:03:59.796213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:59.796241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:59.796313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:03:59.796343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:59.796362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:59.796372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:03:59.796409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:59.796448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:03:59.796494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:59.797151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:03:59.797174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:03:59.797238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:03:59.795663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 403, pipe: [1:7559593584245567666:6504]
2025-10-10T14:03:59.797815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 404 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0
2025-10-10T14:03:59.798609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba3a05f-9abbb95e-dbc3e32f-a81a4639_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:03:59.828614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0] Write session: try to update token
2025-10-10T14:03:59.828673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:03:59.860341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:03:59.860382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:03:59.860420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593582667648885:5896]
2025-10-10T14:03:59.860541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:03:59.860553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:03:59.860564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:03:59.860567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:03:59.860622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:03:59.885854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:03:59.887207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:59.888390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:59.900389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:03:59.902393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:03:59.902848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:00.011231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId: src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:00.080468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:00.080969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:00.080997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:00.081008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:00.081063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:00.081076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:00.081089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:00.081099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:00.081110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:00.081169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593582667648885:5896]
2025-10-10T14:04:00.081195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593582667648885:5896]
2025-10-10T14:04:00.081220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593582667648885:5896]
2025-10-10T14:04:00.081245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593582667648885:5896]
2025-10-10T14:04:00.081388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:00.081424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:00.081436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:00.082558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:00.085313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:00.085376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:00.085409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:00.085442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:00.309465Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:00.316505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:00.318577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:00.320399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:00.320529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:00.320541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:00.319582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:00.331100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593584245567666:6504]
2025-10-10T14:04:00.382465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 404 reason: error at write: Disconnected sessionId: src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0
2025-10-10T14:04:00.382789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 404 sessionId: src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0 is DEAD
2025-10-10T14:04:00.386063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:00.386141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0] Write session will restart in 0.007900s
2025-10-10T14:04:00.386331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0] Write session: Do CDS request
2025-10-10T14:04:00.386394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:00.400314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:00.400355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 405
2025-10-10T14:04:00.401369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:00.401942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:00.402072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:00.402087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:00.402097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:00.403543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 405 sessionId:  describe result for acl check
2025-10-10T14:04:00.403660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:00.403670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:00.403678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:00.403694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593588540535011:6534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:00.406303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593588540535011:6534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:00.428041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593588540535034:6504]
2025-10-10T14:04:00.434552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593588540535011:6534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:00.469247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593588540535011:6534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:00.469298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593588540535011:6534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:00.469317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593588540535011:6534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:00.469350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:00.565829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:00.566897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:00.567620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:00.567638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:00.567682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:00.567951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:00.568146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593586962616459:5908]
2025-10-10T14:04:00.571392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:00.572725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:00.572951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:00.574259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:00.574612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:00.574620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:00.574628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:00.574636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:00.574642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:00.574648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:00.574655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:00.574660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:00.574667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:00.574674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:00.574683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:00.574690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:00.574738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:00.574850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:00.574899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:00.574946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:00.574993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:00.575041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:00.575084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:00.575127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:00.575168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:00.575215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:00.575260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:00.575304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:00.575345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:00.575408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:00.575467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:00.575520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:00.575569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:00.575626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:00.575669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:00.575721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:00.575766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:00.575820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:00.575881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:00.575933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:00.575979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:00.576032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:00.576076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:00.576128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:00.576174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:00.576227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:00.576269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:00.576321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:00.576369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:00.576421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:00.576465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:00.576516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:00.576936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:00.611450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:00.625908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:00.625954Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:00.625972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:00.625993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:00.626018Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 404 [2:7559593586962616459:5908]
2025-10-10T14:04:00.626075Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:00.641301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:00.641349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:00.641361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:00.641373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:00.641440Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:00.641467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:00.641492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:00.643874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:00.643914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:00.643928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:00.643940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:00.643951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:00.644237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:00.644254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:00.644390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:00.644550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:00.644747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:00.644849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:00.644930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593586962616453:5908]
2025-10-10T14:04:00.644947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593586962616453:5908]
2025-10-10T14:04:00.644958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593586962616453:5908]
2025-10-10T14:04:00.644970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593586962616453:5908]
2025-10-10T14:04:00.645018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:00.645104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:00.645290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:00.645308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:00.645439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593586962616453:5908]
2025-10-10T14:04:00.645458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:00.645721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:00.645733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:00.645744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:00.645755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:00.645777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:00.647571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 404
2025-10-10T14:04:00.647683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 404
2025-10-10T14:04:00.647741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 404, pipe: [1:7559593588540535034:6504]
2025-10-10T14:04:00.650385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 405 partition: 0 MaxSeqNo: 36 sessionId: src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0
2025-10-10T14:04:00.653685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d37ec25-9decc17f-33ec6f77-d9a46b2f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:00.648948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593588540534992:2442], now have 1 active actors on pipe
2025-10-10T14:04:00.648994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593588540535097:6534], now have 1 active actors on pipe
2025-10-10T14:04:00.649028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593588540535034:6504], now have 1 active actors on pipe
2025-10-10T14:04:00.649102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:00.649137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:00.649220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:00.649257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:00.649276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:00.649288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:00.649329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:00.649376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:00.649436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:00.649985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:00.650019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:00.650112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:00.716550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0] Write session: try to update token
2025-10-10T14:04:00.716616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:00.748504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:00.748540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:00.748553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:00.855026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:00.855063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:00.855078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:00.855092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:00.855105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:00.855146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593586962616453:5908]
2025-10-10T14:04:00.855174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593586962616453:5908]
2025-10-10T14:04:00.855199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593586962616453:5908]
2025-10-10T14:04:00.855222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593586962616453:5908]
2025-10-10T14:04:00.855402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:00.855417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:00.855428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:00.855480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:00.855508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:00.855519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:00.856705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:00.857342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:00.857387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:00.857446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:00.857501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:00.994982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId: src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:01.024683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:01.192953Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:01.203355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:01.203412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:01.206872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:01.207014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:01.207025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:01.222521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593588540535034:6504]
2025-10-10T14:04:01.222643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 405 reason: error at write: Disconnected sessionId: src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0
2025-10-10T14:04:01.222988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 405 sessionId: src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0 is DEAD
2025-10-10T14:04:01.231774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:01.231818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0] Write session will restart in 0.008451s
2025-10-10T14:04:01.231937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0] Write session: Do CDS request
2025-10-10T14:04:01.231968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:01.249206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:01.296347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:01.296388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 406
2025-10-10T14:04:01.297160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:01.297306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:01.297335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:01.297349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:01.302263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 406 sessionId:  describe result for acl check
2025-10-10T14:04:01.302396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:01.302405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:01.302414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:01.302430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593592835502570:6548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:01.304886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593592835502570:6548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:01.331304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593592835502611:6504]
2025-10-10T14:04:01.337642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:01.394684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593592835502570:6548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:01.490404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593592835502570:6548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:01.490454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593592835502570:6548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:01.490473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593592835502570:6548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:01.490512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:01.545585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:01.546114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:01.546894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:01.546912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:01.546960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:01.547203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:01.547431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593591257584006:5915]
2025-10-10T14:04:01.550498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:01.551670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:01.552011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:01.553458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:01.553786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:01.553795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:01.553801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:01.553807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:01.553814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:01.553821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:01.553828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:01.553834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:01.553840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:01.553848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:01.553855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:01.553862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:01.553910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:01.554012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:01.554056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:01.554099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:01.554140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:01.554181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:01.554222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:01.554266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:01.554327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:01.554375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:01.554415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:01.554458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:01.554497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:01.554558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:01.554614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:01.554677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:01.554721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:01.554778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:01.554821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:01.554873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:01.554920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:01.554971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:01.555014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:01.555064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:01.555110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:01.555165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:01.555207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:01.555260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:01.555314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:01.555365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:01.555427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:01.555497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:01.555543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:01.555597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:01.555641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:01.555691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:01.556141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:01.612738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:01.645755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:01.645794Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:01.645810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:01.645838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:01.645862Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 405 [2:7559593591257584006:5915]
2025-10-10T14:04:01.645911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:01.645976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:01.645990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:01.646000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:01.646011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:01.646056Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:01.646077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:01.646099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:01.648654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:01.648680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:01.648692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:01.648704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:01.648714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:01.654383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 405
2025-10-10T14:04:01.654474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 405, pipe: [1:7559593592835502611:6504]
2025-10-10T14:04:01.654578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 405
2025-10-10T14:04:01.649427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:01.649452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:01.649574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:01.649721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:01.649895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:01.650024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:01.650072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593592835502791:6548], now have 1 active actors on pipe
2025-10-10T14:04:01.650092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593592835502611:6504], now have 1 active actors on pipe
2025-10-10T14:04:01.650111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593592835502553:2442], now have 1 active actors on pipe
2025-10-10T14:04:01.650179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593591257584001:5915]
2025-10-10T14:04:01.650192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593591257584001:5915]
2025-10-10T14:04:01.650203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593591257584001:5915]
2025-10-10T14:04:01.650212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593591257584001:5915]
2025-10-10T14:04:01.650252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:01.650328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:01.650469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:01.650485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:01.650605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593591257584001:5915]
2025-10-10T14:04:01.650623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:01.652178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:01.652193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:01.652203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:01.652213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:01.652239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:01.665748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:01.665797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:01.665903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:01.665942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:01.665963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:01.665973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:01.666009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:01.666058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:01.666106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:01.681621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:01.681667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:01.681746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:01.682840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 406 partition: 0 MaxSeqNo: 36 sessionId: src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0
2025-10-10T14:04:01.688704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21379ab-5db2cc3c-3c08bc54-bbccf6be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:01.749326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:01.749359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:01.749371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:01.758738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0] Write session: try to update token
2025-10-10T14:04:01.758798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:01.867913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:01.868202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:01.868218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:01.868279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:01.868296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:01.868309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:01.868322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:01.868333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:01.868370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593591257584001:5915]
2025-10-10T14:04:01.868402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593591257584001:5915]
2025-10-10T14:04:01.868424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593591257584001:5915]
2025-10-10T14:04:01.868444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593591257584001:5915]
2025-10-10T14:04:01.868575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:01.868588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:01.868613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:01.868623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:01.868624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:01.868651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:01.868678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:01.925214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:01.979960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId: src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:02.032585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:02.153049Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:02.199093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:02.199139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:02.202960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:02.203003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:02.205370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593592835502611:6504]
2025-10-10T14:04:02.205509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:02.204013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:02.237595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:02.237641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0] Write session will restart in 0.009453s
2025-10-10T14:04:02.237743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0] Write session: Do CDS request
2025-10-10T14:04:02.237774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:02.234772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 406 reason: error at write: Disconnected sessionId: src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0
2025-10-10T14:04:02.235088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 406 sessionId: src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0 is DEAD
2025-10-10T14:04:02.252788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:02.253912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:02.253942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 407
2025-10-10T14:04:02.263522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:02.263687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:02.263704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:02.263716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:02.265885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 407 sessionId:  describe result for acl check
2025-10-10T14:04:02.266037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:02.266050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:02.266061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:02.266079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593597130470146:6557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:02.269004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593597130470146:6557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:02.288737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593597130470146:6557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:02.305611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593597130470210:6504]
2025-10-10T14:04:02.308135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593597130470146:6557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:02.308182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593597130470146:6557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:02.308203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593597130470146:6557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:02.308237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:02.389319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:02.392202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:02.393216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:02.393233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:02.393280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:02.393592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:02.393788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593595552551569:5927]
2025-10-10T14:04:02.395958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:02.397035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:02.397315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:02.398580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:02.398909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:02.398916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:02.398922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:02.398929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:02.398935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:02.398941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:02.398947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:02.398954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:02.398961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:02.398968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:02.398974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:02.398980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:02.399027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:02.399130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:02.399168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:02.399204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:02.399254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:02.399293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:02.399330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:02.399368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:02.399401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:02.399437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:02.399472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:02.399505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:02.399540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:02.399599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:02.399649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:02.399693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:02.399734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:02.399779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:02.399816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:02.399874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:02.399927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:02.399978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:02.400017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:02.400064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:02.400107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:02.400155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:02.400198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:02.400248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:02.400292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:02.400344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:02.400383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:02.400435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:02.400477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:02.400523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:02.400564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:02.400617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:02.401283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:02.443930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:02.472742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:02.472985Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:02.473011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:02.473033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:02.473057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 406 [2:7559593595552551569:5927]
2025-10-10T14:04:02.473138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:02.473199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:02.473215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:02.473230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:02.473243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:02.473298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:02.473321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:02.473347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:02.474985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:02.475004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:02.475021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:02.475036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:02.475048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:02.475342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:02.475362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:02.475531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:02.475753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:02.476040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:02.476176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:02.476254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:02.476269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:02.476284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:02.476299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:02.476333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:02.476422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:02.476633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:02.476651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:02.476788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:02.476811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:02.477775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:02.477798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:02.477810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:02.477823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:02.477848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:02.478866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593597130470223:6557], now have 1 active actors on pipe
2025-10-10T14:04:02.478896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593597130470210:6504], now have 1 active actors on pipe
2025-10-10T14:04:02.478921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593597130470129:2442], now have 1 active actors on pipe
2025-10-10T14:04:02.483103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:02.483143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:02.483239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:02.483272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:02.483291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:02.483301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:02.483340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:02.483384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:02.483435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:02.484180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:02.484212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:02.484285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:02.482584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 406
2025-10-10T14:04:02.482670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 406, pipe: [1:7559593597130470210:6504]
2025-10-10T14:04:02.482743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 406
2025-10-10T14:04:02.484646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 407 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0
2025-10-10T14:04:02.493476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78854f2f-45dbc1c0-b1183589-32ddfae2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:02.548151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0] Write session: try to update token
2025-10-10T14:04:02.548217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:02.573987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:02.574029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:02.574043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:02.677014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:02.677069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:02.677103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:02.778059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:02.778094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:02.778107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:02.814510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId: src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:02.903440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:02.920137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:02.920173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:02.920188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:02.920198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:02.920208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:02.920248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:02.920275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:02.920297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:02.920317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:02.920492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:02.920504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:02.920515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:02.920618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:02.920644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:02.921296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:02.921327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:02.921354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:02.921380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:02.947617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:02.947671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:02.947682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:02.948758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:03.180279Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:03.182827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:03.182854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:03.182902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593595552551564:5927]
2025-10-10T14:04:03.183244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:03.185488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593597130470210:6504]
2025-10-10T14:04:03.185636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:03.185850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:03.185874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:03.184381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:03.203412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 407 reason: error at write: Disconnected sessionId: src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0
2025-10-10T14:04:03.203736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 407 sessionId: src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0 is DEAD
2025-10-10T14:04:03.209472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:03.209546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0] Write session will restart in 0.005313s
2025-10-10T14:04:03.209713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0] Write session: Do CDS request
2025-10-10T14:04:03.209770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:03.246749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:03.273996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:03.274035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 408
2025-10-10T14:04:03.281325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:03.281511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:03.281530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:03.281542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:03.285365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593601425437721:6504]
2025-10-10T14:04:03.286460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 408 sessionId:  describe result for acl check
2025-10-10T14:04:03.286581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:03.286591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:03.286601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:03.286619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593601425437732:6570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:03.289533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593601425437732:6570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:03.303835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593601425437732:6570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:03.326728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593601425437732:6570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:03.326773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593601425437732:6570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:03.326791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593601425437732:6570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:03.326824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:03.380574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:03.391068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:03.392027Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:03.392047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:03.392101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:03.392427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:03.392630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593599847519128:5936]
2025-10-10T14:04:03.398300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:03.400888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:03.401204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:03.402618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:03.402983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:03.402993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:03.403000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:03.403009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:03.403017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:03.403024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:03.403033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:03.403041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:03.403048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:03.403055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:03.403063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:03.403071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:03.403124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:03.403243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:03.403302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:03.403358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:03.403410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:03.403461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:03.403525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:03.403576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:03.403628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:03.404344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:03.404413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:03.404463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:03.404521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:03.404597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:03.404663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:03.404723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:03.404776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:03.404835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:03.404889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:03.404952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:03.405009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:03.405066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:03.405116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:03.405200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:03.405265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:03.405331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:03.405387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:03.405456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:03.405515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:03.405590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:03.405644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:03.405713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:03.405771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:03.405834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:03.405885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:03.405950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:03.406502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:03.520441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:03.546564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:03.546614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:03.546640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:03.546662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:03.546689Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 407 [2:7559593599847519128:5936]
2025-10-10T14:04:03.546750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:03.546817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:03.546834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:03.546848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:03.546860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:03.546909Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:03.546932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:03.546956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:03.549857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:03.549891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:03.549909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:03.549926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:03.549939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:03.550263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:03.550285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:03.550450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:03.550670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:03.550933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:03.551069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:03.551153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:03.551170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:03.551185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:03.551201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:03.551250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:03.551365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:03.551588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:03.551604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:03.551737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:03.551763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:03.553597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:03.553616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:03.553629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:03.553644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:03.553671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:03.568671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593601425437829:6570], now have 1 active actors on pipe
2025-10-10T14:04:03.569069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 407
2025-10-10T14:04:03.569178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 407, pipe: [1:7559593601425437721:6504]
2025-10-10T14:04:03.569261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 407
2025-10-10T14:04:03.572646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593601425437721:6504], now have 1 active actors on pipe
2025-10-10T14:04:03.572704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593601425437706:2442], now have 1 active actors on pipe
2025-10-10T14:04:03.572772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:03.572802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:03.572908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:03.572945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:03.572966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:03.572980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:03.573020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:03.573064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:03.573139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:03.575989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:03.576029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:03.576104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:03.577790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 408 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0
2025-10-10T14:04:03.584971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a5cfc65-d257a17f-a1f88468-63a1fd12_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:03.646881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:03.646918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:03.646933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:03.710393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0] Write session: try to update token
2025-10-10T14:04:03.710460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:03.832443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:03.841229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:03.841261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:03.841346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:03.841360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:03.841375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:03.841386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:03.841411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:03.841452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:03.841481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:03.841510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:03.841536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:03.841778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:03.841807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:03.841818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:03.845278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:03.845330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:03.845361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:03.845388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:03.862564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:04.105268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId: src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:04.156605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:04.342267Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:04.368955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:04.369005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:04.369079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:04.369094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:04.374684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:04.374715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:04.378676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593601425437721:6504]
2025-10-10T14:04:04.378814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:04.375666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593599847519123:5936]
2025-10-10T14:04:04.376846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:04.377430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:04.479238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593605720405314:6504]
2025-10-10T14:04:04.489537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 408 reason: error at write: Disconnected sessionId: src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0
2025-10-10T14:04:04.489912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 408 sessionId: src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0 is DEAD
2025-10-10T14:04:04.493642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:04.493684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0] Write session will restart in 0.009672s
2025-10-10T14:04:04.493790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0] Write session: Do CDS request
2025-10-10T14:04:04.493822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:04.510671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:04.516982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:04.517027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 409
2025-10-10T14:04:04.521440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:04.521598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:04.521615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:04.521626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:04.526262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 409 sessionId:  describe result for acl check
2025-10-10T14:04:04.526395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:04.526408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:04.526418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:04.526436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593605720405365:6581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:04.531168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593605720405365:6581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:04.544857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593605720405365:6581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:04.553097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593605720405365:6581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:04.553154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593605720405365:6581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:04.553171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593605720405365:6581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:04.553204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:04.679047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:04.683380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:04.684488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:04.684510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:04.684565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:04.684883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:04.685092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593604142486708:5954]
2025-10-10T14:04:04.687379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:04.688381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:04.688543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:04.689618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:04.689904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:04.689920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:04.689928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:04.689936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:04.689944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:04.689951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:04.689957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:04.689966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:04.689974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:04.689981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:04.689988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:04.689996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:04.690047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:04.690163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:04.690222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:04.690280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:04.690339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:04.690411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:04.690469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:04.690524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:04.690577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:04.690635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:04.690688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:04.690742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:04.690791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:04.690868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:04.690940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:04.691009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:04.691068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:04.691131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:04.691186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:04.691249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:04.691305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:04.691369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:04.691422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:04.691487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:04.691545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:04.691605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:04.691660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:04.691721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:04.691781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:04.691845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:04.691900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:04.691974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:04.692030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:04.692096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:04.692149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:04.692215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:04.692611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:04.775181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:04.789517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:04.789573Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:04.789595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:04.789619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:04.789643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 408 [2:7559593604142486708:5954]
2025-10-10T14:04:04.789708Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:04.789774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:04.789790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:04.789805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:04.789818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:04.789870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:04.789893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:04.789916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:04.791389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:04.791408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:04.791424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:04.791441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:04.791455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:04.791775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:04.791798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:04.791985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:04.792201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:04.792465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:04.792597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:04.794327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 408
2025-10-10T14:04:04.794435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 408
2025-10-10T14:04:04.794507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 408, pipe: [1:7559593605720405314:6504]
2025-10-10T14:04:04.792681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:04.792709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:04.792725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:04.792740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:04.792773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:04.792860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:04.793064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:04.793081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:04.793155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:04.793168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:04.793180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:04.793192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:04.793514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:04.793542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:04.793602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593605720405314:6504], now have 1 active actors on pipe
2025-10-10T14:04:04.793628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593605720405287:2442], now have 1 active actors on pipe
2025-10-10T14:04:04.793667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593605720405428:6581], now have 1 active actors on pipe
2025-10-10T14:04:04.793829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:04.795381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:04.795418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:04.795502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:04.795536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:04.795557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:04.795569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:04.795605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:04.795648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:04.795699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:04.796522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:04.796551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:04.796625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:04.797684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 409 partition: 0 MaxSeqNo: 36 sessionId: src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0
2025-10-10T14:04:04.805402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b9313f-9f17213f-5e93a5bd-102f709e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:04.863108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0] Write session: try to update token
2025-10-10T14:04:04.863174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:04.890996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:04.891032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:04.891045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:04.963964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:04.963996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:04.964009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:04.964021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:04.964033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:04.964069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:04.964097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:04.964123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:04.964146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:04.964273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:04.964310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:04.964348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:04.964358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:04.964380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:04.964387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:04.964398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:05.050419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:05.093261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId: src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:05.142364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:05.300914Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:05.315011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:05.315056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:05.315115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:05.315129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:05.315172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593604142486703:5954]
2025-10-10T14:04:05.315571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:05.315816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:05.320196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593605720405314:6504]
2025-10-10T14:04:05.320291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:05.320406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:05.326285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 409 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0
2025-10-10T14:04:05.326664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 409 sessionId: src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0 is DEAD
2025-10-10T14:04:05.329729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:05.329767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0] Write session will restart in 0.006155s
2025-10-10T14:04:05.329887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0] Write session: Do CDS request
2025-10-10T14:04:05.329940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:05.345005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:05.344133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:05.344168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 410
2025-10-10T14:04:05.349383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:05.349523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:05.349537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:05.349555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:05.357480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 410 sessionId:  describe result for acl check
2025-10-10T14:04:05.357613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:05.357630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:05.357641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:05.357659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593610015372886:6597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:05.360410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593610015372886:6597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:05.389178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593610015372886:6597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:05.418268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593610015372914:6504]
2025-10-10T14:04:05.433235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593610015372886:6597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:05.433283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593610015372886:6597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:05.433300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593610015372886:6597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:05.433335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:05.655627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:05.661435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:05.662389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:05.662407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:05.662454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:05.662710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:05.662892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593608437454274:5965]
2025-10-10T14:04:05.664969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:05.669569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:05.669840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:05.671206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:05.671550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:05.671558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:05.671565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:05.671573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:05.671581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:05.671587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:05.671593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:05.671600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:05.671608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:05.671614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:05.671621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:05.671628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:05.671677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:05.671789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:05.671838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:05.671885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:05.671932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:05.671999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:05.672043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:05.672089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:05.672135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:05.672184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:05.672227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:05.672272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:05.672314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:05.672380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:05.672439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:05.672490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:05.672537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:05.672589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:05.672634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:05.672687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:05.672732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:05.672786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:05.672830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:05.672880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:05.672928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:05.673007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:05.673055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:05.673108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:05.685379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:05.685475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:05.685528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:05.685585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:05.685638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:05.685696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:05.685740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:05.685793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:05.686241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
E1010 14:04:05.806630005  112376 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:04:05.809213Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:04:05.828172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:05.861250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:05.861300Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:05.861317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:05.861337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:05.861363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 409 [2:7559593608437454274:5965]
2025-10-10T14:04:05.861423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:05.861488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:05.861505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:05.861517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:05.861528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:05.861578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:05.861603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:05.861626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:05.863080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:05.863098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:05.863111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:05.863124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:05.863134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:05.863410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:05.863426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:05.863564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:05.863749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:05.863986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:05.864101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:05.864175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:05.864190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:05.864202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:05.864215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:05.864398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:05.864411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:05.864423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:05.864433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:05.866261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 409, pipe: [1:7559593610015372914:6504]
2025-10-10T14:04:05.866370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 409
2025-10-10T14:04:05.866440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 409
2025-10-10T14:04:05.878362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:05.878512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:05.878724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:05.878741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:05.878792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593610015372914:6504], now have 1 active actors on pipe
2025-10-10T14:04:05.878819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593610015372921:6597], now have 1 active actors on pipe
2025-10-10T14:04:05.878843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593610015372877:2442], now have 1 active actors on pipe
2025-10-10T14:04:05.878898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:05.878920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:05.879078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:05.879121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:05.879201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|baf42888-4638136-e61ccbb-657c8150_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:05.879237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:05.879256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:05.879267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:05.879309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:05.879353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:05.879489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:05.880017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:05.881831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:05.881864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:05.881940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:05.882311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 410 partition: 0 MaxSeqNo: 36 sessionId: src_id|baf42888-4638136-e61ccbb-657c8150_0
2025-10-10T14:04:05.885751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c957b84-e943e775-916a03b8-6a2efd5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|baf42888-4638136-e61ccbb-657c8150_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:05.934439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baf42888-4638136-e61ccbb-657c8150_0] Write session: try to update token
2025-10-10T14:04:05.934499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baf42888-4638136-e61ccbb-657c8150_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:05.965336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:05.965367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:05.965380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:06.036379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:06.045150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:06.045186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:06.045197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:06.045207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:06.045245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:06.045269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:06.045291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:06.045321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:06.045572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:06.045600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:06.045610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:06.049276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:06.049324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:06.049352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:06.049378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:06.072490Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:06.161221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId: src_id|baf42888-4638136-e61ccbb-657c8150_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:06.204826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:06.279533Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:06.291685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:06.291729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:06.291790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:06.291803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:06.291841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593608437454269:5965]
2025-10-10T14:04:06.293726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:06.295482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:06.295511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:06.297771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:06.301242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:06.301380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593610015372914:6504]
2025-10-10T14:04:06.348231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 410 reason: error at write: Disconnected sessionId: src_id|baf42888-4638136-e61ccbb-657c8150_0
2025-10-10T14:04:06.348586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 410 sessionId: src_id|baf42888-4638136-e61ccbb-657c8150_0 is DEAD
2025-10-10T14:04:06.353772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf42888-4638136-e61ccbb-657c8150_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:06.353813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf42888-4638136-e61ccbb-657c8150_0] Write session will restart in 0.008599s
2025-10-10T14:04:06.353903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf42888-4638136-e61ccbb-657c8150_0] Write session: Do CDS request
2025-10-10T14:04:06.353933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf42888-4638136-e61ccbb-657c8150_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:06.372033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|baf42888-4638136-e61ccbb-657c8150_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:06.377269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:06.377308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 411
2025-10-10T14:04:06.377834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:06.377969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:06.377986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:06.377996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:06.382867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 411 sessionId:  describe result for acl check
2025-10-10T14:04:06.383014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:06.383034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:06.383043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:06.383062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593614310340469:6606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:06.386151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593614310340469:6606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:06.400344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593614310340516:6504]
2025-10-10T14:04:06.407717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593614310340469:6606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:06.433762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593614310340469:6606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:06.433808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593614310340469:6606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:06.433826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593614310340469:6606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:06.433861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:06.506069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:06.510488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:06.511436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:06.511467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:06.511515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:06.511789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:06.511982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593612732421825:5974]
2025-10-10T14:04:06.514738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:06.516177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:06.516417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:06.517632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:06.517974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:06.517981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:06.517988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:06.517995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:06.518003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:06.518009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:06.518015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:06.518024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:06.518030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:06.518036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:06.518043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:06.518050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:06.518093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:06.518198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:06.518244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:06.518293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:06.518339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:06.518386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:06.518445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:06.518487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:06.518531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:06.518579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:06.518623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:06.518667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:06.518712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:06.518774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:06.518829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:06.518880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:06.518927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:06.518978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:06.519022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:06.519071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:06.519117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:06.519166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:06.519208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:06.519258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:06.519303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:06.519354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:06.519396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:06.519446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:06.519491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:06.519539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:06.519581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:06.519633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:06.519677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:06.519725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:06.519768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:06.519819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:06.520264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:06.566451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:06.673183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:06.673225Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:06.673240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:06.673258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:06.673280Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 410 [2:7559593612732421825:5974]
2025-10-10T14:04:06.673333Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:06.673387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:06.673413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:06.673426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:06.673436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:06.673486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:06.673508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:06.673529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:06.675852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:06.675870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:06.675895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:06.675908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:06.675918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:06.676223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:06.676238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:06.676369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:06.676674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:06.676908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:06.677021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:06.677096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593612732421819:5974]
2025-10-10T14:04:06.677112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593612732421819:5974]
2025-10-10T14:04:06.677148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593612732421819:5974]
2025-10-10T14:04:06.677160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593612732421819:5974]
2025-10-10T14:04:06.677195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:06.677274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:06.677363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:06.677378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:06.677389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:06.677399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:06.677442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:06.677460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:06.677608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593612732421819:5974]
2025-10-10T14:04:06.677633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:06.677677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:06.677733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593614310340591:6606], now have 1 active actors on pipe
2025-10-10T14:04:06.677754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593614310340516:6504], now have 1 active actors on pipe
2025-10-10T14:04:06.677775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593614310340442:2442], now have 1 active actors on pipe
2025-10-10T14:04:06.682682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:06.682728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:06.682823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17769608-3cd4d374-89ac1d02-d33f126_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:06.682859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:06.682876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:06.682887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:06.682939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:06.682982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:06.683030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:06.684063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:06.684088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:06.684151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:06.682101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 410
2025-10-10T14:04:06.682186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 410, pipe: [1:7559593614310340516:6504]
2025-10-10T14:04:06.682273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 410
2025-10-10T14:04:06.684462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 411 partition: 0 MaxSeqNo: 36 sessionId: src_id|17769608-3cd4d374-89ac1d02-d33f126_0
2025-10-10T14:04:06.689359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|baf42888-4638136-e61ccbb-657c8150_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17769608-3cd4d374-89ac1d02-d33f126_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:06.746027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17769608-3cd4d374-89ac1d02-d33f126_0] Write session: try to update token
2025-10-10T14:04:06.746090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17769608-3cd4d374-89ac1d02-d33f126_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:06.777243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:06.777277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:06.777288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:06.882521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:06.882552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:06.882565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:06.882574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:06.882585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:06.882620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593612732421819:5974]
2025-10-10T14:04:06.882646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593612732421819:5974]
2025-10-10T14:04:06.882669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593612732421819:5974]
2025-10-10T14:04:06.882692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593612732421819:5974]
2025-10-10T14:04:06.882863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:06.882875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:06.882887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:06.882933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:06.882958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:06.882970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:06.883157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:06.883186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:06.883212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:06.883237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:06.887633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:06.946905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId: src_id|17769608-3cd4d374-89ac1d02-d33f126_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:07.007864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:07.087408Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:07.102480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:07.102519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:07.105794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:07.104865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:07.105827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:07.106197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593614310340516:6504]
2025-10-10T14:04:07.106316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:07.135700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 411 reason: error at write: Disconnected sessionId: src_id|17769608-3cd4d374-89ac1d02-d33f126_0
2025-10-10T14:04:07.136066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 411 sessionId: src_id|17769608-3cd4d374-89ac1d02-d33f126_0 is DEAD
2025-10-10T14:04:07.137605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17769608-3cd4d374-89ac1d02-d33f126_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:07.137641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17769608-3cd4d374-89ac1d02-d33f126_0] Write session will restart in 0.008302s
2025-10-10T14:04:07.137738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17769608-3cd4d374-89ac1d02-d33f126_0] Write session: Do CDS request
2025-10-10T14:04:07.137766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17769608-3cd4d374-89ac1d02-d33f126_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:07.156717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17769608-3cd4d374-89ac1d02-d33f126_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:07.155870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:07.155906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 412
2025-10-10T14:04:07.157308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:07.157426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:07.157453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:07.157463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:07.158662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 412 sessionId:  describe result for acl check
2025-10-10T14:04:07.158763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:07.158773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:07.158782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:07.158798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593618605308045:6621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:07.165543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593618605308045:6621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:07.190639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593618605308045:6621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:07.205319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593618605308079:6504]
2025-10-10T14:04:07.215966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593618605308045:6621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:07.216023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593618605308045:6621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:07.216040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593618605308045:6621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:07.216072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:07.361370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:07.381953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:07.382777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:07.382795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:07.382838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:07.383082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:07.383262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593617027389390:5980]
2025-10-10T14:04:07.385684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:07.393478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:07.393733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:07.394835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:07.395128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:07.395135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:07.395142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:07.395149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:07.395154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:07.395160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:07.395166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:07.395173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:07.395181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:07.395188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:07.395194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:07.395200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:07.395240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:07.395335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:07.395376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:07.395420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:07.395462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:07.395504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:07.395541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:07.395578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:07.395643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:07.395682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:07.395720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:07.395760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:07.395798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:07.395858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:07.395907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:07.395953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:07.396011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:07.396054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:07.396093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:07.396140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:07.396181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:07.396226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:07.396267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:07.396318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:07.396357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:07.396403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:07.396440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:07.396484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:07.396524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:07.396569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:07.396609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:07.396653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:07.396696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:07.396744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:07.396783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:07.396826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:07.398283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:07.456467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:07.487670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:07.487713Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:07.487729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:07.487745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:07.487766Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 411 [2:7559593617027389390:5980]
2025-10-10T14:04:07.487817Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:07.487872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:07.487888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:07.487900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:07.487910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:07.487960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:07.487995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:07.488016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:07.498549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:07.498579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:07.498592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:07.498606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:07.498616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:07.498888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:07.498904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:07.499031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:07.499187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:07.499381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:07.499488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:07.499561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.499577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.499589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.499601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.499647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:07.499730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:07.499885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:07.499901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:07.500045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.500065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:07.500935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:07.500953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:07.500964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:07.500976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:07.500999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:07.502358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 411
2025-10-10T14:04:07.502431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 411, pipe: [1:7559593618605308079:6504]
2025-10-10T14:04:07.502500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 411
2025-10-10T14:04:07.502876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593618605308091:6621], now have 1 active actors on pipe
2025-10-10T14:04:07.502910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593618605308079:6504], now have 1 active actors on pipe
2025-10-10T14:04:07.502930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593618605308031:2442], now have 1 active actors on pipe
2025-10-10T14:04:07.502977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:07.503000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:07.503084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:07.503118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:07.503136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:07.503146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:07.503182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:07.503228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:07.503292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:07.513085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:07.513138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:07.513216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:07.513752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 412 partition: 0 MaxSeqNo: 36 sessionId: src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0
2025-10-10T14:04:07.517365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17769608-3cd4d374-89ac1d02-d33f126_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:07.564942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0] Write session: try to update token
2025-10-10T14:04:07.565006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:07.589248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:07.589281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:07.589292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:07.671278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:07.671312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:07.671349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.671458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:07.671481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:07.683951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:07.685239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:07.686489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:07.687654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:07.721236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:07.724650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:07.724668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:07.724680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:07.724741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:07.786342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId: src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:07.835378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:07.860580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:07.860814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:07.860828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:07.860918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:07.860942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:07.860978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:07.860989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:07.860998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:07.861008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:07.861016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:07.861051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.861069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.861089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.861108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593617027389384:5980]
2025-10-10T14:04:07.861301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:07.861325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:07.861335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:07.862324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:07.864117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:07.864156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:07.864183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:07.864211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:08.068400Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:08.070519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:04:08.073234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:08.073325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:08.073532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593618605308079:6504]
2025-10-10T14:04:08.124177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:08.124207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:08.124377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 412 reason: error at write: Disconnected sessionId: src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0
2025-10-10T14:04:08.124637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 412 sessionId: src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0 is DEAD
2025-10-10T14:04:08.128839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:08.128869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0] Write session will restart in 0.009190s
2025-10-10T14:04:08.128960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0] Write session: Do CDS request
2025-10-10T14:04:08.128987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:08.148536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:08.163550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:08.163587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 413
2025-10-10T14:04:08.164054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:08.164164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:08.164185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:08.164194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:08.166751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 413 sessionId:  describe result for acl check
2025-10-10T14:04:08.166877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:08.166894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:08.166903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:08.166920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593622900275634:6630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:08.174167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593622900275645:6504]
2025-10-10T14:04:08.174237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593622900275634:6630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:08.214367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593622900275634:6630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:08.253483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593622900275634:6630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:08.253531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593622900275634:6630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:08.253550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593622900275634:6630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:08.253580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:08.313335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:08.322091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:08.323047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:08.323315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:08.323366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:08.323750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:08.323942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593621322356957:5995]
2025-10-10T14:04:08.326251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:08.328237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:08.328443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:08.329720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:08.330031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:08.330039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:08.330046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:08.330052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:08.330058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:08.330065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:08.330072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:08.330079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:08.330085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:08.330091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:08.330098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:08.330106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:08.330151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:08.330272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:08.330319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:08.330364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:08.330408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:08.330451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:08.330496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:08.330541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:08.330584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:08.330627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:08.330673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:08.330718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:08.330758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:08.330818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:08.330874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:08.330926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:08.330971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:08.331026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:08.331074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:08.331123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:08.331170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:08.331221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:08.331264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:08.331315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:08.331360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:08.331409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:08.331450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:08.331502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:08.331547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:08.331597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:08.331641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:08.331691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:08.331736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:08.331785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:08.331826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:08.331878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:08.332319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:08.443145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:08.456726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:08.456778Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:08.456794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:08.456814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:08.456838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 412 [2:7559593621322356957:5995]
2025-10-10T14:04:08.456892Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:08.456956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:08.456979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:08.456990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:08.457002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:08.457051Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:08.457072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:08.457094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:08.459140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:08.459166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:08.459179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:08.459193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:08.459203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:08.459485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:08.459500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:08.459635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:08.459804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:08.460035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:08.460140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:08.460208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593621322356952:5995]
2025-10-10T14:04:08.460221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593621322356952:5995]
2025-10-10T14:04:08.460233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593621322356952:5995]
2025-10-10T14:04:08.460245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593621322356952:5995]
2025-10-10T14:04:08.460515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:08.460528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:08.460540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:08.460550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:08.461785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:08.461884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:08.462073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:08.462087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:08.462131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593622900275778:6630], now have 1 active actors on pipe
2025-10-10T14:04:08.462152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593622900275595:2442], now have 1 active actors on pipe
2025-10-10T14:04:08.462175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593622900275645:6504], now have 1 active actors on pipe
2025-10-10T14:04:08.462289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593621322356952:5995]
2025-10-10T14:04:08.462319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:08.464031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 412
2025-10-10T14:04:08.464154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 412
2025-10-10T14:04:08.464243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 412, pipe: [1:7559593622900275645:6504]
2025-10-10T14:04:08.462689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:08.468676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:08.468709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:08.468803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:08.468840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:08.468858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:08.468867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:08.468908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:08.468954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:08.469004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:08.471874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:08.471911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:08.471990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:08.474140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 413 partition: 0 MaxSeqNo: 36 sessionId: src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0
2025-10-10T14:04:08.476624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c335ddc1-85b2c115-25ec654f-11f9d878_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:08.539085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0] Write session: try to update token
2025-10-10T14:04:08.539143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:08.554429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:08.554454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:08.554465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:08.620105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:08.620137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:08.620151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:08.620160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:08.620170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:08.620206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593621322356952:5995]
2025-10-10T14:04:08.620230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593621322356952:5995]
2025-10-10T14:04:08.620252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593621322356952:5995]
2025-10-10T14:04:08.620272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593621322356952:5995]
2025-10-10T14:04:08.620413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:08.620437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:08.620449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:08.621234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:08.621264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:08.621292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:08.621318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:08.621496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:08.716225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId: src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:08.755997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:08.804216Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:08.806981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:08.807016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:08.814678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:08.814706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:08.817255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:08.817414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593622900275645:6504]
2025-10-10T14:04:08.822599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 413 reason: error at write: Disconnected sessionId: src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0
2025-10-10T14:04:08.827533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:08.829725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 413 sessionId: src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0 is DEAD
2025-10-10T14:04:08.836482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:08.836549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0] Write session will restart in 0.005508s
2025-10-10T14:04:08.836714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0] Write session: Do CDS request
2025-10-10T14:04:08.836767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:08.852554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:08.852593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 414
2025-10-10T14:04:08.855259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:08.856234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:08.856385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:08.856422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:08.856433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:08.858025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 414 sessionId:  describe result for acl check
2025-10-10T14:04:08.858141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:08.858151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:08.858160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:08.858177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593622900275906:6644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:08.861083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593622900275906:6644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:08.877802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593622900275906:6644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:08.898438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593622900275906:6644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:08.898480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593622900275906:6644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:08.898497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593622900275906:6644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:08.898527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:08.917476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593622900275943:6504]
2025-10-10T14:04:09.040195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:09.051898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:09.052701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:09.052720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:09.052759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:09.052997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:09.053195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593625617324525:6001]
2025-10-10T14:04:09.055279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:09.056547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:09.056743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:09.057917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:09.058212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:09.058221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:09.058227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:09.058233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:09.058240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:09.058246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:09.058253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:09.058260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:09.058265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.058270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.058277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.058283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.058328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:09.058427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:09.058476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:09.058522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:09.058564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:09.058607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:09.058650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:09.058695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:09.058738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.058781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.058821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.058864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.058900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:09.058961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:09.059014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:09.059067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:09.059111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:09.059161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:09.059200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:09.059250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:09.059293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:09.059339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:09.059380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:09.059432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:09.059474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:09.059521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:09.059568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:09.059617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:09.059660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.059711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.059755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.059806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.059860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.059909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.059951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.060002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.060434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:09.126394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:09.140607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:09.140658Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:09.140676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:09.140695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:09.140721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 413 [2:7559593625617324525:6001]
2025-10-10T14:04:09.140776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:09.140843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:09.140858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:09.140870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:09.140881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:09.140931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:09.140954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:09.140976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:09.143340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.143359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.143373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.143386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.143397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:09.143672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:09.143687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.143821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.143996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.144235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.144344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:09.144419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.144433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.144446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.144458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.144489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:09.144568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:09.144735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:09.144751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:09.144878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.144896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:09.145188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:09.145200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:09.145210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:09.145220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:09.145242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:09.147532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 413
2025-10-10T14:04:09.147631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 413, pipe: [1:7559593622900275943:6504]
2025-10-10T14:04:09.147714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 413
2025-10-10T14:04:09.163956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593622900275891:2442], now have 1 active actors on pipe
2025-10-10T14:04:09.164010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593622900275943:6504], now have 1 active actors on pipe
2025-10-10T14:04:09.164048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593622900275941:6644], now have 1 active actors on pipe
2025-10-10T14:04:09.164135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:09.164157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:09.164241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:09.164279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:09.164298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:09.164309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:09.164350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:09.164397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:09.164443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:09.169270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:09.169317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:09.169404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:09.172007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 414 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0
2025-10-10T14:04:09.173103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab6c2da-e4afbd75-907cbcd-e62a85ff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:09.237264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0] Write session: try to update token
2025-10-10T14:04:09.237324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:09.239631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:09.239660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:09.239673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:09.408891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:09.408929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:09.408941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:09.408951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:09.408959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:09.408990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.409014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.409034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.409052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.409175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:09.409209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:09.409239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:09.409262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:09.413381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:09.413407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:09.413418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:09.459722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:09.459771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.459782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:09.460912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:09.475713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId: src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:09.515877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:09.652416Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:09.674832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:09.676801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:09.674865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:09.674907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593625617324520:6001]
2025-10-10T14:04:09.676941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593622900275943:6504]
2025-10-10T14:04:09.675053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:09.677017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:09.675077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:09.677028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:09.675289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:09.680743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 414 reason: error at write: Disconnected sessionId: src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0
2025-10-10T14:04:09.681384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:09.681418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0] Write session will restart in 0.009836s
2025-10-10T14:04:09.681518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0] Write session: Do CDS request
2025-10-10T14:04:09.681546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:09.682989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:09.695878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:09.695005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 414 sessionId: src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0 is DEAD
2025-10-10T14:04:09.699037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:09.699068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 415
2025-10-10T14:04:09.699465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:09.699582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:09.699597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:09.699610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:09.702138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 415 sessionId:  describe result for acl check
2025-10-10T14:04:09.702260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:09.702270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:09.702280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:09.702298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593627195243452:6649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:09.704854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593627195243452:6649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:09.754380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593627195243452:6649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:09.776258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593627195243452:6649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:09.776300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593627195243452:6649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:09.776318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593627195243452:6649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:09.776351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:09.776944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593627195243502:6504]
2025-10-10T14:04:09.976241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:09.984908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:09.985858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:09.985880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:09.985931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:09.986229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:09.986427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593625617324796:6015]
2025-10-10T14:04:09.988835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:09.990476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:09.990721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:09.992157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:09.992509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:09.992517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:09.992524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:09.992532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:09.992539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:09.992549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:09.992558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:09.992565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:09.992572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.992581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.992588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.992596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.992651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:09.992771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:09.992823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:09.992877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:09.992927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:09.992979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:09.993029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:09.993080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:09.993145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.993197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.993246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.993295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.993339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:09.993414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:09.993481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:09.993544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:09.993601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:09.993660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:09.993711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:09.993770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:09.993825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:09.993885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:09.993937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:09.993995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:09.994049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:09.994109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:09.994157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:09.994215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:09.994267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.994327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:09.994379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.994434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:09.994484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.994543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:09.994588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.994647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:09.995124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:10.066460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:10.145476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:10.145526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:10.145544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:10.145563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:10.145587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 414 [2:7559593625617324796:6015]
2025-10-10T14:04:10.145642Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:10.145698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:10.145712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:10.145725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:10.145735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:10.145787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:10.145808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:10.145828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:10.148556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:10.148580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:10.148596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:10.148611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:10.148622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:10.148896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:10.148913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:10.149056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:10.149268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:10.149499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:10.149621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:10.149693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.149709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.149723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.149735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.149770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:10.149852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:10.149865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:10.149881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:10.149894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:10.149906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:10.150046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:10.150064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:10.150214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593627195243501:6649], now have 1 active actors on pipe
2025-10-10T14:04:10.150239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593627195243502:6504], now have 1 active actors on pipe
2025-10-10T14:04:10.150264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593627195243445:2442], now have 1 active actors on pipe
2025-10-10T14:04:10.150285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.150321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:10.155342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 414
2025-10-10T14:04:10.155432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 414, pipe: [1:7559593627195243502:6504]
2025-10-10T14:04:10.155510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 414
2025-10-10T14:04:10.151114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:10.169709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:10.169755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:10.169856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|114c7922-58ede314-741521a6-5d4c0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:10.169890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:10.169909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:10.169921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:10.169958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:10.170000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:10.170056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:10.182928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:10.182977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:10.183059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:10.183373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 415 partition: 0 MaxSeqNo: 36 sessionId: src_id|114c7922-58ede314-741521a6-5d4c0a_0
2025-10-10T14:04:10.184169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4149a0e-32faa7af-7d88b164-1afbb29b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|114c7922-58ede314-741521a6-5d4c0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:10.238818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114c7922-58ede314-741521a6-5d4c0a_0] Write session: try to update token
2025-10-10T14:04:10.238878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114c7922-58ede314-741521a6-5d4c0a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:10.343734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:10.343787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:10.343807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:10.343896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:10.343925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:10.343954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:10.343985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:10.344011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:10.344082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.344134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.344185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.344230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.344542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:10.344584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:10.344606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:10.344658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:10.344711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:10.344747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:10.344781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:10.383643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:10.461278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId: src_id|114c7922-58ede314-741521a6-5d4c0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:10.504732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:10.567452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:10.596444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:10.596783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:10.596869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:10.596884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:10.596947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593625617324791:6015]
2025-10-10T14:04:10.597138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:10.597646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:10.605400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:10.606085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593627195243502:6504]
2025-10-10T14:04:10.606157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:10.647685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 415 reason: status is not ok: tablet will be restarted right now sessionId: src_id|114c7922-58ede314-741521a6-5d4c0a_0
2025-10-10T14:04:10.648010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 415 sessionId: src_id|114c7922-58ede314-741521a6-5d4c0a_0 is DEAD
2025-10-10T14:04:10.649633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c7922-58ede314-741521a6-5d4c0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:10.649682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c7922-58ede314-741521a6-5d4c0a_0] Write session will restart in 0.008556s
2025-10-10T14:04:10.649788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c7922-58ede314-741521a6-5d4c0a_0] Write session: Do CDS request
2025-10-10T14:04:10.649823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c7922-58ede314-741521a6-5d4c0a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:10.665025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:10.665064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 416
2025-10-10T14:04:10.666058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|114c7922-58ede314-741521a6-5d4c0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:10.666695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:10.666824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:10.666839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:10.666851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:10.668235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 416 sessionId:  describe result for acl check
2025-10-10T14:04:10.668340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:10.668350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:10.668359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:10.668376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593631490211055:6665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:10.670932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593631490211055:6665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:10.680642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593631490211055:6665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:10.694261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593631490211055:6665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:10.694309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593631490211055:6665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:10.694328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593631490211055:6665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:10.694359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:10.707866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593631490211085:6504]
2025-10-10T14:04:10.888662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:10.898209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:10.899133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:10.899155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:10.899200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:10.899498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:10.899698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593629912292369:6027]
2025-10-10T14:04:10.902138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:10.907794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:10.908079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:10.909437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:10.909798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:10.909806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:10.909812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:10.909819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:10.909826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:10.909833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:10.909840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:10.909849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:10.909855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:10.909862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:10.909869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:10.909874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:10.909918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:10.910025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:10.910070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:10.910113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:10.910158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:10.910202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:10.910247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:10.910290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:10.910337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:10.910380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:10.910426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:10.910469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:10.910508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:10.910570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:10.910628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:10.910684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:10.910730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:10.910782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:10.910828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:10.910876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:10.910919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:10.910972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:10.911016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:10.911067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:10.911112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:10.911163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:10.911205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:10.911255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:10.911302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:10.911352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:10.911398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:10.911448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:10.911493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:10.911548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:10.911591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:10.911643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:10.912081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:11.075084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:11.104030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:11.104095Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:11.104111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:11.104131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:11.104156Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 415 [2:7559593629912292369:6027]
2025-10-10T14:04:11.104208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:11.104265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:11.104280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:11.104290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:11.104301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:11.104360Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:11.104384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:11.104407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:11.106559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:11.113255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:11.113286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:11.113299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:11.113310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:11.113654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:11.113672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:11.113804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:11.113974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:11.114186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:11.114293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:11.114369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593629912292363:6027]
2025-10-10T14:04:11.114385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593629912292363:6027]
2025-10-10T14:04:11.114397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593629912292363:6027]
2025-10-10T14:04:11.114409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593629912292363:6027]
2025-10-10T14:04:11.114460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:11.114544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:11.114725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:11.114742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:11.114869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593629912292363:6027]
2025-10-10T14:04:11.114888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:11.115806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:11.115824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:11.115837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:11.115846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:11.115871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:11.116902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593631490211085:6504], now have 1 active actors on pipe
2025-10-10T14:04:11.116933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593631490211041:2442], now have 1 active actors on pipe
2025-10-10T14:04:11.116954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593631490211083:6665], now have 1 active actors on pipe
2025-10-10T14:04:11.119976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 415, pipe: [1:7559593631490211085:6504]
2025-10-10T14:04:11.120101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 415
2025-10-10T14:04:11.120177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 415
2025-10-10T14:04:11.123569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:11.123610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:11.123693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de490993-e7d2e512-34cf08ac-fe37131c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:11.123730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:11.123749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:11.123760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:11.123798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:11.123842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:11.123886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:11.124634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:11.124661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:11.124723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:11.129373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 416 partition: 0 MaxSeqNo: 36 sessionId: src_id|de490993-e7d2e512-34cf08ac-fe37131c_0
2025-10-10T14:04:11.134191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|114c7922-58ede314-741521a6-5d4c0a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|de490993-e7d2e512-34cf08ac-fe37131c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:11.173088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de490993-e7d2e512-34cf08ac-fe37131c_0] Write session: try to update token
2025-10-10T14:04:11.173316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de490993-e7d2e512-34cf08ac-fe37131c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:11.209276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:11.209317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:11.209331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:11.266173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:11.266209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:11.266226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:11.266240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:11.266251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:11.266291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593629912292363:6027]
2025-10-10T14:04:11.266321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593629912292363:6027]
2025-10-10T14:04:11.266348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593629912292363:6027]
2025-10-10T14:04:11.266374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593629912292363:6027]
2025-10-10T14:04:11.266530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:11.266561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:11.266575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:11.267018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:11.267058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:11.267093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:11.267124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:11.268835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:11.373265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId: src_id|de490993-e7d2e512-34cf08ac-fe37131c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:11.482207Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:11.493277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:11.493508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:11.493658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:11.493670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:11.577300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593631490211085:6504]
2025-10-10T14:04:11.609019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 416 reason: error at write: Disconnected sessionId: src_id|de490993-e7d2e512-34cf08ac-fe37131c_0
2025-10-10T14:04:11.609384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 416 sessionId: src_id|de490993-e7d2e512-34cf08ac-fe37131c_0 is DEAD
2025-10-10T14:04:11.613189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de490993-e7d2e512-34cf08ac-fe37131c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:11.613223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de490993-e7d2e512-34cf08ac-fe37131c_0] Write session will restart in 0.008900s
2025-10-10T14:04:11.613326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de490993-e7d2e512-34cf08ac-fe37131c_0] Write session: Do CDS request
2025-10-10T14:04:11.613357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de490993-e7d2e512-34cf08ac-fe37131c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:11.632936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de490993-e7d2e512-34cf08ac-fe37131c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:11.643804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:11.643841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 417
2025-10-10T14:04:11.652194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:11.652441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:11.652461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:11.652472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:11.654665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 417 sessionId:  describe result for acl check
2025-10-10T14:04:11.654806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:11.654817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:11.654826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:11.654843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593635785178782:6680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:11.661222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593635785178782:6680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:11.682656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593635785178849:6504]
2025-10-10T14:04:11.688295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593635785178782:6680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:11.713058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593635785178782:6680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:11.713105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593635785178782:6680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:11.713139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593635785178782:6680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:11.713173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:11.713889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:11.715630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:11.716586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:11.716607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:11.716654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:11.716933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:11.717164Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593634207259926:6035]
2025-10-10T14:04:11.719593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:11.727760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:11.728043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:11.729466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:11.729816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:11.729833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:11.729841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:11.729849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:11.729857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:11.729864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:11.729872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:11.729880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:11.729888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:11.729895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:11.729903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:11.729911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:11.729965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:11.730077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:11.730130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:11.730181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:11.730232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:11.730282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:11.730330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:11.730379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:11.730430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:11.730484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:11.730535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:11.730587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:11.730630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:11.730704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:11.730770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:11.730832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:11.730889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:11.730948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:11.730998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:11.731056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:11.731109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:11.731169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:11.731236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:11.731296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:11.731342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:11.731405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:11.731454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:11.731511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:11.731565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:11.731625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:11.731673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:11.731730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:11.731782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:11.731839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:11.731887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:11.731946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:11.732458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:11.768810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:11.844991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:11.845032Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:11.845050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:11.845069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:11.845100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 416 [2:7559593634207259926:6035]
2025-10-10T14:04:11.845185Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:11.845250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:11.845266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:11.845279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:11.845290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:11.845338Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:11.845361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:11.845382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:11.849437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:11.849465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:11.849479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:11.849494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:11.849507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:11.849819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:11.849837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:11.849984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:11.850179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:11.850423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:11.850547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:11.850623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:11.850639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:11.850654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:11.850668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:11.850712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:11.850795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:11.850986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:11.851005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:11.851129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:11.851149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:11.852025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:11.852042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:11.852055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:11.852066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:11.852115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:11.853276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593635785178849:6504], now have 1 active actors on pipe
2025-10-10T14:04:11.853324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593635785178626:2442], now have 1 active actors on pipe
2025-10-10T14:04:11.853348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593635785178866:6680], now have 1 active actors on pipe
2025-10-10T14:04:11.854462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:11.854494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:11.854568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c100d85-38cc2814-6fa28718-179ef540_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:11.854599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:11.854617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:11.854629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:11.854675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:11.854717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:11.854766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:11.853918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 416, pipe: [1:7559593635785178849:6504]
2025-10-10T14:04:11.854047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 416
2025-10-10T14:04:11.854144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 416
2025-10-10T14:04:11.857528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:11.857560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:11.857632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:11.861213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de490993-e7d2e512-34cf08ac-fe37131c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1c100d85-38cc2814-6fa28718-179ef540_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:11.860471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 417 partition: 0 MaxSeqNo: 36 sessionId: src_id|1c100d85-38cc2814-6fa28718-179ef540_0
2025-10-10T14:04:11.913677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c100d85-38cc2814-6fa28718-179ef540_0] Write session: try to update token
2025-10-10T14:04:11.913739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c100d85-38cc2814-6fa28718-179ef540_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:11.945665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:11.945696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:11.945708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:12.077403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:12.077437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:12.077451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:12.077464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:12.077476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:12.077513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:12.077542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:12.077569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:12.077592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:12.077824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:12.077838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:12.077849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:12.077894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:12.077921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:12.077934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:12.078951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:12.081726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:12.081772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:12.081805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:12.081840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:12.137392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId: src_id|1c100d85-38cc2814-6fa28718-179ef540_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:12.174292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:12.254793Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:12.283193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:12.283245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:12.283320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:12.283334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:12.283374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593634207259920:6035]
2025-10-10T14:04:12.283830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:12.284352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:12.284381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:12.289145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593635785178849:6504]
2025-10-10T14:04:12.289234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:12.286999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:12.317386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 417 reason: error at write: Disconnected sessionId: src_id|1c100d85-38cc2814-6fa28718-179ef540_0
2025-10-10T14:04:12.317685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 417 sessionId: src_id|1c100d85-38cc2814-6fa28718-179ef540_0 is DEAD
2025-10-10T14:04:12.325381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c100d85-38cc2814-6fa28718-179ef540_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:12.325426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c100d85-38cc2814-6fa28718-179ef540_0] Write session will restart in 0.007642s
2025-10-10T14:04:12.325536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c100d85-38cc2814-6fa28718-179ef540_0] Write session: Do CDS request
2025-10-10T14:04:12.325563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c100d85-38cc2814-6fa28718-179ef540_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:12.346345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c100d85-38cc2814-6fa28718-179ef540_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:12.349315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:12.349352Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 418
2025-10-10T14:04:12.364854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:12.365034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:12.365050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:12.365060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:12.367163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 418 sessionId:  describe result for acl check
2025-10-10T14:04:12.367296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:12.367309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:12.367319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:12.367337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593640080146234:6690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:12.370644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593640080146234:6690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:12.381906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593640080146234:6690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:12.388770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593640080146276:6504]
2025-10-10T14:04:12.391916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593640080146234:6690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:12.391964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593640080146234:6690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:12.391982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593640080146234:6690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:12.392018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:12.476296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:12.481300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:12.482013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:12.482041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:12.482087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:12.482303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:12.482463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593638502227483:6041]
2025-10-10T14:04:12.484172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:12.485359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:12.485606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:12.486945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:12.487301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:12.487311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:12.487319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:12.487327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:12.487335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:12.487342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:12.487351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:12.487359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:12.487366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:12.487374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:12.487382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:12.487390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:12.487882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:12.488013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:12.488073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:12.488144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:12.488195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:12.488242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:12.488281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:12.488320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:12.488360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:12.488398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:12.488435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:12.488473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:12.488505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:12.488561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:12.488610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:12.488656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:12.488691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:12.488734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:12.488770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:12.488809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:12.488845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:12.488886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:12.488925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:12.488966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:12.489004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:12.489045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:12.489080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:12.489118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:12.489192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:12.489252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:12.489303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:12.489363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:12.489410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:12.489471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:12.489520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:12.489577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:12.490023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:12.513188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:12.541534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:12.541582Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:12.541602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:12.541623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:12.541649Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 417 [2:7559593638502227483:6041]
2025-10-10T14:04:12.541712Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:12.541773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:12.541789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:12.541802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:12.541813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:12.541865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:12.541888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:12.541910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:12.543934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:12.543953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:12.543970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:12.543986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:12.544002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:12.544320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:12.544339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:12.544505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:12.544718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:12.544988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:12.545121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:12.545606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593640080146276:6504], now have 1 active actors on pipe
2025-10-10T14:04:12.545643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593640080146208:2442], now have 1 active actors on pipe
2025-10-10T14:04:12.545668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593640080146281:6690], now have 1 active actors on pipe
2025-10-10T14:04:12.545694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:12.545710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:12.545726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:12.545739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:12.545777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:12.545863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:12.546040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:12.546056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:12.546069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:12.546079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:12.546081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:12.546095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:12.546170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:12.546193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:12.546320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:12.546355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:12.546434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:12.546467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:12.546486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:12.546499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:12.546534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:12.546573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:12.546698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:12.546870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:12.548117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:12.548159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:12.545252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 417, pipe: [1:7559593640080146276:6504]
2025-10-10T14:04:12.545366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 417
2025-10-10T14:04:12.545451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 417
2025-10-10T14:04:12.548566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 418 partition: 0 MaxSeqNo: 36 sessionId: src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0
2025-10-10T14:04:12.549443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c100d85-38cc2814-6fa28718-179ef540_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:12.548239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:12.599795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0] Write session: try to update token
2025-10-10T14:04:12.599864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:12.755347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:12.755390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:12.755404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:12.755530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:12.755547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:12.755560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:12.755572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:12.755584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:12.755624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:12.755656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:12.755681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:12.755706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:12.757643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:12.757704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:12.757738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:12.757770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:12.779025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:12.779063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:12.779071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:12.780251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:12.805256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId: src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:12.857462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:13.003619Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:13.013593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:13.013622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:13.013659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593638502227477:6041]
2025-10-10T14:04:13.013788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:13.013812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:13.014313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:13.015982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593640080146276:6504]
2025-10-10T14:04:13.016054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:13.016177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:13.016187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:13.024780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:13.073360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:13.073409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0] Write session will restart in 0.008228s
2025-10-10T14:04:13.073512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0] Write session: Do CDS request
2025-10-10T14:04:13.073542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:13.070317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 418 reason: error at write: Disconnected sessionId: src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0
2025-10-10T14:04:13.070627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 418 sessionId: src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0 is DEAD
2025-10-10T14:04:13.095668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:13.097454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:13.097490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 419
2025-10-10T14:04:13.097910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:13.098031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:13.098047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:13.098057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:13.100796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 419 sessionId:  describe result for acl check
2025-10-10T14:04:13.100921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:13.100931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:13.100941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:13.100961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593644375113802:6696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:13.103942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593644375113802:6696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:13.118372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593644375113817:6504]
2025-10-10T14:04:13.135903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593644375113802:6696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:13.161204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593644375113802:6696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:13.161252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593644375113802:6696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:13.161274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593644375113802:6696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:13.161312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:13.213048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:13.222195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:13.223057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:13.223075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:13.223121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:13.223573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:13.223778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593642797195052:6051]
2025-10-10T14:04:13.225969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:13.237542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:13.237834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:13.239162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:13.239495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:13.239503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:13.239510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:13.239518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:13.239525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:13.239531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:13.239538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:13.239545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:13.239552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:13.239559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:13.239565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:13.239572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:13.239618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:13.239727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:13.239776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:13.239822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:13.239867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:13.239914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:13.239958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:13.240007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:13.240052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:13.240100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:13.240162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:13.240206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:13.240251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:13.240315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:13.240371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:13.240423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:13.240481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:13.240538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:13.240582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:13.240633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:13.240684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:13.240737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:13.240781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:13.240833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:13.240877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:13.240928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:13.240972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:13.241024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:13.241070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:13.241121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:13.257585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:13.257685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:13.257733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:13.257782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:13.257824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:13.257867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:13.258233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:13.338675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:13.352943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:13.353102Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:13.353119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:13.353153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:13.353176Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 418 [2:7559593642797195052:6051]
2025-10-10T14:04:13.353222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:13.353280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:13.353293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:13.353304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:13.353315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:13.353362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:13.353384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:13.353406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:13.354800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:13.354816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:13.354828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:13.354839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:13.354850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:13.355101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:13.355117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:13.355250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:13.355424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:13.355641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:13.355751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:13.355821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:13.355835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:13.355847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:13.355861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:13.356011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:13.356023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:13.356035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:13.356045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:13.357076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:13.357203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:13.357389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:13.357405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:13.357458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593644375113912:6696], now have 1 active actors on pipe
2025-10-10T14:04:13.357482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593644375113777:2442], now have 1 active actors on pipe
2025-10-10T14:04:13.357504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593644375113817:6504], now have 1 active actors on pipe
2025-10-10T14:04:13.357631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:13.357665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:13.358050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:13.364842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 418
2025-10-10T14:04:13.364952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 418
2025-10-10T14:04:13.365033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 418, pipe: [1:7559593644375113817:6504]
2025-10-10T14:04:13.367656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 419 partition: 0 MaxSeqNo: 36 sessionId: src_id|1ee71a24-70565070-191d9d74-97622f02_0
2025-10-10T14:04:13.366300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:13.366351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:13.366449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ee71a24-70565070-191d9d74-97622f02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:13.366483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:13.366502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:13.366514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:13.366557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:13.366603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:13.366655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:13.367270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:13.367295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:13.367363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:13.373702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d912625b-fdfd6d40-38a87dcf-6aa3366d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1ee71a24-70565070-191d9d74-97622f02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:13.430553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ee71a24-70565070-191d9d74-97622f02_0] Write session: try to update token
2025-10-10T14:04:13.430615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ee71a24-70565070-191d9d74-97622f02_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:13.602658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:13.602688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:13.602700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:13.602757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:13.602773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:13.602786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:13.602796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:13.602807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:13.602843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:13.602870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:13.602895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:13.602915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:13.603119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:13.603146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:13.603157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:13.604308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:13.605702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:13.605745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:13.605774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:13.605805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:13.704018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId: src_id|1ee71a24-70565070-191d9d74-97622f02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:13.823254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:14.000117Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:14.054630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:14.054670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:14.054719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:14.054728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:14.054755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593642797195044:6051]
2025-10-10T14:04:14.055459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:14.057101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593644375113817:6504]
2025-10-10T14:04:14.057222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:14.057233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:14.056273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:14.077505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ee71a24-70565070-191d9d74-97622f02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:14.077547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ee71a24-70565070-191d9d74-97622f02_0] Write session will restart in 0.008177s
2025-10-10T14:04:14.076246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:14.076364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 419 reason: error at write: Disconnected sessionId: src_id|1ee71a24-70565070-191d9d74-97622f02_0
2025-10-10T14:04:14.077652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ee71a24-70565070-191d9d74-97622f02_0] Write session: Do CDS request
2025-10-10T14:04:14.076617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 419 sessionId: src_id|1ee71a24-70565070-191d9d74-97622f02_0 is DEAD
2025-10-10T14:04:14.077683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ee71a24-70565070-191d9d74-97622f02_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:14.091045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ee71a24-70565070-191d9d74-97622f02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:14.119535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:14.119570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 420
2025-10-10T14:04:14.120211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:14.120358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:14.120378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:14.120388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:14.122226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 420 sessionId:  describe result for acl check
2025-10-10T14:04:14.122354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:14.122366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:14.122377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:14.122395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593648670081382:6709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:14.125935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593648670081382:6709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:14.145325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593648670081382:6709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:14.157361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593648670081433:6504]
2025-10-10T14:04:14.184215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593648670081382:6709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:14.184261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593648670081382:6709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:14.184280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593648670081382:6709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:14.184311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:14.272267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:14.277629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:14.278545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:14.278579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:14.278624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:14.278913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:14.279113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593647092162622:6060]
2025-10-10T14:04:14.281650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:14.282775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:14.283010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:14.284398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:14.284757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:14.284767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:14.284775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:14.284783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:14.284792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:14.284801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:14.284809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:14.284817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:14.284826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:14.284834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:14.284843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:14.284851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:14.284908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:14.285030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:14.285088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:14.285160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:14.285215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:14.285274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:14.285329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:14.285385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:14.285435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:14.285489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:14.285542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:14.285596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:14.285642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:14.285721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:14.285787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:14.285851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:14.285907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:14.285973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:14.286035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:14.286101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:14.286164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:14.286229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:14.286291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:14.286348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:14.286401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:14.286462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:14.286517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:14.286578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:14.286634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:14.286694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:14.286747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:14.286808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:14.286860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:14.286922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:14.286970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:14.287029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:14.287539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:14.321777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:14.336384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:14.336433Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:14.336450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:14.336472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:14.336496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 419 [2:7559593647092162622:6060]
2025-10-10T14:04:14.336550Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:14.336611Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:14.336625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:14.336637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:14.336648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:14.336698Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:14.336720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:14.336741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:14.339466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:14.339498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:14.339515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:14.339529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:14.339542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:14.339842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:14.339862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:14.340024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:14.340246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:14.340498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:14.340633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:14.340708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.340722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.340737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.340752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.340800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:14.340887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:14.341090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:14.341102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:14.341116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:14.341140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:14.343838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 419, pipe: [1:7559593648670081433:6504]
2025-10-10T14:04:14.343989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 419
2025-10-10T14:04:14.344074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 419
2025-10-10T14:04:14.345486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:14.345524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:14.345729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593648670081481:6709], now have 1 active actors on pipe
2025-10-10T14:04:14.345760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593648670081371:2442], now have 1 active actors on pipe
2025-10-10T14:04:14.345787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593648670081433:6504], now have 1 active actors on pipe
2025-10-10T14:04:14.345822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.345862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:14.349017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:14.350036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:14.350070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:14.350168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:14.350213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:14.350233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:14.350245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:14.350281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:14.350324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:14.350381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:14.361442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:14.361486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:14.361571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:14.394224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ee71a24-70565070-191d9d74-97622f02_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:14.392622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 420 partition: 0 MaxSeqNo: 36 sessionId: src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0
2025-10-10T14:04:14.437379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:14.437411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:14.437422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:14.453356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0] Write session: try to update token
2025-10-10T14:04:14.453414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:14.627809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:14.627843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:14.627856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:14.627915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:14.627931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:14.627945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:14.627958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:14.627969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:14.628008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.628035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.628061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.628084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.628308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:14.628336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:14.628348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:14.631619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:14.631660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:14.631692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:14.631723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:14.637522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:14.652256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId: src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:14.676993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:14.844243Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:14.895238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:14.895641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:14.895736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:14.895752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:14.895794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593647092162617:6060]
2025-10-10T14:04:14.898061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593648670081433:6504]
2025-10-10T14:04:14.898168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:14.898180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:14.896648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:14.897777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:14.968967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 420 reason: error at write: Disconnected sessionId: src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0
2025-10-10T14:04:14.969752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:14.969799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0] Write session will restart in 0.005961s
2025-10-10T14:04:14.969936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0] Write session: Do CDS request
2025-10-10T14:04:14.969988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:14.969313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 420 sessionId: src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0 is DEAD
2025-10-10T14:04:14.979263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:14.986220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:14.986869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:14.986905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 421
2025-10-10T14:04:14.987597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:14.987722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:14.987745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:14.987758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:14.989297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 421 sessionId:  describe result for acl check
2025-10-10T14:04:14.989414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:14.989433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:14.989442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:14.989460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593648670081659:6715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:14.992230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593648670081659:6715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:15.000317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593648670081683:6504]
2025-10-10T14:04:15.003589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593648670081659:6715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:15.028845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593648670081659:6715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:15.028898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593648670081659:6715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:15.028916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593648670081659:6715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:15.028956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:15.109736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:15.121845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:15.122896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:15.122916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:15.122960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:15.123248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:15.123448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593651387130217:6074]
2025-10-10T14:04:15.126326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:15.127886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:15.128173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:15.129661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:15.130058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:15.130067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:15.130076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:15.130084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:15.130093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:15.130101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:15.130110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:15.130117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:15.130126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:15.130134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:15.130143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:15.130152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:15.130201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:15.130344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:15.130400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:15.130448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:15.130495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:15.130546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:15.130594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:15.130639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:15.130686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:15.130735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:15.130784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:15.130830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:15.130880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:15.130953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:15.131021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:15.131076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:15.131124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:15.131177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:15.131224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:15.131281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:15.131339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:15.131392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:15.131436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:15.131490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:15.131538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:15.131591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:15.131635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:15.131689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:15.131739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:15.131790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:15.131835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:15.131889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:15.131935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:15.131984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:15.132027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:15.132079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:15.132571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:15.244102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:15.273841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:15.273889Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:15.273908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:15.273931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:15.273957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 420 [2:7559593651387130217:6074]
2025-10-10T14:04:15.274012Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:15.274077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:15.274093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:15.274107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:15.274118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:15.274171Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:15.274194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:15.274218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:15.275397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:15.275415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:15.275430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:15.275444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:15.275456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:15.275739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:15.275757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:15.275902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:15.276084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:15.276324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:15.276445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:15.276520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.276534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.276547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.276559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.276639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:15.276651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:15.276662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:15.276672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:15.278400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 420, pipe: [1:7559593648670081683:6504]
2025-10-10T14:04:15.278524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 420
2025-10-10T14:04:15.278606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 420
2025-10-10T14:04:15.285458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:15.285641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:15.285859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:15.285880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:15.285934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593648670081683:6504], now have 1 active actors on pipe
2025-10-10T14:04:15.285961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593648670081642:2442], now have 1 active actors on pipe
2025-10-10T14:04:15.285984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593652965049050:6715], now have 1 active actors on pipe
2025-10-10T14:04:15.286071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:15.286093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:15.286254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.286289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:15.286372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:15.286409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:15.286430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:15.286440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:15.286479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:15.286524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:15.286653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:15.287227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:15.292117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:15.292188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:15.292280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:15.292826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 421 partition: 0 MaxSeqNo: 36 sessionId: src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0
2025-10-10T14:04:15.298450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bca5120-526b3a1f-e6f3d996-715802f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:15.374897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0] Write session: try to update token
2025-10-10T14:04:15.374964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:15.376591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:15.376622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:15.376634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:15.486098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:15.486132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:15.486146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:15.486157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:15.486169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:15.486208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.486234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.486259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.486282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.486815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:15.486832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:15.486843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:15.486893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:15.486920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:15.486932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:15.488501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:15.488545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:15.488576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:15.488606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:15.497442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:15.645317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId: src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:15.720679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:15.803647Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:15.869744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:15.869793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:15.869858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:15.869873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:15.869920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593651387130212:6074]
2025-10-10T14:04:15.870453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:15.871814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:15.876953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593648670081683:6504]
2025-10-10T14:04:15.877042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:15.877178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:15.942956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 421 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0
2025-10-10T14:04:15.943272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 421 sessionId: src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0 is DEAD
2025-10-10T14:04:15.945992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:15.946067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0] Write session will restart in 0.006666s
2025-10-10T14:04:15.946268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0] Write session: Do CDS request
2025-10-10T14:04:15.946324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:15.961724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:15.961762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 422
2025-10-10T14:04:15.962875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:15.963574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:15.963722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:15.963738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:15.963749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:15.967327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 422 sessionId:  describe result for acl check
2025-10-10T14:04:15.967486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:15.967500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:15.967517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:15.967536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593652965049234:6725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:15.976542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593652965049234:6725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:15.977150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593652965049246:6504]
2025-10-10T14:04:15.985633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593652965049234:6725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:16.026544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593652965049234:6725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:16.026599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593652965049234:6725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:16.026617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593652965049234:6725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:16.026647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:16.130859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:16.139319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:16.140221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:16.140240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:16.140285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:16.140574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:16.140781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593655682097786:6080]
2025-10-10T14:04:16.143139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:16.153861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:16.154191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:16.155498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:16.155910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:16.155919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:16.155927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:16.155933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:16.155941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:16.155948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:16.155955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:16.155964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:16.155974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.155982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.155990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.155998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.156046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:16.156162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:16.156230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:16.156280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:16.156331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:16.156382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:16.156430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:16.156476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:16.156525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.156574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.156620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.156672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.156728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:16.156803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:16.156867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:16.156926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:16.156977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:16.157034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:16.157080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:16.157168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:16.157232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:16.157289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:16.157338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:16.157393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:16.157444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:16.157497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:16.157546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:16.157600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:16.157651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.157705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.157755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.157811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.157862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.157918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.158002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.158065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.158533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:16.192533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:16.207814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:16.207861Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:16.207878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:16.207898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:16.207920Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 421 [2:7559593655682097786:6080]
2025-10-10T14:04:16.207976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:16.208037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:16.208051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:16.208063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:16.208073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:16.208121Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:16.208143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:16.208165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:16.211446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.211474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.211491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.211505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.211516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:16.211790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:16.211807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.211947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.212129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.212374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.212489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:16.212574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.212590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.212604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.212617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.212661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:16.212748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:16.212928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:16.212945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:16.213074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.213095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:16.213700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:16.213722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:16.213734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:16.213747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:16.213769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:16.214334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593652965049217:2442], now have 1 active actors on pipe
2025-10-10T14:04:16.214368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593657260016620:6725], now have 1 active actors on pipe
2025-10-10T14:04:16.214389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593652965049246:6504], now have 1 active actors on pipe
2025-10-10T14:04:16.217294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 421
2025-10-10T14:04:16.217410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 421
2025-10-10T14:04:16.217473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 421, pipe: [1:7559593652965049246:6504]
2025-10-10T14:04:16.223020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:16.223064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:16.223158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edd83880-72a79237-1a334b47-2e946118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:16.223194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:16.223211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:16.223222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:16.223258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:16.223299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:16.223350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:16.227553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:16.227596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:16.227685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:16.228158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 422 partition: 0 MaxSeqNo: 36 sessionId: src_id|edd83880-72a79237-1a334b47-2e946118_0
2025-10-10T14:04:16.229622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d86ddba6-bbd22735-4b044fbc-f46031b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|edd83880-72a79237-1a334b47-2e946118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:16.297570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edd83880-72a79237-1a334b47-2e946118_0] Write session: try to update token
2025-10-10T14:04:16.297629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edd83880-72a79237-1a334b47-2e946118_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:16.321996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:16.322028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:16.322063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.322185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:16.322204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:16.322216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:16.322277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:16.322906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:16.325429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:16.326718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:16.335709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:16.345535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:16.347184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:16.347654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:16.497215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId: src_id|edd83880-72a79237-1a334b47-2e946118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:16.536208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:16.536250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:16.536265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:16.536323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:16.536339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:16.536353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:16.536366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:16.536378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:16.536422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.536449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.536474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.536501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593655682097780:6080]
2025-10-10T14:04:16.536653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:16.536682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.536694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:16.536955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:16.536987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:16.537016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:16.537046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:16.538471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:16.554902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:16.712545Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:16.715439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:16.715492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:16.717326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593652965049246:6504]
2025-10-10T14:04:16.717427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:16.717438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:16.717452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:16.718074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:16.759071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 422 reason: error at write: Disconnected sessionId: src_id|edd83880-72a79237-1a334b47-2e946118_0
2025-10-10T14:04:16.759385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 422 sessionId: src_id|edd83880-72a79237-1a334b47-2e946118_0 is DEAD
2025-10-10T14:04:16.761381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd83880-72a79237-1a334b47-2e946118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:16.761428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd83880-72a79237-1a334b47-2e946118_0] Write session will restart in 0.009782s
2025-10-10T14:04:16.761535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd83880-72a79237-1a334b47-2e946118_0] Write session: Do CDS request
2025-10-10T14:04:16.761565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd83880-72a79237-1a334b47-2e946118_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:16.781120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edd83880-72a79237-1a334b47-2e946118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:16.781490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:16.781531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 423
2025-10-10T14:04:16.782656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:16.782796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:16.782813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:16.782823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:16.784256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 423 sessionId:  describe result for acl check
2025-10-10T14:04:16.784373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:16.784384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:16.784394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:16.784410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593657260016831:6742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:16.792917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593657260016831:6742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:16.817829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593657260016865:6504]
2025-10-10T14:04:16.820679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593657260016831:6742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:16.840442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593657260016831:6742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:16.840485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593657260016831:6742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:16.840503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593657260016831:6742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:16.840551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:16.925274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:16.935066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:16.936024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:16.936053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:16.936107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:16.936455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:16.936630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593655682098060:6096]
2025-10-10T14:04:16.939013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:16.940356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:16.940602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:16.942039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:16.942412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:16.942429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:16.942438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:16.942447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:16.942454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:16.942463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:16.942470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:16.942478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:16.942487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.942495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.942503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.942510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.942561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:16.942683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:16.942741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:16.942792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:16.942857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:16.942909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:16.942960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:16.943013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:16.943062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.943116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.943165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.943225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.943272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:16.943440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:16.943507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:16.943570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:16.943627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:16.943684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:16.943735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:16.943798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:16.943853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:16.943916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:16.943968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:16.944030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:16.944083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:16.944145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:16.944214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:16.944278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:16.944333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.944391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:16.944442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.944503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:16.944556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.944612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:16.944663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.944720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:16.945234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:16.994464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:17.056003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:17.056055Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:17.056076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:17.056099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:17.056125Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 422 [2:7559593655682098060:6096]
2025-10-10T14:04:17.056194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:17.056342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:17.056377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:17.056416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:17.056445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:17.056497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:17.056521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:17.056544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:17.058820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:17.058850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:17.058868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:17.058884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:17.058897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:17.059198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:17.060519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 422, pipe: [1:7559593657260016865:6504]
2025-10-10T14:04:17.059216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:17.060780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 422
2025-10-10T14:04:17.059390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:17.060889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 422
2025-10-10T14:04:17.059599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:17.059843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:17.060066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:17.060198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593657260016865:6504], now have 1 active actors on pipe
2025-10-10T14:04:17.060237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593657260016816:2442], now have 1 active actors on pipe
2025-10-10T14:04:17.060260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593657260016923:6742], now have 1 active actors on pipe
2025-10-10T14:04:17.060285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593655682098054:6096]
2025-10-10T14:04:17.060301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593655682098054:6096]
2025-10-10T14:04:17.060317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593655682098054:6096]
2025-10-10T14:04:17.060331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593655682098054:6096]
2025-10-10T14:04:17.060373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:17.060468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:17.060832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:17.060849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:17.060984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593655682098054:6096]
2025-10-10T14:04:17.061007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:17.061227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:17.061243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:17.061256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:17.061270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:17.061298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:17.063081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 423 partition: 0 MaxSeqNo: 36 sessionId: src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0
2025-10-10T14:04:17.061726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:17.061764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:17.061841Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:17.061872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:17.061891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:17.061903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:17.061940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:17.061984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:17.062032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:17.062639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:17.062661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:17.062731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:17.065886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edd83880-72a79237-1a334b47-2e946118_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:17.147444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0] Write session: try to update token
2025-10-10T14:04:17.147512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:17.160312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:17.160349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:17.160362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:17.268085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:17.268121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:17.268135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:17.268199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:17.268234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:17.268251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:17.268264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:17.268276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:17.268317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593655682098054:6096]
2025-10-10T14:04:17.268345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593655682098054:6096]
2025-10-10T14:04:17.268373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593655682098054:6096]
2025-10-10T14:04:17.268398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593655682098054:6096]
2025-10-10T14:04:17.268571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:17.268604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:17.268618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:17.272045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:17.272104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:17.272139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:17.272173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:17.281864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:17.445197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId: src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:17.502209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:17.662178Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:17.700276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:17.700335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:17.707105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:17.701908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593657260016865:6504]
2025-10-10T14:04:17.701995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:17.702131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:17.702155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:17.819750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593661554984422:6504]
2025-10-10T14:04:17.927883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 423 reason: error at write: Disconnected sessionId: src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0
2025-10-10T14:04:17.928719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 423 sessionId: src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0 is DEAD
2025-10-10T14:04:17.929888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:17.929929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0] Write session will restart in 0.006772s
2025-10-10T14:04:17.930036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0] Write session: Do CDS request
2025-10-10T14:04:17.930068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:17.962603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
E1010 14:04:17.963416467  202778 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:04:17.978653Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:04:17.994374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:17.994417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 424
2025-10-10T14:04:18.001115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:18.001331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:18.001349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:18.001360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:18.006456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 424 sessionId:  describe result for acl check
2025-10-10T14:04:18.006606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:18.006620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:18.006631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:18.006651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593665849951920:6756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:18.017215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:18.014657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593665849951920:6756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:18.029008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:18.030019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:18.030039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:18.030094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:18.030403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:18.030606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593664272032929:6102]
2025-10-10T14:04:18.033071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:18.040053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593665849951920:6756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:18.046835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:18.047105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:18.048467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:18.048808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:18.048817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:18.048826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:18.048833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:18.048840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:18.048847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:18.048854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:18.048862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:18.048871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.048877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.048884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.048891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.048943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:18.049060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:18.049110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:18.049180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:18.049227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:18.049277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:18.049324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:18.049370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:18.049418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.049468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.049515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.049563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.049608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:18.049679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:18.049742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:18.049798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:18.049848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:18.049901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:18.049948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:18.050000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:18.050050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:18.050108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:18.050153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:18.050203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:18.050249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:18.050308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:18.050353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:18.050408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:18.050460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.050512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.050558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.050609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.050654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.050705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.050750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.050803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.051259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:18.086424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593665849951920:6756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:18.086481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593665849951920:6756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:18.086501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593665849951920:6756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:18.086535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:18.127814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:18.168557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:18.168603Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:18.168623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:18.168643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:18.168667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 423 [2:7559593664272032929:6102]
2025-10-10T14:04:18.168732Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:18.168805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:18.168821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:18.168835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:18.168846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:18.168902Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:18.168926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:18.168951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:18.171153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.171184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.171198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.171212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.171224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:18.171538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:18.171558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.171709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.171908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.172174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.172318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:18.172399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.172417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.172431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.172445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.172496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:18.172585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:18.172613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:18.172636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:18.172648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:18.172661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:18.172786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:18.172804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:18.172949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.172975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:18.173012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:18.173072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593665849951950:6756], now have 1 active actors on pipe
2025-10-10T14:04:18.173099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593661554984422:6504], now have 1 active actors on pipe
2025-10-10T14:04:18.173143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593661554984395:2442], now have 1 active actors on pipe
2025-10-10T14:04:18.175384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 423, pipe: [1:7559593661554984422:6504]
2025-10-10T14:04:18.175497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 423
2025-10-10T14:04:18.175580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 423
2025-10-10T14:04:18.182539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:18.182590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:18.182691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:18.182734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:18.182756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:18.182767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:18.182816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:18.182872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:18.182940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:18.184474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:18.184507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:18.184582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:18.188311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8de873c-98e8f3be-26fa5a46-c3b9fa8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:18.187461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 424 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0
2025-10-10T14:04:18.265712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:18.265749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:18.265763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:18.279554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0] Write session: try to update token
2025-10-10T14:04:18.279616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:18.534512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:18.534545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:18.534556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:18.534618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:18.534633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:18.534647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:18.534658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:18.534670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:18.534709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.534738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.534764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.534787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.535153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:18.535201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:18.535238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:18.535271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:18.574807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:18.574861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.574874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:18.576146Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:18.581934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId: src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:18.624510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:18.724666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:18.727693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:18.727717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:18.727750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593664272032924:6102]
2025-10-10T14:04:18.727873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:18.727903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:18.727929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:18.730944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:18.731811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593661554984422:6504]
2025-10-10T14:04:18.729536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:18.731939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:18.812550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 424 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0
2025-10-10T14:04:18.813445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:18.813527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0] Write session will restart in 0.008080s
2025-10-10T14:04:18.813698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0] Write session: Do CDS request
2025-10-10T14:04:18.813755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:18.813032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 424 sessionId: src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0 is DEAD
2025-10-10T14:04:18.830359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:18.832488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:18.832524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 425
2025-10-10T14:04:18.833007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:18.833142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:18.833159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:18.833168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:18.833341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593665849952031:6504]
2025-10-10T14:04:18.837409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 425 sessionId:  describe result for acl check
2025-10-10T14:04:18.837535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:18.837545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:18.837554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:18.837571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593665849952040:6765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:18.840001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593665849952040:6765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:18.871955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593665849952040:6765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:18.885619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593665849952040:6765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:18.885666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593665849952040:6765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:18.885684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593665849952040:6765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:18.885718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:18.964708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:18.971233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:18.972198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:18.972218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:18.972285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:18.972603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:18.972808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593664272033221:6112]
2025-10-10T14:04:18.975929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:18.977227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:18.977491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:18.978855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:18.979210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:18.979219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:18.979228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:18.979236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:18.979243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:18.979252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:18.979259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:18.979266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:18.979274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.979281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.979289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.979297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.979352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:18.979479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:18.979538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:18.979590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:18.979649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:18.979706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:18.979761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:18.979811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:18.979861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.979915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.979969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.980019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.980064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:18.980136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:18.980205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:18.980286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:18.980343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:18.980404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:18.980456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:18.980516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:18.980569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:18.980630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:18.980686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:18.980746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:18.980798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:18.980859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:18.980909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:18.980978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:18.981031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.981094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:18.983775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.983887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:18.983961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.984025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:18.984077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.984141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:18.984779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:19.078070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:19.093624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:19.093673Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:19.093695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:19.093720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:19.093747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 424 [2:7559593664272033221:6112]
2025-10-10T14:04:19.093816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:19.093882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:19.093898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:19.093911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:19.093924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:19.093974Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:19.093997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:19.094020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:19.095350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:19.095369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:19.095399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:19.095416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:19.095428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:19.095722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:19.095743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:19.095912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:19.096130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:19.096406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:19.096541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:19.096616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.096632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.096647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.096662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.097623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 424
2025-10-10T14:04:19.096809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:19.096825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:19.097751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 424
2025-10-10T14:04:19.096838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:19.097832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 424, pipe: [1:7559593665849952031:6504]
2025-10-10T14:04:19.096851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:19.098743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:19.098872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:19.099120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:19.099139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:19.099193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593665849952123:6765], now have 1 active actors on pipe
2025-10-10T14:04:19.099219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593665849951998:2442], now have 1 active actors on pipe
2025-10-10T14:04:19.099245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593665849952031:6504], now have 1 active actors on pipe
2025-10-10T14:04:19.099300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:19.099323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:19.099480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.099518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:19.099593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:19.099624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:19.099643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:19.099655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:19.099691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:19.099727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:19.099732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:19.099882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:19.101266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:19.101299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:19.101372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:19.105561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 425 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0
2025-10-10T14:04:19.107321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f65dcb-591fbfd0-9ffd720e-4bbb6285_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:19.164952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0] Write session: try to update token
2025-10-10T14:04:19.165019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:19.354022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:19.354059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:19.354102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.354236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:19.354250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:19.354265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:19.354408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:19.354877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:19.361398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:19.362809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:19.364344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:19.365633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:19.379483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId: src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:19.382301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:19.425858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:19.438012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:19.438160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:19.438180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:19.438192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:19.438202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:19.438212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:19.438249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.438272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.438294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.438316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593664272033216:6112]
2025-10-10T14:04:19.438476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:19.438505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:19.438538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:19.438566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:19.438582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:19.439710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:19.441268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:19.441312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:19.441345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:19.441376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:19.592298Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:19.597201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:19.596812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:19.596847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:19.601318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:19.601476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593665849952031:6504]
2025-10-10T14:04:19.607219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 425 reason: error at write: Disconnected sessionId: src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0
2025-10-10T14:04:19.607628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 425 sessionId: src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0 is DEAD
2025-10-10T14:04:19.617523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:19.617566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0] Write session will restart in 0.006941s
2025-10-10T14:04:19.617668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0] Write session: Do CDS request
2025-10-10T14:04:19.617699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:19.632670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:19.636739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:19.636774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 426
2025-10-10T14:04:19.638598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:19.638864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:19.638893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:19.638912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:19.644832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 426 sessionId:  describe result for acl check
2025-10-10T14:04:19.644962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:19.644973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:19.644981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:19.644998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593670144919584:6772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:19.647764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593670144919584:6772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:19.662129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593670144919584:6772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:19.675251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593670144919584:6772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:19.675300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593670144919584:6772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:19.675318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593670144919584:6772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:19.675350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:19.697616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593670144919662:6504]
2025-10-10T14:04:19.817112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:19.819175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:19.820043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:19.820060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:19.820108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:19.820400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:19.820596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593668567000780:6121]
2025-10-10T14:04:19.829531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:19.830940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:19.831208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:19.832509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:19.832888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:19.832897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:19.832904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:19.832912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:19.832920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:19.832925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:19.832932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:19.832939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:19.832946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:19.832953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:19.832961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:19.832968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:19.833021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:19.833153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:19.833205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:19.833251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:19.833295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:19.833342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:19.833384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:19.833432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:19.833477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:19.833523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:19.833569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:19.833613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:19.833655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:19.833721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:19.833780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:19.833828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:19.833876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:19.833926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:19.833970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:19.834018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:19.834064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:19.834113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:19.834155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:19.834206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:19.834250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:19.834300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:19.834344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:19.834396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:19.834441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:19.834495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:19.834540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:19.834590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:19.834636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:19.834690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:19.834732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:19.834786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:19.835213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:19.882471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:19.960473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:19.960667Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:19.960686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:19.960706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:19.960727Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 425 [2:7559593668567000780:6121]
2025-10-10T14:04:19.960778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:19.960835Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:19.960848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:19.960859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:19.960869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:19.960912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:19.960933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:19.960952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:19.963311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:19.963329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:19.963344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:19.963358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:19.963368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:19.963637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:19.963653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:19.963786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:19.963956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:19.964163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:19.964287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:19.964364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:19.964379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:19.964392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:19.964405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:19.964450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:19.964533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:19.964697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:19.964715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:19.964844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:19.964861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:19.965389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:19.965401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:19.965412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:19.965422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:19.965443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:19.967778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 425, pipe: [1:7559593670144919662:6504]
2025-10-10T14:04:19.967891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 425
2025-10-10T14:04:19.967957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 425
2025-10-10T14:04:19.969243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593670144919662:6504], now have 1 active actors on pipe
2025-10-10T14:04:19.969285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593670144919624:6772], now have 1 active actors on pipe
2025-10-10T14:04:19.969304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593670144919570:2442], now have 1 active actors on pipe
2025-10-10T14:04:19.977626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:19.977671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:19.977772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:19.977809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:19.977827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:19.977837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:19.977873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:19.977917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:19.977963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:19.985302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:19.985343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:19.985418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:19.989030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 426 partition: 0 MaxSeqNo: 36 sessionId: src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0
2025-10-10T14:04:19.989974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c7e3a2-ca2cb024-2bbdd630-4a422f88_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:20.031441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0] Write session: try to update token
2025-10-10T14:04:20.031504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:20.168621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:20.168655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:20.168667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:20.168727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:20.168742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:20.168755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:20.168766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:20.168779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:20.168816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:20.168843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:20.168868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:20.168889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:20.169086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:20.169114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:20.170660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:20.170700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:20.170725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:20.170749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:20.175404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:20.207590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:20.360621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId: src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:20.443862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:20.753529Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:20.830863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:20.830908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:20.830960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:20.830974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:20.831012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593668567000774:6121]
2025-10-10T14:04:20.835166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593670144919662:6504]
2025-10-10T14:04:20.835267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:20.835278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:20.833487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:20.841187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:20.842182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:20.857450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 426 reason: error at write: Disconnected sessionId: src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0
2025-10-10T14:04:20.857813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 426 sessionId: src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0 is DEAD
2025-10-10T14:04:20.867992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:20.868032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0] Write session will restart in 0.007746s
2025-10-10T14:04:20.868130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0] Write session: Do CDS request
2025-10-10T14:04:20.868159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:20.894797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:20.897575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:20.897631Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 427
2025-10-10T14:04:20.898435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:20.898746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:20.898812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:20.898836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:20.902518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 427 sessionId:  describe result for acl check
2025-10-10T14:04:20.902661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:20.902679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:20.902687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:20.902706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593674439887200:6789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:20.909723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593674439887200:6789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:20.933804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593674439887220:6504]
2025-10-10T14:04:20.958918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593674439887200:6789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:20.978454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593674439887200:6789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:20.978498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593674439887200:6789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:20.978517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593674439887200:6789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:20.978549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:21.382365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:21.383503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:21.384270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:21.384288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:21.384343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:21.384590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:21.384767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593677156935660:6133]
2025-10-10T14:04:21.388427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:21.389739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:21.389964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:21.391181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:21.391493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:21.391500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:21.391507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:21.391513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:21.391519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:21.391525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:21.391532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:21.391537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:21.391543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:21.391550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:21.391556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:21.391562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:21.391605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:21.391715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:21.391758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:21.391802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:21.391845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:21.391893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:21.391936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:21.391978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:21.392020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:21.392063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:21.392113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:21.392158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:21.392198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:21.392258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:21.392332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:21.392383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:21.392428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:21.392482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:21.392524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:21.392572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:21.392635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:21.392690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:21.392740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:21.392795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:21.392842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:21.392894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:21.392934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:21.392981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:21.393024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:21.393072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:21.393113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:21.394498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:21.394565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:21.394630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:21.394678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:21.394729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:21.395174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:21.438630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:21.505415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:21.505458Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:21.505482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:21.505501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:21.505525Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 426 [2:7559593677156935660:6133]
2025-10-10T14:04:21.505585Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:21.505650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:21.505666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:21.505678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:21.505690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:21.505736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:21.505759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:21.505781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:21.507124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:21.507141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:21.507154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:21.507168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:21.507179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:21.507459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:21.507476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:21.507614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:21.507788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:21.508004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:21.508116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:21.508191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:21.508205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:21.508217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:21.508230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:21.508397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:21.508409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:21.508422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:21.508433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:21.510288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:21.510395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:21.510602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:21.510618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:21.510668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593674439887187:2442], now have 1 active actors on pipe
2025-10-10T14:04:21.510702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593674439887231:6789], now have 1 active actors on pipe
2025-10-10T14:04:21.510723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593674439887220:6504], now have 1 active actors on pipe
2025-10-10T14:04:21.510845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:21.510876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:21.510302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 426
2025-10-10T14:04:21.510398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 426
2025-10-10T14:04:21.510470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 426, pipe: [1:7559593674439887220:6504]
2025-10-10T14:04:21.511501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:21.512428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:21.512457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:21.512539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:21.512575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:21.512594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:21.512606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:21.512649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:21.512697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:21.512742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:21.513914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:21.513944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:21.514013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:21.515342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 427 partition: 0 MaxSeqNo: 36 sessionId: src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0
2025-10-10T14:04:21.521483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1964f62f-1cc5b8f8-7640296e-81f31c0a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:21.558430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0] Write session: try to update token
2025-10-10T14:04:21.558494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:21.609416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:21.609442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:21.609454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:21.783032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:21.783070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:21.783085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:21.783096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:21.783108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:21.783147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:21.783173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:21.783198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:21.783218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:21.783382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:21.783394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:21.783404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:21.783509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:21.783533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:21.783545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:21.784763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:21.786043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:21.786081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:21.786112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:21.786143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:21.868691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId: src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:21.920895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:22.060222Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:22.083768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:22.083820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:22.083883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:22.083898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:22.083940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593677156935654:6133]
2025-10-10T14:04:22.085534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:22.089274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:22.089432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:22.089444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:22.094648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:22.152865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593674439887220:6504]
2025-10-10T14:04:22.153004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 427 reason: error at write: Disconnected sessionId: src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0
2025-10-10T14:04:22.153381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 427 sessionId: src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0 is DEAD
2025-10-10T14:04:22.161363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:22.161412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0] Write session will restart in 0.006260s
2025-10-10T14:04:22.161519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0] Write session: Do CDS request
2025-10-10T14:04:22.161550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:22.182086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:22.182818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:22.182878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 428
2025-10-10T14:04:22.184556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:22.184733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:22.184750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:22.184760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:22.186217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 428 sessionId:  describe result for acl check
2025-10-10T14:04:22.186343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:22.186354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:22.186363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:22.186381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593683029822110:6804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:22.189366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593683029822110:6804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:22.204653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593683029822110:6804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:22.239804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593683029822110:6804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:22.239853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593683029822110:6804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:22.239871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593683029822110:6804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:22.239906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:22.251446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593683029822194:6504]
2025-10-10T14:04:22.365238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:22.368692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:22.369584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:22.369605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:22.369656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:22.369940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:22.370137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593681451903242:6143]
2025-10-10T14:04:22.372303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:22.374182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:22.374411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:22.375644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:22.375975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:22.375983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:22.375989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:22.375997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:22.376003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:22.376010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:22.376016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:22.376022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:22.376030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:22.376036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:22.376043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:22.376050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:22.376096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:22.376200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:22.376247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:22.376294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:22.376358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:22.376407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:22.376452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:22.376497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:22.376543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:22.376588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:22.376634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:22.376677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:22.376716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:22.376782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:22.376842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:22.376897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:22.376943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:22.376992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:22.377037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:22.377088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:22.377955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:22.378027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:22.378077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:22.378131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:22.378179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:22.378233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:22.378281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:22.378338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:22.378386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:22.378436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:22.378482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:22.378537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:22.378584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:22.378637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:22.378682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:22.378732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:22.379170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:22.566086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:22.582490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:22.582537Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:22.582555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:22.582574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:22.582598Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 427 [2:7559593681451903242:6143]
2025-10-10T14:04:22.582651Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:22.582720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:22.582735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:22.582747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:22.582759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:22.582812Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:22.582835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:22.582859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:22.584590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:22.584606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:22.584619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:22.584632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:22.584642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:22.585977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 427, pipe: [1:7559593683029822194:6504]
2025-10-10T14:04:22.586097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 427
2025-10-10T14:04:22.586168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 427
2025-10-10T14:04:22.586817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:22.586848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:22.586982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:22.587158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:22.587380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:22.587486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:22.587532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593683029822194:6504], now have 1 active actors on pipe
2025-10-10T14:04:22.587554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593683029822174:6804], now have 1 active actors on pipe
2025-10-10T14:04:22.587573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593683029822089:2442], now have 1 active actors on pipe
2025-10-10T14:04:22.587624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:22.587646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:22.587745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:22.587759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:22.587771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:22.587783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:22.587822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:22.589051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:22.589073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:22.589084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:22.589096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:22.589623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:22.589667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:22.589687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:22.589696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:22.589736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:22.589781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:22.589849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:22.590019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:22.590038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:22.590180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:22.590236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:22.590264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:22.590703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:22.592310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:22.592355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:22.592427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:22.592781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 428 partition: 0 MaxSeqNo: 36 sessionId: src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0
2025-10-10T14:04:22.593905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb94f76-c3d9f60a-7bd6a64b-4d40bdeb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:22.635270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0] Write session: try to update token
2025-10-10T14:04:22.635334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:22.859229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:22.859256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:22.859266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:22.859318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:22.859330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:22.859341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:22.859350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:22.859359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:22.859394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:22.859419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:22.859440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:22.859460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:22.859659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:22.859683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:22.859693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:22.860677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:22.861653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:22.861689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:22.861715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:22.861741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:22.867368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId: src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:22.946535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:23.185025Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:23.270561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:23.270605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:23.270655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:23.270666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:23.270700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593681451903237:6143]
2025-10-10T14:04:23.271430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:23.275328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:23.273018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:23.279193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 428 reason: status is not ok: tablet will be restarted right now sessionId: src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0
2025-10-10T14:04:23.279564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 428 sessionId: src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0 is DEAD
2025-10-10T14:04:23.285359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:23.285408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0] Write session will restart in 0.006883s
2025-10-10T14:04:23.285506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0] Write session: Do CDS request
2025-10-10T14:04:23.285535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:23.282973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:23.283114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593683029822194:6504]
2025-10-10T14:04:23.299950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:23.299981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 429
2025-10-10T14:04:23.300842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:23.301520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:23.301653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:23.301668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:23.301676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:23.303962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 429 sessionId:  describe result for acl check
2025-10-10T14:04:23.304060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:23.304069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:23.304077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:23.304092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593687324789689:6814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:23.307383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593687324789689:6814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:23.339088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593687324789689:6814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:23.380903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593687324789725:6504]
2025-10-10T14:04:23.386313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593687324789689:6814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:23.386357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593687324789689:6814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:23.386375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593687324789689:6814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:23.386406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:23.565281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:23.574822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:23.575721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:23.575742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:23.575794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:23.576075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:23.576272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593685746870844:6155]
2025-10-10T14:04:23.578800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:23.580262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:23.580580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:23.581862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:23.582162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:23.582169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:23.582174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:23.582181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:23.582187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:23.582192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:23.582197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:23.582203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:23.582208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:23.582213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:23.582219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:23.582223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:23.582264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:23.582356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:23.582396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:23.582434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:23.582470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:23.582505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:23.582539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:23.582577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:23.582612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:23.582647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:23.582684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:23.582715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:23.582749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:23.582803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:23.582853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:23.582896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:23.582928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:23.582974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:23.583002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:23.583037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:23.583070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:23.583106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:23.583135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:23.583172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:23.583207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:23.583246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:23.589225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:23.589363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:23.589438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:23.589498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:23.589548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:23.589606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:23.589659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:23.589714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:23.589759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:23.589813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:23.590291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:23.638041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:04:23.638104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-10-10T14:04:23.657588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:23.692274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:23.692328Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:23.692346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:23.692380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:23.692406Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 428 [2:7559593685746870844:6155]
2025-10-10T14:04:23.692464Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:23.692532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:23.692548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:23.692563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:23.692575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:23.692622Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:23.692644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:23.692680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:23.706985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:23.707018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:23.707034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:23.707050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:23.707064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:23.707358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:23.707378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:23.707544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:23.707762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:23.708016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:23.708144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:23.708224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:23.708240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:23.708255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:23.708270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:23.708305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:23.708415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:23.708638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:23.708656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:23.708789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:23.708811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:23.712422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 428, pipe: [1:7559593687324789725:6504]
2025-10-10T14:04:23.712568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 428
2025-10-10T14:04:23.712711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 428
2025-10-10T14:04:23.710030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:23.710055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:23.710068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:23.710081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:23.710107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:23.721252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593687324789725:6504], now have 1 active actors on pipe
2025-10-10T14:04:23.721306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593687324789729:6814], now have 1 active actors on pipe
2025-10-10T14:04:23.721324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593687324789684:2442], now have 1 active actors on pipe
2025-10-10T14:04:23.721376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:23.721396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:23.721518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:23.721543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:23.721557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:23.721565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:23.721597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:23.721637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:23.721793Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:04:23.721865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:23.722903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 10 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:04:23.723035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:04:23.724231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:23.724272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:23.724350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:23.724707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 429 partition: 0 MaxSeqNo: 36 sessionId: src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0
2025-10-10T14:04:23.725464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87408c98-8c37e7b0-4c4eb101-3e1cbcdb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:23.797447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:23.797474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:23.797486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:23.801561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0] Write session: try to update token
2025-10-10T14:04:23.801636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:24.005418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:24.005451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:24.005464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:24.005521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:24.005539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:24.005555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:24.005569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:24.005582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:24.005622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:24.005651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:24.005675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:24.005702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:24.005915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:24.005943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:24.005957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:24.006977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:24.014113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:24.014164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:24.014195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:24.014225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:24.168916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId: src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:24.183418Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:24.252132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:24.277519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593687324789725:6504]
2025-10-10T14:04:24.277628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:24.277641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:24.278989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:24.280689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:24.280736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:24.280830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593685746870838:6155]
2025-10-10T14:04:24.286165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:24.393203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 429 reason: error at write: Disconnected sessionId: src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0
2025-10-10T14:04:24.393565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 429 sessionId: src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0 is DEAD
2025-10-10T14:04:24.397606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:24.397651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0] Write session will restart in 0.009099s
2025-10-10T14:04:24.397750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0] Write session: Do CDS request
2025-10-10T14:04:24.397780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:24.412633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:24.419994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593691619757301:6504]
2025-10-10T14:04:24.420058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:24.420072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 430
2025-10-10T14:04:24.429643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:24.429814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:24.429830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:24.429842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:24.433709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 430 sessionId:  describe result for acl check
2025-10-10T14:04:24.433843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:24.433855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:24.433864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:24.433882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593691619757317:6824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:24.436846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593691619757317:6824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:24.477095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593691619757317:6824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:24.540316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593691619757317:6824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:24.540402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593691619757317:6824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:24.540421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593691619757317:6824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:24.540470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:24.635490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:24.640703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:24.641653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:24.641671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:24.641716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:24.641970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:24.642147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593690041838423:6164]
2025-10-10T14:04:24.644371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:24.649440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:24.649682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:24.654589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:24.655071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:24.655080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:24.655088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:24.655095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:24.655102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:24.655110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:24.655118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:24.655126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:24.655133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:24.655140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:24.655147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:24.655155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:24.655202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:24.655309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:24.655358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:24.655406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:24.655451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:24.655500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:24.655999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:24.656054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:24.656101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:24.656150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:24.656197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:24.656240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:24.656287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:24.656350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:24.656422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:24.656476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:24.656522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:24.656579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:24.656624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:24.656676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:24.656726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:24.656777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:24.656821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:24.656874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:24.656918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:24.656970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:24.657015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:24.657067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:24.657116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:24.657190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:24.657236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:24.657289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:24.657333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:24.657384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:24.657428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:24.657481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:24.657914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:24.691164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:24.736775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:24.736823Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:24.736839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:24.736860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:24.736884Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 429 [2:7559593690041838423:6164]
2025-10-10T14:04:24.736941Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:24.737000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:24.737014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:24.737025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:24.737036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:24.737085Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:24.737108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:24.737147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:24.739972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:24.739993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:24.740009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:24.740023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:24.740035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:24.740335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:24.740353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:24.740523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:24.740710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:24.740937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:24.741062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:24.741917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 429
2025-10-10T14:04:24.742024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 429
2025-10-10T14:04:24.742126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 429, pipe: [1:7559593691619757301:6504]
2025-10-10T14:04:24.742488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593691619757273:2442], now have 1 active actors on pipe
2025-10-10T14:04:24.742533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593691619757301:6504], now have 1 active actors on pipe
2025-10-10T14:04:24.742559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593691619757474:6824], now have 1 active actors on pipe
2025-10-10T14:04:24.742589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:24.742607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:24.742621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:24.742635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:24.742678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:24.742773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:24.742969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:24.742988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:24.743056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:24.743078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:24.743233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:24.743254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:24.743324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28942c3b-d8fc8026-35101922-987b8c36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:24.743354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:24.743372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:24.743384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:24.743419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:24.743460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:24.743610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:24.744445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:24.744468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:24.744480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:24.744493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:24.744517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:24.746943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:24.746975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:24.747048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:24.747424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 430 partition: 0 MaxSeqNo: 36 sessionId: src_id|28942c3b-d8fc8026-35101922-987b8c36_0
2025-10-10T14:04:24.749872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e44ed28-bfdceb3d-d37c52fb-193073da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|28942c3b-d8fc8026-35101922-987b8c36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:24.830399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28942c3b-d8fc8026-35101922-987b8c36_0] Write session: try to update token
2025-10-10T14:04:24.830458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28942c3b-d8fc8026-35101922-987b8c36_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:24.845257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:24.845287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:24.845298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:24.990715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:24.990749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:24.990762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:24.990772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:24.990784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:24.990818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:24.990843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:24.990867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:24.990891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:24.991110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:24.991122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:24.991133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:24.991176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:24.991204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:24.991215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:24.993325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:24.993380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:24.993408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:24.993434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:24.998206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:25.022234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId: src_id|28942c3b-d8fc8026-35101922-987b8c36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:25.054632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:25.158123Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:25.178551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:25.178602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:25.178678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:25.178694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:25.178736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593690041838418:6164]
2025-10-10T14:04:25.179224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:25.180236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:25.182629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:25.182896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593691619757301:6504]
2025-10-10T14:04:25.182971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:25.182983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:25.204511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 430 reason: error at write: Disconnected sessionId: src_id|28942c3b-d8fc8026-35101922-987b8c36_0
2025-10-10T14:04:25.204834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 430 sessionId: src_id|28942c3b-d8fc8026-35101922-987b8c36_0 is DEAD
2025-10-10T14:04:25.209373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28942c3b-d8fc8026-35101922-987b8c36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:25.209418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28942c3b-d8fc8026-35101922-987b8c36_0] Write session will restart in 0.008312s
2025-10-10T14:04:25.209516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28942c3b-d8fc8026-35101922-987b8c36_0] Write session: Do CDS request
2025-10-10T14:04:25.209546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28942c3b-d8fc8026-35101922-987b8c36_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:25.224044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28942c3b-d8fc8026-35101922-987b8c36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:25.225783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:25.225819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 431
2025-10-10T14:04:25.226279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:25.226394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:25.226409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:25.226420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:25.227821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 431 sessionId:  describe result for acl check
2025-10-10T14:04:25.227943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:25.227953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:25.227962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:25.227978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593695914724887:6836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:25.230673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593695914724887:6836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:25.264702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593695914724887:6836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:25.286397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593695914724986:6504]
2025-10-10T14:04:25.306143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593695914724887:6836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:25.306201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593695914724887:6836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:25.306220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593695914724887:6836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:25.306254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:25.466701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:25.489696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:25.490642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:25.490662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:25.490707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:25.491013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:25.491208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593694336806014:6180]
2025-10-10T14:04:25.493899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:25.495096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:25.495319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:25.496830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:25.497217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:25.497226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:25.497234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:25.497243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:25.497250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:25.497259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:25.497266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:25.497274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:25.497281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:25.497288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:25.497296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:25.497304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:25.497359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:25.497482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:25.497537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:25.497592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:25.497647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:25.497711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:25.497766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:25.497816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:25.497867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:25.497919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:25.497970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:25.498023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:25.498067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:25.498140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:25.498208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:25.498271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:25.498327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:25.498389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:25.498444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:25.498506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:25.498559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:25.498620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:25.498672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:25.498731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:25.498780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:25.498839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:25.498903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:25.498964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:25.499020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:25.499081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:25.499132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:25.499195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:25.499248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:25.499309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:25.499358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:25.499418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:25.499915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:25.534465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:25.551469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:25.551515Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:25.551536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:25.551560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:25.551583Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 430 [2:7559593694336806014:6180]
2025-10-10T14:04:25.551657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:25.551718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:25.551733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:25.551747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:25.551760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:25.551808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:25.551833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:25.551855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:25.553141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:25.553161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:25.553180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:25.553197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:25.553209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:25.553485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:25.553504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:25.553669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:25.553874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:25.554134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:25.554266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:25.554342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:25.554359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:25.554374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:25.554388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:25.554438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:25.554524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:25.554584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:25.554600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:25.554613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:25.554628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:25.554725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:25.554742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:25.554870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:25.554891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:25.554907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:25.554993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593695914725018:6836], now have 1 active actors on pipe
2025-10-10T14:04:25.555020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593695914724871:2442], now have 1 active actors on pipe
2025-10-10T14:04:25.555044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593695914724986:6504], now have 1 active actors on pipe
2025-10-10T14:04:25.557061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 430, pipe: [1:7559593695914724986:6504]
2025-10-10T14:04:25.557212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 430
2025-10-10T14:04:25.557291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 430
2025-10-10T14:04:25.561343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:25.561389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:25.561502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:25.561539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:25.561562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:25.561576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:25.561617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:25.561664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:25.561725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:25.563387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:25.563432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:25.563519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:25.571306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28942c3b-d8fc8026-35101922-987b8c36_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:25.569424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 431 partition: 0 MaxSeqNo: 36 sessionId: src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0
2025-10-10T14:04:25.631808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0] Write session: try to update token
2025-10-10T14:04:25.631870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:25.652220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:25.652253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:25.652269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:25.844087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:25.844131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:25.844147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:25.844160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:25.844171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:25.844213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:25.844244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:25.844270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:25.844293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:25.844595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:25.844611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:25.844622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:25.844680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:25.844709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:25.844723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:25.846087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:25.849476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:25.849537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:25.849571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:25.849603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:25.865539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId: src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:25.960913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:26.144298Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:26.237565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:26.237630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:26.237711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:26.237728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:26.237771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593694336806009:6180]
2025-10-10T14:04:26.238974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:26.240682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:26.245293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:26.245450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593695914724986:6504]
2025-10-10T14:04:26.245574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:26.303722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0
2025-10-10T14:04:26.304117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 431 sessionId: src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0 is DEAD
2025-10-10T14:04:26.309322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:26.309372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0] Write session will restart in 0.006931s
2025-10-10T14:04:26.309516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0] Write session: Do CDS request
2025-10-10T14:04:26.309556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:26.332364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:26.354878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593700209692559:6504]
2025-10-10T14:04:26.355079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:26.355092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 432
2025-10-10T14:04:26.360195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:26.360348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:26.360365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:26.360374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:26.361840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 432 sessionId:  describe result for acl check
2025-10-10T14:04:26.361961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:26.361971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:26.361980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:26.361998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593700209692576:6852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:26.365264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593700209692576:6852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:26.384025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593700209692576:6852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:26.398695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593700209692576:6852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:26.398745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593700209692576:6852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:26.398761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593700209692576:6852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:26.398790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:26.444234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:26.446055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:26.446997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:26.447027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:26.447074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:26.447343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:26.447536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593698631773594:6190]
2025-10-10T14:04:26.449912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:26.451205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:26.451438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:26.452874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:26.453280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:26.453297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:26.453304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:26.453310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:26.453317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:26.453324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:26.453331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:26.453337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:26.453344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:26.453351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:26.453357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:26.453364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:26.453409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:26.453522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:26.453569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:26.453614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:26.453667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:26.453712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:26.453756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:26.453801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:26.453843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:26.453888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:26.453931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:26.453970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:26.454011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:26.454078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:26.454136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:26.454188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:26.454237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:26.454294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:26.454342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:26.454399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:26.454449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:26.454505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:26.454551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:26.454607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:26.455261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:26.455342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:26.455402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:26.455460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:26.455516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:26.455571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:26.455619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:26.455678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:26.455730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:26.455787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:26.455832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:26.455887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:26.456361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:26.500064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:26.543609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:26.543653Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:26.543669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:26.543687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:26.543710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 431 [2:7559593698631773594:6190]
2025-10-10T14:04:26.543765Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:26.543823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:26.543838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:26.543852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:26.543863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:26.543908Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:26.543929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:26.543951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:26.548164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:26.548194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:26.548209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:26.548223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:26.548234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:26.548524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:26.548540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:26.548678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:26.548853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:26.549072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:26.549208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:26.549273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:26.549288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:26.549301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:26.549315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:26.549353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:26.549430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:26.549600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:26.549616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:26.549734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:26.549754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:26.552863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 431
2025-10-10T14:04:26.552942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 431, pipe: [1:7559593700209692559:6504]
2025-10-10T14:04:26.553015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 431
2025-10-10T14:04:26.550644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:26.550663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:26.550674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:26.550687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:26.550711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:26.560653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593700209692475:2442], now have 1 active actors on pipe
2025-10-10T14:04:26.560704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593700209692693:6852], now have 1 active actors on pipe
2025-10-10T14:04:26.560728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593700209692559:6504], now have 1 active actors on pipe
2025-10-10T14:04:26.560933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:26.560965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:26.561059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5b02908-cd4af207-46cbad5-b739a010_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:26.561093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:26.561113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:26.561137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:26.561175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:26.561217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:26.561270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:26.562346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:26.562378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:26.562453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:26.562835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 432 partition: 0 MaxSeqNo: 36 sessionId: src_id|c5b02908-cd4af207-46cbad5-b739a010_0
2025-10-10T14:04:26.565031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53229d02-71c225f3-7b3cc8d9-6a61a26b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c5b02908-cd4af207-46cbad5-b739a010_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:26.621919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b02908-cd4af207-46cbad5-b739a010_0] Write session: try to update token
2025-10-10T14:04:26.621981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b02908-cd4af207-46cbad5-b739a010_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:26.756695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:26.756737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:26.756749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:26.756803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:26.756819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:26.756834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:26.756845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:26.756855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:26.756892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:26.756918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:26.756941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:26.756963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:26.757167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:26.757189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:26.757200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:26.757216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:26.757227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:26.757229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:26.757255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:26.758404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:26.881632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId: src_id|c5b02908-cd4af207-46cbad5-b739a010_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:26.944349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:27.005053Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:27.016083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:27.016136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:27.016207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:27.016222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:27.016268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593698631773589:6190]
2025-10-10T14:04:27.017079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:27.017710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:27.021428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:27.021464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:27.023170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593700209692559:6504]
2025-10-10T14:04:27.023305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:27.047402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b02908-cd4af207-46cbad5-b739a010_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 482 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 15769614 MessagesInflight: 10 }
2025-10-10T14:04:27.046299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 432 reason: error at write: Disconnected sessionId: src_id|c5b02908-cd4af207-46cbad5-b739a010_0
2025-10-10T14:04:27.046840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 432 sessionId: src_id|c5b02908-cd4af207-46cbad5-b739a010_0 is DEAD
2025-10-10T14:04:27.047601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b02908-cd4af207-46cbad5-b739a010_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:27.047661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b02908-cd4af207-46cbad5-b739a010_0] Write session will restart in 0.005726s
2025-10-10T14:04:27.047877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b02908-cd4af207-46cbad5-b739a010_0] Write session: Do CDS request
2025-10-10T14:04:27.047943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b02908-cd4af207-46cbad5-b739a010_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:27.060471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b02908-cd4af207-46cbad5-b739a010_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:27.060303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:27.060338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 433
2025-10-10T14:04:27.065277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:27.065432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:27.065448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:27.065457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:27.068202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 433 sessionId:  describe result for acl check
2025-10-10T14:04:27.068324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:27.068336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:27.068345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:27.068362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593704504660091:6866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:27.074775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593704504660091:6866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:27.086340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593704504660091:6866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:27.121377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593704504660126:6504]
2025-10-10T14:04:27.124292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593704504660091:6866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:27.124339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593704504660091:6866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:27.124357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593704504660091:6866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:27.124389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:27.375025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:27.390778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:27.391898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:27.391921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:27.391984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:27.392356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:27.392637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593702926741187:6201]
2025-10-10T14:04:27.395082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:27.404069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:27.404355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:27.405696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:27.406071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:27.406079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:27.406086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:27.406094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:27.406099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:27.406106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:27.406114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:27.406121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:27.406128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:27.406134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:27.406141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:27.406148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:27.406197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:27.406311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:27.406362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:27.406408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:27.406454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:27.406500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:27.406550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:27.406597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:27.406642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:27.406687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:27.406732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:27.406778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:27.406821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:27.406890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:27.406950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:27.407005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:27.407054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:27.407108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:27.407156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:27.407210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:27.407265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:27.407320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:27.407365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:27.407418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:27.407466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:27.407521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:27.407572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:27.407626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:27.407678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:27.407741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:27.407791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:27.407849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:27.407905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:27.407964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:27.408007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:27.408063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:27.408543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:27.489067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:27.797413Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 4 CurrentSessionLifetimeMs: 302396 BytesRead: 29286416 MessagesRead: 13 BytesReadCompressed: 29286416 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-10-10T14:04:27.811822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:27.811871Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:27.811890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:27.811910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:27.811935Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 432 [2:7559593702926741187:6201]
2025-10-10T14:04:27.811992Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:27.812067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:27.812082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:27.812095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:27.812107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:27.812161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:27.812183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:27.812206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:27.829774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:27.829807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:27.829823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:27.829837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:27.829850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:27.830146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:27.830164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:27.830327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:27.830501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:27.830716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:27.830830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:27.830913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:27.830929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:27.830942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:27.830956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:27.831004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:27.831090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:27.831267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:27.831284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:27.831424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:27.831446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:27.831519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:27.831535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:27.831559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:27.831571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:27.831599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:27.833191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 432, pipe: [1:7559593704504660126:6504]
2025-10-10T14:04:27.833301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 432
2025-10-10T14:04:27.833379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 432
2025-10-10T14:04:27.837312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593704504660078:2442], now have 1 active actors on pipe
2025-10-10T14:04:27.837364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593704504660126:6504], now have 1 active actors on pipe
2025-10-10T14:04:27.837393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593704504660131:6866], now have 1 active actors on pipe
2025-10-10T14:04:27.837487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:27.837515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:27.837627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bf009e-842dffc8-4fde549c-a4b56856_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:27.837670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:27.837695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:27.837707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:27.837749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:27.837801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:27.837850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:27.853357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:27.853410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:27.853510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:27.858062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 433 partition: 0 MaxSeqNo: 36 sessionId: src_id|2bf009e-842dffc8-4fde549c-a4b56856_0
2025-10-10T14:04:27.861411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5b02908-cd4af207-46cbad5-b739a010_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2bf009e-842dffc8-4fde549c-a4b56856_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:27.916104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf009e-842dffc8-4fde549c-a4b56856_0] Write session: try to update token
2025-10-10T14:04:27.916169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf009e-842dffc8-4fde549c-a4b56856_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:27.915033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:27.915071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:27.915085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:28.119067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:28.119098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:28.119110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:28.119164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:28.119182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:28.119197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:28.119208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:28.119218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:28.119255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:28.119283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:28.119309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:28.119330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:28.119539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:28.119568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:28.119583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:28.120025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:28.120064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:28.120093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:28.120123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:28.138407Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:28.276079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId: src_id|2bf009e-842dffc8-4fde549c-a4b56856_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:28.315219Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:28.322757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:28.354005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:28.354025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:28.354054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593702926741181:6201]
2025-10-10T14:04:28.356443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:28.360524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:28.360847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593704504660126:6504]
2025-10-10T14:04:28.361021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:28.361052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:28.376588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 433 reason: error at write: Disconnected sessionId: src_id|2bf009e-842dffc8-4fde549c-a4b56856_0
2025-10-10T14:04:28.380771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf009e-842dffc8-4fde549c-a4b56856_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:28.380815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf009e-842dffc8-4fde549c-a4b56856_0] Write session will restart in 0.009356s
2025-10-10T14:04:28.380918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf009e-842dffc8-4fde549c-a4b56856_0] Write session: Do CDS request
2025-10-10T14:04:28.380950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf009e-842dffc8-4fde549c-a4b56856_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:28.383083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 433 sessionId: src_id|2bf009e-842dffc8-4fde549c-a4b56856_0 is DEAD
2025-10-10T14:04:28.417725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf009e-842dffc8-4fde549c-a4b56856_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:28.443146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:28.443184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 434
2025-10-10T14:04:28.444391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:28.444550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:28.444568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:28.444580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:28.447456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 434 sessionId:  describe result for acl check
2025-10-10T14:04:28.447580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:28.447590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:28.447601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:28.447619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593708799627703:6881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:28.456377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593708799627703:6881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:28.463132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593708799627719:6504]
2025-10-10T14:04:28.499528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593708799627703:6881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:28.519968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593708799627703:6881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:28.520010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593708799627703:6881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:28.520027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593708799627703:6881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:28.520057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:28.787061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:28.799881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:28.800853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:28.800872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:28.800923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:28.801216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:28.801413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593707221708777:6212]
2025-10-10T14:04:28.803967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:28.817548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:28.817849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:28.819237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:28.819601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:28.819609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:28.819618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:28.819624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:28.819631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:28.819638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:28.819645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:28.819652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:28.819660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:28.819666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:28.819673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:28.819681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:28.819730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:28.819846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:28.819898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:28.819944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:28.819988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:28.820033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:28.820082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:28.820130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:28.820176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:28.820227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:28.820271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:28.820320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:28.820364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:28.820429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:28.820507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:28.820566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:28.820619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:28.820675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:28.820720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:28.820774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:28.820822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:28.820879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:28.820926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:28.820983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:28.821027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:28.821084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:28.826207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:28.826322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:28.826396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:28.826453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:28.826500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:28.826560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:28.826611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:28.826665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:28.826715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:28.826769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:28.827235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:28.888836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:28.934124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 433
2025-10-10T14:04:28.934209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 433, pipe: [1:7559593708799627719:6504]
2025-10-10T14:04:28.934296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 433
2025-10-10T14:04:28.929275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:28.929327Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:28.929344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:28.929366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:28.929392Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 433 [2:7559593707221708777:6212]
2025-10-10T14:04:28.929451Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:28.929517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:28.929534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:28.929548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:28.929561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:28.929614Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:28.929637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:28.929661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:28.930987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:28.931007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:28.931021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:28.931036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:28.931046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:28.937038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:28.937068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:28.937233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:28.937421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:28.937646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:28.937763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:28.937810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593708799627761:6881], now have 1 active actors on pipe
2025-10-10T14:04:28.937837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593708799627719:6504], now have 1 active actors on pipe
2025-10-10T14:04:28.937859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593708799627683:2442], now have 1 active actors on pipe
2025-10-10T14:04:28.937918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:28.937941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:28.938069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593707221708772:6212]
2025-10-10T14:04:28.938086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593707221708772:6212]
2025-10-10T14:04:28.938100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593707221708772:6212]
2025-10-10T14:04:28.938112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593707221708772:6212]
2025-10-10T14:04:28.938156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:28.938260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c10c379f-94b98747-95d2ca88-8cf09130_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:28.938293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:28.938314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:28.938325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:28.938363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:28.938411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:28.938468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:28.938650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:28.938665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:28.938815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:28.938858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593707221708772:6212]
2025-10-10T14:04:28.938880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:28.942258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:28.942287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:28.942301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:28.942314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:28.942346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:28.949678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:28.949725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:28.949830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:28.950872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 434 partition: 0 MaxSeqNo: 36 sessionId: src_id|c10c379f-94b98747-95d2ca88-8cf09130_0
2025-10-10T14:04:28.951845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bf009e-842dffc8-4fde549c-a4b56856_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c10c379f-94b98747-95d2ca88-8cf09130_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:29.000944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c10c379f-94b98747-95d2ca88-8cf09130_0] Write session: try to update token
2025-10-10T14:04:29.001007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c10c379f-94b98747-95d2ca88-8cf09130_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:29.037321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:29.037366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:29.037379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:29.155525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:29.155565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:29.155582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:29.155595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:29.155608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:29.155646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593707221708772:6212]
2025-10-10T14:04:29.155676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593707221708772:6212]
2025-10-10T14:04:29.155703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593707221708772:6212]
2025-10-10T14:04:29.155727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593707221708772:6212]
2025-10-10T14:04:29.155899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:29.155915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:29.155927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:29.155975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:29.156006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:29.156019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:29.157422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:29.157463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:29.157506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:29.157541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:29.183401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:29.259293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId: src_id|c10c379f-94b98747-95d2ca88-8cf09130_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:29.283830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:29.368331Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:29.394504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:29.394552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:29.398591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:29.400688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:29.400969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:29.400990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:29.404952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593708799627719:6504]
2025-10-10T14:04:29.408719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 434 reason: error at write: Disconnected sessionId: src_id|c10c379f-94b98747-95d2ca88-8cf09130_0
2025-10-10T14:04:29.414123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 434 sessionId: src_id|c10c379f-94b98747-95d2ca88-8cf09130_0 is DEAD
2025-10-10T14:04:29.417649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10c379f-94b98747-95d2ca88-8cf09130_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:29.417696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10c379f-94b98747-95d2ca88-8cf09130_0] Write session will restart in 0.008453s
2025-10-10T14:04:29.417816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10c379f-94b98747-95d2ca88-8cf09130_0] Write session: Do CDS request
2025-10-10T14:04:29.417849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10c379f-94b98747-95d2ca88-8cf09130_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:29.431120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c10c379f-94b98747-95d2ca88-8cf09130_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:29.431551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:29.431588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 435
2025-10-10T14:04:29.431910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:29.432033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:29.432050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:29.432059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:29.434175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 435 sessionId:  describe result for acl check
2025-10-10T14:04:29.434313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:29.434365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:29.434376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:29.434393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593713094595291:6889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:29.441105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593713094595291:6889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:29.457371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593713094595291:6889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:29.499559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593713094595291:6889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:29.499606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593713094595291:6889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:29.499625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593713094595291:6889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:29.499659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:29.501275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593713094595360:6504]
2025-10-10T14:04:29.667878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:29.668520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:29.669361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:29.669396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:29.669448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:29.669709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:29.669902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593711516676364:6222]
2025-10-10T14:04:29.677388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:29.678745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:29.678977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:29.680310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:29.680656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:29.680664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:29.680671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:29.680678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:29.680686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:29.680694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:29.680701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:29.680707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:29.680714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:29.680721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:29.680727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:29.680733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:29.680783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:29.680895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:29.680947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:29.680996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:29.681044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:29.681094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:29.681158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:29.681205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:29.681250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:29.681297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:29.681348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:29.681393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:29.681438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:29.681503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:29.681560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:29.681615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:29.681659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:29.681717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:29.681763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:29.689322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:29.689422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:29.689486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:29.689539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:29.689595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:29.689648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:29.689701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:29.689752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:29.689810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:29.689868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:29.689921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:29.689970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:29.690027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:29.690078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:29.690134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:29.690177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:29.690247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:29.690701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:29.748351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:29.786010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:29.786068Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:29.786088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:29.786110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:29.786136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 434 [2:7559593711516676364:6222]
2025-10-10T14:04:29.786206Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:29.786278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:29.786296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:29.786311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:29.786324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:29.786381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:29.786405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:29.786429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:29.788191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:29.788212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:29.788229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:29.788244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:29.788257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:29.788571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:29.788593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:29.788763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:29.788982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:29.804053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:29.804246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:29.804385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:29.804404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:29.804420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:29.804436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:29.804475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:29.804590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:29.804819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:29.804839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:29.804982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:29.805005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:29.810099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:29.810134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:29.810146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:29.810158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:29.810187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:29.812556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593713094595282:2442], now have 1 active actors on pipe
2025-10-10T14:04:29.812589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593713094595360:6504], now have 1 active actors on pipe
2025-10-10T14:04:29.812613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593713094595358:6889], now have 1 active actors on pipe
2025-10-10T14:04:29.813483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 434
2025-10-10T14:04:29.813614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 434, pipe: [1:7559593713094595360:6504]
2025-10-10T14:04:29.813694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 434
2025-10-10T14:04:29.814732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:29.814770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:29.814859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:29.814896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:29.814915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:29.814927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:29.814967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:29.815014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:29.815073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:29.819203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:29.819242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:29.819327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:29.823247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 435 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0
2025-10-10T14:04:29.825464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10c379f-94b98747-95d2ca88-8cf09130_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:29.889673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:29.889702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:29.889713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:29.932377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0] Write session: try to update token
2025-10-10T14:04:29.932440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:29.952404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:29.952438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:29.952476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:29.952622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:29.953250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:29.954931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:29.956475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:29.985818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:29.987001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:29.988534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:29.988915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:29.997312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:29.997341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:29.997352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:30.111309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:30.111345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:30.111357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:30.111368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:30.111378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:30.111417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:30.111444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:30.111466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:30.111487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593711516676359:6222]
2025-10-10T14:04:30.111651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:30.111662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:30.111673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:30.111717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:30.111741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:30.111751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:30.112919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:30.113373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:30.113404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:30.113434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:30.113461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:30.200340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId: src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:30.235947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:30.377907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:30.386871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:30.386919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:30.388825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:30.388967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593713094595360:6504]
2025-10-10T14:04:30.389046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:30.389057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:30.395191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:30.428141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 435 reason: error at write: Disconnected sessionId: src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0
2025-10-10T14:04:30.428524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 435 sessionId: src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0 is DEAD
2025-10-10T14:04:30.433404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:30.433483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0] Write session will restart in 0.006720s
2025-10-10T14:04:30.433664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0] Write session: Do CDS request
2025-10-10T14:04:30.433721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0] Start write session. Will connect to endpoint: localhost:62043
E1010 14:04:30.436805411  107741 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:04:30.441291Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:04:30.448761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:30.450339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:30.450381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 436
2025-10-10T14:04:30.454665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:30.454817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:30.454835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:30.454846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:30.458441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 436 sessionId:  describe result for acl check
2025-10-10T14:04:30.458570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:30.458580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:30.458589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:30.458606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593717389562910:6903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:30.461780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593717389562910:6903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:30.485070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593717389562910:6903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:30.501965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593717389562944:6504]
2025-10-10T14:04:30.515218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593717389562910:6903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:30.515267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593717389562910:6903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:30.515284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593717389562910:6903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:30.515318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:30.678517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:30.689487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:30.690574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:30.690596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:30.690648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:30.690977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:30.691179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593715811643950:6232]
2025-10-10T14:04:30.693736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:30.701479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:30.701766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:30.703277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:30.703659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:30.703668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:30.703675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:30.703683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:30.703690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:30.703697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:30.703704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:30.703712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:30.703718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:30.703727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:30.703733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:30.703740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:30.703791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:30.703906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:30.703956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:30.704004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:30.704052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:30.704098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:30.704150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:30.704203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:30.704251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:30.704299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:30.704347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:30.704394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:30.704442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:30.704531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:30.704594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:30.704652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:30.704702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:30.704758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:30.704805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:30.704863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:30.704916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:30.704975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:30.705025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:30.705083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:30.706129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:30.706216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:30.706285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:30.706341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:30.706396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:30.706459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:30.706509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:30.706564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:30.706619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:30.706677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:30.706724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:30.706777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:30.707240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:30.758655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:30.850451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:30.850501Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:30.850518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:30.850538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:30.850562Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 435 [2:7559593715811643950:6232]
2025-10-10T14:04:30.850618Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:30.850679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:30.850694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:30.850707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:30.850719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:30.850769Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:30.850795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:30.850818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:30.852603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:30.852623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:30.852637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:30.852651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:30.852662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:30.857451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 435
2025-10-10T14:04:30.857549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 435
2025-10-10T14:04:30.857621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 435, pipe: [1:7559593717389562944:6504]
2025-10-10T14:04:30.873586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:30.873626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:30.873772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:30.873955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:30.874184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:30.874299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:30.874352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593717389562960:6903], now have 1 active actors on pipe
2025-10-10T14:04:30.874379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593717389562885:2442], now have 1 active actors on pipe
2025-10-10T14:04:30.874401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593717389562944:6504], now have 1 active actors on pipe
2025-10-10T14:04:30.874468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:30.874490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:30.874603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:30.874619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:30.874633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:30.874646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:30.874696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:30.874810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:30.874848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:30.874869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:30.874879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:30.874923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:30.874968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:30.875031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:30.875211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:30.875230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:30.875374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:30.875432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:30.875453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:30.875646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:30.875660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:30.875672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:30.875683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:30.875708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:30.881419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:30.881462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:30.881539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:30.884269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 436 partition: 0 MaxSeqNo: 36 sessionId: src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0
2025-10-10T14:04:30.885280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed17afc4-48f0a2c1-2dbedbe3-7ebd7630_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:30.969718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:30.969752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:30.969765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:31.005188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0] Write session: try to update token
2025-10-10T14:04:31.005256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:31.225021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId: src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:31.234032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:31.234065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:31.234078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:31.234146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:31.234162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:31.234176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:31.234187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:31.234199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:31.234251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:31.234281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:31.234306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:31.234329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:31.234546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:31.234574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:31.234585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:31.235661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:31.237802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:31.237843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:31.237870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:31.237900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:31.257251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:31.481356Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:31.492196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:31.492245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:31.492318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:31.492332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:31.492375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593715811643945:6232]
2025-10-10T14:04:31.494483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:31.494512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:31.493279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:31.501335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:31.501509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593717389562944:6504]
2025-10-10T14:04:31.503894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:31.560682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 436 reason: error at write: Disconnected sessionId: src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0
2025-10-10T14:04:31.561049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 436 sessionId: src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0 is DEAD
2025-10-10T14:04:31.566040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:31.566084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0] Write session will restart in 0.005744s
2025-10-10T14:04:31.566184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0] Write session: Do CDS request
2025-10-10T14:04:31.566214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:31.579911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:31.579945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 437
2025-10-10T14:04:31.580819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:31.581532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:31.581663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:31.581677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:31.581690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:31.585753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 437 sessionId:  describe result for acl check
2025-10-10T14:04:31.585887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:31.585896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:31.585906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:31.585922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593721684530525:6918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:31.588083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593721684530525:6918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:31.603551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593721684530545:6504]
2025-10-10T14:04:31.645878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593721684530525:6918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:31.712604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593721684530525:6918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:31.712664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593721684530525:6918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:31.712685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593721684530525:6918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:31.712721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:31.845091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:31.850032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:31.851089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:31.851110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:31.851166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:31.851499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:31.851699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593720106611547:6244]
2025-10-10T14:04:31.854367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:31.869594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:31.869911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:31.871354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:31.871739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:31.871749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:31.871756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:31.871763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:31.871771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:31.871778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:31.871785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:31.871792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:31.871800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:31.871808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:31.871816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:31.871823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:31.871872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:31.871987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:31.872036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:31.872087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:31.872140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:31.872189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:31.872235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:31.872285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:31.872332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:31.872381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:31.872428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:31.872473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:31.872516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:31.872599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:31.872660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:31.872715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:31.872767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:31.872823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:31.872870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:31.872925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:31.872975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:31.873027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:31.873075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:31.874134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:31.874283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:31.874353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:31.874403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:31.874461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:31.874513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:31.874569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:31.874616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:31.874671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:31.874718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:31.874772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:31.874818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:31.874873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:31.875349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:31.921420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:31.964755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:31.964803Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:31.964821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:31.964848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:31.964873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 436 [2:7559593720106611547:6244]
2025-10-10T14:04:31.964933Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:31.964999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:31.965016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:31.965028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:31.965041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:31.965092Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:31.965114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:31.985564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:31.987928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:31.987948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:31.987962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:31.987975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:31.987987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:31.988322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:31.988342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:31.988497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:31.988709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:31.988964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:31.989084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:31.989739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 436
2025-10-10T14:04:31.989853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 436
2025-10-10T14:04:31.989920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 436, pipe: [1:7559593721684530545:6504]
2025-10-10T14:04:31.993639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593721684530499:2442], now have 1 active actors on pipe
2025-10-10T14:04:31.993684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593721684530665:6918], now have 1 active actors on pipe
2025-10-10T14:04:31.993710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593721684530545:6504], now have 1 active actors on pipe
2025-10-10T14:04:31.993745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:31.993763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:31.993778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:31.993792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:31.993840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:31.993992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:31.994015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:31.994061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:31.994268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:31.994288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:31.994495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:31.994530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:31.994563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:31.994577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:31.994618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:31.994667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:31.994711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:31.994736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:31.994853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:31.994885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:31.994901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:31.994914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:31.994925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:31.994950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:32.008625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 437 partition: 0 MaxSeqNo: 36 sessionId: src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0
2025-10-10T14:04:32.007523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:32.007585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:32.007696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:32.010778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261d0b4c-f36b21ad-53deb812-d7fbc712_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:32.086510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:32.086542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:32.086554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:32.171068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0] Write session: try to update token
2025-10-10T14:04:32.171140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:32.372721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:32.372754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:32.372789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:32.372953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:32.377595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:32.377627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:32.377637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:32.377772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:32.416250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:32.425696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:32.450207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:32.451581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:32.464791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:32.592574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:32.592762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:32.592784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:32.592797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:32.592850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:32.592866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:32.592880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:32.592892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:32.592905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:32.592945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:32.592972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:32.592996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:32.593022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593720106611542:6244]
2025-10-10T14:04:32.593198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:32.593226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:32.593239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:32.593352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:32.593391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:32.593435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:32.593468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:32.595143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId: src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:32.598390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:32.649934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:32.746429Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:32.754167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:32.754215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:32.755990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:32.755780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593721684530545:6504]
2025-10-10T14:04:32.755856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:32.755972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:32.755984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:32.815187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 437 reason: error at write: Disconnected sessionId: src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0
2025-10-10T14:04:32.815556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 437 sessionId: src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0 is DEAD
2025-10-10T14:04:32.817652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:32.817727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0] Write session will restart in 0.008288s
2025-10-10T14:04:32.817929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0] Write session: Do CDS request
2025-10-10T14:04:32.817984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:32.838160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:32.853057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:32.853098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 438
2025-10-10T14:04:32.855619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593725979498153:6504]
2025-10-10T14:04:32.857448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:32.857637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:32.857668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:32.857679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:32.859512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 438 sessionId:  describe result for acl check
2025-10-10T14:04:32.859610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:32.859619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:32.859626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:32.859641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593725979498155:6932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:32.861991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593725979498155:6932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:32.901154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593725979498155:6932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:32.940739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593725979498155:6932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:32.940789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593725979498155:6932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:32.940807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593725979498155:6932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:32.940839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:33.011031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:33.019420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:33.024729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:33.024790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:33.024862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:33.025319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:33.025543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593728696546458:6255]
2025-10-10T14:04:33.027753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:33.030493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:33.030849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:33.032202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:33.032551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:33.032589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:33.032597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:33.032605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:33.032612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:33.032618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:33.032624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:33.032632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:33.032640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:33.032647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:33.032654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:33.032661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:33.032711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:33.032821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:33.032874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:33.032921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:33.032968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:33.033017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:33.033062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:33.033109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:33.045401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:33.045491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:33.045541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:33.045585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:33.045642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:33.045715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:33.045780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:33.045851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:33.045901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:33.045953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:33.046002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:33.046052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:33.046098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:33.046150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:33.046191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:33.046241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:33.046281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:33.046340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:33.046382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:33.046427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:33.046468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:33.046512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:33.046550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:33.046596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:33.046634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:33.046680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:33.046718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:33.046763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:33.047159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:33.092873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:33.114650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:33.114699Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:33.114717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:33.114737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:33.114762Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 437 [2:7559593728696546458:6255]
2025-10-10T14:04:33.114816Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:33.114881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:33.114894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:33.114907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:33.114919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:33.114988Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:33.115012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:33.115035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:33.116481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:33.116499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:33.116513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:33.116526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:33.116538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:33.116836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:33.116853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:33.116995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:33.117193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:33.117413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:33.117525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:33.117606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.117621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.117634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.117646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.117681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:33.117760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:33.117929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:33.117946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:33.118074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.118094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:33.119486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:33.119502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:33.119513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:33.119525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:33.119551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:33.120659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593725979498330:6932], now have 1 active actors on pipe
2025-10-10T14:04:33.120686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593725979498126:2442], now have 1 active actors on pipe
2025-10-10T14:04:33.120709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593725979498153:6504], now have 1 active actors on pipe
2025-10-10T14:04:33.123142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:33.123177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:33.123268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:33.123306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:33.123324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:33.123335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:33.123374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:33.123432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:33.123481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:33.122554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 437
2025-10-10T14:04:33.125084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:33.125114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:33.125189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:33.126450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54cb6968-e8f6e55a-545f1e08-9734674a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:33.122705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 437
2025-10-10T14:04:33.122773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 437, pipe: [1:7559593725979498153:6504]
2025-10-10T14:04:33.125576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 438 partition: 0 MaxSeqNo: 36 sessionId: src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0
2025-10-10T14:04:33.213509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:33.213538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:33.213551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:33.240528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0] Write session: try to update token
2025-10-10T14:04:33.240618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:33.496217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:33.496249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:33.496261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:33.496319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:33.496334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:33.496349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:33.496359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:33.496370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:33.496407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.496435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.496458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.496480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.496696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:33.496725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:33.496737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:33.501244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId: src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:33.497932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:33.501584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:33.501617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:33.501652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:33.501682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:33.573854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:33.843829Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:33.896577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:33.896649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:33.896721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:33.896734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:33.896778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593724401579157:6255]
2025-10-10T14:04:33.897557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:33.898019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:33.898052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:33.898073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:33.898302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593725979498153:6504]
2025-10-10T14:04:33.898717Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:33.934465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 438 reason: error at write: Disconnected sessionId: src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0
2025-10-10T14:04:33.934812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 438 sessionId: src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0 is DEAD
2025-10-10T14:04:33.937854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:33.937893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0] Write session will restart in 0.008070s
2025-10-10T14:04:33.937991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0] Write session: Do CDS request
2025-10-10T14:04:33.938018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:33.952947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:33.989156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:33.989195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 439
2025-10-10T14:04:34.048457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:34.048636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:34.048651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:34.048661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:34.048730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593734569433129:6504]
2025-10-10T14:04:34.052106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 439 sessionId:  describe result for acl check
2025-10-10T14:04:34.052237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:34.052247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:34.052256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:34.052273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593734569433131:6947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:34.054703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593734569433131:6947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:34.087744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593734569433131:6947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:34.122449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593734569433131:6947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:34.122500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593734569433131:6947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:34.122517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593734569433131:6947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:34.122550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:34.180235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:34.182413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:34.183191Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:34.183208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:34.183249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:34.183478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:34.183653Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593732991514047:6268]
2025-10-10T14:04:34.185702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:34.187035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:34.187247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:34.188421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:34.188733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:34.188741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:34.188748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:34.188755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:34.188762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:34.188769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:34.188774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:34.188781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:34.188788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:34.188796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:34.188801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:34.188808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:34.188850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:34.188948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:34.188992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:34.189038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:34.189082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:34.189147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:34.189188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:34.189229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:34.189270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:34.189313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:34.189358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:34.189398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:34.189437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:34.189501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:34.189556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:34.189606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:34.189650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:34.189699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:34.189739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:34.189788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:34.189832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:34.189883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:34.189924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:34.189974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:34.190016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:34.190065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:34.190108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:34.190157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:34.190205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:34.190255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:34.190294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:34.190344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:34.190389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:34.190440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:34.190483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:34.190527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:34.190907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:34.246396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:34.269953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:34.270000Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:34.270016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:34.270034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:34.270058Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 438 [2:7559593732991514047:6268]
2025-10-10T14:04:34.270111Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:34.270167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:34.270183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:34.270193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:34.270204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:34.270255Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:34.270276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:34.270300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:34.272723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:34.272740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:34.272756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:34.272768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:34.272781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:34.273064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:34.273084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:34.276517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:34.276749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:34.276983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:34.277095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:34.277225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593730274465729:2442], now have 1 active actors on pipe
2025-10-10T14:04:34.277260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593734569433272:6947], now have 1 active actors on pipe
2025-10-10T14:04:34.277281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593734569433129:6504], now have 1 active actors on pipe
2025-10-10T14:04:34.277305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.277332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.277351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.277363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.277407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:34.277505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:34.276435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 438
2025-10-10T14:04:34.276556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 438
2025-10-10T14:04:34.277686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:34.276631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 438, pipe: [1:7559593734569433129:6504]
2025-10-10T14:04:34.277710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:34.277847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.277874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:34.277997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:34.278016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:34.278027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:34.278039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:34.278065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:34.279493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:34.279534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:34.279619Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:34.279661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:34.279681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:34.279692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:34.279730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:34.279784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:34.279841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:34.280588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:34.280624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:34.280683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:34.285376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 439 partition: 0 MaxSeqNo: 36 sessionId: src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0
2025-10-10T14:04:34.293378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760b2f9d-1a20883a-8c32ccda-3b754812_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:34.342264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0] Write session: try to update token
2025-10-10T14:04:34.342322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:34.492348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:34.492381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:34.492391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:34.492450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:34.492463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:34.492475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:34.492485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:34.492496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:34.492533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.492558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.492581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.492599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.492732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:34.492770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:34.492807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:34.492825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:34.492832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:34.492850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:34.492860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:34.501714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:34.549231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId: src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:34.580106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:34.726318Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:34.746254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:34.746310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:34.746379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:34.746394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:34.746444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593732991514042:6268]
2025-10-10T14:04:34.749515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:34.750012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:34.754824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:34.754975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:34.757480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593734569433129:6504]
2025-10-10T14:04:34.765082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:34.765161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0] Write session will restart in 0.009032s
2025-10-10T14:04:34.765264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0] Write session: Do CDS request
2025-10-10T14:04:34.763958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 439 reason: status is not ok: tablet will be restarted right now sessionId: src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0
2025-10-10T14:04:34.765295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:34.764317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 439 sessionId: src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0 is DEAD
2025-10-10T14:04:34.795689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:34.797435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:34.797497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 440
2025-10-10T14:04:34.798199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:34.798421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:34.798460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:34.798474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:34.812318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 440 sessionId:  describe result for acl check
2025-10-10T14:04:34.812450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:34.812460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:34.812470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:34.812488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593734569433357:6958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:34.824487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593734569433357:6958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:34.836199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593734569433357:6958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:34.859905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593734569433414:6504]
2025-10-10T14:04:34.863546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593734569433357:6958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:34.863598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593734569433357:6958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:34.863616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593734569433357:6958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:34.863649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:35.016123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:35.025520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:35.026596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:35.026618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:35.026670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:35.026971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:35.027176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593737286481646:6281]
2025-10-10T14:04:35.041960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:35.043864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:35.044153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:35.045702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:35.046067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:35.046076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:35.046083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:35.046090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:35.046096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:35.046102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:35.046110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:35.046121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:35.046129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.046135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.046142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.046148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.046200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:35.046319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:35.046367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:35.046411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:35.046454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:35.046499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:35.046541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:35.046586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:35.046628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.046673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.046715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.046757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.046803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:35.046870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:35.046930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:35.046987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:35.047035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:35.047087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:35.047141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:35.047191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:35.047238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:35.047317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:35.047369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:35.047424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:35.047468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:35.047515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:35.047559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:35.047607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:35.047653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.047704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.047750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.048275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.048335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.048398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.048440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.048491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.048953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:35.120602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:35.158955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:35.159000Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:35.159016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:35.159037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:35.159062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 439 [2:7559593737286481646:6281]
2025-10-10T14:04:35.159116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:35.159182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:35.159199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:35.159211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:35.159222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:35.159270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:35.159293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:35.159318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:35.160605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.160638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.160650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.160665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.160675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:35.162447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 439
2025-10-10T14:04:35.162533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 439
2025-10-10T14:04:35.162593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 439, pipe: [1:7559593734569433414:6504]
2025-10-10T14:04:35.169597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:35.169633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.169773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.169942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.170148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.170269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:35.170313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593734569433417:6958], now have 1 active actors on pipe
2025-10-10T14:04:35.170335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593734569433334:2442], now have 1 active actors on pipe
2025-10-10T14:04:35.170355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593734569433414:6504], now have 1 active actors on pipe
2025-10-10T14:04:35.170413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:35.170437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:35.170567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593737286481641:6281]
2025-10-10T14:04:35.170581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593737286481641:6281]
2025-10-10T14:04:35.170595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593737286481641:6281]
2025-10-10T14:04:35.170606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593737286481641:6281]
2025-10-10T14:04:35.170644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:35.170742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:35.170775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:35.170792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:35.170802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:35.170839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:35.170886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:35.170944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:35.171118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:35.171133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:35.171278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:35.171335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593737286481641:6281]
2025-10-10T14:04:35.171354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:35.172716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:35.172754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:35.172768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:35.172783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:35.172833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:35.183610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:35.183665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:35.186977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 440 partition: 0 MaxSeqNo: 36 sessionId: src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0
2025-10-10T14:04:35.188508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abeb33b1-a737778f-1fa3a046-bf8c9071_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:35.186529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:35.229352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0] Write session: try to update token
2025-10-10T14:04:35.229413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:35.261358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:35.261388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:35.261400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:35.326687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:35.326727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:35.326742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:35.326753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:35.326765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:35.326806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593737286481641:6281]
2025-10-10T14:04:35.326833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593737286481641:6281]
2025-10-10T14:04:35.326858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593737286481641:6281]
2025-10-10T14:04:35.326882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593737286481641:6281]
2025-10-10T14:04:35.327034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:35.327062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.327074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:35.328206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:35.329296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:35.329331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:35.329364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:35.329392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:35.384827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId: src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:35.407324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:35.571234Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:35.586911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:35.586959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:35.589344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:35.589403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:35.590200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:35.590420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593734569433414:6504]
2025-10-10T14:04:35.590485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:35.597498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 440 reason: error at write: Disconnected sessionId: src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0
2025-10-10T14:04:35.597839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 440 sessionId: src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0 is DEAD
2025-10-10T14:04:35.601397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:35.601456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0] Write session will restart in 0.008174s
2025-10-10T14:04:35.601639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0] Write session: Do CDS request
2025-10-10T14:04:35.601695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:35.622021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:35.670004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:35.670043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 441
2025-10-10T14:04:35.683242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:35.683407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:35.683422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:35.683433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:35.685434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 441 sessionId:  describe result for acl check
2025-10-10T14:04:35.685554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:35.685564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:35.685572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:35.685588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593738864400954:6966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:35.688036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593738864400954:6966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:35.696151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593738864400960:6504]
2025-10-10T14:04:35.776893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593738864400954:6966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:35.809114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593738864400954:6966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:35.815578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593738864400954:6966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:35.815600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593738864400954:6966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:35.815645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:35.910717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:35.921725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:35.922697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:35.922718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:35.922767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:35.923045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:35.923359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593737286481940:6285]
2025-10-10T14:04:35.925524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:35.926928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:35.927175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:35.928538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:35.928883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:35.928891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:35.928897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:35.928903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:35.928909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:35.928915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:35.928921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:35.928927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:35.928934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.928939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.928945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.928950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.928997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:35.929094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:35.929161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:35.929208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:35.929254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:35.929301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:35.929350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:35.929393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:35.929436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.929483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.929525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.929568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.929606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:35.929666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:35.929720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:35.929772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:35.929818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:35.929866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:35.929910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:35.929960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:35.930006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:35.930072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:35.930110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:35.930159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:35.930203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:35.930249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:35.930288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:35.930333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:35.930377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.930502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:35.930543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.930597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:35.930639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.930690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:35.930731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.930782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:35.931187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:36.048977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:36.084277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:36.084328Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:36.084342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:36.084360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:36.084384Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 440 [2:7559593737286481940:6285]
2025-10-10T14:04:36.084432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:36.084493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:36.084506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:36.084517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:36.084527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:36.084572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:36.084589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:36.084611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:36.088929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:36.088963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:36.088976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:36.088989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:36.088999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:36.089303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:36.089319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:36.089442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:36.089596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:36.089813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:36.089921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:36.090005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593738864400960:6504], now have 1 active actors on pipe
2025-10-10T14:04:36.090027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593738864400924:2442], now have 1 active actors on pipe
2025-10-10T14:04:36.090047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593738864401097:6966], now have 1 active actors on pipe
2025-10-10T14:04:36.090074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593737286481933:6285]
2025-10-10T14:04:36.090089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593737286481933:6285]
2025-10-10T14:04:36.090102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593737286481933:6285]
2025-10-10T14:04:36.090113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593737286481933:6285]
2025-10-10T14:04:36.090151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:36.090227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:36.090395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:36.090412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:36.090535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593737286481933:6285]
2025-10-10T14:04:36.090551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:36.093207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:36.093226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:36.093238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:36.093250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:36.093278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:36.093327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 440, pipe: [1:7559593738864400960:6504]
2025-10-10T14:04:36.093491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 440
2025-10-10T14:04:36.093600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 440
2025-10-10T14:04:36.094383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:36.094420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:36.094497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed77816c-c507802a-fb82397e-74dadc9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:36.094531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:36.094548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:36.094559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:36.094596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:36.094643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:36.094686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:36.098817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:36.099302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 441 partition: 0 MaxSeqNo: 36 sessionId: src_id|ed77816c-c507802a-fb82397e-74dadc9d_0
2025-10-10T14:04:36.098869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:36.098949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:36.100092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c08c9eec-527ad9b-cd720b4e-a69f61fb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ed77816c-c507802a-fb82397e-74dadc9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:36.184173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:36.184205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:36.184215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:36.202960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed77816c-c507802a-fb82397e-74dadc9d_0] Write session: try to update token
2025-10-10T14:04:36.203023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed77816c-c507802a-fb82397e-74dadc9d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:36.331727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:36.331968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:36.331985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:36.332045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:36.332061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:36.332076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:36.332087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:36.332096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:36.332133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593737286481933:6285]
2025-10-10T14:04:36.332160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593737286481933:6285]
2025-10-10T14:04:36.332182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593737286481933:6285]
2025-10-10T14:04:36.332202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593737286481933:6285]
2025-10-10T14:04:36.332358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:36.332382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:36.332393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:36.332783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:36.332815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:36.332845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:36.332873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:36.347612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:36.507368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId: src_id|ed77816c-c507802a-fb82397e-74dadc9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:36.555374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:36.661037Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:36.662913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:36.662947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:36.669655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593738864400960:6504]
2025-10-10T14:04:36.669746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:36.669891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:36.669903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:36.676745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 441 reason: error at write: Disconnected sessionId: src_id|ed77816c-c507802a-fb82397e-74dadc9d_0
2025-10-10T14:04:36.677116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 441 sessionId: src_id|ed77816c-c507802a-fb82397e-74dadc9d_0 is DEAD
2025-10-10T14:04:36.681358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed77816c-c507802a-fb82397e-74dadc9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:36.681403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed77816c-c507802a-fb82397e-74dadc9d_0] Write session will restart in 0.006381s
2025-10-10T14:04:36.681516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed77816c-c507802a-fb82397e-74dadc9d_0] Write session: Do CDS request
2025-10-10T14:04:36.681549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed77816c-c507802a-fb82397e-74dadc9d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:36.708698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:36.719949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed77816c-c507802a-fb82397e-74dadc9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:36.725883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:36.725920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 442
2025-10-10T14:04:36.729655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:36.729802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:36.729818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:36.729829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:36.731256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 442 sessionId:  describe result for acl check
2025-10-10T14:04:36.731367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:36.731389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:36.731399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:36.731415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593743159368565:6982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:36.752243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593743159368565:6982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:36.769249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593743159368575:6504]
2025-10-10T14:04:36.791696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593743159368565:6982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:36.818245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593743159368565:6982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:36.818289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593743159368565:6982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:36.818306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593743159368565:6982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:36.818338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:36.920754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:36.930818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:36.931737Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:36.931756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:36.931804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:36.932140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:36.932349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593741581449542:6302]
2025-10-10T14:04:36.934583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:36.941098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:36.941401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:36.946112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:36.946650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:36.946659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:36.946667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:36.946674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:36.946682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:36.946689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:36.946697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:36.946704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:36.946710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:36.946718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:36.946725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:36.946732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:36.946780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:36.946889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:36.946938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:36.946986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:36.947029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:36.947073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:36.947115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:36.947162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:36.947203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:36.947247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:36.947288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:36.947331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:36.947378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:36.947445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:36.947504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:36.947558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:36.947607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:36.947658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:36.947704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:36.947755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:36.947804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:36.947855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:36.947898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:36.947950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:36.947994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:36.948044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:36.948085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:36.948137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:36.948186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:36.948240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:36.948285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:36.948341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:36.948390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:36.948444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:36.948488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:36.948536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:36.949010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:36.988835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:37.017717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:37.017770Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:37.017786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:37.017806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:37.017831Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 441 [2:7559593741581449542:6302]
2025-10-10T14:04:37.017887Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:37.017954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:37.017971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:37.017983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:37.017994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:37.018044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:37.018068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:37.018091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:37.026638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:37.026670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:37.026683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:37.026698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:37.026708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:37.027013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:37.027031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:37.027168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:37.027344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:37.027573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:37.027680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:37.027759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593741581449537:6302]
2025-10-10T14:04:37.027772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593741581449537:6302]
2025-10-10T14:04:37.027785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593741581449537:6302]
2025-10-10T14:04:37.027798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593741581449537:6302]
2025-10-10T14:04:37.027846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:37.027930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:37.028102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:37.028119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:37.028251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593741581449537:6302]
2025-10-10T14:04:37.028271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:37.029312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:37.029326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:37.029337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:37.029349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:37.029378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:37.029910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593743159368652:6982], now have 1 active actors on pipe
2025-10-10T14:04:37.029946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593743159368550:2442], now have 1 active actors on pipe
2025-10-10T14:04:37.029966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593743159368575:6504], now have 1 active actors on pipe
2025-10-10T14:04:37.030336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 441
2025-10-10T14:04:37.030438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 441
2025-10-10T14:04:37.030502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 441, pipe: [1:7559593743159368575:6504]
2025-10-10T14:04:37.033236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:37.033281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:37.033390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:37.033428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:37.033448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:37.033459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:37.033499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:37.033549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:37.033602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:37.038859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 442 partition: 0 MaxSeqNo: 36 sessionId: src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0
2025-10-10T14:04:37.038426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:37.038469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:37.038549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:37.042821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed77816c-c507802a-fb82397e-74dadc9d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:37.088422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0] Write session: try to update token
2025-10-10T14:04:37.088486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:37.171587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:37.171620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:37.171633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:37.171697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:37.171713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:37.171726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:37.171738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:37.171749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:37.171791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593741581449537:6302]
2025-10-10T14:04:37.171816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593741581449537:6302]
2025-10-10T14:04:37.171840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593741581449537:6302]
2025-10-10T14:04:37.171861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593741581449537:6302]
2025-10-10T14:04:37.171981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:37.172011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:37.172019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:37.172041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:37.172045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:37.172057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:37.172071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:37.173108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:37.298302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId: src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:37.319346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:37.402994Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:37.405748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:37.405789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:37.409226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:37.409393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:37.409541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593743159368575:6504]
2025-10-10T14:04:37.409625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:37.409636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:37.421551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 442 reason: error at write: Disconnected sessionId: src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0
2025-10-10T14:04:37.421919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 442 sessionId: src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0 is DEAD
2025-10-10T14:04:37.425307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:37.425367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0] Write session will restart in 0.009996s
2025-10-10T14:04:37.425461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0] Write session: Do CDS request
2025-10-10T14:04:37.425503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:37.442422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:37.442458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 443
2025-10-10T14:04:37.445352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:37.446457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:37.446717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:37.446749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:37.446767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:37.449182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 443 sessionId:  describe result for acl check
2025-10-10T14:04:37.449327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:37.449338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:37.449347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:37.449365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593747454336150:6988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:37.452807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593747454336150:6988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:37.472031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593747454336150:6988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:37.494409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593747454336150:6988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:37.494455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593747454336150:6988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:37.494473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593747454336150:6988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:37.494508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:37.508297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593747454336216:6504]
2025-10-10T14:04:37.596944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:37.608600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:37.609566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:37.609587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:37.609638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:37.609941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:37.610131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593745876417105:6306]
2025-10-10T14:04:37.612408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:37.613645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:37.613886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:37.615203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:37.615538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:37.615556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:37.615563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:37.615571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:37.615578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:37.615586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:37.615592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:37.615600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:37.615607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:37.615614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:37.615621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:37.615629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:37.615678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:37.615790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:37.615841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:37.615896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:37.615950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:37.616005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:37.616054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:37.616104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:37.616157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:37.616209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:37.616260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:37.616312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:37.616361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:37.616431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:37.616494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:37.616551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:37.616605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:37.617054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:37.617118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:37.617191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:37.617263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:37.617321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:37.617377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:37.617434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:37.617489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:37.617545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:37.617597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:37.617657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:37.617712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:37.617760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:37.617795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:37.617833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:37.617879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:37.617950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:37.618019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:37.618061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:37.618420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:37.692280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:37.760314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:37.760356Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:37.760367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:37.760384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:37.760404Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 442 [2:7559593745876417105:6306]
2025-10-10T14:04:37.760449Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:37.760502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:37.760514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:37.760525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:37.760536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:37.760582Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:37.760604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:37.760625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:37.762978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:37.763004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:37.763017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:37.763030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:37.763039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:37.763301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:37.763316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:37.763439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:37.763606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:37.763808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:37.763910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:37.763977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:37.763991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:37.764004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:37.764015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:37.764057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:37.764132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:37.764297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:37.764313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:37.764435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:37.764453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:37.765271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:37.765284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:37.765297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:37.765307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:37.765333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:37.767122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 442
2025-10-10T14:04:37.767211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 442, pipe: [1:7559593747454336216:6504]
2025-10-10T14:04:37.767273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 442
2025-10-10T14:04:37.772480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593747454336139:2442], now have 1 active actors on pipe
2025-10-10T14:04:37.772537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593747454336216:6504], now have 1 active actors on pipe
2025-10-10T14:04:37.772559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593747454336202:6988], now have 1 active actors on pipe
2025-10-10T14:04:37.772633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:37.772657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:37.772760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85805188-ffd60a38-21980354-ff8811cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:37.772799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:37.772817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:37.772828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:37.772865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:37.772911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:37.772956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:37.777236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:37.777266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:37.777345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:37.777748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 443 partition: 0 MaxSeqNo: 36 sessionId: src_id|85805188-ffd60a38-21980354-ff8811cb_0
2025-10-10T14:04:37.781761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65e5eff5-d0578f50-8dd2bdf9-2ea903bf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85805188-ffd60a38-21980354-ff8811cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:37.823557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85805188-ffd60a38-21980354-ff8811cb_0] Write session: try to update token
2025-10-10T14:04:37.823610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85805188-ffd60a38-21980354-ff8811cb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:37.849698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:37.849732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:37.849767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:37.849892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:37.851739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:37.852991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:37.853430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:37.883752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:37.890417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:37.892251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:37.896053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:37.896069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:37.896079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:37.896130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:38.000436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:38.000469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:38.000480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:38.054357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId: src_id|85805188-ffd60a38-21980354-ff8811cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:38.110541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:38.110569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:38.110583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:38.110593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:38.110603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:38.110641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:38.110667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:38.110690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:38.110711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593745876417099:6306]
2025-10-10T14:04:38.110866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:38.110879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:38.110889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:38.110935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:38.110958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:38.110967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:38.112099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:38.115781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:38.116108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:38.116143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:38.116169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:38.116195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:38.310387Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:38.312068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:38.312102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:38.313322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:38.313486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593747454336216:6504]
2025-10-10T14:04:38.313579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:38.313595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:38.319141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:38.325256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 443 reason: error at write: Disconnected sessionId: src_id|85805188-ffd60a38-21980354-ff8811cb_0
2025-10-10T14:04:38.325610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 443 sessionId: src_id|85805188-ffd60a38-21980354-ff8811cb_0 is DEAD
2025-10-10T14:04:38.329685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85805188-ffd60a38-21980354-ff8811cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:38.329726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85805188-ffd60a38-21980354-ff8811cb_0] Write session will restart in 0.005477s
2025-10-10T14:04:38.329827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85805188-ffd60a38-21980354-ff8811cb_0] Write session: Do CDS request
2025-10-10T14:04:38.329862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85805188-ffd60a38-21980354-ff8811cb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:38.344783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85805188-ffd60a38-21980354-ff8811cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:38.347268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:38.347307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 444
2025-10-10T14:04:38.348590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:38.348747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:38.348764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:38.348775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:38.350265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 444 sessionId:  describe result for acl check
2025-10-10T14:04:38.350390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:38.350401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:38.350410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:38.350428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593751749303772:7004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:38.357245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593751749303772:7004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:38.371709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593751749303772:7004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:38.392520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593751749303772:7004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:38.392569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593751749303772:7004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:38.392586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593751749303772:7004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:38.392615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:38.415806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593751749303875:6504]
2025-10-10T14:04:38.502309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:38.518885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:38.519724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:38.519757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:38.519802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:38.520056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:38.520235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593750171384722:6323]
2025-10-10T14:04:38.523356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:38.524691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:38.524958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:38.526277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:38.526592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:38.526599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:38.526605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:38.526612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:38.526619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:38.526625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:38.526633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:38.526640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:38.526646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:38.526653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:38.526659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:38.526666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:38.526710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:38.526819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:38.526875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:38.526927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:38.526973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:38.527017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:38.527062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:38.527107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:38.527151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:38.527196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:38.527243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:38.527290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:38.527332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:38.527395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:38.527453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:38.527508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:38.527558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:38.527607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:38.527652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:38.527704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:38.527752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:38.527805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:38.527849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:38.527904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:38.527950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:38.528001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:38.528047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:38.528100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:38.528152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:38.528204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:38.528248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:38.528299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:38.528345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:38.528394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:38.528439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:38.528490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:38.528948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:38.564551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:38.577863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:38.577910Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:38.577928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:38.577947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:38.577970Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 443 [2:7559593750171384722:6323]
2025-10-10T14:04:38.578025Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:38.578094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:38.578112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:38.578125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:38.578136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:38.578189Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:38.578212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:38.578236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:38.579546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:38.579563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:38.579575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:38.579590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:38.579600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:38.579867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:38.579883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:38.580019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:38.580195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:38.580413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:38.580526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:38.580602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593750171384716:6323]
2025-10-10T14:04:38.580617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593750171384716:6323]
2025-10-10T14:04:38.580629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593750171384716:6323]
2025-10-10T14:04:38.580642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593750171384716:6323]
2025-10-10T14:04:38.580894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:38.580905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:38.580916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:38.580926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:38.581876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:38.581984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:38.582165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:38.582182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:38.582245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593751749303830:7004], now have 1 active actors on pipe
2025-10-10T14:04:38.582268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593751749303875:6504], now have 1 active actors on pipe
2025-10-10T14:04:38.582287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593751749303762:2442], now have 1 active actors on pipe
2025-10-10T14:04:38.582433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593750171384716:6323]
2025-10-10T14:04:38.582463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:38.582522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:38.582543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:38.582730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:38.582770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:38.582787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:38.582797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:38.582835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:38.582881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:38.582943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:38.583192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:38.581993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 443
2025-10-10T14:04:38.582077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 443, pipe: [1:7559593751749303875:6504]
2025-10-10T14:04:38.582142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 443
2025-10-10T14:04:38.585463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:38.585493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:38.585559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:38.585922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 444 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0
2025-10-10T14:04:38.593782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85805188-ffd60a38-21980354-ff8811cb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:38.647906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0] Write session: try to update token
2025-10-10T14:04:38.647965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:38.745177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:38.745214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:38.745227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:38.745302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:38.745318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:38.745332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:38.745343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:38.745354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:38.745396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593750171384716:6323]
2025-10-10T14:04:38.745426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593750171384716:6323]
2025-10-10T14:04:38.745451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593750171384716:6323]
2025-10-10T14:04:38.745472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593750171384716:6323]
2025-10-10T14:04:38.745628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:38.745655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:38.745666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:38.746860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:38.749295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:38.749331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:38.749364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:38.749398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:38.835536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId: src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:38.871908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:38.927503Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:38.959773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:38.959822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:38.963384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593751749303875:6504]
2025-10-10T14:04:38.963470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:38.963594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:38.963606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:38.965659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:39.065736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593756044271408:6504]
2025-10-10T14:04:39.073513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 444 reason: error at write: Disconnected sessionId: src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0
2025-10-10T14:04:39.073894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 444 sessionId: src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0 is DEAD
2025-10-10T14:04:39.076835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:39.076870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0] Write session will restart in 0.009126s
2025-10-10T14:04:39.076971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0] Write session: Do CDS request
2025-10-10T14:04:39.077002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:39.096181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:39.101258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:39.101297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 445
2025-10-10T14:04:39.105073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:39.105469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:39.105492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:39.105503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:39.106896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 445 sessionId:  describe result for acl check
2025-10-10T14:04:39.107020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:39.107035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:39.107043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:39.107061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593756044271454:7011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:39.110621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593756044271454:7011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:39.149254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593756044271454:7011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:39.183697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593756044271454:7011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:39.183746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593756044271454:7011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:39.183766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593756044271454:7011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:39.183803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:39.231005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:39.234590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:39.235478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:39.235501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:39.235549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:39.235840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:39.236044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593754466352301:6327]
2025-10-10T14:04:39.238469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:39.241819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:39.242097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:39.243465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:39.243808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:39.243817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:39.243826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:39.243834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:39.243841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:39.243848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:39.243855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:39.243862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:39.243869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:39.243876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:39.243884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:39.243891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:39.243939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:39.244044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:39.244095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:39.244149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:39.244198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:39.244245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:39.244306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:39.244355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:39.244399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:39.244450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:39.244498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:39.244547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:39.244609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:39.244673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:39.244753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:39.244815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:39.244867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:39.244921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:39.244966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:39.245024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:39.245074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:39.247870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:39.247958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:39.248040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:39.248093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:39.248151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:39.248210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:39.248268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:39.248319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:39.248375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:39.248422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:39.248479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:39.248527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:39.248591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:39.248649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:39.248707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:39.249202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:39.301034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:39.332093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:39.332145Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:39.332160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:39.332179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:39.332205Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 444 [2:7559593754466352301:6327]
2025-10-10T14:04:39.332261Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:39.332321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:39.332335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:39.332347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:39.332357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:39.332404Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:39.332426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:39.332449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:39.336685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:39.336733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:39.336748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:39.336762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:39.336773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:39.337079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:39.337097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:39.337260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:39.337443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:39.337662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:39.337766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:39.337857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593756044271589:7011], now have 1 active actors on pipe
2025-10-10T14:04:39.337881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593756044271408:6504], now have 1 active actors on pipe
2025-10-10T14:04:39.337902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593751749304062:2442], now have 1 active actors on pipe
2025-10-10T14:04:39.337930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.337943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.337956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.337968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.338039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:39.338057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:39.338076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:39.338087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:39.339115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 444
2025-10-10T14:04:39.339204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 444, pipe: [1:7559593756044271408:6504]
2025-10-10T14:04:39.339272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 444
2025-10-10T14:04:39.338656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:39.338753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:39.338948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:39.338965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:39.339128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.339150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:39.339383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:39.340192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:39.340216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:39.356300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 445 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0
2025-10-10T14:04:39.352330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:39.352400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:39.352421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:39.352433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:39.352474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:39.352523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:39.352608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:39.355890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:39.355924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:39.356001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:39.361727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff2ed250-866518d2-7cf0491a-842af9ab_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:39.443377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0] Write session: try to update token
2025-10-10T14:04:39.443439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:39.516347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:39.516383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:39.516424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.516562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:39.516574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:39.516586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:39.516599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:39.516664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:39.538225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:39.540042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:39.549166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:39.558620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:39.560670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:39.561335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:39.662891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:39.662915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:39.662926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:39.662983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:39.662995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:39.663008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:39.663018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:39.663026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:39.663066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.663088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.663109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.663134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593754466352296:6327]
2025-10-10T14:04:39.663259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:39.663281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:39.663291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:39.664586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:39.665520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:39.665551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:39.665574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:39.665597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:39.699249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId: src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:39.726812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:39.876071Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:39.880360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:39.880401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:39.882105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:39.886837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:39.893470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593756044271408:6504]
2025-10-10T14:04:39.893689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:39.894858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 445 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0
2025-10-10T14:04:39.895700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 445 sessionId: src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0 is DEAD
2025-10-10T14:04:39.897465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:39.897527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0] Write session will restart in 0.005333s
2025-10-10T14:04:39.897705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0] Write session: Do CDS request
2025-10-10T14:04:39.897762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:39.936515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:39.941351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:39.941403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 446
2025-10-10T14:04:39.949347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:39.949543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:39.949560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:39.949572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:39.952469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 446 sessionId:  describe result for acl check
2025-10-10T14:04:39.952748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:39.952774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:39.952792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:39.952830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593756044271696:7026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:39.955767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593756044271696:7026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:39.978971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593756044271696:7026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:40.001274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593760339239021:6504]
2025-10-10T14:04:40.006640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593756044271696:7026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:40.006682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593756044271696:7026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:40.006700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593756044271696:7026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:40.006731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:40.214185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:40.221087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:40.239318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:40.239357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:40.239440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:40.239811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:40.239983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593758761319920:6338]
2025-10-10T14:04:40.241967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:40.243149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:40.243367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:40.244548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:40.244880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:40.244887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:40.244893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:40.244900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:40.244906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:40.244914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:40.244920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:40.244926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:40.244932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:40.244938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:40.244943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:40.244950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:40.244992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:40.245094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:40.245164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:40.245209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:40.245252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:40.245295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:40.245338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:40.245388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:40.245431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:40.245478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:40.245524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:40.245568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:40.245610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:40.245670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:40.245732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:40.245782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:40.245827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:40.245879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:40.245922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:40.245974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:40.246021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:40.246072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:40.246117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:40.246170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:40.246212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:40.246264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:40.246307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:40.246358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:40.246404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:40.246455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:40.246501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:40.246550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:40.246598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:40.246646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:40.246687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:40.246735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:40.247148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:40.295877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:40.329376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:40.329432Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:40.329462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:40.329483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:40.329509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 445 [2:7559593758761319920:6338]
2025-10-10T14:04:40.329578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:40.329661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:40.329678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:40.329690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:40.329701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:40.329752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:40.329775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:40.329797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:40.331114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:40.331131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:40.331146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:40.331159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:40.331171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:40.331470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:40.331487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:40.331633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:40.331817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:40.332056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:40.332172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:40.332264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.332280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.332294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.332308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.332355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:40.332435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:40.332610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:40.332629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:40.332789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.332810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:40.333246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:40.333261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:40.333271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:40.333282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:40.333308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:40.337002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 445, pipe: [1:7559593760339239021:6504]
2025-10-10T14:04:40.337114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 445
2025-10-10T14:04:40.337205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 445
2025-10-10T14:04:40.337643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593760339239021:6504], now have 1 active actors on pipe
2025-10-10T14:04:40.337690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593760339239025:7026], now have 1 active actors on pipe
2025-10-10T14:04:40.337713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593756044271675:2442], now have 1 active actors on pipe
2025-10-10T14:04:40.341391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:40.341437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:40.341526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:40.341565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:40.341583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:40.341594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:40.341634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:40.341682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:40.341731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:40.346596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 446 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0
2025-10-10T14:04:40.345271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:40.345319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:40.345405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:40.349761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb0400d1-b5d7716e-e93b7d30-e431c856_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:40.391842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0] Write session: try to update token
2025-10-10T14:04:40.391903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:40.590410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:40.590442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:40.590474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.590593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:40.590603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:40.590614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:40.590727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:40.590925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:40.595839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:40.596962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:40.598032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:40.599231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:40.600798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:40.604283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId: src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:40.646834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:40.742701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:40.742893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:40.742918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:40.742958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:40.742970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:40.742980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:40.742988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:40.742996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:40.743034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.743051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.743070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.743087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593758761319914:6338]
2025-10-10T14:04:40.743239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:40.743250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:40.743260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:40.743337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:40.743360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:40.743369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:40.744441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:40.745315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:40.745345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:40.745370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:40.745397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:40.938231Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:40.958871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:04:40.960737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:40.967083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593760339239021:6504]
2025-10-10T14:04:40.967248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:40.969186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:40.969202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:40.969386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 446 reason: error at write: Disconnected sessionId: src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0
2025-10-10T14:04:40.969688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 446 sessionId: src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0 is DEAD
2025-10-10T14:04:40.972731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:40.972794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0] Write session will restart in 0.005798s
2025-10-10T14:04:40.972954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0] Write session: Do CDS request
2025-10-10T14:04:40.973025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:40.996382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:40.998108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:40.998144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 447
2025-10-10T14:04:41.002037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:41.002157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:41.002174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:41.002184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:41.003568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 447 sessionId:  describe result for acl check
2025-10-10T14:04:41.003681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:41.003691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:41.003700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:41.003720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593764634206602:7033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:41.006493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593764634206602:7033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:41.052141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593764634206602:7033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:41.062920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593764634206637:6504]
2025-10-10T14:04:41.100002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593764634206602:7033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:41.100052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593764634206602:7033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:41.100068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593764634206602:7033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:41.100100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:41.249331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:41.262021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:41.262912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:41.262930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:41.262979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:41.263224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:41.263395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593763056287516:6346]
2025-10-10T14:04:41.269616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:41.277463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:41.277708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:41.279077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:41.279394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:41.279402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:41.279410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:41.279416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:41.279423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:41.279430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:41.279437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:41.279444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:41.279451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:41.279458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:41.279463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:41.279469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:41.279517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:41.279619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:41.279667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:41.279711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:41.279755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:41.279799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:41.279841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:41.279883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:41.279923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:41.279968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:41.280009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:41.280050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:41.280087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:41.280149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:41.280208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:41.280260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:41.280304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:41.280353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:41.280396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:41.280447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:41.280493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:41.280541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:41.280582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:41.280632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:41.280677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:41.280726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:41.280785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:41.280834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:41.280878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:41.280925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:41.280967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:41.281015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:41.281059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:41.281106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:41.285271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:41.285358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:41.285791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:41.396078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:41.422847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:41.422890Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:41.422904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:41.422922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:41.422945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 446 [2:7559593763056287516:6346]
2025-10-10T14:04:41.422997Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:41.423058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:41.423073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:41.423083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:41.423095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:41.423142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:41.423162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:41.423196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:41.433261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:41.433294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:41.433307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:41.433321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:41.433331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:41.433614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:41.433631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:41.433756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:41.433930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:41.434132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:41.434237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:41.434311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.434324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.434336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.434348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.434395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:41.434473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:41.434632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:41.434648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:41.434775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.434793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:41.438949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 446, pipe: [1:7559593764634206637:6504]
2025-10-10T14:04:41.439089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 446
2025-10-10T14:04:41.439174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 446
2025-10-10T14:04:41.437982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:41.438011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:41.438024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:41.438035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:41.438058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:41.441235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593764634206637:6504], now have 1 active actors on pipe
2025-10-10T14:04:41.441269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593764634206689:7033], now have 1 active actors on pipe
2025-10-10T14:04:41.441293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593760339239283:2442], now have 1 active actors on pipe
2025-10-10T14:04:41.441350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:41.441373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:41.441468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:41.441506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:41.441524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:41.441535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:41.441574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:41.441621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:41.441669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:41.449263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:41.449306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:41.449385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:41.450277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 447 partition: 0 MaxSeqNo: 36 sessionId: src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0
2025-10-10T14:04:41.453649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f3b7565-f2d72f63-4792f75c-b7397401_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:41.512447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0] Write session: try to update token
2025-10-10T14:04:41.512508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:41.524580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:41.524612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:41.524635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:41.737740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:41.737774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:41.737786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:41.737850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:41.737867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:41.737881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:41.737892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:41.737903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:41.737954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.737986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.738011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.738039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.738275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:41.738278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:41.738302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:41.738312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:41.738314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:41.738340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:41.738391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:41.743568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:41.792804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId: src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:41.831702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:41.940434Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:41.980808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:41.980864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:41.980944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:41.980961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:41.981006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593763056287510:6346]
2025-10-10T14:04:41.981852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:41.982598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:41.989385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:41.993302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:41.993497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593764634206637:6504]
2025-10-10T14:04:42.049909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 447 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0
2025-10-10T14:04:42.050273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 447 sessionId: src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0 is DEAD
2025-10-10T14:04:42.055931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:42.055993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0] Write session will restart in 0.008008s
2025-10-10T14:04:42.056120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0] Write session: Do CDS request
2025-10-10T14:04:42.056153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:42.071421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:42.073209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:42.073246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 448
2025-10-10T14:04:42.073984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:42.074130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:42.074153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:42.074165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:42.075704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 448 sessionId:  describe result for acl check
2025-10-10T14:04:42.075850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:42.075868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:42.075879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:42.075899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593768929174231:7052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:42.078961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593768929174231:7052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:42.095298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593768929174245:6504]
2025-10-10T14:04:42.155773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593768929174231:7052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:42.190366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593768929174231:7052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:42.190423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593768929174231:7052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:42.190444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593768929174231:7052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:42.190479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:42.278194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:42.297578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:42.298820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:42.298855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:42.298906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:42.299414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:42.299646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593767351255124:6363]
2025-10-10T14:04:42.302288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:42.309860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:42.310159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:42.311673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:42.312062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:42.312071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:42.312080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:42.312089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:42.312097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:42.312106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:42.312114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:42.312122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:42.312130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:42.312138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:42.312145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:42.312152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:42.312211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:42.312347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:42.312406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:42.312465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:42.312547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:42.312605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:42.312659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:42.312716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:42.312768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:42.312843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:42.312903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:42.312956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:42.313009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:42.313092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
E1010 14:04:42.314055641  106874 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:04:42.313967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:42.314057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:42.314122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:42.314187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:42.314243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:42.314306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:42.314365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:42.314428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:42.314481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:42.314542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:42.314600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:42.314663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:42.314717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:42.314782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:42.314839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:42.314899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:42.314954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:42.315019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:42.315073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:42.315136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:42.315186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:42.315249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:42.315755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:42.319414Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:04:42.368395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:42.382239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:42.382297Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:42.382315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:42.382335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:42.382360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 447 [2:7559593767351255124:6363]
2025-10-10T14:04:42.382418Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:42.382483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:42.382499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:42.382512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:42.382523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:42.382575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:42.382598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:42.382621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:42.435250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:42.435275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:42.435283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:42.435293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:42.435303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:42.435581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:42.435597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:42.435718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:42.435868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:42.436059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:42.436164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:42.436239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.436256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.436268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.436281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.436325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:42.436405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:42.436567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:42.436583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:42.436711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.436730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:42.437561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:42.437580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:42.437590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:42.437601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:42.437625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:42.439056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593768929174245:6504], now have 1 active actors on pipe
2025-10-10T14:04:42.439091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593764634206909:2442], now have 1 active actors on pipe
2025-10-10T14:04:42.439113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593768929174400:7052], now have 1 active actors on pipe
2025-10-10T14:04:42.442601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:42.442642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:42.442728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c0435cc-19f78ef9-317875d3-444f0979_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:42.442765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:42.442785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:42.442798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:42.442838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:42.442884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:42.442933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:42.441380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 447
2025-10-10T14:04:42.441506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 447
2025-10-10T14:04:42.441584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 447, pipe: [1:7559593768929174245:6504]
2025-10-10T14:04:42.444032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:42.444065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:42.444136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:42.444542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 448 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c0435cc-19f78ef9-317875d3-444f0979_0
2025-10-10T14:04:42.448276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dad53a1f-b142a3c4-b97c1754-3ea021da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c0435cc-19f78ef9-317875d3-444f0979_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:42.489305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:42.489345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:42.489360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:42.551171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0435cc-19f78ef9-317875d3-444f0979_0] Write session: try to update token
2025-10-10T14:04:42.551236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0435cc-19f78ef9-317875d3-444f0979_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:42.624336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:42.624373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:42.624387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:42.624522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:42.624539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:42.624554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:42.624567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:42.624580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:42.624619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.624650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.624677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.624701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.625093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:42.625146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:42.625179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:42.625211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:42.676098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:42.676149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:42.676163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:42.685610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:42.738185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId: src_id|9c0435cc-19f78ef9-317875d3-444f0979_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:42.768844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:42.868340Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:42.870406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:42.870427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:42.870477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593767351255119:6363]
2025-10-10T14:04:42.870671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:42.870744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:42.870775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:42.872421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:42.873355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593768929174245:6504]
2025-10-10T14:04:42.873453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:42.873585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:42.873597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:42.977084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593768929174549:6504]
2025-10-10T14:04:42.977244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 448 reason: error at write: Disconnected sessionId: src_id|9c0435cc-19f78ef9-317875d3-444f0979_0
2025-10-10T14:04:42.977548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 448 sessionId: src_id|9c0435cc-19f78ef9-317875d3-444f0979_0 is DEAD
2025-10-10T14:04:42.979092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0435cc-19f78ef9-317875d3-444f0979_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:42.979144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0435cc-19f78ef9-317875d3-444f0979_0] Write session will restart in 0.007505s
2025-10-10T14:04:42.979301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0435cc-19f78ef9-317875d3-444f0979_0] Write session: Do CDS request
2025-10-10T14:04:42.979346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0435cc-19f78ef9-317875d3-444f0979_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:42.998351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:42.998388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 449
2025-10-10T14:04:43.002060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0435cc-19f78ef9-317875d3-444f0979_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:43.005420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:43.005588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:43.005607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:43.005619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:43.010721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 449 sessionId:  describe result for acl check
2025-10-10T14:04:43.010864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:43.010875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:43.010884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:43.010902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593773224141903:7059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:43.018817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593773224141903:7059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:43.057609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593773224141903:7059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:43.090935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593773224141903:7059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:43.090982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593773224141903:7059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:43.091001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593773224141903:7059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:43.091035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:43.126289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:43.150076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:43.151074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:43.151095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:43.151146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:43.151470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:43.151672Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593771646222721:6367]
2025-10-10T14:04:43.156074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:43.167212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:43.167493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:43.168861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:43.169257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:43.169265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:43.169273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:43.169281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:43.169289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:43.169296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:43.169303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:43.169310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:43.169318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:43.169326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:43.169336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:43.169343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:43.169395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:43.169521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:43.169576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:43.169632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:43.169685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:43.169742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:43.169794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:43.169846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:43.169896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:43.169950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:43.170003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:43.170058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:43.170104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:43.170180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:43.170248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:43.170312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:43.170369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:43.170430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:43.170481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:43.170539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:43.170593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:43.170652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:43.170705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:43.170766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:43.170820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:43.170881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:43.170934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:43.171000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:43.171058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:43.171127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:43.171187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:43.171249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:43.171308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:43.171373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:43.171429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:43.171490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:43.171970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:43.217766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:43.242596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:43.242645Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:43.242662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:43.242683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:43.242707Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 448 [2:7559593771646222721:6367]
2025-10-10T14:04:43.242764Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:43.242819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:43.242834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:43.242846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:43.242858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:43.242906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:43.242930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:43.242954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:43.265915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:43.265947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:43.265960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:43.265974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:43.265986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:43.266263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:43.266280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:43.266422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:43.266616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:43.266853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:43.266977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:43.267047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593771646222706:6367]
2025-10-10T14:04:43.267062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593771646222706:6367]
2025-10-10T14:04:43.267077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593771646222706:6367]
2025-10-10T14:04:43.267090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593771646222706:6367]
2025-10-10T14:04:43.267136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:43.267217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:43.267407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:43.267425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:43.267554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593771646222706:6367]
2025-10-10T14:04:43.267575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:43.268501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:43.268525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:43.268538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:43.268550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:43.268575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:43.269456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593768929174549:6504], now have 1 active actors on pipe
2025-10-10T14:04:43.269493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593773224142077:7059], now have 1 active actors on pipe
2025-10-10T14:04:43.269514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593768929174503:2442], now have 1 active actors on pipe
2025-10-10T14:04:43.270706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 448, pipe: [1:7559593768929174549:6504]
2025-10-10T14:04:43.270826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 448
2025-10-10T14:04:43.270902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 448
2025-10-10T14:04:43.281265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:43.281316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:43.281428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:43.281464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:43.281481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:43.281493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:43.281529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:43.281574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:43.281627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:43.285532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:43.285575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:43.285657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:43.286952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c0435cc-19f78ef9-317875d3-444f0979_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:43.286125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 449 partition: 0 MaxSeqNo: 36 sessionId: src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0
2025-10-10T14:04:43.341019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:43.341052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:43.341064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:43.363123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0] Write session: try to update token
2025-10-10T14:04:43.363182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:43.519382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:43.519416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:43.519429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:43.519486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:43.519501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:43.519515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:43.519526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:43.519539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:43.519574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593771646222706:6367]
2025-10-10T14:04:43.519603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593771646222706:6367]
2025-10-10T14:04:43.519630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593771646222706:6367]
2025-10-10T14:04:43.519653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593771646222706:6367]
2025-10-10T14:04:43.519797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:43.519824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:43.519837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:43.520250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:43.520286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:43.520330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:43.520361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:43.520901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:43.565475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId: src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:43.600525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:43.750610Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:43.768102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:43.768153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:43.775341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593768929174549:6504]
2025-10-10T14:04:43.775457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:43.775470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:43.780714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:43.787564Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:43.827127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 449 reason: error at write: Disconnected sessionId: src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0
2025-10-10T14:04:43.827493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 449 sessionId: src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0 is DEAD
2025-10-10T14:04:43.833436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:43.833505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0] Write session will restart in 0.006989s
2025-10-10T14:04:43.833679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0] Write session: Do CDS request
2025-10-10T14:04:43.833731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:43.866328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:43.866371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 450
2025-10-10T14:04:43.869984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:43.876279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593773224142155:6504]
2025-10-10T14:04:43.881655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:43.881814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:43.881831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:43.881841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:43.883205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 450 sessionId:  describe result for acl check
2025-10-10T14:04:43.883324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:43.883335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:43.883343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:43.883362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593773224142157:7073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:43.885948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593773224142157:7073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:43.915498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593773224142157:7073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:43.942719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593773224142157:7073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:43.942771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593773224142157:7073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:43.942790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593773224142157:7073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:43.942824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:44.064445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:44.065050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:44.065897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:44.065933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:44.065980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:44.066239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:44.066444Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593775941190317:6384]
2025-10-10T14:04:44.074248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:44.075705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:44.075947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:44.077354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:44.077726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:44.077736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:44.077742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:44.077749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:44.077756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:44.077762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:44.077769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:44.077776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:44.077782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:44.077790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:44.077796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:44.077802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:44.077862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:44.077967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:44.078012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:44.078056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:44.078096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:44.078137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:44.078176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:44.078216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:44.078257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:44.078301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:44.078343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:44.078383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:44.078425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:44.078486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:44.078541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:44.078590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:44.078631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:44.078679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:44.078724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:44.078776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:44.078820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:44.078864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:44.078905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:44.078954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:44.079000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:44.079046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:44.079098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:44.079152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:44.079198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:44.079249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:44.079292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:44.079344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:44.079385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:44.079432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:44.079473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:44.079545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:44.079981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:44.325520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:44.357542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:44.357590Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:44.357607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:44.357626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:44.357652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 449 [2:7559593775941190317:6384]
2025-10-10T14:04:44.357703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:44.357766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:44.357780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:44.357791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:44.357802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:44.357848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:44.357867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:44.357888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:44.359441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:44.359469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:44.359482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:44.359493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:44.359504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:44.359759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:44.359775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:44.359904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:44.360069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:44.360288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:44.360407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:44.360494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.360509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.360520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.360531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.360577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:44.360657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:44.360810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:44.360823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:44.360961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.360980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:44.365570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:44.365584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:44.365596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:44.365613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:44.365639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:44.367563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 449
2025-10-10T14:04:44.367654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 449
2025-10-10T14:04:44.367718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 449, pipe: [1:7559593773224142155:6504]
2025-10-10T14:04:44.381286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593773224142254:7073], now have 1 active actors on pipe
2025-10-10T14:04:44.381347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593773224142133:2442], now have 1 active actors on pipe
2025-10-10T14:04:44.381373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593773224142155:6504], now have 1 active actors on pipe
2025-10-10T14:04:44.381438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:44.381463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:44.381571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:44.381609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:44.381626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:44.381637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:44.381678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:44.381726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:44.381784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:44.385295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:44.385330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:44.385421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:44.385902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 450 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0
2025-10-10T14:04:44.386911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85e4b92d-e3a6dfdb-2d62de5c-5ff4e826_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:44.462404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0] Write session: try to update token
2025-10-10T14:04:44.462467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:44.600204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId: src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:44.630774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:44.634407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:44.634439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:44.634449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:44.634506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:44.634520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:44.634531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:44.634541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:44.634550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:44.634583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.634607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.634629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.634648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.634873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:44.634895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:44.634927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:44.634951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:44.634960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:44.635910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:44.641282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:44.641315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:44.641339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:44.641363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:44.795903Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:44.814534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:44.814570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:44.814614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593775941190312:6384]
2025-10-10T14:04:44.814822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:44.816510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:44.816539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:44.823089Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:44.871799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:44.885350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 450 reason: error at write: Disconnected sessionId: src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0
2025-10-10T14:04:44.885710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 450 sessionId: src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0 is DEAD
2025-10-10T14:04:44.886456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:44.886498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0] Write session will restart in 0.008791s
2025-10-10T14:04:44.886637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0] Write session: Do CDS request
2025-10-10T14:04:44.886680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:44.905259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:44.908817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593773224142155:6504]
2025-10-10T14:04:44.909004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:44.909018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 451
2025-10-10T14:04:44.917743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:44.917883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:44.917898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:44.917909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:44.922441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 451 sessionId:  describe result for acl check
2025-10-10T14:04:44.922579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:44.922590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:44.922600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:44.922616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593777519109779:7086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:44.925098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593777519109779:7086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:44.946095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593777519109779:7086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:44.960215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593777519109779:7086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:44.960263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593777519109779:7086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:44.960283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593777519109779:7086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:44.960318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:45.008561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593781814077169:6504]
2025-10-10T14:04:45.113366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:45.115965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:45.116872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:45.116890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:45.116935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:45.117214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:45.117415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593780236157919:6394]
2025-10-10T14:04:45.120315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:45.121610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:45.121821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:45.123109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:45.123418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:45.123427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:45.123433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:45.123439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:45.123446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:45.123453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:45.123459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:45.123466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:45.123472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:45.123479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:45.123486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:45.123493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:45.123539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:45.123641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:45.123686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:45.123729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:45.123770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:45.123810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:45.123850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:45.123892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:45.123930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:45.123972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:45.124011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:45.124055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:45.124095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:45.124158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:45.124213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:45.124263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:45.124309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:45.124357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:45.124397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:45.124442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:45.124491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:45.124540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:45.124578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:45.124628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:45.124670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:45.124716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:45.124759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:45.124812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:45.124879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:45.124935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:45.124981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:45.125034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:45.125082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:45.126528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:45.126596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:45.126653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:45.127101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:45.266423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:45.306970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 450, pipe: [1:7559593781814077169:6504]
2025-10-10T14:04:45.301406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:45.307078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 450
2025-10-10T14:04:45.301454Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:45.307146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 450
2025-10-10T14:04:45.301471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:45.301491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:45.301520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 450 [2:7559593780236157919:6394]
2025-10-10T14:04:45.301576Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:45.301639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:45.301654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:45.301665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:45.301678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:45.301725Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:45.301747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:45.301770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:45.303056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:45.303072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:45.303084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:45.303096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:45.303106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:45.303381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:45.303397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:45.303534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:45.303714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:45.303935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:45.304046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:45.304120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.304134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.304148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.304160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.304207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:45.304281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:45.304449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:45.304465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:45.304600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.304620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:45.304650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:45.304664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:45.304675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:45.304687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:45.304711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:45.305399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593781814077169:6504], now have 1 active actors on pipe
2025-10-10T14:04:45.305426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593777519109817:7086], now have 1 active actors on pipe
2025-10-10T14:04:45.305446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593777519109754:2442], now have 1 active actors on pipe
2025-10-10T14:04:45.307894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:45.307922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:45.308010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdd92964-f8a7536a-af07e140-977b2170_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:45.308046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:45.308063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:45.308074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:45.308111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:45.308157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:45.308203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:45.317883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:45.317930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:45.318018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:45.322451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 451 partition: 0 MaxSeqNo: 36 sessionId: src_id|fdd92964-f8a7536a-af07e140-977b2170_0
2025-10-10T14:04:45.328980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2c64e6d-e5e77a94-ba39136a-c70f17e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fdd92964-f8a7536a-af07e140-977b2170_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:45.389059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd92964-f8a7536a-af07e140-977b2170_0] Write session: try to update token
2025-10-10T14:04:45.389121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd92964-f8a7536a-af07e140-977b2170_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:45.401239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:45.401270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:45.401282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:45.519508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:45.519553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:45.519569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:45.519580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:45.519590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:45.519653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.519683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.519706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.519737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.520013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:45.520026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:45.520037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:45.520085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:45.520111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:45.520123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:45.520349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:45.520393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:45.520428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:45.520460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:45.521470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:45.611234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId: src_id|fdd92964-f8a7536a-af07e140-977b2170_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:45.653177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:45.752441Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:45.781020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:45.784392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:45.784542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:45.784556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:45.784603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593780236157911:6394]
2025-10-10T14:04:45.785100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:45.785271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:45.787774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:45.787770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593781814077169:6504]
2025-10-10T14:04:45.787919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:45.833316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 451 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fdd92964-f8a7536a-af07e140-977b2170_0
2025-10-10T14:04:45.833647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 451 sessionId: src_id|fdd92964-f8a7536a-af07e140-977b2170_0 is DEAD
2025-10-10T14:04:45.837534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd92964-f8a7536a-af07e140-977b2170_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:45.837594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd92964-f8a7536a-af07e140-977b2170_0] Write session will restart in 0.009134s
2025-10-10T14:04:45.837761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd92964-f8a7536a-af07e140-977b2170_0] Write session: Do CDS request
2025-10-10T14:04:45.837811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd92964-f8a7536a-af07e140-977b2170_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:45.853239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd92964-f8a7536a-af07e140-977b2170_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:45.852183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:45.852238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 452
2025-10-10T14:04:45.853805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:45.853937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:45.853954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:45.853965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:45.857893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 452 sessionId:  describe result for acl check
2025-10-10T14:04:45.858038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:45.858055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:45.858067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:45.858085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593781814077389:7096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:45.861139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593781814077389:7096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:45.871493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593781814077389:7096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:45.886337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593781814077424:6504]
2025-10-10T14:04:45.890108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593781814077389:7096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:45.890156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593781814077389:7096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:45.890174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593781814077389:7096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:45.890215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:46.007585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:46.016996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:46.017944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:46.017974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:46.018014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:46.022323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:46.022691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593784531125528:6405]
2025-10-10T14:04:46.028212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:46.033582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:46.033886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:46.035363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:46.035730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:46.035740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:46.035746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:46.035754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:46.035762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:46.035769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:46.035777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:46.035784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:46.035791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:46.035798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:46.035806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:46.035814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:46.035867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:46.035986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:46.036042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:46.036094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:46.036145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:46.036195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:46.036250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:46.036299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:46.036351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:46.036399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:46.036447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:46.036499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:46.036545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:46.036623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:46.036690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:46.036751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:46.036806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:46.036863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:46.036937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:46.036999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:46.037053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:46.037114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:46.039080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:46.039178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:46.039241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:46.039304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:46.039359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:46.039421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:46.039479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:46.039537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:46.039591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:46.039654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:46.039708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:46.039768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:46.039821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:46.039880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:46.040408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:46.084840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:46.175214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:46.175254Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:46.175268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:46.175283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:46.175301Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 451 [2:7559593784531125528:6405]
2025-10-10T14:04:46.175345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:46.175395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:46.175406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:46.175416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:46.175424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:46.175462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:46.175478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:46.175495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:46.177007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:46.177042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:46.177060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:46.177076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:46.177089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:46.177424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:46.177447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:46.177606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:46.177816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:46.178124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:46.178263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:46.178368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593781814077424:6504], now have 1 active actors on pipe
2025-10-10T14:04:46.178398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593781814077364:2442], now have 1 active actors on pipe
2025-10-10T14:04:46.178428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593781814077427:7096], now have 1 active actors on pipe
2025-10-10T14:04:46.178461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.178481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.178498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.178514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.178566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:46.178671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:46.178882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:46.178903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:46.179061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.179088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:46.178712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 451, pipe: [1:7559593781814077424:6504]
2025-10-10T14:04:46.178824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 451
2025-10-10T14:04:46.178917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 451
2025-10-10T14:04:46.182672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:46.182697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:46.182710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:46.182723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:46.182747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:46.183339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:46.183367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:46.183447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:46.183478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:46.183498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:46.183511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:46.183544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:46.183585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:46.183634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:46.187889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 452 partition: 0 MaxSeqNo: 36 sessionId: src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0
2025-10-10T14:04:46.188833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdd92964-f8a7536a-af07e140-977b2170_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:46.187166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:46.187202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:46.187292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:46.265453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0] Write session: try to update token
2025-10-10T14:04:46.265515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:46.278185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:46.278233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:46.278246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:46.394923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:46.394955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:46.394968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:46.394979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:46.394990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:46.395025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.395055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.395078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.395098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.395202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:46.395232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:46.395252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:46.395258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:46.395264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:46.395274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:46.395283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:46.434441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:46.434491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:46.434503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:46.435513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:46.524437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId: src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:46.573606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:46.814531Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:46.903074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:46.903106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:46.903153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593784531125523:6405]
2025-10-10T14:04:46.903321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:46.903347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:46.905490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:46.913308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:46.913477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:46.913491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:46.914228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:46.929593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 452 reason: error at write: Disconnected sessionId: src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0
2025-10-10T14:04:46.929923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 452 sessionId: src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0 is DEAD
2025-10-10T14:04:46.933570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:46.933606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0] Write session will restart in 0.005982s
2025-10-10T14:04:46.933718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0] Write session: Do CDS request
2025-10-10T14:04:46.933751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:46.969753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593781814077424:6504]
2025-10-10T14:04:46.969900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:46.969916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 453
2025-10-10T14:04:46.973378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:46.973980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:46.974121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:46.974137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:46.974147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:46.976294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 453 sessionId:  describe result for acl check
2025-10-10T14:04:46.976495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:46.976517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:46.976539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:46.976568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593786109045002:7111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:46.982021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593786109045002:7111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:46.996992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593786109045002:7111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:47.022440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593786109045002:7111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:47.022497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593786109045002:7111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:47.022521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593786109045002:7111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:47.022556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:47.071939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593790404012404:6504]
2025-10-10T14:04:47.172013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:47.193796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:47.195071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:47.195103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:47.195158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:47.195476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:47.195699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593788826093157:6415]
2025-10-10T14:04:47.198077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:47.199577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:47.199816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:47.203789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:47.204240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:47.204250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:47.204256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:47.204263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:47.204270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:47.204278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:47.204287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:47.204295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:47.204302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.204308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.204316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.204324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.204379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:47.204499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:47.204553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:47.204606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:47.204655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:47.204705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:47.204754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:47.204801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:47.204853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.204921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.204971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.205021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.205065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:47.205161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:47.205225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:47.205285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:47.205336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:47.205395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:47.205441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:47.205504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:47.205557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:47.205613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:47.205660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:47.205715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:47.205768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:47.205826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:47.205872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:47.205929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:47.205982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.206036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.206080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.206137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.206189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.206243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.206292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.206348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.206812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:47.266880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:47.302405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:47.302458Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:47.302480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:47.302502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:47.302529Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 452 [2:7559593788826093157:6415]
2025-10-10T14:04:47.302595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:47.302663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:47.302680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:47.302695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:47.302708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:47.302758Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:47.302782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:47.302807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:47.304117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.304134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.304150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.304164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.304176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:47.305519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 452, pipe: [1:7559593790404012404:6504]
2025-10-10T14:04:47.305542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 452
2025-10-10T14:04:47.305625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 452
2025-10-10T14:04:47.304461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:47.304489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.304656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.304860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.305156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.305301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:47.305393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593790404012404:6504], now have 1 active actors on pipe
2025-10-10T14:04:47.305421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593790404012326:7111], now have 1 active actors on pipe
2025-10-10T14:04:47.305446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593786109044986:2442], now have 1 active actors on pipe
2025-10-10T14:04:47.305476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.305493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.305507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.305523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.305568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:47.305656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:47.305862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:47.305879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:47.306005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.306030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:47.306210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:47.306224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:47.306237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:47.306249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:47.306274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:47.307007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:47.307043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:47.307132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:47.307165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:47.307185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:47.307201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:47.307239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:47.307281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:47.307333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:47.312775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:47.312814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:47.312924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:47.313559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 453 partition: 0 MaxSeqNo: 36 sessionId: src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0
2025-10-10T14:04:47.314484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c3c533-4ad93d9c-7c31fa96-37de4d5f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:47.376726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0] Write session: try to update token
2025-10-10T14:04:47.376790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:47.405080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:47.405113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:47.405146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:47.539052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:47.539087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:47.539101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:47.539113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:47.539122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:47.539164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.539191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.539211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.539233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.539395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:47.539407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:47.539418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:47.539523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:47.539547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.539558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:47.540624Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:47.549553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:47.549606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:47.549636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:47.549665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:47.575489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId: src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:47.626039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:47.763843Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:47.775885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:47.775942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:47.776014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:47.776029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:47.776076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593788826093152:6415]
2025-10-10T14:04:47.776810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:47.778211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:47.778315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593790404012404:6504]
2025-10-10T14:04:47.778426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:47.778439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:47.778797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:47.878272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593790404012660:6504]
2025-10-10T14:04:47.900061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 453 reason: error at write: Disconnected sessionId: src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0
2025-10-10T14:04:47.900397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 453 sessionId: src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0 is DEAD
2025-10-10T14:04:47.901588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:47.901633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0] Write session will restart in 0.006856s
2025-10-10T14:04:47.901739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0] Write session: Do CDS request
2025-10-10T14:04:47.901772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:47.923241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:47.925589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:47.925645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 454
2025-10-10T14:04:47.926340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:47.926583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:47.926626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:47.926643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:47.931967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 454 sessionId:  describe result for acl check
2025-10-10T14:04:47.932114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:47.932125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:47.932134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:47.932152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593790404012736:7121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:47.934947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593790404012736:7121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:47.945992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593790404012736:7121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:47.958155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593790404012736:7121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:47.958201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593790404012736:7121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:47.958219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593790404012736:7121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:47.958249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:47.969707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:47.988043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:47.988777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:47.988789Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:47.988818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:47.989028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:47.989198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593788826093447:6426]
2025-10-10T14:04:47.992081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:47.993906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:47.994185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:47.995605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:47.995934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:47.995957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:47.995966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:47.995974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:47.995983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:47.995992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:47.995999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:47.996007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:47.996014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.996022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.996029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.996038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.996091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:47.996217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:47.996278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:47.996341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:47.996397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:47.996468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:47.996712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:47.996774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:47.996828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.996887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.996961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.997018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.997074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:47.997171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:47.997240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:47.997306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:47.997370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:47.997436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:47.997491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:47.997581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:47.997641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:47.997708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:47.997764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:47.997828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:47.997886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:47.997949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:47.998008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:47.998073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:47.998138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.998202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:47.998258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.998351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:47.998409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.998475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:47.998530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.998595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:47.998995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:48.036663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:48.050269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:48.050322Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:48.050342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:48.050363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:48.050388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 453 [2:7559593788826093447:6426]
2025-10-10T14:04:48.050451Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:48.050515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:48.050532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:48.050545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:48.050556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:48.050608Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:48.050631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:48.050653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:48.139489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:48.139527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:48.139540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:48.139552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:48.139564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:48.139858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:48.139879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:48.140021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:48.140201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:48.140430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:48.140541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:48.140650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593790404012660:6504], now have 1 active actors on pipe
2025-10-10T14:04:48.140679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593790404012600:2442], now have 1 active actors on pipe
2025-10-10T14:04:48.140702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593790404012868:7121], now have 1 active actors on pipe
2025-10-10T14:04:48.140728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593788826093442:6426]
2025-10-10T14:04:48.140744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593788826093442:6426]
2025-10-10T14:04:48.140757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593788826093442:6426]
2025-10-10T14:04:48.140768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593788826093442:6426]
2025-10-10T14:04:48.140814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:48.140903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:48.141113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:48.141148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:48.141288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593788826093442:6426]
2025-10-10T14:04:48.141307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:48.141928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:48.141948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:48.141961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:48.141975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:48.142005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:48.141291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 453, pipe: [1:7559593790404012660:6504]
2025-10-10T14:04:48.141307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 453
2025-10-10T14:04:48.141414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 453
2025-10-10T14:04:48.146265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:48.146308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:48.146395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27ce5da6-22f3573a-18aab113-885e8f01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:48.146431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:48.146449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:48.146460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:48.146498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:48.146544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:48.146589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:48.150242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:48.150277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:48.150289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:48.151103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:48.151142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:48.151226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:48.157354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ce496f-9c00f01c-294b7747-6cf124ae_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27ce5da6-22f3573a-18aab113-885e8f01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:48.155793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 454 partition: 0 MaxSeqNo: 36 sessionId: src_id|27ce5da6-22f3573a-18aab113-885e8f01_0
2025-10-10T14:04:48.194998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce5da6-22f3573a-18aab113-885e8f01_0] Write session: try to update token
2025-10-10T14:04:48.195055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce5da6-22f3573a-18aab113-885e8f01_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:48.318574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:48.318605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:48.318618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:48.318673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:48.318690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:48.318704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:48.318716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:48.318728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:48.318762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593788826093442:6426]
2025-10-10T14:04:48.318791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593788826093442:6426]
2025-10-10T14:04:48.318817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593788826093442:6426]
2025-10-10T14:04:48.318841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593788826093442:6426]
2025-10-10T14:04:48.318951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:48.318980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:48.318985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:48.319006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:48.319014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:48.319018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:48.319042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:48.344150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:48.378118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId: src_id|27ce5da6-22f3573a-18aab113-885e8f01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:48.403336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:48.530257Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:48.533388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:48.533427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:48.537332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593790404012660:6504]
2025-10-10T14:04:48.537450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:48.537638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:48.537653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:48.563131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 454 reason: error at write: Disconnected sessionId: src_id|27ce5da6-22f3573a-18aab113-885e8f01_0
2025-10-10T14:04:48.561537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:48.564559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 454 sessionId: src_id|27ce5da6-22f3573a-18aab113-885e8f01_0 is DEAD
2025-10-10T14:04:48.566288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce5da6-22f3573a-18aab113-885e8f01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:48.566325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce5da6-22f3573a-18aab113-885e8f01_0] Write session will restart in 0.008656s
2025-10-10T14:04:48.566428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce5da6-22f3573a-18aab113-885e8f01_0] Write session: Do CDS request
2025-10-10T14:04:48.566460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce5da6-22f3573a-18aab113-885e8f01_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:48.584562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:48.584596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 455
2025-10-10T14:04:48.585574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce5da6-22f3573a-18aab113-885e8f01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:48.586133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:48.586276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:48.586304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:48.586315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:48.587731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 455 sessionId:  describe result for acl check
2025-10-10T14:04:48.587840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:48.587851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:48.587861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:48.587877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593794698980226:7133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:48.590889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593794698980226:7133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:48.614014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593794698980226:7133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:48.637329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593794698980256:6504]
2025-10-10T14:04:48.639109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593794698980226:7133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:48.639156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593794698980226:7133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:48.639175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593794698980226:7133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:48.639208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:48.782544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:48.793895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:48.794544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:48.794568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:48.794598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:48.794768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:48.794917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593793121061049:6436]
2025-10-10T14:04:48.797603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:48.802744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:48.802991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:48.804304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:48.804626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:48.804633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:48.804640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:48.804645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:48.804654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:48.804661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:48.804668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:48.804675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:48.804681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:48.804687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:48.804693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:48.804699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:48.804743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:48.804851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:48.804897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:48.804964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:48.805006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:48.805047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:48.805089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:48.805147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:48.805187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:48.805244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:48.805283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:48.805321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:48.805361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:48.805422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:48.805476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:48.805524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:48.805567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:48.805615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:48.805657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:48.805704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:48.805745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:48.805794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:48.805837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:48.805886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:48.805929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:48.805978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:48.806017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:48.806062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:48.806104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:48.806153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:48.806192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:48.806252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:48.806292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:48.806340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:48.806379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:48.806427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:48.806839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:48.888956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:48.909795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:48.909846Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:48.909865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:48.909885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:48.909909Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 454 [2:7559593793121061049:6436]
2025-10-10T14:04:48.909968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:48.910024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:48.910038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:48.910050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:48.910062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:48.910111Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:48.910132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:48.910155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:48.934585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:48.934616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:48.934628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:48.934639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:48.934651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:48.934925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:48.934943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:48.935086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:48.935280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:48.935525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:48.935650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:48.935733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593793121061043:6436]
2025-10-10T14:04:48.935749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593793121061043:6436]
2025-10-10T14:04:48.935763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593793121061043:6436]
2025-10-10T14:04:48.935778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593793121061043:6436]
2025-10-10T14:04:48.935815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:48.935900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593794698980214:2442], now have 1 active actors on pipe
2025-10-10T14:04:48.935927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593794698980256:6504], now have 1 active actors on pipe
2025-10-10T14:04:48.935951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593794698980259:7133], now have 1 active actors on pipe
2025-10-10T14:04:48.935984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:48.936180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:48.936547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 454
2025-10-10T14:04:48.936638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 454, pipe: [1:7559593794698980256:6504]
2025-10-10T14:04:48.936656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 454
2025-10-10T14:04:48.936198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:48.936321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593793121061043:6436]
2025-10-10T14:04:48.936342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:48.936746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:48.936761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:48.936772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:48.936785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:48.936809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:48.937506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:48.937537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:48.937609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:48.937642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:48.937659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:48.937670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:48.937706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:48.937747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:48.937791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:48.939332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:48.939366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:48.939442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:48.939772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 455 partition: 0 MaxSeqNo: 36 sessionId: src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0
2025-10-10T14:04:48.945413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27ce5da6-22f3573a-18aab113-885e8f01_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:48.982937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0] Write session: try to update token
2025-10-10T14:04:48.982999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:49.047364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:49.047401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:49.047416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:49.047477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:49.047494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:49.047510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:49.047522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:49.047537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:49.047577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593793121061043:6436]
2025-10-10T14:04:49.047610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593793121061043:6436]
2025-10-10T14:04:49.047636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593793121061043:6436]
2025-10-10T14:04:49.047661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593793121061043:6436]
2025-10-10T14:04:49.047788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:49.047821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:49.047830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:49.047851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:49.047863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:49.047877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:49.047917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:49.049007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:49.176049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId: src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:49.202923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:49.272390Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:49.283143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:49.283319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593794698980256:6504]
2025-10-10T14:04:49.283406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:49.283419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:49.277338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:49.277387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:49.299853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 455 reason: error at write: Disconnected sessionId: src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0
2025-10-10T14:04:49.301698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:49.301758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0] Write session will restart in 0.008116s
2025-10-10T14:04:49.301904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0] Write session: Do CDS request
2025-10-10T14:04:49.301955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:49.300580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 455 sessionId: src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0 is DEAD
2025-10-10T14:04:49.329067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:49.335653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:49.335698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 456
2025-10-10T14:04:49.337517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:49.337670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:49.337685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:49.337698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:49.339172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 456 sessionId:  describe result for acl check
2025-10-10T14:04:49.339301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:49.339312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:49.339322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:49.339340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593798993947846:7143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:49.352439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593798993947846:7143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:49.374620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593798993947846:7143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:49.384349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593798993947885:6504]
2025-10-10T14:04:49.381434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:49.418482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593798993947846:7143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:49.418537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593798993947846:7143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:49.418558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593798993947846:7143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:49.418591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:49.541264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:49.543358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:49.544314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:49.544350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:49.544413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:49.544712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:49.544919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593797416028665:6447]
2025-10-10T14:04:49.547965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:49.549353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:49.549627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:49.551143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:49.551500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:49.551509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:49.551518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:49.551525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:49.551533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:49.551543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:49.551552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:49.551560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:49.551567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:49.551575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:49.551583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:49.551591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:49.551646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:49.551776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:49.551829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:49.551886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:49.551939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:49.551995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:49.552048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:49.552100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:49.552153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:49.552208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:49.552263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:49.552315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:49.552361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:49.552436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:49.552506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:49.552568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:49.552626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:49.552687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:49.552738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:49.552802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:49.552861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:49.552920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:49.553884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:49.553971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:49.554036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:49.554099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:49.554154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:49.554217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:49.554275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:49.554342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:49.554394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:49.554455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:49.554512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:49.554572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:49.554623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:49.554682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:49.555205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:49.602245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:49.633022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:49.633076Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:49.633095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:49.633118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:49.642079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 455 [2:7559593797416028665:6447]
2025-10-10T14:04:49.642169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:49.642246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:49.642264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:49.642277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:49.642290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:49.642341Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:49.642364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:49.642386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:49.716990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:49.717019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:49.717034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:49.717049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:49.717061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:49.717359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:49.717379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:49.717533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:49.717722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:49.717957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:49.718074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:49.718144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593797416028660:6447]
2025-10-10T14:04:49.718159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593797416028660:6447]
2025-10-10T14:04:49.718172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593797416028660:6447]
2025-10-10T14:04:49.718185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593797416028660:6447]
2025-10-10T14:04:49.718228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:49.718312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:49.718451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:49.718468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:49.718481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:49.718496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:49.718499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:49.718516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:49.718659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593797416028660:6447]
2025-10-10T14:04:49.718684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:49.718780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:49.718854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593798993947885:6504], now have 1 active actors on pipe
2025-10-10T14:04:49.718883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593798993947936:7143], now have 1 active actors on pipe
2025-10-10T14:04:49.718908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593798993947828:2442], now have 1 active actors on pipe
2025-10-10T14:04:49.720659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 455, pipe: [1:7559593798993947885:6504]
2025-10-10T14:04:49.720779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 455
2025-10-10T14:04:49.720854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 455
2025-10-10T14:04:49.724185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:49.724232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:49.724339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:49.724388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:49.724408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:49.724419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:49.724458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:49.724501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:49.724556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:49.729245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:49.729290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:49.729375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:49.729824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 456 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0
2025-10-10T14:04:49.733374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|838afabc-b4f9d70f-a5516964-1ff663b5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:49.745278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:49.745312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:49.745326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:49.778039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0] Write session: try to update token
2025-10-10T14:04:49.778104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:49.885882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:49.885917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:49.885931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:49.885988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:49.886005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:49.886021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:49.886036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:49.886048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:49.886089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593797416028660:6447]
2025-10-10T14:04:49.886122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593797416028660:6447]
2025-10-10T14:04:49.886148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593797416028660:6447]
2025-10-10T14:04:49.886176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593797416028660:6447]
2025-10-10T14:04:49.886332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:49.886361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:49.886374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:49.887507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:49.889691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:49.889739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:49.889775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:49.889809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:50.045325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId: src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:50.089887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:50.175880Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:50.179433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:50.179484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:50.184870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:50.183943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593798993947885:6504]
2025-10-10T14:04:50.184067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:50.184079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:50.240889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:50.240964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0] Write session will restart in 0.007982s
2025-10-10T14:04:50.241180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0] Write session: Do CDS request
2025-10-10T14:04:50.238113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:50.241214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:50.238267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 456 reason: error at write: Disconnected sessionId: src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0
2025-10-10T14:04:50.238559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 456 sessionId: src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0 is DEAD
2025-10-10T14:04:50.262918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:50.303641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593803288915465:6504]
2025-10-10T14:04:50.307116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:50.307156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 457
2025-10-10T14:04:50.309464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:50.309636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:50.309653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:50.309665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:50.312472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 457 sessionId:  describe result for acl check
2025-10-10T14:04:50.312574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:50.312584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:50.312594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:50.312609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593803288915481:7156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:50.315234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593803288915481:7156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:50.342981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593803288915481:7156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:50.392915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593803288915481:7156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:50.392991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593803288915481:7156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:50.393009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593803288915481:7156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:50.393042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:50.459930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:50.463675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:50.464385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:50.464404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:50.464436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:50.464615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:50.464787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593801710996271:6455]
2025-10-10T14:04:50.467075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:50.468207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:50.468369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:50.469310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:50.469710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:50.469732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:50.469740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:50.469748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:50.469755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:50.469764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:50.469772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:50.469781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:50.469789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:50.469800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:50.469808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:50.469816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:50.469869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:50.469986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:50.470037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:50.470137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:50.470195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:50.470252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:50.470304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:50.470356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:50.470408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:50.470463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:50.470514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:50.470566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:50.470616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:50.470691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:50.470763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:50.470834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:50.470886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:50.470942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:50.470981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:50.471024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:50.471065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:50.471106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:50.471157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:50.471201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:50.471238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:50.471289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:50.471335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:50.471375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:50.471410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:50.471448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:50.471480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:50.471521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:50.471556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:50.471593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:50.471625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:50.471662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:50.472021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:50.506992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:50.543248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:50.543294Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:50.543311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:50.543328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:50.543350Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 456 [2:7559593801710996271:6455]
2025-10-10T14:04:50.543406Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:50.543460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:50.543474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:50.543487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:50.543497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:50.543540Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:50.543562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:50.543584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:50.546531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:50.546561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:50.546574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:50.546583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:50.546590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:50.546792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:50.546811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:50.546909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:50.547039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:50.547254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:50.547384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:50.547462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593801710996266:6455]
2025-10-10T14:04:50.547482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593801710996266:6455]
2025-10-10T14:04:50.547495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593801710996266:6455]
2025-10-10T14:04:50.547508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593801710996266:6455]
2025-10-10T14:04:50.547548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:50.547642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:50.547803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:50.547828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:50.547958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593801710996266:6455]
2025-10-10T14:04:50.547988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:50.548289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:50.548310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:50.548322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:50.548334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:50.548358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:50.550708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593803288915465:6504], now have 1 active actors on pipe
2025-10-10T14:04:50.550753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593803288915632:7156], now have 1 active actors on pipe
2025-10-10T14:04:50.550776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593803288915446:2442], now have 1 active actors on pipe
2025-10-10T14:04:50.553300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 456, pipe: [1:7559593803288915465:6504]
2025-10-10T14:04:50.553469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 456
2025-10-10T14:04:50.553542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 456
2025-10-10T14:04:50.557291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:50.557341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:50.557420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:50.557452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:50.557470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:50.557481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:50.557516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:50.557558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:50.557603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:50.561626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:50.561668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:50.561751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:50.564646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc18bf32-3ae06adc-a79910aa-2d8b1c2f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:50.562100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 457 partition: 0 MaxSeqNo: 36 sessionId: src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0
2025-10-10T14:04:50.587527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0] Write session: try to update token
2025-10-10T14:04:50.587582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:50.715093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:50.715126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:50.715139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:50.715193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:50.715209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:50.715224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:50.715237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:50.715251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:50.715287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593801710996266:6455]
2025-10-10T14:04:50.715314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593801710996266:6455]
2025-10-10T14:04:50.715340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593801710996266:6455]
2025-10-10T14:04:50.715364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593801710996266:6455]
2025-10-10T14:04:50.715479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:50.715505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:50.715512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:50.715524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:50.715545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:50.715594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:50.715631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:50.716430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:50.785945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId: src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:50.813144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:50.873114Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:50.902102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:50.902154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:50.904850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:50.905995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593803288915465:6504]
2025-10-10T14:04:50.906104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:50.906117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:50.909238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:50.994183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 457 reason: error at write: Disconnected sessionId: src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0
2025-10-10T14:04:50.994510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 457 sessionId: src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0 is DEAD
2025-10-10T14:04:50.998239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:50.998303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0] Write session will restart in 0.005518s
2025-10-10T14:04:50.998504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0] Write session: Do CDS request
2025-10-10T14:04:50.998566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:51.012163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:51.009035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593807583883114:6504]
2025-10-10T14:04:51.010669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:51.010688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 458
2025-10-10T14:04:51.013398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:51.013581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:51.013599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:51.013610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:51.015050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 458 sessionId:  describe result for acl check
2025-10-10T14:04:51.015163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:51.015175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:51.015186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:51.015204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593807583883121:7164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:51.017870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593807583883121:7164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:51.040228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593807583883121:7164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:51.061709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593807583883121:7164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:51.061764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593807583883121:7164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:51.061784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593807583883121:7164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:51.061817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:51.148352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:51.155455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:51.156425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:51.156447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:51.156503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:51.156813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:51.157051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593806005963874:6466]
2025-10-10T14:04:51.159575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:51.161185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:51.161466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:51.163222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:51.163609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:51.163618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:51.163625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:51.163635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:51.163642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:51.163650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:51.163659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:51.163668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:51.163675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.163682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.163689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.163697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.163748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:51.163872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:51.164022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:51.164124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:51.164182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:51.164247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:51.164300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:51.164351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:51.164403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.164457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.164510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.164564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.164612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:51.164686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:51.164754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:51.164817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:51.164874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:51.164937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:51.165006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:51.165065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:51.165122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:51.167172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:51.167243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:51.167306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:51.167362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:51.167427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:51.167480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:51.167542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:51.167595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.167658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.167712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.167775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.167830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.167892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.167942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.168005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.168531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:51.204895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:51.284903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:51.284941Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:51.284953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:51.284967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:51.284984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 457 [2:7559593806005963874:6466]
2025-10-10T14:04:51.285037Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:51.285084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:51.285095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:51.285106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:51.285114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:51.285179Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:51.285196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:51.285214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:51.287162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.287179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.287195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.287211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.287223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:51.287500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:51.287520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.287671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.287879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.288122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.288251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:51.288334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593807583883114:6504], now have 1 active actors on pipe
2025-10-10T14:04:51.288359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593807583883241:7164], now have 1 active actors on pipe
2025-10-10T14:04:51.288381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593803288915766:2442], now have 1 active actors on pipe
2025-10-10T14:04:51.288406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.288422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.288435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.288447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.288492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:51.288574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:51.288761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:51.289278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 457, pipe: [1:7559593807583883114:6504]
2025-10-10T14:04:51.289413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 457
2025-10-10T14:04:51.289485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 457
2025-10-10T14:04:51.288775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:51.288898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.288916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:51.293244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:51.293263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:51.293275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:51.293287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:51.293319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:51.294788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:51.294843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:51.294955Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:51.295006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:51.295026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:51.295037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:51.295078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:51.295125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:51.295184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:51.297795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 458 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0
2025-10-10T14:04:51.298878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cafcd77-e3bb1d21-bfd92bf7-8b8fc470_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:51.297410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:51.297447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:51.297516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:51.352840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0] Write session: try to update token
2025-10-10T14:04:51.352905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:51.389261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:51.389303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:51.389318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:51.532483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:51.532523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:51.532537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:51.532594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:51.532611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:51.532624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:51.532636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:51.532648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:51.532684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.532715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.532748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.532790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.533172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:51.533226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:51.533269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:51.533305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:51.552746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:51.552799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.552811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:51.553959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:51.586674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId: src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:51.618154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:51.729970Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:51.733157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:51.733175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:51.733221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593806005963869:6466]
2025-10-10T14:04:51.733309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:51.733363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:51.733388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:51.738386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:51.741290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:51.741321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:51.751523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 458 reason: error at write: Disconnected sessionId: src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0
2025-10-10T14:04:51.765345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:51.765414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0] Write session will restart in 0.006421s
2025-10-10T14:04:51.765574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0] Write session: Do CDS request
2025-10-10T14:04:51.765628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:51.764475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 458 sessionId: src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0 is DEAD
2025-10-10T14:04:51.779565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:51.780107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:51.780263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593807583883114:6504]
2025-10-10T14:04:51.780358Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:51.780371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 459
2025-10-10T14:04:51.780809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:51.780929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:51.780944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:51.780953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:51.782599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 459 sessionId:  describe result for acl check
2025-10-10T14:04:51.782721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:51.782731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:51.782741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:51.782758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593807583883401:7179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:51.785528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593807583883401:7179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:51.807142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593807583883401:7179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:51.831861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593807583883401:7179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:51.831913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593807583883401:7179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:51.831930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593807583883401:7179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:51.831992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:51.885872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593807583883531:6504]
2025-10-10T14:04:51.952365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:51.963297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:51.964287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:51.964322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:51.964373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:51.964685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:51.964880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593806005964184:6476]
2025-10-10T14:04:51.967407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:51.971738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:51.972034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:51.973627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:51.974090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:51.974101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:51.974108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:51.974115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:51.974122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:51.974130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:51.974139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:51.974149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:51.974157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.974165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.974173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.974181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.974252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:51.974378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:51.974439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:51.974493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:51.974568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:51.974635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:51.974687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:51.974739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:51.974802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.974857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.974908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.974957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.975024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:51.975100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:51.975163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:51.975225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:51.975283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:51.975343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:51.975393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:51.975457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:51.975528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:51.975598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:51.975653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:51.975724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:51.975784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:51.975847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:51.975901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:51.975961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:51.976016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.976073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:51.976124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.976208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:51.976272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.976336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:51.976389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.976450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:51.976958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:52.057542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:52.072256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:52.072299Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:52.072314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:52.072333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:52.072355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 458 [2:7559593806005964184:6476]
2025-10-10T14:04:52.072410Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:52.072463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:52.072476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:52.072489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:52.072501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:52.072547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:52.072570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:52.072593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:52.075155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:52.075184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:52.075199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:52.075213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:52.075225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:52.075489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:52.075505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:52.075644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:52.075842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:52.076097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:52.076225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:52.076392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 458, pipe: [1:7559593807583883531:6504]
2025-10-10T14:04:52.076515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 458
2025-10-10T14:04:52.076588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 458
2025-10-10T14:04:52.076306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593807583883531:6504], now have 1 active actors on pipe
2025-10-10T14:04:52.076337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593807583883451:7179], now have 1 active actors on pipe
2025-10-10T14:04:52.076360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593807583883396:2442], now have 1 active actors on pipe
2025-10-10T14:04:52.076387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593806005964178:6476]
2025-10-10T14:04:52.076401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593806005964178:6476]
2025-10-10T14:04:52.076414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593806005964178:6476]
2025-10-10T14:04:52.076426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593806005964178:6476]
2025-10-10T14:04:52.076463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:52.076542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:52.076724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:52.076740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:52.076766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:52.076781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:52.076795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:52.076808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:52.076858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593806005964178:6476]
2025-10-10T14:04:52.076877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:52.076925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:52.076995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:52.077031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:52.077149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:52.077179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:52.077197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:52.077216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:52.077253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:52.077290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:52.077339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:52.080583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:52.080621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:52.080693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:52.081434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 459 partition: 0 MaxSeqNo: 36 sessionId: src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0
2025-10-10T14:04:52.082380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5c3597-566c53c8-9cea4b5-6c324eeb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:52.142170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0] Write session: try to update token
2025-10-10T14:04:52.142214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:52.172188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:52.172213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:52.172221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:52.383771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:52.383798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:52.383811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:52.383865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:52.383879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:52.383891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:52.383902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:52.383912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:52.383953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593806005964178:6476]
2025-10-10T14:04:52.383984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593806005964178:6476]
2025-10-10T14:04:52.384008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593806005964178:6476]
2025-10-10T14:04:52.384029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593806005964178:6476]
2025-10-10T14:04:52.384164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:52.384187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:52.384199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:52.384253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:52.384284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:52.384313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:52.384339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:52.385986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:52.406362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId: src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:52.459626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:52.609706Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:52.611645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:52.611681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:52.613885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:52.617102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593807583883531:6504]
2025-10-10T14:04:52.617270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:52.617283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:52.619309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:52.647879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 459 reason: error at write: Disconnected sessionId: src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0
2025-10-10T14:04:52.650581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:52.650634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0] Write session will restart in 0.008553s
2025-10-10T14:04:52.650753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0] Write session: Do CDS request
2025-10-10T14:04:52.650786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:52.655998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 459 sessionId: src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0 is DEAD
2025-10-10T14:04:52.666582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:52.666625Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 460
2025-10-10T14:04:52.667414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:52.667944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:52.668099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:52.668118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:52.668128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:52.673834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 460 sessionId:  describe result for acl check
2025-10-10T14:04:52.673976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:52.673985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:52.673995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:52.674013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593811878851031:7189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:52.676591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593811878851031:7189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:52.692741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593811878851031:7189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:52.708340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593811878851031:7189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:52.708388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593811878851031:7189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:52.708405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593811878851031:7189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:52.708438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:52.718851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593811878851081:6504]
2025-10-10T14:04:52.828683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:52.830311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:52.831264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:52.831282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:52.831329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:52.831590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:52.831774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593810300931804:6487]
2025-10-10T14:04:52.833981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:52.835147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:52.835375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:52.836660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:52.836997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:52.837005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:52.837012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:52.837019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:52.837040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:52.837047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:52.837053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:52.837059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:52.837065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:52.837072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:52.837079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:52.837086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:52.837153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:52.837261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:52.837312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:52.837358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:52.837398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:52.837444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:52.837489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:52.837530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:52.837575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:52.837623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:52.837667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:52.837710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:52.837756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:52.837820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:52.837881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:52.837935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:52.837983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:52.838035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:52.839318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:52.839406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:52.839460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:52.839514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:52.839557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:52.839608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:52.839671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:52.839720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:52.839767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:52.839819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:52.839868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:52.839916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:52.839963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:52.840014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:52.840059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:52.840108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:52.840151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:52.840200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:52.840616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:52.879465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:52.899400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:52.899446Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:52.899463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:52.899485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:52.899508Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 459 [2:7559593810300931804:6487]
2025-10-10T14:04:52.899561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:52.899624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:52.899640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:52.899652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:52.899664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:52.899714Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:52.899736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:52.899758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:52.901026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:52.901055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:52.901068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:52.901081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:52.901090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:52.905997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 459, pipe: [1:7559593811878851081:6504]
2025-10-10T14:04:52.906102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 459
2025-10-10T14:04:52.906179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 459
2025-10-10T14:04:52.905511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:52.905544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:52.905689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:52.905852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:52.906045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:52.906146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:52.906232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593811878851081:6504], now have 1 active actors on pipe
2025-10-10T14:04:52.906253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593811878851015:2442], now have 1 active actors on pipe
2025-10-10T14:04:52.906272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593811878851070:7189], now have 1 active actors on pipe
2025-10-10T14:04:52.906296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:52.906310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:52.906323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:52.906335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:52.906367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:52.906419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:52.906432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:52.906442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:52.906444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:52.906453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:52.906609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:52.906626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:52.906790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:52.906810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:52.906843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:52.906876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:52.906988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b1a42db-771e9426-83543ac-f379dfd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:52.907021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:52.907039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:52.907048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:52.907084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:52.907128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:52.907207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:52.908075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:52.914114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:52.914161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:52.914270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:52.915338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 460 partition: 0 MaxSeqNo: 36 sessionId: src_id|8b1a42db-771e9426-83543ac-f379dfd8_0
2025-10-10T14:04:52.916257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f45b30-e5427b0f-9c2c0072-9bee7b5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8b1a42db-771e9426-83543ac-f379dfd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:52.937908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1a42db-771e9426-83543ac-f379dfd8_0] Write session: try to update token
2025-10-10T14:04:52.937952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1a42db-771e9426-83543ac-f379dfd8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:53.018391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:53.018450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:53.018495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:53.018624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:53.018637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:53.018652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:53.018719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:53.021252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:53.039792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:53.049764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:53.050975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:53.052083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:53.053961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:53.098636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:53.147562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId: src_id|8b1a42db-771e9426-83543ac-f379dfd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:53.203309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:53.203342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:53.203354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:53.203414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:53.203428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:53.203441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:53.203452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:53.203461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:53.203505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:53.203531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:53.203553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:53.203576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593810300931799:6487]
2025-10-10T14:04:53.203721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:53.203748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:53.203759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:53.205247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:53.209476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:53.209521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:53.209550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:53.209581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:53.211865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:53.369320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:53.371016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:53.371050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:53.372079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593811878851081:6504]
2025-10-10T14:04:53.372167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:53.372298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:53.372309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:53.375231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:53.412429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1a42db-771e9426-83543ac-f379dfd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:53.412570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1a42db-771e9426-83543ac-f379dfd8_0] Write session will restart in 0.007477s
2025-10-10T14:04:53.412754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1a42db-771e9426-83543ac-f379dfd8_0] Write session: Do CDS request
2025-10-10T14:04:53.412811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1a42db-771e9426-83543ac-f379dfd8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:53.411145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 460 reason: error at write: Disconnected sessionId: src_id|8b1a42db-771e9426-83543ac-f379dfd8_0
2025-10-10T14:04:53.411489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 460 sessionId: src_id|8b1a42db-771e9426-83543ac-f379dfd8_0 is DEAD
2025-10-10T14:04:53.429608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1a42db-771e9426-83543ac-f379dfd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:53.452317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:53.452353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 461
2025-10-10T14:04:53.465656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:53.465792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:53.465808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:53.465818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:53.473477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593816173818650:6504]
2025-10-10T14:04:53.474518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 461 sessionId:  describe result for acl check
2025-10-10T14:04:53.474621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:53.474631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:53.474640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:53.474657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593816173818652:7201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:53.485627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593816173818652:7201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:53.507556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593816173818652:7201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:53.539977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593816173818652:7201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:53.540027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593816173818652:7201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:53.540043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593816173818652:7201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:53.540073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:53.635585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:53.636105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:53.636870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:53.636889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:53.636932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:53.637216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:53.637391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593814595899412:6491]
2025-10-10T14:04:53.639493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:53.639641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:04:53.639700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-10T14:04:53.641092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:53.641338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:53.642614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:53.642961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:53.642969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:53.642976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:53.642985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:53.642992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:53.643000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:53.643006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:53.643015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:53.643021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:53.643028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:53.643034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:53.643042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:53.643090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:53.643191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:53.643240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:53.643287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:53.643328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:53.643379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:53.643426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:53.643471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:53.643515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:53.643563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:53.643610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:53.643655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:53.643699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:53.643761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:53.643817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:53.643870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:53.643919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:53.643975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:53.644022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:53.644075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:53.644127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:53.644177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:53.644223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:53.644280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:53.644328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:53.645295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:53.645359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:53.645415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:53.645464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:53.645514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:53.645556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:53.645604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:53.645648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:53.645697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:53.645736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:53.645785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:53.646228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:53.678881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:53.728519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:53.728571Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:53.728591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:53.728612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:53.728638Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 460 [2:7559593814595899412:6491]
2025-10-10T14:04:53.728698Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:53.728763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:53.728778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:53.728791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:53.728803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:53.728853Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:53.728876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:53.728898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:53.730971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:53.731006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:53.731022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:53.731037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:53.731049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:53.732722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 460
2025-10-10T14:04:53.732829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 460, pipe: [1:7559593816173818650:6504]
2025-10-10T14:04:53.732909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 460
2025-10-10T14:04:53.731343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:53.731371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:53.731535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:53.731747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:53.732035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:53.732171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:53.732255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593816173818623:2442], now have 1 active actors on pipe
2025-10-10T14:04:53.732284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593816173818650:6504], now have 1 active actors on pipe
2025-10-10T14:04:53.732308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593816173818760:7201], now have 1 active actors on pipe
2025-10-10T14:04:53.732333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593814595899407:6491]
2025-10-10T14:04:53.732350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593814595899407:6491]
2025-10-10T14:04:53.732366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593814595899407:6491]
2025-10-10T14:04:53.732380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593814595899407:6491]
2025-10-10T14:04:53.732427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:53.732519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:53.732719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:53.732737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:53.732865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593814595899407:6491]
2025-10-10T14:04:53.732887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:53.733017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:53.733033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:53.733061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:53.733072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:53.733101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:53.737292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:53.737324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:53.737502Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:04:53.737623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:53.737666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:53.737684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:53.737696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:53.737733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:53.737774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:53.737864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:53.740800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 11 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:04:53.740939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:04:53.742235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:53.742271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:53.742343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:53.742761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 461 partition: 0 MaxSeqNo: 36 sessionId: src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0
2025-10-10T14:04:53.745735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b1a42db-771e9426-83543ac-f379dfd8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:53.793111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0] Write session: try to update token
2025-10-10T14:04:53.805315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:53.976704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:53.976739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:53.976746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:53.976790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:53.976800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:53.976809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:53.976815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:53.976822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:53.976845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593814595899407:6491]
2025-10-10T14:04:53.976860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593814595899407:6491]
2025-10-10T14:04:53.976874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593814595899407:6491]
2025-10-10T14:04:53.976887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593814595899407:6491]
2025-10-10T14:04:53.977013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:53.977021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:53.977045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:53.977045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:53.977068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:53.977090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:53.977140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:53.978231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:54.093618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId: src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:54.137110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:54.181604Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:54.189759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:54.189793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:54.190106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:54.190224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593816173818650:6504]
2025-10-10T14:04:54.186210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:54.186252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:54.197774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 461 reason: error at write: Disconnected sessionId: src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0
2025-10-10T14:04:54.198118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 461 sessionId: src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0 is DEAD
2025-10-10T14:04:54.206041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:54.206085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0] Write session will restart in 0.006812s
2025-10-10T14:04:54.206194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0] Write session: Do CDS request
2025-10-10T14:04:54.206226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:54.237849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:54.245267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:54.245306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 462
2025-10-10T14:04:54.248660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:54.248807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:54.248821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:54.248832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:54.255058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 462 sessionId:  describe result for acl check
2025-10-10T14:04:54.255213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:54.255225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:54.255234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:54.255254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593820468786270:7210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:54.264812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593820468786270:7210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:54.268749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:54.285373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593820468786270:7210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:54.285577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593820468786287:6504]
2025-10-10T14:04:54.302969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593820468786270:7210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:54.303014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593820468786270:7210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:54.303033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593820468786270:7210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:54.303066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:54.494803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:54.510115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:54.511062Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:54.511080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:54.511128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:54.511410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:54.511588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593818890867035:6502]
2025-10-10T14:04:54.515653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:54.517376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:54.517606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:54.518808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:54.519112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:54.519120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:54.519127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:54.519134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:54.519140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:54.519147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:54.519153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:54.519158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:54.519165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:54.519171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:54.519177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:54.519184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:54.519229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:54.519328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:54.519374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:54.519420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:54.519464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:54.519506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:54.519551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:54.519594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:54.519640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:54.519685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:54.519727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:54.519769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:54.519807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:54.519865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:54.519914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:54.519960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:54.520013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:54.520058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:54.520115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:54.520195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:54.520238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:54.520282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:54.520318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:54.520365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:54.520404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:54.520448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:54.520485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:54.520529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:54.520571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:54.520618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:54.520654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:54.520701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:54.520740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:54.520787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:54.520824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:54.520868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:54.528597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:54.627447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:54.643281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:54.643557Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:54.643586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:54.643608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:54.643634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 461 [2:7559593818890867035:6502]
2025-10-10T14:04:54.643699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:54.643766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:54.643782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:54.643795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:54.643806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:54.643860Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:54.643883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:54.643906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:54.645471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:54.645490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:54.645505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:54.645521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:54.645535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:54.645843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:54.645863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:54.646030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:54.646239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:54.646499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:54.646626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:54.646719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593820468786297:7210], now have 1 active actors on pipe
2025-10-10T14:04:54.646744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593820468786287:6504], now have 1 active actors on pipe
2025-10-10T14:04:54.646768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593820468786255:2442], now have 1 active actors on pipe
2025-10-10T14:04:54.646793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593818890867030:6502]
2025-10-10T14:04:54.646808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593818890867030:6502]
2025-10-10T14:04:54.646822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593818890867030:6502]
2025-10-10T14:04:54.646838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593818890867030:6502]
2025-10-10T14:04:54.646890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:54.647003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:54.647204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:54.647224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:54.647361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593818890867030:6502]
2025-10-10T14:04:54.647385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:54.647502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:54.647516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:54.647528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:54.647541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:54.647565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:54.647695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 461
2025-10-10T14:04:54.647779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 461, pipe: [1:7559593820468786287:6504]
2025-10-10T14:04:54.647847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 461
2025-10-10T14:04:54.649158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:54.649203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:54.649346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86ffce84-b82051cc-44b97ad-65cd378e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:54.649380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:54.649400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:54.649412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:54.649449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:54.649493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:54.649544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:54.652943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 462 partition: 0 MaxSeqNo: 36 sessionId: src_id|86ffce84-b82051cc-44b97ad-65cd378e_0
2025-10-10T14:04:54.652338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:54.652384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:54.652465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:54.654116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118188a3-a1a4e8c1-54d01be1-558a70f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86ffce84-b82051cc-44b97ad-65cd378e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:54.692992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86ffce84-b82051cc-44b97ad-65cd378e_0] Write session: try to update token
2025-10-10T14:04:54.693054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86ffce84-b82051cc-44b97ad-65cd378e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:54.801633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:54.801672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:54.801685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:54.801744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:54.801758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:54.801771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:54.801780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:54.801791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:54.801829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593818890867030:6502]
2025-10-10T14:04:54.801854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593818890867030:6502]
2025-10-10T14:04:54.801874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593818890867030:6502]
2025-10-10T14:04:54.801893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593818890867030:6502]
2025-10-10T14:04:54.802035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:54.802060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:54.802071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:54.803086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:54.805293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:54.805344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:54.805377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:54.805417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:54.941349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId: src_id|86ffce84-b82051cc-44b97ad-65cd378e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:54.966334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:55.055755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:55.057847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:55.057897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:55.059192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:55.059221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:55.061377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593820468786287:6504]
2025-10-10T14:04:55.061464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:55.068033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:55.101053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 462 reason: error at write: Disconnected sessionId: src_id|86ffce84-b82051cc-44b97ad-65cd378e_0
2025-10-10T14:04:55.101439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 462 sessionId: src_id|86ffce84-b82051cc-44b97ad-65cd378e_0 is DEAD
2025-10-10T14:04:55.106067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86ffce84-b82051cc-44b97ad-65cd378e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:55.106101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86ffce84-b82051cc-44b97ad-65cd378e_0] Write session will restart in 0.007283s
2025-10-10T14:04:55.106201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86ffce84-b82051cc-44b97ad-65cd378e_0] Write session: Do CDS request
2025-10-10T14:04:55.106231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86ffce84-b82051cc-44b97ad-65cd378e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:55.118988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:55.119025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 463
2025-10-10T14:04:55.119932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86ffce84-b82051cc-44b97ad-65cd378e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:55.125178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:55.125344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:55.125359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:55.125370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:55.130341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 463 sessionId:  describe result for acl check
2025-10-10T14:04:55.130470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:55.130481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:55.130491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:55.130508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593824763753887:7216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:55.133384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593824763753887:7216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:55.153867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593824763753887:7216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:55.160732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593824763753941:6504]
2025-10-10T14:04:55.172189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593824763753887:7216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:55.172234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593824763753887:7216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:55.172254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593824763753887:7216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:55.172284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:55.261242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:55.281911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:55.282868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:55.282888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:55.282933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:55.283226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:55.283447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593823185834618:6511]
2025-10-10T14:04:55.287308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:55.290625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:55.290898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:55.292315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:55.292670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:55.292679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:55.292688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:55.292695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:55.292703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:55.292711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:55.292719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:55.292729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:55.292736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:55.292744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:55.292752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:55.292759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:55.292813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:55.292937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:55.292993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:55.293049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:55.293118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:55.293196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:55.293259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:55.293311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:55.293364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:55.293420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:55.293471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:55.293525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:55.294882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:55.294991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:55.295092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:55.295177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:55.295242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:55.295323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:55.295395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:55.295464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:55.295527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:55.295594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:55.295662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:55.295732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:55.295790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:55.295856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:55.295911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:55.295977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:55.296041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:55.296105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:55.296163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:55.296227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:55.296283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:55.296349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:55.296404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:55.296471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:55.296985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:55.363570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:55.378585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:55.378629Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:55.378647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:55.378666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:55.378688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 462 [2:7559593823185834618:6511]
2025-10-10T14:04:55.378747Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:55.378804Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:55.378819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:55.378832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:55.378845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:55.378892Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:55.378914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:55.378935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:55.381022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:55.381049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:55.381065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:55.381081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:55.381107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:55.381394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:55.381420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:55.381557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:55.381757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:55.382012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:55.382140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:55.382209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.382223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.382236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.382249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.382286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:55.382320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:55.382336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:55.382368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:55.382381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:55.382383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:55.382567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:55.382583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:55.382628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593824763753869:2442], now have 1 active actors on pipe
2025-10-10T14:04:55.382652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593824763753965:7216], now have 1 active actors on pipe
2025-10-10T14:04:55.382675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593824763753941:6504], now have 1 active actors on pipe
2025-10-10T14:04:55.382782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.382810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:55.382980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:55.383358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 462
2025-10-10T14:04:55.383480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 462
2025-10-10T14:04:55.383550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 462, pipe: [1:7559593824763753941:6504]
2025-10-10T14:04:55.385314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:55.385361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:55.385451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:55.385489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:55.385507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:55.385517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:55.385567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:55.385616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:55.385669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:55.387787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:55.387828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:55.387910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:55.388622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 463 partition: 0 MaxSeqNo: 36 sessionId: src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0
2025-10-10T14:04:55.389537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86ffce84-b82051cc-44b97ad-65cd378e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:55.432209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0] Write session: try to update token
2025-10-10T14:04:55.432270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:55.598612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:55.598644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:55.598655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:55.598711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:55.598725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:55.598738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:55.598747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:55.598760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:55.598792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.598815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.598835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.598853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.599045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:55.599068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:55.599079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:55.600074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:55.601247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:55.601280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:55.601306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:55.601333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:55.637873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId: src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:55.675871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:55.827616Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:55.850058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:55.850100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:55.850157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:55.850170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:55.850210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593823185834613:6511]
2025-10-10T14:04:55.850703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:55.851771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:55.851908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:55.852065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:55.852079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:55.852630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593824763753941:6504]
2025-10-10T14:04:55.887796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 463 reason: error at write: Disconnected sessionId: src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0
2025-10-10T14:04:55.888067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 463 sessionId: src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0 is DEAD
2025-10-10T14:04:55.891181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:55.891233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0] Write session will restart in 0.007316s
2025-10-10T14:04:55.891395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0] Write session: Do CDS request
2025-10-10T14:04:55.891443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:55.910212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:55.913929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:55.913968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 464
2025-10-10T14:04:55.945488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:55.945685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:55.945707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:55.945718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:55.949662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 464 sessionId:  describe result for acl check
2025-10-10T14:04:55.949800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:55.949809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:55.949819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:55.949837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593824763754242:7232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:55.952494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593824763754242:7232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:55.961497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593824763754251:6504]
2025-10-10T14:04:55.976436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593824763754242:7232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:56.006303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593824763754242:7232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:56.006343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593824763754242:7232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:56.006354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593824763754242:7232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:56.006377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:56.117280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:56.128532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:56.129535Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:56.129572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:56.129628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:56.129953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:56.130159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593827480802255:6523]
2025-10-10T14:04:56.132417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:56.137893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:56.138171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:56.139540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:56.139895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:56.139906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:56.139913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:56.139920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:56.139927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:56.139935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:56.139942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:56.139951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:56.139958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.139965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.139971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.139978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.140027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:56.140137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:56.140185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:56.140235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:56.140278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:56.140325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:56.140369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:56.140413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:56.140458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.140504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.140547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.140592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.140637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:56.140703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:56.140764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:56.140820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:56.140869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:56.140922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:56.140968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:56.141023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:56.141072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:56.144260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:56.144348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:56.144413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:56.144465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:56.144518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:56.144566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:56.144621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:56.144673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.144728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.144774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.144831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.144878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.144929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.144975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.145024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.145516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:56.198690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:56.250363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:56.250405Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:56.250419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:56.250437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:56.250459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 463 [2:7559593827480802255:6523]
2025-10-10T14:04:56.250510Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:56.250565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:56.250578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:56.250589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:56.250599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:56.250641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:56.250661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:56.250681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:56.251799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.251815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.251827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.251840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.251851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:56.252105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:56.252120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.252253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.252410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.252615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.252714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:56.254207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 463
2025-10-10T14:04:56.254304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 463, pipe: [1:7559593824763754251:6504]
2025-10-10T14:04:56.254382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 463
2025-10-10T14:04:56.254494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.254521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.254534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.254547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.254591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:56.254695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593829058721647:7232], now have 1 active actors on pipe
2025-10-10T14:04:56.254725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593824763754251:6504], now have 1 active actors on pipe
2025-10-10T14:04:56.254751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593824763754216:2442], now have 1 active actors on pipe
2025-10-10T14:04:56.254781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:56.254968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:56.254990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:56.255080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:56.255113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:56.255116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.255126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:56.255136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:56.255140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:56.255169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:56.256173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:56.256216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:56.256311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97067dcf-ce15133-63b98447-5f7a00e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:56.256353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:56.256373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:56.256385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:56.256420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:56.256464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:56.256516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:56.257292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 464 partition: 0 MaxSeqNo: 36 sessionId: src_id|97067dcf-ce15133-63b98447-5f7a00e4_0
2025-10-10T14:04:56.258338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b53f9e2-2f2a64be-67c42458-e634b873_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97067dcf-ce15133-63b98447-5f7a00e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:56.256922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:56.256944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:56.256992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:56.308206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97067dcf-ce15133-63b98447-5f7a00e4_0] Write session: try to update token
2025-10-10T14:04:56.308269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97067dcf-ce15133-63b98447-5f7a00e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:56.315288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:56.315329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:56.315369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.315499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:56.316422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:56.318195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:56.319494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:56.320667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:56.330944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:56.332775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:56.341305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:56.353376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:56.353408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:56.353432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:56.459318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:56.459353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:56.459365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:56.459421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:56.459437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:56.459451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:56.459465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:56.459476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:56.459519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.459548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.459575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.459600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593827480802249:6523]
2025-10-10T14:04:56.459752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:56.459781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.459794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:56.460913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:56.461469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:56.461521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:56.461550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:56.461590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:56.502461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId: src_id|97067dcf-ce15133-63b98447-5f7a00e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:56.527938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:56.632766Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:56.674112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:56.674162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:56.674987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:56.676557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:56.676593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:56.681283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593824763754251:6504]
2025-10-10T14:04:56.681363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:56.692854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 464 reason: error at write: Disconnected sessionId: src_id|97067dcf-ce15133-63b98447-5f7a00e4_0
2025-10-10T14:04:56.694723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97067dcf-ce15133-63b98447-5f7a00e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:56.694821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97067dcf-ce15133-63b98447-5f7a00e4_0] Write session will restart in 0.008361s
2025-10-10T14:04:56.695063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97067dcf-ce15133-63b98447-5f7a00e4_0] Write session: Do CDS request
2025-10-10T14:04:56.695136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97067dcf-ce15133-63b98447-5f7a00e4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:56.693154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 464 sessionId: src_id|97067dcf-ce15133-63b98447-5f7a00e4_0 is DEAD
2025-10-10T14:04:56.720841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97067dcf-ce15133-63b98447-5f7a00e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:56.721965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:56.722006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 465
2025-10-10T14:04:56.722322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:56.722451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:56.722475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:56.722486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:56.723940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 465 sessionId:  describe result for acl check
2025-10-10T14:04:56.724066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:56.724085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:56.724095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:56.724112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593829058721848:7241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:56.726937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593829058721848:7241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:56.740399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593829058721848:7241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:56.763200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593829058721848:7241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:56.763257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593829058721848:7241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:56.763276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593829058721848:7241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:56.763309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:56.784809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593829058721938:6504]
2025-10-10T14:04:56.883438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:56.896921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:56.897980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:56.898001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:56.898037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:56.898266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:56.898397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593827480802559:6532]
2025-10-10T14:04:56.900204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:56.901423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:56.901652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:56.904270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:56.904702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:56.904716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:56.904738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:56.904752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:56.904765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:56.904777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:56.904800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:56.904820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:56.904840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.904863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.904879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.904897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.904991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:56.905152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:56.905211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:56.905265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:56.905317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:56.905371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:56.905423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:56.905473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:56.905524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.905578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.905630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.905681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.905727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:56.905798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:56.905923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:56.906010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:56.906058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:56.906099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:56.906134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:56.906178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:56.906215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:56.906256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:56.906288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:56.906328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:56.906363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:56.906400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:56.906432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:56.906476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:56.906531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.906590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.906639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.906697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.906748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.906804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.906851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.906966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.907573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:56.942008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:56.957932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:56.957979Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:56.958000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:56.958021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:56.958046Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 464 [2:7559593827480802559:6532]
2025-10-10T14:04:56.958110Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:56.958178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:56.958198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:56.958211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:56.958223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:56.958273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:56.958296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:56.958318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:56.959858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.959887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.959905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.959921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.959934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:56.960493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 464, pipe: [1:7559593829058721938:6504]
2025-10-10T14:04:56.960620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 464
2025-10-10T14:04:56.960724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 464
2025-10-10T14:04:56.984004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:56.984037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:56.984145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:56.984280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:56.984447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:56.984533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:56.984569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593829058721938:6504], now have 1 active actors on pipe
2025-10-10T14:04:56.984590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593829058721839:2442], now have 1 active actors on pipe
2025-10-10T14:04:56.984606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593829058721889:7241], now have 1 active actors on pipe
2025-10-10T14:04:56.984654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:56.984669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:56.984677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:56.984687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:56.984718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:56.984776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:56.984910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:56.984933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:56.984950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:56.984974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:56.984986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:56.984997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:56.985026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:56.985040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:56.985105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:56.985172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:56.985186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:56.985248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:56.985275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:56.985288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:56.985295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:56.985318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:56.985347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:56.985378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:56.987286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:56.987322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:56.987391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:56.987724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 465 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0
2025-10-10T14:04:56.988486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97067dcf-ce15133-63b98447-5f7a00e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:57.040816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0] Write session: try to update token
2025-10-10T14:04:57.040875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:57.058738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:57.058770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:57.058782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:04:57.148671388  106874 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:04:57.158087Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:04:57.231980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:57.232018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:57.232033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:57.232056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:57.232069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:57.232110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:57.232140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:57.232167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:57.232188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:57.232358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:57.232370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:57.232381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:57.232480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:57.232517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:57.232529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:57.232837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:57.232889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:57.232918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:57.232947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:57.249315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:57.274490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId: src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:57.299809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:57.408113Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:57.430279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:57.430310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:57.428879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:57.428921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:57.428973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:57.428988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:57.429027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593827480802553:6532]
2025-10-10T14:04:57.429289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:57.429947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:57.439563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 465 reason: error at write: Disconnected sessionId: src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0
2025-10-10T14:04:57.445694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:57.445735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0] Write session will restart in 0.006605s
2025-10-10T14:04:57.445834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0] Write session: Do CDS request
2025-10-10T14:04:57.445864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:57.449846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 465 sessionId: src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0 is DEAD
2025-10-10T14:04:57.466552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593829058721938:6504]
2025-10-10T14:04:57.466649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:57.478643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:57.479589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:57.479630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 466
2025-10-10T14:04:57.479950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:57.480083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:57.480099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:57.480108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:57.481640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 466 sessionId:  describe result for acl check
2025-10-10T14:04:57.481757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:57.481767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:57.481786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:57.481806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593833353689458:7252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:57.484863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593833353689458:7252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:57.498863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593833353689458:7252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:57.526935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593833353689458:7252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:57.526984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593833353689458:7252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:57.527001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593833353689458:7252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:57.527036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:57.568931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593833353689593:6504]
2025-10-10T14:04:57.723238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:57.729032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:57.730087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:57.730108Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:57.730168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:57.730488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:57.730697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593831775770179:6541]
2025-10-10T14:04:57.737508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:57.741866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:57.742144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:57.743528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:57.743895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:57.743905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:57.743914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:57.743923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:57.743931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:57.743939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:57.743947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:57.743955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:57.743963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:57.743971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:57.743979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:57.743987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:57.744043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:57.744174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:57.744229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:57.744285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:57.744335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:57.744389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:57.744439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:57.744497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:57.744546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:57.744598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:57.744651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:57.744703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:57.744754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:57.744837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:57.744905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:57.744971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:57.745029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:57.745090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:57.745239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:57.745304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:57.745359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:57.745418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:57.745469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:57.745547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:57.745608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:57.745668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:57.745725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:57.745783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:57.745838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:57.745898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:57.745952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:57.746010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:57.746064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:57.746127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:57.746177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:57.746240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:57.746750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:57.779376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:57.831968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:57.832011Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:57.832028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:57.832048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:57.832073Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 465 [2:7559593831775770179:6541]
2025-10-10T14:04:57.832133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:57.832192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:57.832214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:57.832227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:57.832239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:57.832283Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:57.832310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:57.832337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:57.834032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:57.834063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:57.834078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:57.834093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:57.834106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:57.834395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:57.834423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:57.834549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:57.834714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:57.834908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:57.835041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:57.835113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:57.835134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:57.835148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:57.835162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:57.836497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 465
2025-10-10T14:04:57.835201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:57.836599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 465, pipe: [1:7559593833353689593:6504]
2025-10-10T14:04:57.835293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:57.836669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 465
2025-10-10T14:04:57.835421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:57.835433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:57.835446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:57.835457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:57.835480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:57.835498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:57.835641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593833353689497:7252], now have 1 active actors on pipe
2025-10-10T14:04:57.835665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593833353689593:6504], now have 1 active actors on pipe
2025-10-10T14:04:57.835685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:57.835713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:57.835791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593833353689454:2442], now have 1 active actors on pipe
2025-10-10T14:04:57.835965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:57.837356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:57.837391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:57.837478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:57.837517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:57.837539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:57.837551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:57.837587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:57.837629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:57.837681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:57.838406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:57.838431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:57.838490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:57.838747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 466 partition: 0 MaxSeqNo: 36 sessionId: src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0
2025-10-10T14:04:57.841352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4c27b0-8563fbed-74fa08e0-f56799d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:57.899316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0] Write session: try to update token
2025-10-10T14:04:57.899377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:57.956494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:57.956529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:57.956540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:58.078501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:58.086880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:58.086905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:58.087044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:58.087061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:58.087073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:58.087085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:58.087096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:58.087131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:58.087162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:58.087189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:58.087211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:58.087818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:58.087858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:58.087891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:58.087924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:58.131760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:58.131814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:58.131828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:58.132955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:58.204891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId: src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:58.232421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:58.304406Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:58.306306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:58.306334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:58.306379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593831775770174:6541]
2025-10-10T14:04:58.306530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:58.306558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:58.306854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:58.307958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:58.311658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:58.311804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:04:58.313027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593833353689593:6504]
2025-10-10T14:04:58.352019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 466 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0
2025-10-10T14:04:58.352323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 466 sessionId: src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0 is DEAD
2025-10-10T14:04:58.359061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:04:58.359104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0] Write session will restart in 0.009658s
2025-10-10T14:04:58.359207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0] Write session: Do CDS request
2025-10-10T14:04:58.359237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:58.375697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:58.376414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:58.376451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 467
2025-10-10T14:04:58.376819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:58.376936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:58.376953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:58.376963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:58.380998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 467 sessionId:  describe result for acl check
2025-10-10T14:04:58.381178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:58.381191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:58.381202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:58.381220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593837648657109:7262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:58.384350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593837648657109:7262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:58.405061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593837648657109:7262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:58.408522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593837648657160:6504]
2025-10-10T14:04:58.417796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593837648657109:7262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:58.417847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593837648657109:7262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:58.417873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593837648657109:7262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:58.417905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:58.533742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:58.536652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:58.537638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:58.537671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:58.537719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:58.538006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:58.538333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593836070737786:6551]
2025-10-10T14:04:58.540788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:58.542639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:58.542895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:58.544419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:58.544793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:58.544804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:58.544812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:58.544820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:58.544828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:58.544836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:58.544844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:58.544852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:58.544862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:58.544870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:58.544878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:58.544887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:58.544944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:58.545073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:58.545170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:58.545226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:58.545281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:58.545335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:58.545391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:58.545445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:58.545500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:58.545555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:58.545609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:58.545665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:58.545714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:58.545795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:58.545864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:58.545929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:58.545989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:58.546973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:58.547047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:58.547112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:58.547173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:58.547237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:58.547289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:58.547350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:58.547404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:58.547464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:58.547513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:58.547575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:58.547631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:58.547694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:58.547748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:58.547811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:58.547867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:58.547932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:58.547984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:58.548043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:58.548998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:58.578399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:58.590957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:58.591012Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:58.591035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:58.591058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:58.591085Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 466 [2:7559593836070737786:6551]
2025-10-10T14:04:58.591148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:58.591213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:58.591231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:58.591244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:58.591257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:58.591308Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:58.591331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:58.591354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:58.649852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:58.649882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:58.649896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:58.649908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:58.649918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:58.650211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:58.650228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:58.650363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:58.650532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:58.650751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:58.650862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:58.650944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593837648657168:7262], now have 1 active actors on pipe
2025-10-10T14:04:58.650969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593837648657160:6504], now have 1 active actors on pipe
2025-10-10T14:04:58.650992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593837648657079:2442], now have 1 active actors on pipe
2025-10-10T14:04:58.651016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.651032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.651047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.651062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.651105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:58.651139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:58.651155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:58.651165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:58.651178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:58.651184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:58.651360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:58.651377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:58.651497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.651526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:58.651544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:58.652850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 466
2025-10-10T14:04:58.652944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 466, pipe: [1:7559593837648657160:6504]
2025-10-10T14:04:58.653013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 466
2025-10-10T14:04:58.654428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:58.654466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:58.654556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:58.654589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:58.654608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:58.654619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:58.654654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:58.654695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:58.654742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:58.661692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:58.661739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:58.661822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:58.662273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 467 partition: 0 MaxSeqNo: 36 sessionId: src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0
2025-10-10T14:04:58.663262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8290a261-9d6579f4-f0574ca1-6c75a96f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:58.691885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:58.691915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:58.691929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:58.702876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0] Write session: try to update token
2025-10-10T14:04:58.702936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:58.738671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:58.738706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:58.738747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.738885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:58.740682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:58.741771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:58.743043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:58.744214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:58.757842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:58.760149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:58.765558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:58.795069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:58.795100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:58.795112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:58.885246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId: src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:58.936409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:58.936448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:58.936461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:58.936518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:58.936534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:58.936546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:58.936558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:58.936571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:58.936613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.936641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.936668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.936693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593836070737781:6551]
2025-10-10T14:04:58.936831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:58.936859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:58.936871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:58.938032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:58.945293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:58.945339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:58.945373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:58.945407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:59.026445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:59.173329Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:59.175826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:59.175858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:59.177471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:59.177609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:59.177621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:59.176923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:59.258583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593837648657160:6504]
2025-10-10T14:04:59.258769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 467 reason: error at write: Disconnected sessionId: src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0
2025-10-10T14:04:59.259055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 467 sessionId: src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0 is DEAD
2025-10-10T14:04:59.261557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:59.261596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0] Write session will restart in 0.006809s
2025-10-10T14:04:59.261699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0] Write session: Do CDS request
2025-10-10T14:04:59.261727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:59.321515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:59.343825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:59.343867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 468
2025-10-10T14:04:59.344216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:04:59.344356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:04:59.344373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:04:59.344380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:04:59.352038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 468 sessionId:  describe result for acl check
2025-10-10T14:04:59.352176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:04:59.352185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:04:59.352194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:04:59.352211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593841943624780:7275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:04:59.354772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593841943624780:7275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:04:59.372995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593841943624803:6504]
2025-10-10T14:04:59.411567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593841943624780:7275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:04:59.439250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593841943624780:7275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:04:59.439300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593841943624780:7275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:04:59.439315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593841943624780:7275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:04:59.439345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:04:59.501647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:04:59.504406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:04:59.505374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:04:59.505405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:04:59.505449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:04:59.505718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:04:59.505892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593840365705409:6561]
2025-10-10T14:04:59.508391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:04:59.510494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:04:59.510738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:04:59.512083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:04:59.512436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:59.512444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:59.512454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:59.512462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:59.512469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:59.512477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:59.512485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:59.512492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:59.512501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:59.512508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:59.512515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:59.512523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:59.512576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:59.512707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:59.512768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:59.512824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:59.512876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:59.512928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:59.512980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:59.513032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:59.513084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:59.513162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:59.513811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:59.513874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:59.513926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:59.514004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:04:59.514071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:59.514131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:04:59.514190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:59.514255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:04:59.514310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:59.514371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:04:59.514430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:59.514490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:04:59.514540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:59.514605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:04:59.514672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:59.514732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:04:59.514787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:59.514845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:04:59.514901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:59.514960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:59.515013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:59.515079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:59.515134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:59.515194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:59.515246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:59.515306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:59.515814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:04:59.548803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:04:59.563296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:04:59.563330Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:04:59.563341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:04:59.563356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:04:59.563373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 467 [2:7559593840365705409:6561]
2025-10-10T14:04:59.563419Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:04:59.563474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:04:59.563484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:59.563494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:59.563503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:59.563537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:04:59.563554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:04:59.563570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:04:59.575447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:59.575473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:59.575484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:59.575495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:59.575506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:04:59.575746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:04:59.575763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:59.575882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:04:59.576047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:04:59.576280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:04:59.576390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:04:59.576457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593841943624803:6504], now have 1 active actors on pipe
2025-10-10T14:04:59.576483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593841943624710:2442], now have 1 active actors on pipe
2025-10-10T14:04:59.576505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593841943624941:7275], now have 1 active actors on pipe
2025-10-10T14:04:59.576523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.576535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.576544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.576554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.576586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:04:59.576608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:04:59.576620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:04:59.576632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:04:59.576642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:04:59.576661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:04:59.576799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:04:59.577258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 467, pipe: [1:7559593841943624803:6504]
2025-10-10T14:04:59.576809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:04:59.576909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.577342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 467
2025-10-10T14:04:59.576931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:04:59.577398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 467
2025-10-10T14:04:59.576959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:04:59.577900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:59.577935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:59.578003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:04:59.578038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:59.578056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:59.578067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:04:59.578102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:59.578138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:04:59.578181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:59.578558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:59.578581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:59.578637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:04:59.578888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 468 partition: 0 MaxSeqNo: 36 sessionId: src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0
2025-10-10T14:04:59.579537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e00e4626-5a631a7d-3bda6cee-e24f8755_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:04:59.601427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0] Write session: try to update token
2025-10-10T14:04:59.601480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:04:59.610790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:04:59.610827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:59.610862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.610982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:04:59.611206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:04:59.620909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:04:59.629245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:59.638210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:59.639740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:04:59.654251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:04:59.654817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:04:59.664865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:59.664898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:59.664909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:59.767358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:04:59.767392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:04:59.767406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:04:59.767416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:04:59.767427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:04:59.767463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.767489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.767514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.767539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593840365705402:6561]
2025-10-10T14:04:59.767636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:04:59.767669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:04:59.767702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:04:59.767710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:04:59.767717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:04:59.767729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:04:59.767740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:04:59.767771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:04:59.767799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:04:59.767809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:04:59.769502Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:04:59.775794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId: src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:04:59.804915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:04:59.942828Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:04:59.945601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:04:59.945642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:04:59.947068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:04:59.948874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593841943624803:6504]
2025-10-10T14:04:59.949033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:04:59.949285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:04:59.949306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:04:59.973748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:04:59.973798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0] Write session will restart in 0.005610s
2025-10-10T14:04:59.973907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0] Write session: Do CDS request
2025-10-10T14:04:59.973939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:04:59.971663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 468 reason: error at write: Disconnected sessionId: src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0
2025-10-10T14:04:59.972060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 468 sessionId: src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0 is DEAD
2025-10-10T14:04:59.998238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:04:59.998312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 469
2025-10-10T14:05:00.002002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:00.002886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:00.003071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:00.003089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:00.003101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:00.005218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 469 sessionId:  describe result for acl check
2025-10-10T14:05:00.005503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:00.005532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:00.005557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:00.005600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593846238592355:7284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:00.009679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593846238592355:7284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:00.041764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593846238592355:7284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:00.057291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593846238592387:6504]
2025-10-10T14:05:00.075475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593846238592355:7284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:00.075527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593846238592355:7284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:00.075545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593846238592355:7284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:00.075578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:00.222387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:00.239003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:00.239954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:00.239997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:00.240050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:00.240367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:00.240586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593844660673028:6572]
2025-10-10T14:05:00.243023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:00.250020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:00.250313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:00.251733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:00.252135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:00.252144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:00.252152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:00.252160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:00.252168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:00.252175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:00.252183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:00.252191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:00.252198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:00.252205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:00.252212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:00.252220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:00.252275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:00.252403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:00.252458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:00.252515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:00.252567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:00.252621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:00.252673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:00.252727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:00.252780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:00.252832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:00.252883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:00.252934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:00.252977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:00.253052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:00.253782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:00.253884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:00.253953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:00.254016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:00.254070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:00.254133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:00.254190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:00.254252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:00.254310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:00.254372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:00.254427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:00.254491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:00.254546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:00.254605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:00.254666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:00.254730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:00.254783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:00.254841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:00.254894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:00.254952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:00.255004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:00.255062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:00.255577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:00.288138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:00.357479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:00.357534Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:00.357555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:00.357577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:00.357601Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 468 [2:7559593844660673028:6572]
2025-10-10T14:05:00.357663Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:00.357729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:00.357744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:00.357757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:00.357770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:00.357821Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:00.357843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:00.357865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:00.359502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:00.359524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:00.359542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:00.359558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:00.359572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:00.359882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:00.359904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:00.360073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:00.360285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:00.360542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:00.360673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:00.360750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.360765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.360779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.360793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.360843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:00.360925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:00.361631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:00.361645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:00.361659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:00.361673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:00.362683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:00.362713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:00.362882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593846238592415:7284], now have 1 active actors on pipe
2025-10-10T14:05:00.362907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593841943625042:2442], now have 1 active actors on pipe
2025-10-10T14:05:00.362932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593846238592387:6504], now have 1 active actors on pipe
2025-10-10T14:05:00.362954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.362989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:00.363332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:00.366696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 468
2025-10-10T14:05:00.366814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 468
2025-10-10T14:05:00.366896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 468, pipe: [1:7559593846238592387:6504]
2025-10-10T14:05:00.371484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:00.371534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:00.371642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59349ff8-ace252cf-864d302a-1f519e0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:00.371679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:00.371699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:00.371710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:00.371751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:00.371796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:00.371849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:00.375127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:00.375177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:00.375273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:00.376094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 469 partition: 0 MaxSeqNo: 36 sessionId: src_id|59349ff8-ace252cf-864d302a-1f519e0d_0
2025-10-10T14:05:00.381425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df51bfeb-c9939747-ba3a58a4-c63cb4b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59349ff8-ace252cf-864d302a-1f519e0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:00.433070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59349ff8-ace252cf-864d302a-1f519e0d_0] Write session: try to update token
2025-10-10T14:05:00.433156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59349ff8-ace252cf-864d302a-1f519e0d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:00.526912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:00.526946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:00.526956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:00.527012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:00.527024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:00.527034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:00.527045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:00.527054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:00.527087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.527109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.527130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.527151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.527353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:00.527378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:00.527388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:00.528408Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:00.529297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:00.529333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:00.529362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:00.529393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:00.589278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId: src_id|59349ff8-ace252cf-864d302a-1f519e0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:00.638005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:00.700158Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:00.721263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:00.721317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:00.721383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:00.721397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:00.721441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593844660673022:6572]
2025-10-10T14:05:00.723076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:00.723217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593846238592387:6504]
2025-10-10T14:05:00.723293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:00.723302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:00.721915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:00.722773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:00.748153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 469 reason: error at write: Disconnected sessionId: src_id|59349ff8-ace252cf-864d302a-1f519e0d_0
2025-10-10T14:05:00.748567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 469 sessionId: src_id|59349ff8-ace252cf-864d302a-1f519e0d_0 is DEAD
2025-10-10T14:05:00.752768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59349ff8-ace252cf-864d302a-1f519e0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:00.752804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59349ff8-ace252cf-864d302a-1f519e0d_0] Write session will restart in 0.005744s
2025-10-10T14:05:00.752903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59349ff8-ace252cf-864d302a-1f519e0d_0] Write session: Do CDS request
2025-10-10T14:05:00.752933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59349ff8-ace252cf-864d302a-1f519e0d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:00.770015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59349ff8-ace252cf-864d302a-1f519e0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:00.775013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:00.775065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 470
2025-10-10T14:05:00.775734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:00.775893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:00.775912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:00.775924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:00.783092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 470 sessionId:  describe result for acl check
2025-10-10T14:05:00.783263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:00.783276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:00.783287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:00.783305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593846238592698:7297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:00.794972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593846238592698:7297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:00.827683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593846238592741:6504]
2025-10-10T14:05:00.844990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593846238592698:7297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:00.878340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593846238592698:7297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:00.878394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593846238592698:7297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:00.878409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593846238592698:7297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:00.878432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:01.005247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:01.029478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:01.030365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:01.030384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:01.030434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:01.030770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:01.030980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593848955640647:6576]
2025-10-10T14:05:01.033108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:01.034711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:01.034958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:01.036317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:01.036663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:01.036671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:01.036679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:01.036685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:01.036691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:01.036698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:01.036704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:01.036711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:01.036717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.036723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.036730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.036736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.036782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:01.036887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:01.036937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:01.036987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:01.037033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:01.037082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:01.037158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:01.037205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:01.037264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.037313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.037359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.037406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.037447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:01.037515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:01.037576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:01.037630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:01.037680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:01.037736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:01.037783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:01.037835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:01.037886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:01.037939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:01.037988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:01.038041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:01.038087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:01.038141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:01.038187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:01.038240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:01.038287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.038339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.038382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.038438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.038487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.038541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.038589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.038643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.045710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:01.172026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:01.221186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:01.221252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:01.221269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:01.221288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:01.221311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 469 [2:7559593848955640647:6576]
2025-10-10T14:05:01.221362Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:01.221425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:01.221440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:01.221453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:01.221464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:01.221513Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:01.221536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:01.221557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:01.223887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.223907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.223921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.223934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.223945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:01.225537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 469, pipe: [1:7559593846238592741:6504]
2025-10-10T14:05:01.225657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 469
2025-10-10T14:05:01.225729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 469
2025-10-10T14:05:01.230843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:01.230882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.231025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.231198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.231403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.231507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:01.231552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593846238592741:6504], now have 1 active actors on pipe
2025-10-10T14:05:01.231576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593846238592830:7297], now have 1 active actors on pipe
2025-10-10T14:05:01.231596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593846238592682:2442], now have 1 active actors on pipe
2025-10-10T14:05:01.231655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:01.231676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:01.231779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.231792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.231803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.231816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.231865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:01.231975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|541aa7ad-5a89db1-b20a917-457df609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:01.232013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:01.232032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:01.232042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:01.232079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:01.232125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:01.232183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:01.232349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:01.232365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:01.232507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:01.232571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.232591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:01.232612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:01.232628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:01.232639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:01.232650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:01.232676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:01.235415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:01.235456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:01.235530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:01.235851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 470 partition: 0 MaxSeqNo: 36 sessionId: src_id|541aa7ad-5a89db1-b20a917-457df609_0
2025-10-10T14:05:01.237769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59349ff8-ace252cf-864d302a-1f519e0d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|541aa7ad-5a89db1-b20a917-457df609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:01.274917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|541aa7ad-5a89db1-b20a917-457df609_0] Write session: try to update token
2025-10-10T14:05:01.274979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|541aa7ad-5a89db1-b20a917-457df609_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:01.321839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:01.321870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:01.321881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:01.445040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:01.445081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:01.445095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:01.445106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:01.445116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:01.445173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.445201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.445224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.445261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.445432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:01.445451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:01.445462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:01.445563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:01.445585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.445597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:01.450532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:01.450587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:01.450617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:01.450641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:01.454316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:01.469256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId: src_id|541aa7ad-5a89db1-b20a917-457df609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:01.503020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:01.603300Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:01.616913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:01.616962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:01.617036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:01.617053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:01.617099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593848955640642:6576]
2025-10-10T14:05:01.617474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:01.617935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:01.620451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593846238592741:6504]
2025-10-10T14:05:01.620671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:01.624562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:01.642511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 470 reason: status is not ok: tablet will be restarted right now sessionId: src_id|541aa7ad-5a89db1-b20a917-457df609_0
2025-10-10T14:05:01.642880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 470 sessionId: src_id|541aa7ad-5a89db1-b20a917-457df609_0 is DEAD
2025-10-10T14:05:01.647194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541aa7ad-5a89db1-b20a917-457df609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:01.647241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541aa7ad-5a89db1-b20a917-457df609_0] Write session will restart in 0.009387s
2025-10-10T14:05:01.647351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541aa7ad-5a89db1-b20a917-457df609_0] Write session: Do CDS request
2025-10-10T14:05:01.647380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541aa7ad-5a89db1-b20a917-457df609_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:01.664298Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:01.664334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 471
2025-10-10T14:05:01.670327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|541aa7ad-5a89db1-b20a917-457df609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:01.671433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:01.671659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:01.671687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:01.671705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:01.674081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 471 sessionId:  describe result for acl check
2025-10-10T14:05:01.674209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:01.674219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:01.674229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:01.674246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593850533560329:7308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:01.677873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593850533560329:7308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:01.707530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593850533560329:7308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:01.718978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593850533560428:6504]
2025-10-10T14:05:01.729272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593850533560329:7308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:01.729324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593850533560329:7308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:01.729343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593850533560329:7308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:01.729377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:01.807264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:01.809860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:01.810792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:01.810813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:01.810863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:01.811151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:01.811332Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593848955640982:6592]
2025-10-10T14:05:01.813504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:01.814850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:01.815067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:01.816507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:01.816836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:01.816844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:01.816849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:01.816856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:01.816862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:01.816868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:01.816874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:01.816880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:01.816886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.816893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.816898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.816905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.816949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:01.817049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:01.817092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:01.817154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:01.817197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:01.817251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:01.817292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:01.817331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:01.817373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.817414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.817454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.817491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.817529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:01.817591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:01.817645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:01.817693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:01.817738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:01.817787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:01.817828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:01.817876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:01.817922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:01.817972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:01.818012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:01.818061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:01.818104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:01.818152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:01.818193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:01.818241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:01.818289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.818337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.818378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.818429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.818472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.818525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.818586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.818638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.819061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:01.856868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:01.891195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:01.891242Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:01.891260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:01.891279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:01.891307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 470 [2:7559593848955640982:6592]
2025-10-10T14:05:01.891368Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:01.891437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:01.891455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:01.891467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:01.891479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:01.891528Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:01.891564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:01.891587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:01.954996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.955022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.955031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.955038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.955048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:01.955325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:01.955342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:01.955466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:01.955621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:01.955814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:01.955920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:01.955996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:01.956008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:01.956020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:01.956030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:01.956079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:01.956155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:01.956211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:01.956224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:01.956236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:01.956248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:01.956315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:01.956332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:01.956463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:01.956482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:01.956517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:01.956569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593850533560309:2442], now have 1 active actors on pipe
2025-10-10T14:05:01.956593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593850533560428:6504], now have 1 active actors on pipe
2025-10-10T14:05:01.956664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593850533560454:7308], now have 1 active actors on pipe
2025-10-10T14:05:01.958653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 470
2025-10-10T14:05:01.958675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 470, pipe: [1:7559593850533560428:6504]
2025-10-10T14:05:01.958777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 470
2025-10-10T14:05:01.961457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:01.961500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:01.961588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:01.961627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:01.961645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:01.961655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:01.961695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:01.961743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:01.961788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:01.963517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 471 partition: 0 MaxSeqNo: 36 sessionId: src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0
2025-10-10T14:05:01.963058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:01.963095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:01.963168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:01.965840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|541aa7ad-5a89db1-b20a917-457df609_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:01.996144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:01.996179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:01.996192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:01.998194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0] Write session: try to update token
2025-10-10T14:05:01.998246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:02.182357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId: src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:02.190575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:02.190610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:02.197192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:02.197265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:02.197278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:02.197324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:02.197353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:02.197377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:02.197401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:02.197596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:02.197609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:02.197623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:02.197731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:02.197757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:02.197768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:02.198174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:02.198213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:02.198241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:02.198272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:02.240442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:02.236067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:02.421345Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:02.451392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:02.451442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:02.451521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:02.451536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:02.451579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593848955640977:6592]
2025-10-10T14:05:02.453459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:02.456746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:02.465816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:02.466144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593850533560428:6504]
2025-10-10T14:05:02.466313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:02.542994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 471 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0
2025-10-10T14:05:02.543357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 471 sessionId: src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0 is DEAD
2025-10-10T14:05:02.545450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:02.545488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0] Write session will restart in 0.009295s
2025-10-10T14:05:02.545589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0] Write session: Do CDS request
2025-10-10T14:05:02.545619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:02.560563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:02.583298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593854828528060:6504]
2025-10-10T14:05:02.583403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:02.583423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 472
2025-10-10T14:05:02.584002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:02.584164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:02.584194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:02.584204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:02.585936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 472 sessionId:  describe result for acl check
2025-10-10T14:05:02.586179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:02.586196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:02.586206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:02.586223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593854828528072:7320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:02.588784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593854828528072:7320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:02.604858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593854828528072:7320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:02.621313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593854828528072:7320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:02.621355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593854828528072:7320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:02.621372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593854828528072:7320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:02.621402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:02.630891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:02.640015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:02.641240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:02.641283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:02.641337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:02.641620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:02.641814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593853250608589:6595]
2025-10-10T14:05:02.644159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:02.645461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:02.645726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:02.647051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:02.647426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:02.647449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:02.647457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:02.647463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:02.647469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:02.647476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:02.647482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:02.647489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:02.647495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:02.647500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:02.647507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:02.647514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:02.647586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:02.647716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:02.647767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:02.647814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:02.647862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:02.647909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:02.647956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:02.648003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:02.648048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:02.648097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:02.648149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:02.648203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:02.648243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:02.648310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:02.648372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:02.648430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:02.648480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:02.651066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:02.651151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:02.651217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:02.651272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:02.651333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:02.651392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:02.651460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:02.651514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:02.651572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:02.651622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:02.651681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:02.651735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:02.651794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:02.651845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:02.651902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:02.651951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:02.652010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:02.652061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:02.652126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:02.652602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:02.679507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:02.723383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:02.723427Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:02.723443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:02.723462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:02.723486Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 471 [2:7559593853250608589:6595]
2025-10-10T14:05:02.723544Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:02.723604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:02.723618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:02.723630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:02.723641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:02.723687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:02.723710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:02.723734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:02.732220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:02.732902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:02.732925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:02.732940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:02.732950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:02.733309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:02.733329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:02.733477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:02.733695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:02.733935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:02.734058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:02.734143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593854828527947:2442], now have 1 active actors on pipe
2025-10-10T14:05:02.734170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593854828528233:7320], now have 1 active actors on pipe
2025-10-10T14:05:02.734194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593854828528060:6504], now have 1 active actors on pipe
2025-10-10T14:05:02.734219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:02.734236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:02.734250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:02.734264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:02.734308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:02.734389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:02.734617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:02.734636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:02.734772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:02.734796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:02.735697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:02.735718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:02.735730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:02.735741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:02.735765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:02.736822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:02.736853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:02.736929Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:02.736958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:02.736975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:02.736986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:02.737018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:02.737059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:02.737103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:02.739304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:02.739333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:02.739400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:02.735517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 471
2025-10-10T14:05:02.735632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 471
2025-10-10T14:05:02.735690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 471, pipe: [1:7559593854828528060:6504]
2025-10-10T14:05:02.744078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a41cc92d-c04d084c-6b8cd50f-c5733525_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:02.741331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 472 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0
2025-10-10T14:05:02.784376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0] Write session: try to update token
2025-10-10T14:05:02.784429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:02.895545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:02.895583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:02.895596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:02.895651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:02.895665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:02.895678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:02.895691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:02.895703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:02.895741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:02.895770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:02.895797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:02.895821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:02.896033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:02.896060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:02.896071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:02.897332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:02.897426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:02.897486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:02.897547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:02.904234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:03.002779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId: src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:03.025180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:03.064534Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:03.078654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:03.078705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:03.078770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:03.078784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:03.078826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593853250608584:6595]
2025-10-10T14:05:03.080195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:03.081092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:03.081276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:03.081289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:03.082184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593854828528060:6504]
2025-10-10T14:05:03.086627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:03.164606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 472 reason: error at write: Disconnected sessionId: src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0
2025-10-10T14:05:03.164895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 472 sessionId: src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0 is DEAD
2025-10-10T14:05:03.167098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:03.167171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0] Write session will restart in 0.008189s
2025-10-10T14:05:03.167371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0] Write session: Do CDS request
2025-10-10T14:05:03.167438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:03.182617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593859123495602:6504]
2025-10-10T14:05:03.189282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:03.189545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:03.189325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 473
2025-10-10T14:05:03.193935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:03.194057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:03.194068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:03.194078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:03.195640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 473 sessionId:  describe result for acl check
2025-10-10T14:05:03.195729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:03.195736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:03.195743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:03.195756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593859123495605:7330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:03.197976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593859123495605:7330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:03.226699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593859123495605:7330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:03.262919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593859123495605:7330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:03.262972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593859123495605:7330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:03.262991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593859123495605:7330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:03.263037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:03.386656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:03.392699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:03.393691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:03.393719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:03.393756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:03.393973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:03.394098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593857545576220:6607]
2025-10-10T14:05:03.396398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:03.397568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:03.397832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:03.399202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:03.399561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:03.399574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:03.399583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:03.399591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:03.399599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:03.399608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:03.399614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:03.399622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:03.399630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:03.399638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:03.399646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:03.399653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:03.399710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:03.399831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:03.399886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:03.399940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:03.399992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:03.400047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:03.400096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:03.400149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:03.400200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:03.400255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:03.400308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:03.400359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:03.400406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:03.400480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:03.400546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:03.400608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:03.400665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:03.400731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:03.400785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:03.400848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:03.400904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:03.400965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:03.401017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:03.401078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:03.401160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:03.401224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:03.401289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:03.401350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:03.401404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:03.401468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:03.401521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:03.401583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:03.401638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:03.401697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:03.401750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:03.401809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:03.402320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:03.431630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:03.446332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:03.446383Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:03.446404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:03.446424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:03.446449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 472 [2:7559593857545576220:6607]
2025-10-10T14:05:03.446521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:03.446584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:03.446601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:03.446614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:03.446626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:03.446680Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:03.446703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:03.446728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:03.448153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:03.448172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:03.448188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:03.448203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:03.448216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:03.448504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:03.448523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:03.448685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:03.448895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:03.449797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 472, pipe: [1:7559593859123495602:6504]
2025-10-10T14:05:03.449913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 472
2025-10-10T14:05:03.449988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 472
2025-10-10T14:05:03.451059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:03.451212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:03.451307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593859123495602:6504], now have 1 active actors on pipe
2025-10-10T14:05:03.451334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593859123495726:7330], now have 1 active actors on pipe
2025-10-10T14:05:03.451358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593859123495578:2442], now have 1 active actors on pipe
2025-10-10T14:05:03.451408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:03.451432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:03.451486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.451501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.451515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.451530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.451572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:03.451660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:03.451857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:03.451876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:03.451937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b33ecc10-734ce487-992f10f-fc651003_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:03.451964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:03.451984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:03.451995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:03.452028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:03.452065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:03.452196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.452216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:03.452263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:03.452642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:03.452654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:03.452665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:03.452678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:03.452700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:03.456506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:03.456553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:03.456640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:03.459619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 473 partition: 0 MaxSeqNo: 36 sessionId: src_id|b33ecc10-734ce487-992f10f-fc651003_0
2025-10-10T14:05:03.460509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb6dcced-a97cd9aa-ae86f85f-26e39e41_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b33ecc10-734ce487-992f10f-fc651003_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:03.511870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b33ecc10-734ce487-992f10f-fc651003_0] Write session: try to update token
2025-10-10T14:05:03.511934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b33ecc10-734ce487-992f10f-fc651003_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:03.698246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId: src_id|b33ecc10-734ce487-992f10f-fc651003_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:03.708858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:03.708900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:03.708943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.709084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:03.709097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:03.709111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:03.709301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:03.710401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:03.715037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:03.716622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:03.717869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:03.725451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:03.729143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:03.729970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:03.767393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:03.767616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:03.767645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:03.767689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:03.767704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:03.767719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:03.767731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:03.767745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:03.767787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.767816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.767844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.767871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593857545576215:6607]
2025-10-10T14:05:03.768071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:03.768113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:03.768127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:03.768926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:03.768963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:03.768996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:03.769027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:03.771678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:03.933268Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:03.988989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:05:03.993333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:04.064118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:04.064160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:04.064323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 473 reason: error at write: Disconnected sessionId: src_id|b33ecc10-734ce487-992f10f-fc651003_0
2025-10-10T14:05:04.064604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 473 sessionId: src_id|b33ecc10-734ce487-992f10f-fc651003_0 is DEAD
2025-10-10T14:05:04.067053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33ecc10-734ce487-992f10f-fc651003_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:04.067114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33ecc10-734ce487-992f10f-fc651003_0] Write session will restart in 0.005005s
2025-10-10T14:05:04.067266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33ecc10-734ce487-992f10f-fc651003_0] Write session: Do CDS request
2025-10-10T14:05:04.067312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33ecc10-734ce487-992f10f-fc651003_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:04.083629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b33ecc10-734ce487-992f10f-fc651003_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:04.088878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593859123495602:6504]
2025-10-10T14:05:04.089038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:04.097282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:04.097333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 474
2025-10-10T14:05:04.102329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:04.102470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:04.102485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:04.102497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:04.109860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 474 sessionId:  describe result for acl check
2025-10-10T14:05:04.109997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:04.110007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:04.110016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:04.110033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593863418463284:7342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:04.112493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593863418463284:7342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:04.136233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593863418463284:7342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:04.167070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593863418463284:7342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:04.167117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593863418463284:7342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:04.167134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593863418463284:7342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:04.167165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:04.178435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593863418463385:6504]
2025-10-10T14:05:04.307340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:04.317523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:04.318397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:04.318414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:04.318458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:04.318704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:04.318872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593861840543841:6616]
2025-10-10T14:05:04.320921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:04.322706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:04.322929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:04.324175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:04.324466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:04.324474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:04.324479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:04.324486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:04.324492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:04.324498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:04.324504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:04.324509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:04.324515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:04.324521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:04.324528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:04.324533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:04.324575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:04.324669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:04.324716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:04.324758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:04.324799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:04.324840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:04.324880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:04.324921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:04.324959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:04.325000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:04.325039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:04.325079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:04.325115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:04.325198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:04.325249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:04.325312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:04.325356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:04.325404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:04.325451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:04.325498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:04.325542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:04.325586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:04.325626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:04.325672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:04.325714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:04.325763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:04.325803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:04.325852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:04.325894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:04.325937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:04.325980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:04.326028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:04.326070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:04.326116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:04.326156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:04.326202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:04.326606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:04.387272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:04.409387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:04.409434Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:04.409449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:04.409466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:04.409489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 473 [2:7559593861840543841:6616]
2025-10-10T14:05:04.409539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:04.409601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:04.409617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:04.409628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:04.409638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:04.409685Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:04.409707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:04.409728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:04.411924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:04.411940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:04.411953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:04.411965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:04.411976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:04.412264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:04.412281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:04.412409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:04.412572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:04.414562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:04.414678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:04.414771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593863418463385:6504], now have 1 active actors on pipe
2025-10-10T14:05:04.414798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593863418463364:7342], now have 1 active actors on pipe
2025-10-10T14:05:04.414818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593863418463253:2442], now have 1 active actors on pipe
2025-10-10T14:05:04.414842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.414855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.414868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.414881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.414919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:04.415008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:04.415164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:04.415182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:04.415304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.415324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:04.415710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:04.415723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:04.415729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:04.415737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:04.415752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:04.418699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 473, pipe: [1:7559593863418463385:6504]
2025-10-10T14:05:04.418832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 473
2025-10-10T14:05:04.418910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 473
2025-10-10T14:05:04.422273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b33ecc10-734ce487-992f10f-fc651003_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:04.419387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:04.419427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:04.419521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:04.419558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:04.419575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:04.419585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:04.419622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:04.419668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:04.419716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:04.420247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:04.420268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:04.420324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:04.421351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 474 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0
2025-10-10T14:05:04.464087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0] Write session: try to update token
2025-10-10T14:05:04.464152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:04.578778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:04.578814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:04.578827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:04.578882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:04.578896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:04.578909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:04.578921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:04.578931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:04.578966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.578997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.579031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.579061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.579218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:04.579279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:04.579315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:04.579318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:04.579342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:04.579352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:04.579369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:04.580477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:04.641012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId: src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:04.678575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:04.743715Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:04.772564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:04.772611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:04.772677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:04.772690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:04.772728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593861840543836:6616]
2025-10-10T14:05:04.773668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:04.775455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:04.776368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:04.776567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593863418463385:6504]
2025-10-10T14:05:04.776660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:04.790191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 474 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0
2025-10-10T14:05:04.790686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 474 sessionId: src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0 is DEAD
2025-10-10T14:05:04.793896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:04.793931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0] Write session will restart in 0.005293s
2025-10-10T14:05:04.794039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0] Write session: Do CDS request
2025-10-10T14:05:04.794074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:04.818460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:04.818547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:04.818584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 475
2025-10-10T14:05:04.821810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:04.821982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:04.822000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:04.822011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:04.824374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 475 sessionId:  describe result for acl check
2025-10-10T14:05:04.824493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:04.824504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:04.824516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:04.824533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593863418463569:7352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:04.827731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593863418463569:7352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:04.836734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593863418463569:7352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:04.851389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593863418463569:7352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:04.851435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593863418463569:7352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:04.851453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593863418463569:7352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:04.851485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:04.881269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593863418463619:6504]
2025-10-10T14:05:05.047208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:05.056742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:05.057759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:05.057792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:05.057840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:05.058147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:05.058344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593866135511475:6628]
2025-10-10T14:05:05.069686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:05.071192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:05.071440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:05.072838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:05.073218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:05.073227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:05.073235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:05.073243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:05.073251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:05.073258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:05.073265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:05.073273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:05.073281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.073289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.073296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.073303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.073374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:05.073499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:05.073555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:05.073612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:05.073665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:05.073719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:05.073771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:05.073821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:05.073873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.073928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.073981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.074032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.074078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:05.074154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:05.074219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:05.074282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:05.074338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:05.074399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:05.074451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:05.074509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:05.074562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:05.075872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:05.075947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:05.076013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:05.076072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:05.076137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:05.076191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:05.076254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:05.076310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.076375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.076428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.076491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.076546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.076608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.076658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.076729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.077275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:05.183005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:05.196208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:05.196259Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:05.196281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:05.196303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:05.196328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 474 [2:7559593866135511475:6628]
2025-10-10T14:05:05.196394Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:05.196457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:05.196472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:05.196486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:05.196498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:05.196547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:05.196570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:05.196593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:05.200611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.200642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.200659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.200674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.200687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:05.200992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:05.201014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.201201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.201429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.201684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.201816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:05.201898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.201915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.201930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.201944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.201980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:05.202009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:05.202025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:05.202039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:05.202052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:05.202071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:05.202270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:05.202288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:05.202337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593863418463557:2442], now have 1 active actors on pipe
2025-10-10T14:05:05.202363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593863418463619:6504], now have 1 active actors on pipe
2025-10-10T14:05:05.202386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593863418463598:7352], now have 1 active actors on pipe
2025-10-10T14:05:05.202526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.202564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:05.203567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:05.205193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 474
2025-10-10T14:05:05.205300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 474, pipe: [1:7559593863418463619:6504]
2025-10-10T14:05:05.205359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 474
2025-10-10T14:05:05.206803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:05.206843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:05.206931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:05.206966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:05.206994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:05.207014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:05.207068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:05.207118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:05.207166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:05.208189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:05.208222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:05.208293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:05.208579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 475 partition: 0 MaxSeqNo: 36 sessionId: src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0
2025-10-10T14:05:05.209722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ab2f795-1706a3d3-60c5d6aa-7e82dc5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:05.271343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0] Write session: try to update token
2025-10-10T14:05:05.271410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:05.464576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId: src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:05.483593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:05.483629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:05.483642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:05.483698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:05.483713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:05.483728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:05.483742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:05.483755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:05.483794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.483821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.483850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.483875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.484082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:05.484109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.484121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:05.485691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:05.485742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:05.485774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:05.485805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:05.488019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:05.508390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:05.673656Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:05.703046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:05.703100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:05.703176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:05.703192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:05.703234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593866135511469:6628]
2025-10-10T14:05:05.703772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:05.705627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:05.705174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:05.705346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593863418463619:6504]
2025-10-10T14:05:05.705436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:05.705449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:05.726462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 475 reason: error at write: Disconnected sessionId: src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0
2025-10-10T14:05:05.731576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 475 sessionId: src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0 is DEAD
2025-10-10T14:05:05.732717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:05.732781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0] Write session will restart in 0.005195s
2025-10-10T14:05:05.732945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0] Write session: Do CDS request
2025-10-10T14:05:05.732991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:05.753865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:05.761425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:05.761466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 476
2025-10-10T14:05:05.762935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:05.763088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:05.763104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:05.763115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:05.767745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 476 sessionId:  describe result for acl check
2025-10-10T14:05:05.767970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:05.767991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:05.768007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:05.768041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593867713431198:7364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:05.776762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593867713431198:7364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:05.800903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593867713431198:7364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:05.806060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593867713431259:6504]
2025-10-10T14:05:05.839122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593867713431198:7364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:05.839176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593867713431198:7364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:05.839196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593867713431198:7364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:05.839227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:05.937001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:05.940557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:05.941502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:05.941531Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:05.941578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:05.941865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:05.942056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593866135511790:6635]
2025-10-10T14:05:05.944333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:05.945535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:05.945770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:05.947037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:05.947374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:05.947381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:05.947390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:05.947398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:05.947406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:05.947413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:05.947421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:05.947429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:05.947437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.947444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.947452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.947461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.947514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:05.947630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:05.947683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:05.947733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:05.947776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:05.947825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:05.947871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:05.947920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:05.947967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.948019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.948067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.948115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.948154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:05.948218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:05.948281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:05.948339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:05.948389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:05.948444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:05.948490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:05.948548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:05.948600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:05.948660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:05.948711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:05.948771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:05.948822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:05.948876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:05.948923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:05.948980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:05.949032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.949093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:05.950078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.950153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:05.950212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.950267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:05.950315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.950370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:05.950813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:05.990302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:06.006584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:06.006626Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:06.006642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:06.006662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:06.006683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 475 [2:7559593866135511790:6635]
2025-10-10T14:05:06.006738Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:06.006790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:06.006803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:06.006815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:06.006827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:06.006874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:06.006895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:06.006915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:06.009414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.009444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:06.009459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:06.009473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:06.009485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:06.009750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:06.009774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.010343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 475
2025-10-10T14:05:06.010437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 475
2025-10-10T14:05:06.010522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 475, pipe: [1:7559593867713431259:6504]
2025-10-10T14:05:06.009924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:06.010122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:06.010357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:06.010482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:06.010565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593867713431319:7364], now have 1 active actors on pipe
2025-10-10T14:05:06.010589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593867713431185:2442], now have 1 active actors on pipe
2025-10-10T14:05:06.010615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593867713431259:6504], now have 1 active actors on pipe
2025-10-10T14:05:06.010641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.010654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.010668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.010681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.010723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:06.010804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:06.010992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:06.011009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:06.011098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:06.011114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:06.011127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.011128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:06.011140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:06.011146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:06.011167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:06.011911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:06.011936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:06.012020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:06.012048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:06.012066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:06.012077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:06.012107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:06.012144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:06.012194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:06.017084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:06.017145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:06.017237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:06.018086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 476 partition: 0 MaxSeqNo: 36 sessionId: src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0
2025-10-10T14:05:06.021788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dd23ffe-d03ae70b-497b7a45-86a27dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:06.074050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0] Write session: try to update token
2025-10-10T14:05:06.074110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:06.151094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:06.151217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:06.151229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:06.151270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:06.151284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:06.151297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:06.151310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:06.151323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:06.151350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.151367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.151383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.151398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.151568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:06.151598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.151606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:06.152688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:06.155924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:06.156012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:06.156065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:06.156119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:06.220149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId: src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:06.279454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:06.305453Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:06.320436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:06.320491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:06.320560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:06.320576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:06.320621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593866135511785:6635]
2025-10-10T14:05:06.323116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:06.323151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:06.325273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:06.325464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593867713431259:6504]
2025-10-10T14:05:06.321676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:06.322853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:06.364025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 476 reason: error at write: Disconnected sessionId: src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0
2025-10-10T14:05:06.368765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 476 sessionId: src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0 is DEAD
2025-10-10T14:05:06.369231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:06.369292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0] Write session will restart in 0.005380s
2025-10-10T14:05:06.369442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0] Write session: Do CDS request
2025-10-10T14:05:06.369475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:06.383486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:06.385313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:06.385396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 477
2025-10-10T14:05:06.385962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:06.386204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:06.386245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:06.386267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:06.388522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 477 sessionId:  describe result for acl check
2025-10-10T14:05:06.388688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:06.388706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:06.388720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:06.388748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593872008398842:7375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:06.391668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593872008398842:7375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:06.397762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593872008398842:7375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:06.423249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593872008398842:7375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:06.423303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593872008398842:7375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:06.423322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593872008398842:7375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:06.423354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:06.425722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593872008398954:6504]
2025-10-10T14:05:06.491704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:06.492432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:06.493432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:06.493452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:06.493498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:06.493773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:06.493982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593870430479407:6647]
2025-10-10T14:05:06.496384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:06.497994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:06.498216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:06.499545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:06.499860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:06.499873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:06.499881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:06.499888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:06.499897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:06.499906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:06.499914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:06.499921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:06.499928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.499934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:06.499944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:06.499952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:06.500004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:06.500564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:06.500628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:06.500682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:06.500731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:06.500781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:06.500830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:06.500882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:06.500931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.500986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:06.501035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:06.501086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:06.501144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:06.501231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:06.501297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:06.501370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:06.501425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:06.501974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:06.502043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:06.502105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:06.502161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:06.502220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:06.502270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:06.502331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:06.502385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:06.502443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:06.502495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:06.502552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:06.502603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.502658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.502707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:06.502765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:06.502817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:06.502875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:06.502943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:06.502999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:06.503485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:06.563841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:06.579294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:06.579345Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:06.579366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:06.579387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:06.579413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 476 [2:7559593870430479407:6647]
2025-10-10T14:05:06.579477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:06.579541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:06.579557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:06.579571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:06.579584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:06.579638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:06.579661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:06.579685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:06.581607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.581635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:06.581650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:06.581664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:06.581676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:06.582762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 476
2025-10-10T14:05:06.582838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 476, pipe: [1:7559593872008398954:6504]
2025-10-10T14:05:06.582887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 476
2025-10-10T14:05:06.581981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:06.582009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.582177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:06.582386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:06.582637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:06.582768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:06.582853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593872008398818:2442], now have 1 active actors on pipe
2025-10-10T14:05:06.582879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593872008398954:6504], now have 1 active actors on pipe
2025-10-10T14:05:06.582902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593872008398944:7375], now have 1 active actors on pipe
2025-10-10T14:05:06.582931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.582947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.582961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.582976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.583022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:06.583064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:06.583081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:06.583092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:06.583104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:06.583109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:06.583305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:06.583322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:06.583505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:06.583527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:06.583561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.583602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:06.583670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:06.583726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:06.583757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:06.583775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:06.583786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:06.583820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:06.583858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:06.583952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:06.584707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:06.584759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:06.584827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:06.585453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 477 partition: 0 MaxSeqNo: 36 sessionId: src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0
2025-10-10T14:05:06.586256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a30a7-3ad9ecf1-5efa12df-dd32273c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:06.629724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0] Write session: try to update token
2025-10-10T14:05:06.629787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:06.739440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:06.739477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:06.739494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:06.739508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:06.739523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:06.739564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.739592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.739628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.739656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.739811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:06.739832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:06.739848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:06.739850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:06.739861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:06.739884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:06.739916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:06.739963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:06.739988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:06.740002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:06.749386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:06.761142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId: src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:06.794843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:06.934184Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:06.969285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:06.969337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:06.969426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:06.969440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:06.969485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593870430479402:6647]
2025-10-10T14:05:06.969943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:06.970907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:06.977331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593872008398954:6504]
2025-10-10T14:05:06.977332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:06.977449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:06.992493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 477 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0
2025-10-10T14:05:06.992818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 477 sessionId: src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0 is DEAD
2025-10-10T14:05:06.997679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:06.997719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0] Write session will restart in 0.006009s
2025-10-10T14:05:06.997822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0] Write session: Do CDS request
2025-10-10T14:05:06.997852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:07.009780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:07.009108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:07.009177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 478
2025-10-10T14:05:07.016158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:07.016366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:07.016393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:07.016405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:07.036153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 478 sessionId:  describe result for acl check
2025-10-10T14:05:07.036306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:07.036323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:07.036334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:07.036352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593876303366463:7381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:07.039402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593876303366463:7381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:07.048784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593876303366463:7381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:07.068900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593876303366463:7381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:07.068951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593876303366463:7381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:07.068970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593876303366463:7381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:07.069003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:07.078177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593876303366508:6504]
2025-10-10T14:05:07.251997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:07.258552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:07.259405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:07.259423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:07.259469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:07.259738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:07.259920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593874725447038:6656]
2025-10-10T14:05:07.262133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:07.264702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:07.264952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:07.266260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:07.266602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:07.266610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:07.266618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:07.266624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:07.266631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:07.266638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:07.266645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:07.266680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:07.266693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:07.266702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:07.266710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:07.266718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:07.266767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:07.266874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:07.266925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:07.266973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:07.267018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:07.267067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:07.267116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:07.267163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:07.267208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:07.267254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:07.267299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:07.267343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:07.267385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:07.267448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:07.267506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:07.267562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:07.267609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:07.267666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:07.267709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:07.267761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:07.267807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:07.267861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:07.267908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:07.267962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:07.268009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:07.268061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:07.268115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:07.268169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:07.268216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:07.268266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:07.268311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:07.268365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:07.268409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:07.268463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:07.268508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:07.268560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:07.270511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:07.307227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:07.323896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:07.323938Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:07.323954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:07.323974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:07.323999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 477 [2:7559593874725447038:6656]
2025-10-10T14:05:07.324052Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:07.324110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:07.324124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:07.324135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:07.324146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:07.324203Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:07.324227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:07.324248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:07.326673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:07.326698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:07.326712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:07.326726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:07.326737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:07.328939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:07.328959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:07.329090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:07.329283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:07.329525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:07.328060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 477
2025-10-10T14:05:07.328155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 477
2025-10-10T14:05:07.328215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 477, pipe: [1:7559593876303366508:6504]
2025-10-10T14:05:07.329637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:07.329691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593876303366506:7381], now have 1 active actors on pipe
2025-10-10T14:05:07.329715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593872008399150:2442], now have 1 active actors on pipe
2025-10-10T14:05:07.329735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593876303366508:6504], now have 1 active actors on pipe
2025-10-10T14:05:07.329782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:07.329803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:07.329906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593874725447033:6656]
2025-10-10T14:05:07.329921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593874725447033:6656]
2025-10-10T14:05:07.329932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593874725447033:6656]
2025-10-10T14:05:07.329942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593874725447033:6656]
2025-10-10T14:05:07.329982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:07.330090Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:07.330125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:07.330142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:07.330153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:07.330191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:07.330235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:07.330290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:07.330459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:07.330475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:07.330615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:07.330667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593874725447033:6656]
2025-10-10T14:05:07.330688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:07.331170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:07.331181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:07.331192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:07.331202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:07.331222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:07.341463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:07.341507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:07.341589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:07.342155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 478 partition: 0 MaxSeqNo: 36 sessionId: src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0
2025-10-10T14:05:07.345380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9149c1a2-25e4a55f-9ab23498-c33a46d2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:07.414332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0] Write session: try to update token
2025-10-10T14:05:07.414398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:07.518663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:07.518694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:07.518706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:07.518760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:07.518774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:07.518787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:07.518796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:07.518806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:07.518839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593874725447033:6656]
2025-10-10T14:05:07.518864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593874725447033:6656]
2025-10-10T14:05:07.518887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593874725447033:6656]
2025-10-10T14:05:07.518909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593874725447033:6656]
2025-10-10T14:05:07.519041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:07.519066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:07.519076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:07.520064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:07.521652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:07.521693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:07.521720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:07.521747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:07.654360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId: src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:07.740858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:07.795264Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:07.798876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:07.798916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:07.802491Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:07.809477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:07.811419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:07.811566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593876303366508:6504]
2025-10-10T14:05:07.816379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 478 reason: status is not ok: tablet will be restarted right now sessionId: src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0
2025-10-10T14:05:07.820568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:07.820650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0] Write session will restart in 0.005013s
2025-10-10T14:05:07.820839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0] Write session: Do CDS request
2025-10-10T14:05:07.820895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:07.819669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 478 sessionId: src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0 is DEAD
2025-10-10T14:05:07.830767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:07.832718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:07.832755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 479
2025-10-10T14:05:07.851707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:07.851906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:07.851934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:07.851947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:07.859783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 479 sessionId:  describe result for acl check
2025-10-10T14:05:07.859930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:07.859943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:07.859952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:07.859969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593876303366815:7397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:07.866626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593876303366815:7397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:07.904667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593876303366815:7397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:07.913472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593876303366850:6504]
2025-10-10T14:05:07.919630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593876303366815:7397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:07.919662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593876303366815:7397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:07.919673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593876303366815:7397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:07.919703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:08.116696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:08.122863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:08.123820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:08.123852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:08.123901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:08.124192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:08.124397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593879020414671:6667]
2025-10-10T14:05:08.126554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:08.129693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:08.129934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:08.131233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:08.131560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:08.131578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:08.131585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:08.131590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:08.131595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:08.131603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:08.131609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:08.131615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:08.131621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:08.131626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:08.131632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:08.131639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:08.131687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:08.131826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:08.131869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:08.131916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:08.131953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:08.131991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:08.132028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:08.132067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:08.132104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:08.132140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:08.132177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:08.132214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:08.132252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:08.132311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:08.132372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:08.132423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:08.132470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:08.132510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:08.132546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:08.132597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:08.132660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:08.132718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:08.132758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:08.132813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:08.132850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:08.132895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:08.132958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:08.133007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:08.133060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:08.133107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:08.133162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:08.133208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:08.133262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:08.133308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:08.133344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:08.133403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:08.133788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:08.221632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:08.254015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:08.254856Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:08.254880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:08.254899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:08.254922Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 478 [2:7559593879020414671:6667]
2025-10-10T14:05:08.254975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:08.255035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:08.255047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:08.255058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:08.255069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:08.255114Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:08.255137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:08.255156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:08.256877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:08.256901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:08.256915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:08.256926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:08.256936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:08.257235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:08.257250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:08.257382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:08.257560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:08.257761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:08.257873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:08.257944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.257958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.257970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.257982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.258030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:08.258112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:08.258300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:08.258318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:08.258452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.258472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:08.261266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 478
2025-10-10T14:05:08.261367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 478
2025-10-10T14:05:08.261440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 478, pipe: [1:7559593876303366850:6504]
2025-10-10T14:05:08.259321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:08.259338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:08.259350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:08.259359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:08.259380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:08.264254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593876303366792:2442], now have 1 active actors on pipe
2025-10-10T14:05:08.264291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593876303366857:7397], now have 1 active actors on pipe
2025-10-10T14:05:08.264312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593876303366850:6504], now have 1 active actors on pipe
2025-10-10T14:05:08.268489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:08.268533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:08.268624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:08.268660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:08.268680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:08.268691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:08.268731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:08.268776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:08.268829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:08.270059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:08.270093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:08.270165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:08.271452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|933ece68-6dc3b051-f3a45a1c-3a3892c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:08.270551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 479 partition: 0 MaxSeqNo: 36 sessionId: src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0
2025-10-10T14:05:08.323642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0] Write session: try to update token
2025-10-10T14:05:08.323700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:08.353585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:08.353617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:08.353628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:08.426527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:08.433298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:08.433723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:08.433744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:08.433755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:08.433797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.433826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.433855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.433879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.439330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:08.439379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:08.439413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:08.439445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:08.475683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:08.475732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:08.475757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:08.476843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:08.507788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId: src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:08.546124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:08.631522Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:08.633613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:08.633635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:08.633681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593879020414666:6667]
2025-10-10T14:05:08.633829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:08.633856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:08.637297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:08.639062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:08.639209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:08.639220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:08.640757Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:08.645426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593876303366850:6504]
E1010 14:05:08.686366053  106882 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:05:08.688987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 479 reason: error at write: Disconnected sessionId: src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0
2025-10-10T14:05:08.690502Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:05:08.697500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 479 sessionId: src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0 is DEAD
2025-10-10T14:05:08.702168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:08.702212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0] Write session will restart in 0.005742s
2025-10-10T14:05:08.702320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0] Write session: Do CDS request
2025-10-10T14:05:08.702354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:08.715066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:08.717437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:08.717476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 480
2025-10-10T14:05:08.721445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:08.721626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:08.721644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:08.721657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:08.723499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 480 sessionId:  describe result for acl check
2025-10-10T14:05:08.723624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:08.723637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:08.723648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:08.723666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593880598334442:7402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:08.726756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593880598334442:7402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:08.746434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593880598334468:6504]
2025-10-10T14:05:08.749185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593880598334442:7402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:08.779909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593880598334442:7402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:08.779956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593880598334442:7402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:08.779974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593880598334442:7402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:08.780009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:08.990436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:09.005666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:09.006809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:09.006839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:09.006886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:09.007201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:09.007392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593883315382304:6675]
2025-10-10T14:05:09.009828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:09.011781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:09.012034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:09.013503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:09.013848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:09.013857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:09.013865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:09.013872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:09.013879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:09.013887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:09.013895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:09.013904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:09.013912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.013920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.013927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.013935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.013988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:09.014111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:09.014167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:09.014220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:09.014270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:09.014326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:09.014379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:09.014431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:09.014485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.014541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.014593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.014645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.014687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:09.014759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:09.014820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:09.014879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:09.014932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:09.014989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:09.015035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:09.015093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:09.015148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:09.015207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:09.015256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:09.015314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:09.015367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:09.015425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:09.015472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:09.015530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:09.015581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.015637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.015686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.015745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.015795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.015851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.015898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.015955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.016429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:09.060659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:09.077000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:09.077048Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:09.077067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:09.077089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:09.077116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 479 [2:7559593883315382304:6675]
2025-10-10T14:05:09.077373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:09.077451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:09.077468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:09.077483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:09.077495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:09.077546Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:09.077568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:09.077591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:09.128934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.128964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.128979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.128992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.129003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:09.129301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:09.129319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.129485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.129679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.129922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.130050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:09.130119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593879020415002:6675]
2025-10-10T14:05:09.130134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593879020415002:6675]
2025-10-10T14:05:09.130147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593879020415002:6675]
2025-10-10T14:05:09.130161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593879020415002:6675]
2025-10-10T14:05:09.130204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:09.130287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:09.130479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:09.130496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:09.130617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593879020415002:6675]
2025-10-10T14:05:09.130637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:09.131314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:09.131338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:09.131350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:09.131361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:09.131386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:09.133208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593880598334496:7402], now have 1 active actors on pipe
2025-10-10T14:05:09.133239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593880598334429:2442], now have 1 active actors on pipe
2025-10-10T14:05:09.133262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593880598334468:6504], now have 1 active actors on pipe
2025-10-10T14:05:09.134352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:09.134391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:09.134486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9196c224-ca822619-705a60a-df1ff750_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:09.134522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:09.134543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:09.134556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:09.134595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:09.134637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:09.134692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:09.135359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:09.135384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:09.135441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:09.133254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 479
2025-10-10T14:05:09.133377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 479
2025-10-10T14:05:09.133465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 479, pipe: [1:7559593880598334468:6504]
2025-10-10T14:05:09.135790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 480 partition: 0 MaxSeqNo: 36 sessionId: src_id|9196c224-ca822619-705a60a-df1ff750_0
2025-10-10T14:05:09.137710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e62d81c-7535bf87-c6550f46-9e80918d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9196c224-ca822619-705a60a-df1ff750_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:09.177313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:09.177346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:09.177358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:09.202523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9196c224-ca822619-705a60a-df1ff750_0] Write session: try to update token
2025-10-10T14:05:09.202585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9196c224-ca822619-705a60a-df1ff750_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:09.244060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:09.248814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:09.248865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:09.248876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:09.248887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:09.248937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593879020415002:6675]
2025-10-10T14:05:09.248965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593879020415002:6675]
2025-10-10T14:05:09.248988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593879020415002:6675]
2025-10-10T14:05:09.249021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593879020415002:6675]
2025-10-10T14:05:09.249286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:09.249319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.249332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:09.251083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:09.251112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:09.251131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:09.251148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:09.261830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:09.452014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId: src_id|9196c224-ca822619-705a60a-df1ff750_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:09.478708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:09.508038Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:09.511884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:09.511924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:09.515048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:09.515100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:09.517036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:09.551395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 480 reason: error at write: Disconnected sessionId: src_id|9196c224-ca822619-705a60a-df1ff750_0
2025-10-10T14:05:09.551694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 480 sessionId: src_id|9196c224-ca822619-705a60a-df1ff750_0 is DEAD
2025-10-10T14:05:09.557370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9196c224-ca822619-705a60a-df1ff750_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:09.557439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9196c224-ca822619-705a60a-df1ff750_0] Write session will restart in 0.008896s
2025-10-10T14:05:09.557539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9196c224-ca822619-705a60a-df1ff750_0] Write session: Do CDS request
2025-10-10T14:05:09.557574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9196c224-ca822619-705a60a-df1ff750_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:09.566207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:09.566366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593880598334468:6504]
2025-10-10T14:05:09.577283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:09.577319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 481
2025-10-10T14:05:09.577549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9196c224-ca822619-705a60a-df1ff750_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:09.581475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:09.581618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:09.581634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:09.581643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:09.592091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 481 sessionId:  describe result for acl check
2025-10-10T14:05:09.592235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:09.592245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:09.592255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:09.592271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593884893302098:7415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:09.595017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593884893302098:7415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:09.616906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593884893302098:7415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:09.657374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593884893302098:7415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:09.657444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593884893302098:7415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:09.657464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593884893302098:7415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:09.657498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:09.670383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593884893302263:6504]
2025-10-10T14:05:09.736893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:09.741240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:09.742230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:09.742252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:09.742300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:09.742597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:09.742800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593883315382627:6685]
2025-10-10T14:05:09.747418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:09.753753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:09.754036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:09.758276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:09.758672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:09.758680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:09.758688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:09.758694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:09.758702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:09.758709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:09.758717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:09.758726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:09.758733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.758741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.758749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.758756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.758806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:09.758919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:09.758968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:09.759021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:09.759069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:09.759121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:09.759170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:09.759216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:09.759266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.759315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.759361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.759409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.759450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:09.759516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:09.759577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:09.759633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:09.759682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:09.759737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:09.759789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:09.759844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:09.759893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:09.759947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:09.759993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:09.760050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:09.760100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:09.760200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:09.760249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:09.760307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:09.760359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.760417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.760471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.760530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.760582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.760638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.760686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.760743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.761286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:09.802157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:09.838624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:09.838667Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:09.838682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:09.838700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:09.838725Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 480 [2:7559593883315382627:6685]
2025-10-10T14:05:09.838778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:09.838838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:09.838855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:09.838867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:09.838878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:09.838923Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:09.838944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:09.838965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:09.841513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.841540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.841552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.841563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.841583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:09.841875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:09.841892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:09.842029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:09.842200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:09.842403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:09.842511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:09.842588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:09.842603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:09.842617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:09.842629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:09.842673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:09.842753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:09.842916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:09.842933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:09.843065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:09.843082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:09.843778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:09.843815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:09.843829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:09.843843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:09.843870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:09.845031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 480
2025-10-10T14:05:09.845175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 480
2025-10-10T14:05:09.845244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 480, pipe: [1:7559593884893302263:6504]
2025-10-10T14:05:09.848848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593884893302080:2442], now have 1 active actors on pipe
2025-10-10T14:05:09.848930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593884893302234:7415], now have 1 active actors on pipe
2025-10-10T14:05:09.848958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593884893302263:6504], now have 1 active actors on pipe
2025-10-10T14:05:09.849049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:09.849075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:09.849183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:09.849237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:09.849257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:09.849268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:09.849308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:09.849364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:09.849442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:09.850848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:09.850888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:09.850968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:09.852365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 481 partition: 0 MaxSeqNo: 36 sessionId: src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0
2025-10-10T14:05:09.853048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9196c224-ca822619-705a60a-df1ff750_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:09.899828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:09.899865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:09.899899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:09.900031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:09.901295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:09.906652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0] Write session: try to update token
2025-10-10T14:05:09.906715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:09.932200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:09.934592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:09.935842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:10.001247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:10.003080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:10.003564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:10.003588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:10.003602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:10.003720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:10.088898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:10.088937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:10.088952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:10.088963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:10.088975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:10.089018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:10.089043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:10.089066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:10.089090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593883315382617:6685]
2025-10-10T14:05:10.089297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:10.089328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:10.089341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:10.089594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:10.089635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:10.089667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:10.089698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:10.090446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:10.127256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId: src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:10.165835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:10.261245Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:10.275839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:10.275892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:10.277497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:10.277628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:10.277640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:10.279956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593884893302263:6504]
2025-10-10T14:05:10.277156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:10.286624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 481 reason: error at write: Disconnected sessionId: src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0
2025-10-10T14:05:10.287438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:10.287477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0] Write session will restart in 0.005709s
2025-10-10T14:05:10.287585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0] Write session: Do CDS request
2025-10-10T14:05:10.287617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:10.286933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 481 sessionId: src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0 is DEAD
2025-10-10T14:05:10.306733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:10.306761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 482
2025-10-10T14:05:10.310987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:10.311688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:10.311889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:10.311917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:10.311938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:10.314775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 482 sessionId:  describe result for acl check
2025-10-10T14:05:10.314988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:10.315018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:10.315043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:10.315082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593889188269734:7425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:10.323797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593889188269734:7425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:10.341306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:10.351295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593889188269734:7425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:10.356781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:10.357688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:10.357718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:10.357765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:10.358043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:10.358236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593887610350024:6696]
2025-10-10T14:05:10.360514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:10.362459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:10.362893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:10.364817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:10.365194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:10.365213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:10.365220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:10.365227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:10.365234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:10.365242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:10.365249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:10.365256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:10.365264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:10.365271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:10.365279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:10.365286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:10.365335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:10.365464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:10.365516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:10.365570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:10.365619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:10.365679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:10.365728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:10.365777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:10.365824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:10.365874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:10.365924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:10.365971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:10.366014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:10.366085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:10.366147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:10.366206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:10.366260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:10.366316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:10.366366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:10.366422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:10.366471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:10.366549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:10.366596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:10.366652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:10.366704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:10.366762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:10.366811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:10.366867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:10.366919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:10.366983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:10.367040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:10.367099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:10.367165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:10.367222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:10.367280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:10.367338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:10.367812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:10.377787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593889188269771:6504]
2025-10-10T14:05:10.392756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593889188269734:7425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:10.392793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593889188269734:7425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:10.392813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593889188269734:7425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:10.392844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:10.461330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:10.477119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:10.477185Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:10.477206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:10.477228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:10.477255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 481 [2:7559593887610350024:6696]
2025-10-10T14:05:10.477320Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:10.477381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:10.477397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:10.477410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:10.477422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:10.477482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:10.477505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:10.477529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:10.478955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:10.478973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:10.478988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:10.479002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:10.479015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:10.479264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:10.479289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:10.479410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:10.479581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:10.479797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:10.479927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:10.480009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593889188269776:7425], now have 1 active actors on pipe
2025-10-10T14:05:10.480036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593889188269771:6504], now have 1 active actors on pipe
2025-10-10T14:05:10.480061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593889188269719:2442], now have 1 active actors on pipe
2025-10-10T14:05:10.480087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593887610350019:6696]
2025-10-10T14:05:10.480104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593887610350019:6696]
2025-10-10T14:05:10.480118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593887610350019:6696]
2025-10-10T14:05:10.480131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593887610350019:6696]
2025-10-10T14:05:10.480173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:10.480227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:10.480243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:10.480255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:10.480255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:10.480268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:10.480439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:10.480456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:10.480573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593887610350019:6696]
2025-10-10T14:05:10.480597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:10.480615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:10.481674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 481
2025-10-10T14:05:10.481765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 481, pipe: [1:7559593889188269771:6504]
2025-10-10T14:05:10.481838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 481
2025-10-10T14:05:10.491620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:10.491674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:10.491794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:10.491832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:10.491852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:10.491862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:10.491902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:10.491948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:10.491998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:10.493148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:10.493175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:10.493250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:10.497407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 482 partition: 0 MaxSeqNo: 36 sessionId: src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0
2025-10-10T14:05:10.499513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4344d510-a10dd269-a58b6ba1-d77e288e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:10.577775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:10.577827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:10.577839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:10.578512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0] Write session: try to update token
2025-10-10T14:05:10.578566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:10.654711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:10.654748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:10.654761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:10.654771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:10.654780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:10.654817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593887610350019:6696]
2025-10-10T14:05:10.654843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593887610350019:6696]
2025-10-10T14:05:10.654866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593887610350019:6696]
2025-10-10T14:05:10.654885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593887610350019:6696]
2025-10-10T14:05:10.655004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:10.655029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:10.655038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:10.655058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:10.655068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:10.655070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:10.655096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:10.656210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:10.853253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId: src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:10.898036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:10.918937Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:10.922268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:10.922311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:10.929333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:10.929360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:10.944315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593889188269771:6504]
2025-10-10T14:05:10.944387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:10.944498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 482 reason: error at write: Disconnected sessionId: src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0
2025-10-10T14:05:10.944825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 482 sessionId: src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0 is DEAD
2025-10-10T14:05:10.945483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:10.977506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:10.977572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0] Write session will restart in 0.006019s
2025-10-10T14:05:10.977733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0] Write session: Do CDS request
2025-10-10T14:05:10.977784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:10.988451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:11.026890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:11.026924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 483
2025-10-10T14:05:11.037290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:11.037434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:11.037463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:11.037473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:11.039335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 483 sessionId:  describe result for acl check
2025-10-10T14:05:11.039441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:11.039451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:11.039460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:11.039477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593893483237131:7437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:11.045013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593893483237131:7437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:11.045186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593893483237138:6504]
2025-10-10T14:05:11.069172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:11.075216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593893483237131:7437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:11.079592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:11.080440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:11.080457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:11.080501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:11.080743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:11.080920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593891905317397:6698]
2025-10-10T14:05:11.082936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:11.088744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:11.088992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:11.090325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:11.090632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:11.090639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:11.090645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:11.090653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:11.090659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:11.090665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:11.090672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:11.090679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:11.090685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.090692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.090699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.090708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.090751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:11.090852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:11.090901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:11.090946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:11.090988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:11.091048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:11.091091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:11.091136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:11.091177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.091224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.091265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.091305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.091345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:11.091406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:11.091461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:11.091512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:11.091560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:11.091610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:11.091654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:11.091705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:11.091747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:11.091794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:11.091835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:11.091885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:11.091928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:11.091978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:11.092017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:11.092064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:11.092107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.092155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.092195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.092240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.092280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.092330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.092371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.092419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.092813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:11.120709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593893483237131:7437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:11.120747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593893483237131:7437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:11.120764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593893483237131:7437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:11.120792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:11.148257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:11.164746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:11.164792Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:11.164808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:11.164828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:11.164853Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 482 [2:7559593891905317397:6698]
2025-10-10T14:05:11.164908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:11.164970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:11.164987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:11.164999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:11.165011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:11.165060Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:11.165081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:11.165103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:11.168261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.168280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.168293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.168307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.168319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:11.170062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 482, pipe: [1:7559593893483237138:6504]
2025-10-10T14:05:11.170163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 482
2025-10-10T14:05:11.170237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 482
2025-10-10T14:05:11.175687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:11.175727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.175858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.176027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.176231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.176337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:11.176379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593893483237138:6504], now have 1 active actors on pipe
2025-10-10T14:05:11.176400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593893483237171:7437], now have 1 active actors on pipe
2025-10-10T14:05:11.176420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593889188269813:2442], now have 1 active actors on pipe
2025-10-10T14:05:11.176469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:11.176490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:11.176588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593891905317391:6698]
2025-10-10T14:05:11.176602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593891905317391:6698]
2025-10-10T14:05:11.176614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593891905317391:6698]
2025-10-10T14:05:11.176625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593891905317391:6698]
2025-10-10T14:05:11.176668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:11.176761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|132f10ed-260b89ca-c1e8029d-7944e60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:11.176791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:11.176809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:11.176818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:11.176853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:11.176896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:11.176946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:11.177101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:11.177118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:11.177275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:11.177323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593891905317391:6698]
2025-10-10T14:05:11.177340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:11.181539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:11.181561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:11.181571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:11.181582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:11.181607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:11.201619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:11.201663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:11.201747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:11.202253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 483 partition: 0 MaxSeqNo: 36 sessionId: src_id|132f10ed-260b89ca-c1e8029d-7944e60_0
2025-10-10T14:05:11.203248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da49ca94-15d769d0-ff446b2a-1036ed76_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|132f10ed-260b89ca-c1e8029d-7944e60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:11.265334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:11.265364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:11.265375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:11.301669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132f10ed-260b89ca-c1e8029d-7944e60_0] Write session: try to update token
2025-10-10T14:05:11.301724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132f10ed-260b89ca-c1e8029d-7944e60_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:11.385368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:11.385400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:11.385413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:11.385423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:11.385434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:11.385481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593891905317391:6698]
2025-10-10T14:05:11.385507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593891905317391:6698]
2025-10-10T14:05:11.385528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593891905317391:6698]
2025-10-10T14:05:11.385547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593891905317391:6698]
2025-10-10T14:05:11.385702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:11.385715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:11.385725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:11.385770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:11.385794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.385803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:11.386848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:11.389728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:11.389766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:11.389793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:11.389818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:11.542915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId: src_id|132f10ed-260b89ca-c1e8029d-7944e60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:11.553972Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:11.578044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:11.583353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593893483237138:6504]
2025-10-10T14:05:11.583456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:11.583468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:11.644370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:11.650356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:11.651111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:11.651124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:11.651163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:11.651434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:11.651600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593891905317463:6708]
2025-10-10T14:05:11.655162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:11.655707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:11.655867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 483 reason: error at write: Disconnected sessionId: src_id|132f10ed-260b89ca-c1e8029d-7944e60_0
2025-10-10T14:05:11.657452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132f10ed-260b89ca-c1e8029d-7944e60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:11.657503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132f10ed-260b89ca-c1e8029d-7944e60_0] Write session will restart in 0.006490s
2025-10-10T14:05:11.657625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132f10ed-260b89ca-c1e8029d-7944e60_0] Write session: Do CDS request
2025-10-10T14:05:11.657664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132f10ed-260b89ca-c1e8029d-7944e60_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:11.658345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 483 sessionId: src_id|132f10ed-260b89ca-c1e8029d-7944e60_0 is DEAD
2025-10-10T14:05:11.656976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:11.657233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:11.658608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:11.659052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:11.659059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:11.659065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:11.659074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:11.659081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:11.659092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:11.659103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:11.659112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:11.659119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.659125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.659136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.659145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.659224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:11.659357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:11.659438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:11.659520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:11.659573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:11.659631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:11.659695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:11.659762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:11.659820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.659880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.659960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.660013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.660061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:11.660143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:11.660230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:11.660304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:11.660354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:11.660407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:11.660459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:11.660554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:11.660646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:11.660747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:11.660843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:11.660961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:11.661073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:11.662911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:11.663096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:11.663404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:11.663560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.663723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.663798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.663866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.663924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.663992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.664048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.664116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.664598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:11.676306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132f10ed-260b89ca-c1e8029d-7944e60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:11.688563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593893483237214:6504]
2025-10-10T14:05:11.688609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:11.688621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 484
2025-10-10T14:05:11.689196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:11.689306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:11.689329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:11.689339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:11.693997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 484 sessionId:  describe result for acl check
2025-10-10T14:05:11.694122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:11.694142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:11.694152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:11.694170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593893483237218:7444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:11.696764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593893483237218:7444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:11.711564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593893483237218:7444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:11.720507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:11.723051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593893483237218:7444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:11.723094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593893483237218:7444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:11.723114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593893483237218:7444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:11.723145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:11.743061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:11.743112Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:11.743128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:11.743147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:11.743170Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 483 [2:7559593891905317463:6708]
2025-10-10T14:05:11.743224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:11.743283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:11.743298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:11.743310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:11.743322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:11.743369Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:11.743392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:11.743414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:11.746644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.746677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.746691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.746704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.746715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:11.747007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:11.747023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.747163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:11.747357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:11.747580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:11.747693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:11.747767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593891905317458:6708]
2025-10-10T14:05:11.747783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593891905317458:6708]
2025-10-10T14:05:11.747795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593891905317458:6708]
2025-10-10T14:05:11.747808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593891905317458:6708]
2025-10-10T14:05:11.747854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:11.747934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:11.747997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:11.748013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:11.748026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:11.748039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:11.748107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:11.748126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:11.748258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593891905317458:6708]
2025-10-10T14:05:11.748279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:11.748335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:11.748365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593893483237214:6504], now have 1 active actors on pipe
2025-10-10T14:05:11.748388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593893483237255:7444], now have 1 active actors on pipe
2025-10-10T14:05:11.748437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593893483237208:2442], now have 1 active actors on pipe
2025-10-10T14:05:11.749739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 483, pipe: [1:7559593893483237214:6504]
2025-10-10T14:05:11.749853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 483
2025-10-10T14:05:11.749939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 483
2025-10-10T14:05:11.754070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:11.754123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:11.754215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:11.754262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:11.754280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:11.754290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:11.754326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:11.754368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:11.754420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:11.759180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 484 partition: 0 MaxSeqNo: 36 sessionId: src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0
2025-10-10T14:05:11.757572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:11.757620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:11.757695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:11.761088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132f10ed-260b89ca-c1e8029d-7944e60_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:11.794847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0] Write session: try to update token
2025-10-10T14:05:11.794910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:11.846584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:11.846617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:11.846629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:11.921503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:11.921538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:11.921553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:11.921564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:11.921575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:11.921610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593891905317458:6708]
2025-10-10T14:05:11.921636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593891905317458:6708]
2025-10-10T14:05:11.921665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593891905317458:6708]
2025-10-10T14:05:11.921689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593891905317458:6708]
2025-10-10T14:05:11.921838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:11.921867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:11.921879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:11.922943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:11.926266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:11.926305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:11.926352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:11.926387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:12.010134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId: src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:12.035982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:12.099318Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:12.121269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:12.121312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:12.124872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593893483237214:6504]
2025-10-10T14:05:12.125065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:12.125092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:12.123828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:12.129332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:12.132692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 484 reason: error at write: Disconnected sessionId: src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0
2025-10-10T14:05:12.132990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 484 sessionId: src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0 is DEAD
2025-10-10T14:05:12.133617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:12.133684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0] Write session will restart in 0.005563s
2025-10-10T14:05:12.133863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0] Write session: Do CDS request
2025-10-10T14:05:12.133912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:12.159234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:12.159262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 485
2025-10-10T14:05:12.162271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:12.164607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:12.164765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:12.164781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:12.164792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:12.166315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 485 sessionId:  describe result for acl check
2025-10-10T14:05:12.166433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:12.166445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:12.166455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:12.166473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593897778204590:7452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:12.170366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593897778204590:7452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:12.193050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593897778204590:7452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:12.206573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:12.206207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593897778204590:7452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:12.206246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593897778204590:7452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:12.206265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593897778204590:7452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:12.206295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:12.212990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:12.213950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:12.213969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:12.214015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:12.214303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:12.214503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593896200284859:6719]
2025-10-10T14:05:12.216948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:12.218819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:12.219056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:12.220708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:12.221058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:12.221067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:12.221076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:12.221085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:12.221092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:12.221101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:12.221109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:12.221116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:12.221141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.221152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.221159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.221167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.221223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:12.221346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:12.221402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:12.221455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:12.221522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:12.221580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:12.221634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:12.221688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:12.221739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.221791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.221845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.224967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593897778204636:6504]
2025-10-10T14:05:12.221898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.221943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:12.222016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:12.222080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:12.222144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:12.222197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:12.222255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:12.222306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:12.222368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:12.222422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:12.222478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:12.222527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:12.222584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:12.222639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:12.222701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:12.222753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:12.222813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:12.222864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.222924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.222973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.223033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.223085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.223143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.223195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.223251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.224982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:12.321771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:12.348521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:12.353270Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:12.353319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:12.353343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:12.353369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 484 [2:7559593896200284859:6719]
2025-10-10T14:05:12.353437Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:12.353523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:12.353539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:12.353553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:12.353566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:12.353626Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:12.353661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:12.353684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:12.355232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.355250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.355268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.355285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.355297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:12.355607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:12.355628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.355792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.356003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.356272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.356402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:12.356480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.356496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.356509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.356521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.356597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:12.356610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:12.356624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:12.356636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:12.358302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 484
2025-10-10T14:05:12.358405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 484, pipe: [1:7559593897778204636:6504]
2025-10-10T14:05:12.358484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 484
2025-10-10T14:05:12.359439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:12.359562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:12.359793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:12.359811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:12.359865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593897778204580:2442], now have 1 active actors on pipe
2025-10-10T14:05:12.359894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593897778204636:6504], now have 1 active actors on pipe
2025-10-10T14:05:12.359919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593897778204629:7452], now have 1 active actors on pipe
2025-10-10T14:05:12.359987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:12.360011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:12.360149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.360183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:12.360263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|989a768e-c653f7d9-f1c2a543-fd503908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:12.360295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:12.360314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:12.360325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:12.360360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:12.360400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:12.360885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:12.365211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:12.367155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:12.367298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:12.367393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:12.367839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 485 partition: 0 MaxSeqNo: 36 sessionId: src_id|989a768e-c653f7d9-f1c2a543-fd503908_0
2025-10-10T14:05:12.368909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e894ecb0-cdc0790e-f84d0eeb-765d793b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|989a768e-c653f7d9-f1c2a543-fd503908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:12.429083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989a768e-c653f7d9-f1c2a543-fd503908_0] Write session: try to update token
2025-10-10T14:05:12.429164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989a768e-c653f7d9-f1c2a543-fd503908_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:12.453001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:12.453039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:12.453051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:12.581263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId: src_id|989a768e-c653f7d9-f1c2a543-fd503908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:12.586091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:12.586129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:12.586144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:12.586158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:12.586171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:12.586213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.586242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.586268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.586294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.586466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:12.586480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:12.586492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:12.586592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:12.586621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.586632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:12.588043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:12.588107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:12.588144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:12.588180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:12.588950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:12.610215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:12.740769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:12.762956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:12.763001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:12.763069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:12.763082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:12.763121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593896200284853:6719]
2025-10-10T14:05:12.763441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:12.764577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:12.764884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593897778204636:6504]
2025-10-10T14:05:12.764982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:12.764994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:12.767848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:12.780668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 485 reason: error at write: Disconnected sessionId: src_id|989a768e-c653f7d9-f1c2a543-fd503908_0
2025-10-10T14:05:12.780968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 485 sessionId: src_id|989a768e-c653f7d9-f1c2a543-fd503908_0 is DEAD
2025-10-10T14:05:12.790002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989a768e-c653f7d9-f1c2a543-fd503908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:12.790062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989a768e-c653f7d9-f1c2a543-fd503908_0] Write session will restart in 0.005140s
2025-10-10T14:05:12.790211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989a768e-c653f7d9-f1c2a543-fd503908_0] Write session: Do CDS request
2025-10-10T14:05:12.790244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989a768e-c653f7d9-f1c2a543-fd503908_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:12.803555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:12.803586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 486
2025-10-10T14:05:12.804178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989a768e-c653f7d9-f1c2a543-fd503908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:12.809080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:12.809237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:12.809254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:12.809263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:12.811929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 486 sessionId:  describe result for acl check
2025-10-10T14:05:12.812045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:12.812055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:12.812066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:12.812084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593897778204673:7460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:12.814894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593897778204673:7460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:12.839781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:12.840653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:12.841540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:12.841558Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:12.841605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:12.841881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:12.842077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593896200284919:6721]
2025-10-10T14:05:12.844489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:12.846370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593897778204673:7460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:12.847780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:12.848094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:12.849829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:12.850204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:12.850213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:12.850220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:12.850228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:12.850235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:12.850243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:12.850250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:12.850257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:12.850267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.850274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.850282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.850290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.850341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:12.850447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:12.850497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:12.850547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:12.850596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:12.850643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:12.850690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:12.850738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:12.850788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.850836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.850879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.850928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.850971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:12.851042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:12.851103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:12.851158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:12.851209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:12.851268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:12.851316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:12.851371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:12.851420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:12.851472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:12.851517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:12.851572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:12.851622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:12.851677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:12.851725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:12.851780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:12.851829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.851882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.851927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.851984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.852034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.852094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.852142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.852198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.852657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:12.854453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593897778204673:7460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:12.854498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593897778204673:7460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:12.854518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593897778204673:7460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:12.854550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:12.865270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593897778204725:6504]
2025-10-10T14:05:12.915364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:12.938508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:12.938557Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:12.938575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:12.938594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:12.938618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 485 [2:7559593896200284919:6721]
2025-10-10T14:05:12.938675Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:12.938729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:12.938744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:12.938756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:12.938768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:12.938815Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:12.938837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:12.938858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:12.940999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.941017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.941032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.941048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.941061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:12.944031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:12.944065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:12.944200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:12.945361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 485
2025-10-10T14:05:12.945461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 485, pipe: [1:7559593897778204725:6504]
2025-10-10T14:05:12.945563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 485
2025-10-10T14:05:12.944386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:12.944664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:12.944782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:12.944863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593897778204655:2442], now have 1 active actors on pipe
2025-10-10T14:05:12.944889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593897778204725:6504], now have 1 active actors on pipe
2025-10-10T14:05:12.944913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593897778204723:7460], now have 1 active actors on pipe
2025-10-10T14:05:12.944939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:12.944954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:12.944967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:12.944980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:12.945018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:12.945097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:12.945304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:12.945322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:12.945448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:12.945468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:12.947032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:12.947055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:12.947069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:12.947081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:12.947108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:12.949106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:12.949153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:12.949244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6c752a-c6744a77-bb581e57-b73484a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:12.949277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:12.949294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:12.949317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:12.949357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:12.949404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:12.949465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:12.954376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:12.954417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:12.954518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:12.955200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 486 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6c752a-c6744a77-bb581e57-b73484a1_0
2025-10-10T14:05:12.956135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989a768e-c653f7d9-f1c2a543-fd503908_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6c752a-c6744a77-bb581e57-b73484a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:13.029585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c752a-c6744a77-bb581e57-b73484a1_0] Write session: try to update token
2025-10-10T14:05:13.029643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c752a-c6744a77-bb581e57-b73484a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:13.040885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:13.040920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:13.040932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:13.179117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId: src_id|e6c752a-c6744a77-bb581e57-b73484a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:13.201238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:13.201270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:13.201281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:13.201388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:13.201401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:13.201414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:13.201425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:13.201436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:13.201467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:13.201492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:13.201531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:13.201553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:13.202823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:13.202889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:13.202919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:13.202960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:13.210156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:13.221360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:13.221409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.221421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:13.222334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:13.372320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:13.381976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:13.382023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:13.382062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:13.382075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:13.382113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593896200284914:6721]
2025-10-10T14:05:13.385264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:13.386507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:13.390324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:13.390348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:13.390902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:13.391173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593897778204725:6504]
2025-10-10T14:05:13.412377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 486 reason: error at write: Disconnected sessionId: src_id|e6c752a-c6744a77-bb581e57-b73484a1_0
2025-10-10T14:05:13.413579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c752a-c6744a77-bb581e57-b73484a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:13.413641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c752a-c6744a77-bb581e57-b73484a1_0] Write session will restart in 0.009325s
2025-10-10T14:05:13.413828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c752a-c6744a77-bb581e57-b73484a1_0] Write session: Do CDS request
2025-10-10T14:05:13.413879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c752a-c6744a77-bb581e57-b73484a1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:13.412607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 486 sessionId: src_id|e6c752a-c6744a77-bb581e57-b73484a1_0 is DEAD
2025-10-10T14:05:13.431907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c752a-c6744a77-bb581e57-b73484a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:13.433733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:13.433758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 487
2025-10-10T14:05:13.434257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:13.434365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:13.434380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:13.434389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:13.435755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 487 sessionId:  describe result for acl check
2025-10-10T14:05:13.435867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:13.435876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:13.435885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:13.435900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593902073172097:7473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:13.438526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593902073172097:7473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:13.444028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:13.448987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:13.449919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:13.449953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:13.449999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:13.450265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:13.450447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593900495252311:6731]
2025-10-10T14:05:13.452692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:13.457101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593902073172097:7473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:13.455329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:13.455566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:13.456894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:13.457261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:13.457271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:13.457278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:13.457286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:13.457294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:13.457302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:13.457311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:13.457318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:13.457326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.457336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.457344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.457352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.457403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:13.457532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:13.457585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:13.457634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:13.457685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:13.457735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:13.457784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:13.457833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:13.457879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.457930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.457976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.458026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.458070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:13.458141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:13.458204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:13.458264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:13.458314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:13.458703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:13.458759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:13.458816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:13.458867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:13.458927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:13.458976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:13.459033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:13.459088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:13.459158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:13.459213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:13.459272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:13.459324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.459378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.459444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.459501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.459551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.459611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.459657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.459712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.460192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:13.482730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593902073172097:7473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:13.482771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593902073172097:7473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:13.482789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593902073172097:7473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:13.482819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:13.490982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593902073172131:6504]
2025-10-10T14:05:13.527865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:13.543090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:13.543144Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:13.543162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:13.543186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:13.543209Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 486 [2:7559593900495252311:6731]
2025-10-10T14:05:13.543270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:13.543340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:13.543363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:13.543376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:13.543389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:13.543438Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:13.543461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:13.543489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:13.544858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.544897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.544912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.544930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.544942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:13.545233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:13.545258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.545415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.545647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.545906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.546048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:13.546131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593900495252305:6731]
2025-10-10T14:05:13.546152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593900495252305:6731]
2025-10-10T14:05:13.546168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593900495252305:6731]
2025-10-10T14:05:13.546182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593900495252305:6731]
2025-10-10T14:05:13.546224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:13.546320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:13.546524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:13.546553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:13.546694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593900495252305:6731]
2025-10-10T14:05:13.546723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:13.551999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:13.552030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:13.552044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:13.552059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:13.552088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:13.552609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593902073172131:6504], now have 1 active actors on pipe
2025-10-10T14:05:13.552807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593902073172063:2442], now have 1 active actors on pipe
2025-10-10T14:05:13.552847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593902073172129:7473], now have 1 active actors on pipe
2025-10-10T14:05:13.553841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 486, pipe: [1:7559593902073172131:6504]
2025-10-10T14:05:13.553950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 486
2025-10-10T14:05:13.554050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 486
2025-10-10T14:05:13.554447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:13.554490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:13.554570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:13.554625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:13.554649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:13.554663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:13.554716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:13.554771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:13.554826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:13.555337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:13.555382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:13.555466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:13.555976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 487 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0
2025-10-10T14:05:13.556832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6c752a-c6744a77-bb581e57-b73484a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:13.583309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0] Write session: try to update token
2025-10-10T14:05:13.583381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:13.670143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:13.670183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:13.670197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:13.670293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:13.670309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:13.670321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:13.670332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:13.670345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:13.670390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593900495252305:6731]
2025-10-10T14:05:13.670418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593900495252305:6731]
2025-10-10T14:05:13.670442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593900495252305:6731]
2025-10-10T14:05:13.670479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593900495252305:6731]
2025-10-10T14:05:13.670664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:13.670692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.670704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:13.671238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:13.671279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:13.671330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:13.671359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:13.681105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:13.760577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId: src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:13.790418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:13.839706Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:13.841930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:13.841975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:13.847023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:13.847157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:13.847169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:13.849355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593902073172131:6504]
2025-10-10T14:05:13.864178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 487 reason: error at write: Disconnected sessionId: src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0
2025-10-10T14:05:13.864518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 487 sessionId: src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0 is DEAD
2025-10-10T14:05:13.865373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:13.865415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0] Write session will restart in 0.008813s
2025-10-10T14:05:13.865549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0] Write session: Do CDS request
2025-10-10T14:05:13.865581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:13.870388Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:13.886054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:13.886085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 488
2025-10-10T14:05:13.889146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:13.894541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:13.894695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:13.894712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:13.894722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:13.896156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 488 sessionId:  describe result for acl check
2025-10-10T14:05:13.896270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:13.896282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:13.896291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:13.896307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593902073172163:7478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:13.900643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593902073172163:7478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:13.910965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:13.917313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593902073172163:7478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:13.921312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:13.922257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:13.922276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:13.922319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:13.922579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:13.922744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593900495252393:6740]
2025-10-10T14:05:13.926600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:13.927432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593902073172163:7478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:13.927469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593902073172163:7478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:13.927487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593902073172163:7478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:13.927519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:13.930250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:13.930540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:13.933054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:13.933809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:13.933831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:13.933846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:13.933859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:13.933877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:13.933898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:13.933912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:13.933933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:13.933951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.933968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.933988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.934011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.934212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:13.934472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:13.934560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:13.934656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:13.934746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:13.934844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:13.934941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:13.935046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:13.935144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.935244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.935329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.935424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.935503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:13.935644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:13.935763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:13.935883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:13.935994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:13.936091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:13.936211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:13.936349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:13.936450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:13.936582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:13.936696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:13.936801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:13.936870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:13.936937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:13.936999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:13.937066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:13.937249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.937339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:13.937405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.937478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:13.937566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.937636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:13.937699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.937769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:13.938303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:13.949766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593902073172209:6504]
2025-10-10T14:05:13.991010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:14.006066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:14.006122Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:14.006140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:14.006165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:14.006200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 487 [2:7559593900495252393:6740]
2025-10-10T14:05:14.006264Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:14.006328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:14.006343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:14.006359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:14.006375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:14.006428Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:14.006450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:14.006473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:14.026371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.026408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:14.026427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:14.026443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:14.026458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:14.026786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:14.026807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.026988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:14.027204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:14.027485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:14.027623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:14.027699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.027716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.027731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.027744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.027794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:14.027888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:14.028099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:14.028117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:14.028254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.028278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:14.029063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:14.029087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:14.029100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:14.029113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:14.029160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:14.030824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593902073172209:6504], now have 1 active actors on pipe
2025-10-10T14:05:14.030867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593902073172148:2442], now have 1 active actors on pipe
2025-10-10T14:05:14.030893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593902073172203:7478], now have 1 active actors on pipe
2025-10-10T14:05:14.031557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 487, pipe: [1:7559593902073172209:6504]
2025-10-10T14:05:14.031677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 487
2025-10-10T14:05:14.031759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 487
2025-10-10T14:05:14.038617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:14.038668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:14.038752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:14.038792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:14.038813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:14.038825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:14.038860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:14.038906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:14.038957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:14.045270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:14.045324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:14.045417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:14.046694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 488 partition: 0 MaxSeqNo: 36 sessionId: src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0
2025-10-10T14:05:14.047481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b0dd25d-879d0139-34a51130-8cc79c51_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:14.089588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0] Write session: try to update token
2025-10-10T14:05:14.089651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:14.112409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:14.112448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:14.112491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.112587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:14.113941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:14.113971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:14.113984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:14.114050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:14.136030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:14.137365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:14.138611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:14.139833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:14.149601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:14.150099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:14.212489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:14.212523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:14.212538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:14.212556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:14.212570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:14.212616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.212650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.212677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.212703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593900495252387:6740]
2025-10-10T14:05:14.212910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:14.212970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.212989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:14.213107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:14.213163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:14.213196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:14.213232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:14.216684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:14.305951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId: src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:14.344563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:14.399890Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:14.403574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:14.403621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:14.405104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593902073172209:6504]
2025-10-10T14:05:14.405192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:14.405327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:14.405339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:14.409816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:14.435353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 488 reason: error at write: Disconnected sessionId: src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0
2025-10-10T14:05:14.435635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 488 sessionId: src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0 is DEAD
2025-10-10T14:05:14.440251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:14.440292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0] Write session will restart in 0.005356s
2025-10-10T14:05:14.440392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0] Write session: Do CDS request
2025-10-10T14:05:14.440425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:14.452876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:14.466794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:14.466831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 489
2025-10-10T14:05:14.467383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:14.467603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:14.467626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:14.467637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:14.469198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 489 sessionId:  describe result for acl check
2025-10-10T14:05:14.469322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:14.469334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:14.469346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:14.469363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593906368139556:7486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:14.472473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593906368139556:7486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:14.478603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:14.484920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593906368139556:7486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:14.490311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:14.491176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:14.491195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:14.491241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:14.491516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:14.491726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593904790219766:6744]
2025-10-10T14:05:14.493815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:14.502069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:14.502403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:14.503783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:14.504156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:14.504180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:14.504188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:14.504195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:14.504201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:14.504209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:14.504217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:14.504223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:14.504231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.504238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:14.504246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:14.504254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:14.504305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:14.504416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:14.504472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:14.504519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:14.504567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:14.504613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:14.504661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:14.504711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:14.504753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.504799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:14.504846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:14.504889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:14.504938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:14.505011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:14.505074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:14.512507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:14.512680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:14.512768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:14.512827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:14.512897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:14.512955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:14.513007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:14.513056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:14.513144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:14.513199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:14.513257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:14.513315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:14.511918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593906368139595:6504]
2025-10-10T14:05:14.513244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593906368139556:7486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:14.513273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593906368139556:7486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:14.513291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593906368139556:7486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:14.513322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:14.513374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:14.513430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.513487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.513550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:14.513608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:14.513657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:14.513713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:14.513758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:14.513811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:14.514287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:14.570627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:14.636590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:14.636643Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:14.636660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:14.636678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:14.636700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 488 [2:7559593904790219766:6744]
2025-10-10T14:05:14.636758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:14.636811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:14.636825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:14.636837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:14.636848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:14.636894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:14.636914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:14.636935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:14.643436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.643477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:14.643493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:14.643511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:14.643523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:14.643844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:14.643865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.644018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:14.645977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 488, pipe: [1:7559593906368139595:6504]
2025-10-10T14:05:14.646089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 488
2025-10-10T14:05:14.646165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 488
2025-10-10T14:05:14.650200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:14.650536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:14.650692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:14.650796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593906368139595:6504], now have 1 active actors on pipe
2025-10-10T14:05:14.650823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593906368139598:7486], now have 1 active actors on pipe
2025-10-10T14:05:14.650846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593906368139528:2442], now have 1 active actors on pipe
2025-10-10T14:05:14.650918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:14.650942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:14.651000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593904790219761:6744]
2025-10-10T14:05:14.651015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593904790219761:6744]
2025-10-10T14:05:14.651030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593904790219761:6744]
2025-10-10T14:05:14.651044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593904790219761:6744]
2025-10-10T14:05:14.651089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:14.651191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:14.651377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:14.651395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:14.651457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:14.651489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:14.651507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:14.651518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:14.651553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:14.651593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:14.651733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593904790219761:6744]
2025-10-10T14:05:14.651756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:14.651799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:14.652430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:14.652445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:14.652458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:14.652471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:14.652495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:14.655576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 489 partition: 0 MaxSeqNo: 36 sessionId: src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0
2025-10-10T14:05:14.656441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83169b7-a10283b9-95bf00ac-f41d02a8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:14.653974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:14.654016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:14.654096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:14.725678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0] Write session: try to update token
2025-10-10T14:05:14.725725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:14.858272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:14.858306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:14.858317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:14.858372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:14.858384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:14.858398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:14.858406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:14.858416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:14.858467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593904790219761:6744]
2025-10-10T14:05:14.858494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593904790219761:6744]
2025-10-10T14:05:14.858516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593904790219761:6744]
2025-10-10T14:05:14.858536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593904790219761:6744]
2025-10-10T14:05:14.858674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:14.858698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:14.858709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:14.859079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:14.859117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:14.859149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:14.859195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:14.859850Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:15.021258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId: src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:15.055950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:15.076212Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:15.080425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:15.080482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:15.083428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593906368139595:6504]
2025-10-10T14:05:15.083521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:15.083532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:15.091827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:15.184394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 489 reason: error at write: Disconnected sessionId: src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0
2025-10-10T14:05:15.184758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 489 sessionId: src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0 is DEAD
2025-10-10T14:05:15.189983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:15.190018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0] Write session will restart in 0.007680s
2025-10-10T14:05:15.190117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0] Write session: Do CDS request
2025-10-10T14:05:15.190144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:15.195959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:15.203224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593910663106939:6504]
2025-10-10T14:05:15.203559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:15.204430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:15.208541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:15.208574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 490
2025-10-10T14:05:15.205625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:15.205654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:15.205726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:15.206039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:15.206233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593909085187153:6753]
2025-10-10T14:05:15.208512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:15.210025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:15.209848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:15.210110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:15.211769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:15.212113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:15.212121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:15.212127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:15.212133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:15.212140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:15.212148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:15.212155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:15.212162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:15.212168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:15.212175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:15.212183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:15.212190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:15.212248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:15.212358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:15.212406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:15.212453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:15.212505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:15.212551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:15.212594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:15.212640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:15.212689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:15.212735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:15.212782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:15.212826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:15.212869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:15.212940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:15.212997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:15.213050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:15.213095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:15.213653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:15.213709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:15.218864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:15.218975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:15.219053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:15.219110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:15.219173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:15.219229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:15.219311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:15.219369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:15.219433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:15.219494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:15.219556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:15.219612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:15.219676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:15.219731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:15.219791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:15.219845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:15.219906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:15.220470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:15.226134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:15.226297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:15.226315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:15.226326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:15.237572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 490 sessionId:  describe result for acl check
2025-10-10T14:05:15.237745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:15.237759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:15.237769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:15.237788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593910663106959:7496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:15.250598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593910663106959:7496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:15.267299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593910663106959:7496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:15.291179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593910663106959:7496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:15.291220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593910663106959:7496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:15.291238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593910663106959:7496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:15.291271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:15.323318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:15.389887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:15.389932Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:15.389950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:15.389970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:15.389994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 489 [2:7559593909085187153:6753]
2025-10-10T14:05:15.390048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:15.390120Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:15.390138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:15.390148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:15.390159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:15.390207Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:15.390242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:15.390264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:15.392505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:15.392524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:15.392538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:15.392552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:15.392564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:15.394412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 489
2025-10-10T14:05:15.394503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 489, pipe: [1:7559593910663106939:6504]
2025-10-10T14:05:15.394588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 489
2025-10-10T14:05:15.396186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:15.396218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:15.396354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:15.396531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:15.396751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:15.396864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:15.396927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593910663106941:2442], now have 1 active actors on pipe
2025-10-10T14:05:15.396951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593910663106939:6504], now have 1 active actors on pipe
2025-10-10T14:05:15.396973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593910663107001:7496], now have 1 active actors on pipe
2025-10-10T14:05:15.397045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:15.397068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:15.397199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:15.397214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:15.397228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:15.397240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:15.397279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:15.397387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:15.397423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:15.397440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:15.397452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:15.397492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:15.397545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:15.397618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:15.397801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:15.397819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:15.397971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:15.398027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:15.398051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:15.398934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:15.398955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:15.398967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:15.398977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:15.399002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:15.407840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:15.407888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:15.407980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:15.409971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 490 partition: 0 MaxSeqNo: 36 sessionId: src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0
2025-10-10T14:05:15.410966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a68544c-c14bf982-c4a666e4-8c2a073_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:15.442158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0] Write session: try to update token
2025-10-10T14:05:15.442220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:15.601334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:15.601373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:15.601386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:15.601398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:15.601407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:15.601456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:15.601489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:15.601518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:15.601544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:15.601762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:15.601789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:15.601804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:15.601926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:15.601959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:15.601972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:15.602309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:15.602346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:15.602379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:15.602411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:15.601261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId: src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:15.612637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:15.685697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:16.032519Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:16.081634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:16.081682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:16.081746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:16.081761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:16.081804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593909085187147:6753]
2025-10-10T14:05:16.082324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:16.086762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:16.086901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593910663106939:6504]
2025-10-10T14:05:16.087041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:16.087057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:16.083361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:16.095076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 490 reason: error at write: Disconnected sessionId: src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0
2025-10-10T14:05:16.095393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 490 sessionId: src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0 is DEAD
2025-10-10T14:05:16.100761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:16.100807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0] Write session will restart in 0.006676s
2025-10-10T14:05:16.100915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0] Write session: Do CDS request
2025-10-10T14:05:16.100949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:16.114347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:16.115029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:16.115058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 491
2025-10-10T14:05:16.115327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:16.115442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:16.115457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:16.115467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:16.116876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 491 sessionId:  describe result for acl check
2025-10-10T14:05:16.116991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:16.117002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:16.117012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:16.117029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593914958074336:7505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:16.119624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593914958074336:7505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:16.137772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593914958074336:7505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:16.170494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:16.176953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593914958074336:7505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:16.177000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593914958074336:7505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:16.177018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593914958074336:7505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:16.177051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:16.177487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:16.178442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:16.178463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:16.178507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:16.178798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:16.178950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593913380154556:6763]
2025-10-10T14:05:16.180410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:16.181920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:16.182191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:16.183600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:16.183950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:16.183959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:16.183966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:16.183973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:16.183981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:16.183989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:16.183996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:16.184003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:16.184012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.184020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.184027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.184034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.184086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:16.184212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:16.184264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:16.184318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:16.184369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:16.184423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:16.184478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:16.184532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:16.184586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.184636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.184690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.184739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.184783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:16.184856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:16.184920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:16.184983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:16.185042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:16.185104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:16.185266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:16.185332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:16.185386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:16.185444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:16.185497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:16.185555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:16.185625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:16.185686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:16.185737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:16.185800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:16.185855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.185915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.185968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.186030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.186082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.186158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.186214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.186272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.186776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:16.189045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593914958074386:6504]
2025-10-10T14:05:16.231419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:16.287495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:16.287540Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:16.287559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:16.287578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:16.287600Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 490 [2:7559593913380154556:6763]
2025-10-10T14:05:16.287656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:16.287713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:16.287729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:16.287740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:16.287751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:16.287795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:16.287818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:16.287839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:16.290189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.290207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.290223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.290238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.290249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:16.291842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 490
2025-10-10T14:05:16.291469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:16.291916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 490, pipe: [1:7559593914958074386:6504]
2025-10-10T14:05:16.291499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.291990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 490
2025-10-10T14:05:16.291644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.291837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.292066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.292184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:16.292227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593914958074381:7505], now have 1 active actors on pipe
2025-10-10T14:05:16.292251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593914958074386:6504], now have 1 active actors on pipe
2025-10-10T14:05:16.292273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593914958074324:2442], now have 1 active actors on pipe
2025-10-10T14:05:16.292335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.292350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.292363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.292376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.292417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:16.292499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:16.292681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:16.292698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:16.292759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:16.292782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:16.292925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.292948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:16.293016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27bca85d-3ffe82ad-5090369b-b182131f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:16.293044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:16.293063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:16.293073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:16.293108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:16.293172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:16.293304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:16.293311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:16.293321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:16.293335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:16.293348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:16.293373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:16.295928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:16.295976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:16.296070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:16.300965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 491 partition: 0 MaxSeqNo: 36 sessionId: src_id|27bca85d-3ffe82ad-5090369b-b182131f_0
2025-10-10T14:05:16.301687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25c1e28-c61cf41e-9a4ba524-9d497324_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|27bca85d-3ffe82ad-5090369b-b182131f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:16.344052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27bca85d-3ffe82ad-5090369b-b182131f_0] Write session: try to update token
2025-10-10T14:05:16.344113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27bca85d-3ffe82ad-5090369b-b182131f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:16.395790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:16.395822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:16.395836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:16.395848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:16.395861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:16.395895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.395926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.395952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.395978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.396206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:16.396219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:16.396232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:16.396274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:16.396299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.396309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:16.397620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:16.397667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:16.397710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:16.397766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:16.407673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:16.487213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId: src_id|27bca85d-3ffe82ad-5090369b-b182131f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:16.514304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:16.579345Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:16.597039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:16.597091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:16.597170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:16.597185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:16.597225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593913380154549:6763]
2025-10-10T14:05:16.599370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:16.599393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:16.597748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:16.607501Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:16.643085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 491 reason: error at write: Disconnected sessionId: src_id|27bca85d-3ffe82ad-5090369b-b182131f_0
2025-10-10T14:05:16.643407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 491 sessionId: src_id|27bca85d-3ffe82ad-5090369b-b182131f_0 is DEAD
2025-10-10T14:05:16.647300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bca85d-3ffe82ad-5090369b-b182131f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:16.647341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bca85d-3ffe82ad-5090369b-b182131f_0] Write session will restart in 0.008120s
2025-10-10T14:05:16.647443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bca85d-3ffe82ad-5090369b-b182131f_0] Write session: Do CDS request
2025-10-10T14:05:16.647474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bca85d-3ffe82ad-5090369b-b182131f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:16.665056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27bca85d-3ffe82ad-5090369b-b182131f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:16.684433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:16.692288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593914958074386:6504]
2025-10-10T14:05:16.692363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:16.692735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:16.692500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:16.692522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 492
2025-10-10T14:05:16.693412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:16.693526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:16.693548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:16.693557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:16.693996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:16.694027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:16.694072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:16.694394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:16.694581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593913380154635:6769]
2025-10-10T14:05:16.695320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 492 sessionId:  describe result for acl check
2025-10-10T14:05:16.695433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:16.695449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:16.695459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:16.695475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593914958074458:7519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:16.696989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:16.698360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593914958074458:7519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:16.700160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:16.700397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:16.701876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:16.702253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:16.702261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:16.702269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:16.702276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:16.702284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:16.702292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:16.702300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:16.702314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:16.702323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.702331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.702338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.702345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.702395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:16.702514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:16.702564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:16.702612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:16.702658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:16.702723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:16.702781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:16.702839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:16.702884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.702932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.702977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.703022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.703064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:16.703132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:16.703209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:16.703277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:16.703326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:16.703389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:16.703436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:16.703492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:16.703543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:16.703600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:16.703647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:16.703703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:16.703752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:16.703811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:16.703858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:16.703913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:16.703961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.704017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.704062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.704116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.704167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.704228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.704293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.704373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.704847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:16.712928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593914958074458:7519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:16.734851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593914958074458:7519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:16.734881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593914958074458:7519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:16.734893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593914958074458:7519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:16.734916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:16.738470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:16.758391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:16.758438Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:16.758457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:16.758475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:16.758498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 491 [2:7559593913380154635:6769]
2025-10-10T14:05:16.758559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:16.758614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:16.758628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:16.758640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:16.758651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:16.758699Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:16.758721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:16.758743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:16.771511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.771812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.771830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.771841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.771850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:16.774430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 491
2025-10-10T14:05:16.774519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 491
2025-10-10T14:05:16.773508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:16.773537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.773688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:16.773871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:16.774097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:16.774214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:16.774300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593914958074492:7519], now have 1 active actors on pipe
2025-10-10T14:05:16.774324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593914958074453:2442], now have 1 active actors on pipe
2025-10-10T14:05:16.774350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:16.774366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:16.774380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:16.774393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:16.774438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:16.774535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:16.774708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:16.774724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:16.774852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:16.774874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:16.775456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:16.775474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:16.775486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:16.775497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:16.775523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:16.777225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:16.777265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:16.777356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:16.777397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:16.777426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:16.777444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:16.777483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:16.777537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:16.777608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:16.778243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:16.778284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:16.778362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:16.778758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 492 partition: 0 MaxSeqNo: 36 sessionId: src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0
2025-10-10T14:05:16.781310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27bca85d-3ffe82ad-5090369b-b182131f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:16.793497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593914958074500:6504]
2025-10-10T14:05:16.800265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593914958074500:6504], now have 1 active actors on pipe
2025-10-10T14:05:16.800649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 491, pipe: [1:7559593914958074500:6504]
2025-10-10T14:05:16.838631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0] Write session: try to update token
2025-10-10T14:05:16.838687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:16.948068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:16.948101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:16.948112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:16.948165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:16.948180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:16.948192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:16.948203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:16.948212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:16.948245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:16.948271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:16.948294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:16.948317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:16.948523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:16.948549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:16.948560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:16.949561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:16.951305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:16.951343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:16.951376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:16.951408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:17.077578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId: src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:17.108095Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:17.137221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:17.137252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:17.137292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593913380154630:6769]
2025-10-10T14:05:17.138030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:17.140958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:17.141036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:17.141047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:17.144420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:17.144669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593914958074500:6504]
2025-10-10T14:05:17.162130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 492 reason: error at write: Disconnected sessionId: src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0
2025-10-10T14:05:17.162403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 492 sessionId: src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0 is DEAD
2025-10-10T14:05:17.168196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:17.168235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0] Write session will restart in 0.009551s
2025-10-10T14:05:17.168334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0] Write session: Do CDS request
2025-10-10T14:05:17.168364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:17.192922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:17.196234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:17.196296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 493
2025-10-10T14:05:17.199787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:17.200017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:17.200052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:17.200075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:17.202495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 493 sessionId:  describe result for acl check
2025-10-10T14:05:17.202617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:17.202629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:17.202639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:17.202655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593919253041826:7527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:17.205616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593919253041826:7527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:17.213401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593919253041826:7527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:17.236118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593919253041826:7527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:17.236159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593919253041826:7527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:17.236178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593919253041826:7527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:17.236210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:17.245374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593919253041873:6504]
2025-10-10T14:05:17.246426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:17.253328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:17.254364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:17.254384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:17.254440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:17.254775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:17.254979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593917675122041:6778]
2025-10-10T14:05:17.257812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:17.261430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:17.261719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:17.263084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:17.263445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:17.263453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:17.263461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:17.263468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:17.263475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:17.263484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:17.263492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:17.263499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:17.263507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.263513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.263522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.263528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.263579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:17.263692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:17.263743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:17.263791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:17.263839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:17.263885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:17.263929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:17.263977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:17.264023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.264074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.264121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.264171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.264214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:17.264291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:17.264361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:17.264421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:17.264476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:17.264539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:17.264594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:17.264654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:17.264707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:17.264766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:17.264813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:17.264870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:17.264921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:17.264975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:17.265023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:17.265080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:17.266149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.266239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.266300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.266361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.266415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.266476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.266526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.266589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.267095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:17.309874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:17.325411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:17.325465Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:17.325486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:17.325522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:17.325550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 492 [2:7559593917675122041:6778]
2025-10-10T14:05:17.325644Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:17.325718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:17.325736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:17.325752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:17.325766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:17.325825Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:17.325852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:17.325876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:17.359179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.359208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.359222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.359235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.359247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:17.359533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:17.359552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.359723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.359925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.360409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.360544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:17.360619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.360634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.360648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.360661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.360704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:17.360789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:17.360983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:17.360999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:17.361137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.361159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:17.361864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:17.361890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:17.361903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:17.361917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:17.361947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:17.362415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593919253041816:2442], now have 1 active actors on pipe
2025-10-10T14:05:17.362443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593919253041873:6504], now have 1 active actors on pipe
2025-10-10T14:05:17.362468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593919253041869:7527], now have 1 active actors on pipe
2025-10-10T14:05:17.365238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 492
2025-10-10T14:05:17.365362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 492
2025-10-10T14:05:17.365387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 492, pipe: [1:7559593919253041873:6504]
2025-10-10T14:05:17.367260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:17.367302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:17.367387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:17.367422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:17.367440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:17.367452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:17.367488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:17.367533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:17.367580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:17.368699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:17.368728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:17.368803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:17.369102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 493 partition: 0 MaxSeqNo: 36 sessionId: src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0
2025-10-10T14:05:17.373415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e018d-ff5b0ab0-61552944-4d7d45b3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:17.412838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0] Write session: try to update token
2025-10-10T14:05:17.412907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:17.425272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:17.425312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:17.425325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:17.525527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:17.525558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:17.525570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:17.525582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:17.525593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:17.525648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.525679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.525702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.525726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.525891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:17.525904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:17.525915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:17.527550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:17.527594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:17.527625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:17.527655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:17.560553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:17.560604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.560616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:17.582198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:17.615315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId: src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:17.637421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:17.817942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:17.819649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:17.819664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:17.819708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593917675122034:6778]
2025-10-10T14:05:17.819858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:17.819884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:17.819889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:17.820934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:17.824997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:17.825359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:17.825764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593919253041873:6504]
2025-10-10T14:05:17.835965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:17.836006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0] Write session will restart in 0.008021s
2025-10-10T14:05:17.836106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0] Write session: Do CDS request
2025-10-10T14:05:17.836135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:17.835288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 493 reason: status is not ok: tablet will be restarted right now sessionId: src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0
2025-10-10T14:05:17.841636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 493 sessionId: src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0 is DEAD
2025-10-10T14:05:17.862510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:17.863111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:17.863140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 494
2025-10-10T14:05:17.863499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:17.863611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:17.863627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:17.863636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:17.865096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 494 sessionId:  describe result for acl check
2025-10-10T14:05:17.865237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:17.865248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:17.865258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:17.865275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593919253041921:7534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:17.868005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593919253041921:7534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:17.888431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593919253041921:7534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:17.911459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:17.914911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:17.915762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:17.915791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:17.915837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:17.916117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:17.917115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593919253041921:7534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:17.916297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593917675122108:6786]
2025-10-10T14:05:17.917167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593919253041921:7534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:17.917184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593919253041921:7534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:17.917214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:17.918831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:17.919660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:17.919865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:17.920929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:17.921257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:17.921273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:17.921280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:17.921288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:17.921296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:17.921302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:17.921309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:17.921316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:17.921323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.921330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.921338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.921345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.921396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:17.921505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:17.921904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:17.921967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:17.922024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:17.922083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:17.922141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:17.922191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:17.922247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.922304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.922356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.922411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.922454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:17.922522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:17.922583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:17.922637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:17.922681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:17.922724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:17.922757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:17.922799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:17.922840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:17.922897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:17.922945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:17.923002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:17.923049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:17.923124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:17.923174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:17.923237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:17.923294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.923352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:17.923405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.923466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:17.923521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.923580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:17.923630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.923691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:17.924201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:17.927619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593919253041972:6504]
2025-10-10T14:05:17.972843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:18.014477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:18.014526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:18.014544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:18.014563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:18.014587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 493 [2:7559593917675122108:6786]
2025-10-10T14:05:18.014639Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:18.014700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:18.014714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:18.014725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:18.014736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:18.014783Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:18.014804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:18.014826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:18.016014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.016042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:18.016053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:18.016066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:18.016077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:18.017531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 493
2025-10-10T14:05:18.017636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 493, pipe: [1:7559593919253041972:6504]
2025-10-10T14:05:18.017708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 493
2025-10-10T14:05:18.020845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:18.020881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.021028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:18.021236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:18.021469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:18.021587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:18.021646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593919253041972:6504], now have 1 active actors on pipe
2025-10-10T14:05:18.021672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593919253041909:2442], now have 1 active actors on pipe
2025-10-10T14:05:18.021693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593919253041968:7534], now have 1 active actors on pipe
2025-10-10T14:05:18.021747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:18.021770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:18.021873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593917675122102:6786]
2025-10-10T14:05:18.021887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593917675122102:6786]
2025-10-10T14:05:18.021898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593917675122102:6786]
2025-10-10T14:05:18.021913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593917675122102:6786]
2025-10-10T14:05:18.021955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:18.022062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:18.022097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:18.022117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:18.022128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:18.022166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:18.022210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:18.022264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:18.022437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:18.022454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:18.022591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:18.022639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593917675122102:6786]
2025-10-10T14:05:18.022660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:18.023940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:18.023965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:18.023976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:18.023988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:18.024013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:18.027858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:18.027913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:18.028012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:18.034226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|941c9770-3b2b2aa3-7056f1b-96cab8a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:18.033413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 494 partition: 0 MaxSeqNo: 36 sessionId: src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0
2025-10-10T14:05:18.065005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0] Write session: try to update token
2025-10-10T14:05:18.065071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:18.159309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:18.159362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:18.159387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:18.159449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:18.159465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:18.159478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:18.159488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:18.159500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:18.159535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593917675122102:6786]
2025-10-10T14:05:18.159558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593917675122102:6786]
2025-10-10T14:05:18.159581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593917675122102:6786]
2025-10-10T14:05:18.159600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593917675122102:6786]
2025-10-10T14:05:18.159752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:18.159779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.159790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:18.160678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:18.160713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:18.160741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:18.160767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:18.161271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:18.261330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId: src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:18.303742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:18.320114Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:18.323411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:18.323453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:18.329342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593919253041972:6504]
2025-10-10T14:05:18.329463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:18.329477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:18.334821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:18.339296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 494 reason: error at write: Disconnected sessionId: src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0
2025-10-10T14:05:18.339683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 494 sessionId: src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0 is DEAD
2025-10-10T14:05:18.342977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:18.343013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0] Write session will restart in 0.006458s
2025-10-10T14:05:18.343120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0] Write session: Do CDS request
2025-10-10T14:05:18.343151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:18.356748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:18.362867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:18.365789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:18.365821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 495
2025-10-10T14:05:18.366295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:18.366413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:18.366429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:18.366440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:18.369471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 495 sessionId:  describe result for acl check
2025-10-10T14:05:18.373824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:18.373849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:18.373859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:18.373876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593923548009317:7546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:18.376711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593923548009317:7546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:18.398822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593923548009317:7546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:18.408466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:18.411471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:18.411454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593923548009317:7546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:18.411491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593923548009317:7546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:18.411508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593923548009317:7546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:18.411540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:18.412303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:18.412333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:18.412374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:18.412616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:18.412802Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593921970089499:6796]
2025-10-10T14:05:18.415024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:18.418536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:18.418787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:18.420108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:18.420481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:18.420489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:18.420496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:18.420503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:18.420511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:18.420518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:18.420524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:18.420533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:18.420539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.420547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:18.420556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:18.420563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:18.420613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:18.420728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:18.420779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:18.420833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:18.420883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:18.420932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:18.420980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:18.421027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:18.421074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.421151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:18.421203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:18.421255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:18.421301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:18.421374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:18.421434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:18.421495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:18.421545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:18.421605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:18.421668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:18.421730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:18.421779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:18.421835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:18.421885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:18.421942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:18.421991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:18.422047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:18.422096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:18.422153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:18.422220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.422278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.422329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:18.422387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:18.422437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:18.422493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:18.422542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:18.422603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:18.423077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:18.433284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593923548009372:6504]
2025-10-10T14:05:18.449504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:18.466041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:18.466087Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:18.466105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:18.466125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:18.466148Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 494 [2:7559593921970089499:6796]
2025-10-10T14:05:18.466203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:18.466256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:18.466272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:18.466285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:18.466296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:18.466343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:18.466366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:18.466389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:18.469470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.469498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:18.469515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:18.469529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:18.469541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:18.469824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:18.469841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.469982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:18.472777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 494
2025-10-10T14:05:18.472882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 494, pipe: [1:7559593923548009372:6504]
2025-10-10T14:05:18.472960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 494
2025-10-10T14:05:18.474886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:18.475172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:18.475304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:18.475395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593923548009310:2442], now have 1 active actors on pipe
2025-10-10T14:05:18.475420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593923548009372:6504], now have 1 active actors on pipe
2025-10-10T14:05:18.475443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593923548009366:7546], now have 1 active actors on pipe
2025-10-10T14:05:18.475510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:18.475532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:18.475572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593921970089494:6796]
2025-10-10T14:05:18.475589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593921970089494:6796]
2025-10-10T14:05:18.475603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593921970089494:6796]
2025-10-10T14:05:18.475617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593921970089494:6796]
2025-10-10T14:05:18.475659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:18.475750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:18.475939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:18.475959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:18.476025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:18.476056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:18.476074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:18.476086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:18.476120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:18.476163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:18.476294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593921970089494:6796]
2025-10-10T14:05:18.476315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:18.476367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:18.477108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:18.477144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:18.477157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:18.477170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:18.477196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:18.488279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:18.488336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:18.488428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:18.489021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 495 partition: 0 MaxSeqNo: 36 sessionId: src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0
2025-10-10T14:05:18.490013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105eaaf0-43351e6a-ca5e7817-b2d73a74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:18.527900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0] Write session: try to update token
2025-10-10T14:05:18.527959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:18.566234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:18.566265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:18.566278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:18.706586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:18.706619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:18.706630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:18.706687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:18.706702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:18.706715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:18.706725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:18.706737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:18.706773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593921970089494:6796]
2025-10-10T14:05:18.706797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593921970089494:6796]
2025-10-10T14:05:18.706820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593921970089494:6796]
2025-10-10T14:05:18.706840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593921970089494:6796]
2025-10-10T14:05:18.706972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:18.706996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:18.707007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:18.711986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:18.712036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:18.712063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:18.712098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:18.719693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:18.740932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId: src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:18.783826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:18.915679Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:18.918576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:18.918616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:18.922860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593923548009372:6504]
2025-10-10T14:05:18.922956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:18.922968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:18.926980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 495 reason: error at write: Disconnected sessionId: src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0
2025-10-10T14:05:18.929383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:18.929438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0] Write session will restart in 0.009531s
2025-10-10T14:05:18.929553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0] Write session: Do CDS request
2025-10-10T14:05:18.929585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:18.930706Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:18.935158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 495 sessionId: src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0 is DEAD
2025-10-10T14:05:18.947279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:18.952676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:18.961700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:18.961732Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 496
2025-10-10T14:05:18.967714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:18.967879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:18.967895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:18.967905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:18.969310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 496 sessionId:  describe result for acl check
2025-10-10T14:05:18.969424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:18.969434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:18.969442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:18.969459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593923548009397:7551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:18.978864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593923548009397:7551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:19.004429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593927842976707:6504]
2025-10-10T14:05:19.016386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593923548009397:7551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:19.066866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:19.071032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593923548009397:7551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:19.071069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593923548009397:7551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:19.071086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593923548009397:7551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:19.071122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:19.079757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:19.080734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:19.080752Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:19.080800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:19.081067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:19.081269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593926265056886:6803]
2025-10-10T14:05:19.083405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:19.089689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:19.089969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:19.091386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:19.091739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:19.091747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:19.091753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:19.091760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:19.091767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:19.091773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:19.091780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:19.091787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:19.091793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.091800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.091807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.091814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.091863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:19.091966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:19.092012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:19.092057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:19.092099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:19.092145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:19.092189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:19.092233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:19.092278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.092325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.092369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.092430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.092474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:19.092566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:19.092622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:19.092675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:19.092721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:19.092773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:19.092815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:19.092868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:19.092910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:19.092964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:19.093009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:19.093059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:19.093103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:19.094222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:19.094287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:19.094346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:19.094396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.094450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.094494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.094550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.094597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.094650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.094697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.094752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.095194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:19.174630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:19.189041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:19.189101Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:19.189682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:19.189742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:19.189769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 495 [2:7559593926265056886:6803]
2025-10-10T14:05:19.189835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:19.189902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:19.189918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:19.189933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:19.189946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:19.189995Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:19.190023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:19.190048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:19.191566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.191585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.191600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.191617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.191630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:19.191932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:19.191951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.192112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.192322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.192571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.192702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:19.192776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593926265056879:6803]
2025-10-10T14:05:19.192793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593926265056879:6803]
2025-10-10T14:05:19.192808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593926265056879:6803]
2025-10-10T14:05:19.192822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593926265056879:6803]
2025-10-10T14:05:19.193017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:19.193030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:19.193044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:19.193056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:19.195297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:19.195413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:19.195626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:19.195644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:19.195694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593923548009393:2442], now have 1 active actors on pipe
2025-10-10T14:05:19.195722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593927842976707:6504], now have 1 active actors on pipe
2025-10-10T14:05:19.195744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593927842976748:7551], now have 1 active actors on pipe
2025-10-10T14:05:19.195793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:19.195815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:19.195978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593926265056879:6803]
2025-10-10T14:05:19.196014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:19.196087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:19.196119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:19.196137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:19.196148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:19.196185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:19.196224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:19.196386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:19.194878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 495
2025-10-10T14:05:19.195010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 495
2025-10-10T14:05:19.195022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 495, pipe: [1:7559593927842976707:6504]
2025-10-10T14:05:19.197359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:19.198580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:19.198609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:19.198695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:19.199108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 496 partition: 0 MaxSeqNo: 36 sessionId: src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0
2025-10-10T14:05:19.204062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59a48aae-15a26c89-86268e29-e91a6e2f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:19.238739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0] Write session: try to update token
2025-10-10T14:05:19.238799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:19.292240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:19.292278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:19.292291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:19.372906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:19.372945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:19.372961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:19.372973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:19.372987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:19.373028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593926265056879:6803]
2025-10-10T14:05:19.373059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593926265056879:6803]
2025-10-10T14:05:19.373088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593926265056879:6803]
2025-10-10T14:05:19.373114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593926265056879:6803]
2025-10-10T14:05:19.373303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:19.373337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.373350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:19.374529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:19.377301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:19.377342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:19.377382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:19.377417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:19.463589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId: src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:19.518562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:19.529737Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:19.531531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:19.531561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:19.534512Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:19.541773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:19.541919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593927842976707:6504]
2025-10-10T14:05:19.542007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:19.551666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 496 reason: status is not ok: tablet will be restarted right now sessionId: src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0
2025-10-10T14:05:19.551966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 496 sessionId: src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0 is DEAD
2025-10-10T14:05:19.569683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:19.569731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0] Write session will restart in 0.005466s
2025-10-10T14:05:19.569835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0] Write session: Do CDS request
2025-10-10T14:05:19.569866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:19.584761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:19.585985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:19.586014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 497
2025-10-10T14:05:19.586364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:19.586521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:19.586547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:19.586559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:19.588094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 497 sessionId:  describe result for acl check
2025-10-10T14:05:19.588230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:19.588242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:19.588252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:19.588269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593927842976811:7560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:19.591184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593927842976811:7560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:19.602257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593927842976811:7560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:19.609557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:19.615668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593927842976811:7560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:19.615713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593927842976811:7560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:19.615735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593927842976811:7560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:19.615779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:19.619856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:19.620798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:19.620829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:19.620875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:19.621182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:19.621372Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593926265056979:6809]
2025-10-10T14:05:19.623705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:19.626272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:19.626522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:19.627837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:19.628178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:19.628185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:19.628192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:19.628198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:19.628205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:19.628210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:19.628217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:19.628224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:19.628230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.628236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.628243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.628250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.628298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:19.628406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:19.628452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:19.628497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:19.628537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:19.628578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:19.628615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:19.628654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:19.628690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.628730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.628769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.628810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.628848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:19.628914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:19.628967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:19.629015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:19.629055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:19.629100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:19.630155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:19.630236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:19.630298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:19.630348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:19.630388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:19.630437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:19.630479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:19.630527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:19.630565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:19.630609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:19.630651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.630696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.630733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.630780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.630819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.630864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.630903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.630952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.631337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:19.649271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593927842976876:6504]
2025-10-10T14:05:19.662470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:19.675904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:19.675956Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:19.675976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:19.675996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:19.676021Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 496 [2:7559593926265056979:6809]
2025-10-10T14:05:19.676085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:19.676145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:19.676169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:19.676182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:19.676195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:19.676244Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:19.676393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:19.676426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:19.677800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.677829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.677845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.677861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.677874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:19.678157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:19.678182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.678383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:19.678605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:19.678869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:19.679007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:19.679092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:19.679110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:19.679124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:19.679139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:19.679180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:19.679268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:19.679479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:19.679498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:19.679635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:19.679659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:19.681889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:19.681919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:19.681931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:19.681944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:19.681970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:19.684246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593927842976796:2442], now have 1 active actors on pipe
2025-10-10T14:05:19.684303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593927842976876:6504], now have 1 active actors on pipe
2025-10-10T14:05:19.684331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593927842976863:7560], now have 1 active actors on pipe
2025-10-10T14:05:19.686931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:19.686978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:19.687111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65fd9285-977a585d-5b866726-fc96a331_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:19.687185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:19.687256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:19.687270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:19.687321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:19.687370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:19.687424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:19.686404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 496, pipe: [1:7559593927842976876:6504]
2025-10-10T14:05:19.686514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 496
2025-10-10T14:05:19.686592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 496
2025-10-10T14:05:19.690912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 497 partition: 0 MaxSeqNo: 36 sessionId: src_id|65fd9285-977a585d-5b866726-fc96a331_0
2025-10-10T14:05:19.690021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:19.690058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:19.690134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:19.693943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|614e04a6-271bb7f7-a70b6525-5b06414c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|65fd9285-977a585d-5b866726-fc96a331_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:19.736630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd9285-977a585d-5b866726-fc96a331_0] Write session: try to update token
2025-10-10T14:05:19.736692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd9285-977a585d-5b866726-fc96a331_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:19.890341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:19.890385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:19.890396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:19.890455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:19.890471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:19.890487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:19.890499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:19.890512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:19.890550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:19.890578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:19.890606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:19.890629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:19.890801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:19.890838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:19.890842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:19.890870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:19.890875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:19.890882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:19.890908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:19.892049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:19.945220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId: src_id|65fd9285-977a585d-5b866726-fc96a331_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:19.990490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:20.070847Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:20.091635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:20.091688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:20.092451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:20.092478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:20.092521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593926265056972:6809]
2025-10-10T14:05:20.093171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:20.094255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:20.097362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:20.097595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593927842976876:6504]
2025-10-10T14:05:20.097752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:20.137476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 497 reason: status is not ok: tablet will be restarted right now sessionId: src_id|65fd9285-977a585d-5b866726-fc96a331_0
2025-10-10T14:05:20.137800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 497 sessionId: src_id|65fd9285-977a585d-5b866726-fc96a331_0 is DEAD
2025-10-10T14:05:20.140402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd9285-977a585d-5b866726-fc96a331_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:20.140467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd9285-977a585d-5b866726-fc96a331_0] Write session will restart in 0.008981s
2025-10-10T14:05:20.140643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd9285-977a585d-5b866726-fc96a331_0] Write session: Do CDS request
2025-10-10T14:05:20.140695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd9285-977a585d-5b866726-fc96a331_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:20.158022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd9285-977a585d-5b866726-fc96a331_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:20.164058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:20.164090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 498
2025-10-10T14:05:20.169331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:20.169488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:20.169505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:20.169514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:20.171039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 498 sessionId:  describe result for acl check
2025-10-10T14:05:20.171153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:20.171165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:20.171174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:20.171190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593932137944227:7567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:20.174026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593932137944227:7567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:20.186033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:20.185852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593932137944227:7567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:20.193556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:20.194507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:20.194526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:20.194570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:20.194835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:20.195012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593930560024362:6817]
2025-10-10T14:05:20.197635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:20.201523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:20.201784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:20.200441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593932137944266:6504]
2025-10-10T14:05:20.201567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593932137944227:7567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:20.201594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593932137944227:7567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:20.201612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593932137944227:7567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:20.201643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:20.203389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:20.203747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:20.203756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:20.203762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:20.203770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:20.203777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:20.203784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:20.203790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:20.203797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:20.203804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:20.203810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:20.203817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:20.203824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:20.203871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:20.203975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:20.204024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:20.204070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:20.204115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:20.204164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:20.204209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:20.204255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:20.204298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:20.204345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:20.204389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:20.204436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:20.204476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:20.204540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:20.204597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:20.204650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:20.204696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:20.204750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:20.204798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:20.204851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:20.204897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:20.204951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:20.204996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:20.205052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:20.205102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:20.206090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:20.206154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:20.206213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:20.206275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:20.206328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:20.206374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:20.206441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:20.206488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:20.206544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:20.206590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:20.206646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:20.207099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:20.275956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:20.293802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:20.293850Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:20.293865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:20.293883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:20.293906Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 497 [2:7559593930560024362:6817]
2025-10-10T14:05:20.293960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:20.294020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:20.294035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:20.294047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:20.294058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:20.294104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:20.294127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:20.294151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:20.296872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:20.296890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:20.296902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:20.296914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:20.296924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:20.298316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 497
2025-10-10T14:05:20.298405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 497
2025-10-10T14:05:20.298472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 497, pipe: [1:7559593932137944266:6504]
2025-10-10T14:05:20.298245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:20.298278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:20.298406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:20.298574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:20.298795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:20.298913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:20.298972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593932137944269:7567], now have 1 active actors on pipe
2025-10-10T14:05:20.298997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593932137944190:2442], now have 1 active actors on pipe
2025-10-10T14:05:20.299019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593932137944266:6504], now have 1 active actors on pipe
2025-10-10T14:05:20.299104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.299121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.299134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.299147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.299187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:20.299270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:20.299442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:20.299459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:20.299585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.299606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:20.301641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:20.301684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:20.301697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:20.301708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:20.301735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:20.304103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:20.304136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:20.304227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:20.304261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:20.304279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:20.304289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:20.304325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:20.304366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:20.304413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:20.312260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:20.312304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:20.312397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:20.314464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 498 partition: 0 MaxSeqNo: 36 sessionId: src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0
2025-10-10T14:05:20.316283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd9285-977a585d-5b866726-fc96a331_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:20.339049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0] Write session: try to update token
2025-10-10T14:05:20.339110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:20.494717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:20.494753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:20.494764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:20.494818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:20.494831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:20.494844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:20.494856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:20.494866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:20.494902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.494928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.494949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.494968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.495163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:20.495195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:20.495205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:20.496198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:20.497445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:20.497479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:20.497507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:20.497536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:20.519637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId: src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:20.599436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:20.916763Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:20.959487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:20.970715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:20.970874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:20.970891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:20.970948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593930560024357:6817]
2025-10-10T14:05:20.971515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:20.973523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:20.972621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:20.972652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:20.972947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:20.973149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593932137944266:6504]
2025-10-10T14:05:21.020119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:21.020168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0] Write session will restart in 0.008929s
2025-10-10T14:05:21.020586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0] Write session: Do CDS request
2025-10-10T14:05:21.020622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:21.017375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 498 reason: error at write: Disconnected sessionId: src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0
2025-10-10T14:05:21.017738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 498 sessionId: src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0 is DEAD
2025-10-10T14:05:21.040701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:21.040726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 499
2025-10-10T14:05:21.041240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:21.041806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:21.041939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:21.041954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:21.041963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:21.044813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 499 sessionId:  describe result for acl check
2025-10-10T14:05:21.044927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:21.044938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:21.044947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:21.044963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593936432911634:7581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:21.047421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593936432911634:7581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:21.075207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593936432911645:6504]
2025-10-10T14:05:21.094333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593936432911634:7581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:21.105853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:21.122383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593936432911634:7581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:21.122426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593936432911634:7581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:21.122445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593936432911634:7581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:21.122482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:21.125582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:21.126518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:21.126538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:21.126586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:21.126857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:21.127048Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593934854991772:6828]
2025-10-10T14:05:21.129103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:21.137875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:21.138162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:21.139421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:21.139739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:21.139746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:21.139754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:21.139761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:21.139767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:21.139774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:21.139781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:21.139789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:21.139794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:21.139801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:21.139808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:21.139815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:21.139862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:21.139962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:21.140005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:21.140047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:21.140089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:21.140130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:21.140174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:21.140218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:21.140260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:21.140303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:21.140349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:21.140393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:21.140436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:21.140501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:21.140558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:21.140606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:21.140653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:21.140705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:21.140748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:21.140798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:21.140849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:21.140902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:21.140945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:21.140990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:21.141036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:21.141086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:21.142409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:21.142498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:21.142554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:21.142608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:21.142656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:21.142707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:21.142749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:21.142798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:21.142839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:21.142887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:21.143315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:21.241565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:21.289209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:21.289252Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:21.289272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:21.289292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:21.289316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 498 [2:7559593934854991772:6828]
2025-10-10T14:05:21.289373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:21.289436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:21.289452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:21.289464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:21.289475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:21.289522Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:21.289544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:21.289566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:21.292686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 498, pipe: [1:7559593936432911645:6504]
2025-10-10T14:05:21.292812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 498
2025-10-10T14:05:21.292886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 498
2025-10-10T14:05:21.291862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:21.291888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:21.291901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:21.291913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:21.291923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:21.292186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:21.292203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:21.292354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:21.292539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:21.292757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:21.292866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:21.292948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593936432911645:6504], now have 1 active actors on pipe
2025-10-10T14:05:21.292968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593936432911686:7581], now have 1 active actors on pipe
2025-10-10T14:05:21.292989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593932137944323:2442], now have 1 active actors on pipe
2025-10-10T14:05:21.293014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.293029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.293041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.293054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.293096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:21.293185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:21.293353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:21.293371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:21.293472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:21.293489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:21.293503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:21.293505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.293516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:21.293522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:21.293543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:21.294542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:21.294588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:21.294686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:21.294729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:21.294748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:21.294759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:21.294796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:21.294838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:21.297039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 499 partition: 0 MaxSeqNo: 36 sessionId: src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0
2025-10-10T14:05:21.294889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:21.296625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:21.296652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:21.296727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:21.297857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf9cee6-6e8e3326-35143ff9-17420909_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:21.425081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0] Write session: try to update token
2025-10-10T14:05:21.425162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:21.496734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:21.496768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:21.496803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.496923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:21.496933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:21.496932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:21.496944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:21.497062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:21.505772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:21.515354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:21.521414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:21.526612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:21.528789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:21.604959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:21.605170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:21.605187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:21.605202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:21.605214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:21.605223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:21.605254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.605271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.605289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.605305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593934854991765:6828]
2025-10-10T14:05:21.605414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:21.605442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:21.605472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:21.605474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:21.605487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:21.605500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:21.605500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:21.605545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:21.605571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:21.605583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:21.606501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:21.626999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId: src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:21.697422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:21.870440Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:21.873235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:21.873281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:21.878316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593936432911645:6504]
2025-10-10T14:05:21.878417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:21.878429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:21.879332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:21.879846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:21.979848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593936432911767:6504]
2025-10-10T14:05:21.995994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 499 reason: error at write: Disconnected sessionId: src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0
2025-10-10T14:05:21.996323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 499 sessionId: src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0 is DEAD
2025-10-10T14:05:22.000059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:22.000096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0] Write session will restart in 0.007615s
2025-10-10T14:05:22.000196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0] Write session: Do CDS request
2025-10-10T14:05:22.000225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:22.026159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:22.030843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:22.037297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:22.037326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 500
2025-10-10T14:05:22.038113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:22.038243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:22.038260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:22.038270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:22.039863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 500 sessionId:  describe result for acl check
2025-10-10T14:05:22.040187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:22.040204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:22.040214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:22.040230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593940727879078:7596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:22.043786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:22.044661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:22.044680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:22.043022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593940727879078:7596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:22.045136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:22.045461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:22.045660Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593939149959171:6838]
2025-10-10T14:05:22.048042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:22.049786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:22.050039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:22.051504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:22.051860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:22.051869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:22.051876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:22.051883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:22.051890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:22.051898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:22.051906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:22.051914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:22.051921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.051928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.051935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.051943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.051992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:22.052107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:22.052158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:22.052212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:22.052261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:22.052310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:22.052358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:22.052407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:22.052455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.052503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.052552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.052600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.052640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:22.052709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:22.052775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:22.052834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:22.052887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:22.052944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:22.052993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:22.053050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:22.053100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:22.059330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593940727879078:7596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:22.060259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:22.060339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:22.060403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:22.060456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:22.060516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:22.060563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:22.060620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:22.060674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.060732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.060780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.060840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.060890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.060946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.060996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.061053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.061550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:22.079695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593940727879078:7596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:22.079738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593940727879078:7596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:22.079756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593940727879078:7596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:22.079791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:22.108152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:22.124080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:22.124131Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:22.124149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:22.124169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:22.124193Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 499 [2:7559593939149959171:6838]
2025-10-10T14:05:22.124250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:22.124303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:22.124317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:22.124330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:22.124341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:22.124389Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:22.124411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:22.124434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:22.127330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.127365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.127379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.127394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.127405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:22.127682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:22.127699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.127835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.128018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.128247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.128363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:22.128429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.128443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.128456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.128469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.128516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:22.128601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:22.128775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:22.128792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:22.128910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.128928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:22.129224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:22.129241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:22.129254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:22.129266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:22.129295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:22.130529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 499
2025-10-10T14:05:22.130662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 499
2025-10-10T14:05:22.130722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 499, pipe: [1:7559593936432911767:6504]
2025-10-10T14:05:22.134694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593940727879108:7596], now have 1 active actors on pipe
2025-10-10T14:05:22.134752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593936432911767:6504], now have 1 active actors on pipe
2025-10-10T14:05:22.134779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593936432911727:2442], now have 1 active actors on pipe
2025-10-10T14:05:22.134857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:22.134880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:22.134961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:22.134994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:22.135013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:22.135025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:22.135060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:22.135102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:22.135146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:22.136371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:22.136406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:22.136475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:22.136930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 500 partition: 0 MaxSeqNo: 36 sessionId: src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0
2025-10-10T14:05:22.141368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff4e5e60-6dd5d19c-9f5bbbba-e6f1b945_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:22.203340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0] Write session: try to update token
2025-10-10T14:05:22.203397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0] Send 10 message(s) (0 left), first sequence number is 37
E1010 14:05:22.381613773  107557 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:05:22.384867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:22.384923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:22.384989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.385408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:22.385525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:22.385560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:22.385588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:22.385827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:22.406733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:22.407924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:22.409117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:22.450146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:22.467371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:22.480292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId: src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:22.542572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:22.553406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:22.553558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:22.553573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:22.553585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:22.553596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:22.553608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:22.553646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.553671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.553697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.553740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593939149959166:6838]
2025-10-10T14:05:22.553889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:22.553902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:22.553913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:22.553995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:22.554020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:22.554051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:22.554077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.554089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:22.555171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:22.555418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:22.555482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:22.555517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:22.555546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:22.735765Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:22.739869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:22.739894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:22.744346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 500 reason: error at write: Disconnected sessionId: src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0
2025-10-10T14:05:22.744654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 500 sessionId: src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0 is DEAD
2025-10-10T14:05:22.745297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593936432911767:6504]
2025-10-10T14:05:22.745376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:22.750580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:22.750664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0] Write session will restart in 0.009387s
2025-10-10T14:05:22.750871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0] Write session: Do CDS request
2025-10-10T14:05:22.750929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:22.747838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:22.770037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:22.771843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:22.771871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 501
2025-10-10T14:05:22.772262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:22.772634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:22.772671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:22.772690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:22.775996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 501 sessionId:  describe result for acl check
2025-10-10T14:05:22.776130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:22.776146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:22.776156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:22.776172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593940727879162:7605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:22.779077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593940727879162:7605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:22.830201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593940727879162:7605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:22.847464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593940727879214:6504]
2025-10-10T14:05:22.854184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:22.869626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:22.870567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:22.870585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:22.870631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:22.870912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:22.871104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593939149959286:6849]
2025-10-10T14:05:22.876848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:22.876741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593940727879162:7605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:22.876783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593940727879162:7605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:22.876803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593940727879162:7605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:22.876835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:22.878593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:22.878863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:22.880267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:22.880621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:22.880630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:22.880639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:22.880648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:22.880655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:22.880663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:22.880670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:22.880679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:22.880686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.880693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.880701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.880708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.880760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:22.880882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:22.880938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:22.880990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:22.881040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:22.881093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:22.881167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:22.881223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:22.881272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.881322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.881376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.881428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.881474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:22.881549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:22.881615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:22.881677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:22.881747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:22.881804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:22.881854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:22.881914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:22.881968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:22.882027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:22.882079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:22.882136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:22.882188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:22.882246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:22.882299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:22.882358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:22.882414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.882471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.882521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.882578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.882632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.882692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.882743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.882803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.883301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:22.910563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:22.924605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:22.924663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:22.924684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:22.924707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:22.924735Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 500 [2:7559593939149959286:6849]
2025-10-10T14:05:22.924799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:22.924866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:22.924883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:22.924896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:22.924909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:22.924960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:22.924983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:22.925007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:22.963201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.963235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.963249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.963264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.963277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:22.963585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:22.963605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:22.963767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:22.963980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:22.964238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:22.964368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:22.964445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:22.964462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:22.964477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:22.964493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:22.964538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:22.964626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:22.964827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:22.964846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:22.964980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:22.965002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:22.965187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:22.965201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:22.965214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:22.965228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:22.965254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:22.967162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 500
2025-10-10T14:05:22.967276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 500
2025-10-10T14:05:22.967338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 500, pipe: [1:7559593940727879214:6504]
2025-10-10T14:05:22.983237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593940727879154:2442], now have 1 active actors on pipe
2025-10-10T14:05:22.983283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593940727879223:7605], now have 1 active actors on pipe
2025-10-10T14:05:22.983309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593940727879214:6504], now have 1 active actors on pipe
2025-10-10T14:05:22.983390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:22.983415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:22.983500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:22.983538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:22.983558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:22.983569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:22.983605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:22.983648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:22.983697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:22.985568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:22.985612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:22.985692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:22.988134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f737b4c5-3bf2c683-8995bd86-10f8de38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:22.986144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 501 partition: 0 MaxSeqNo: 36 sessionId: src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0
2025-10-10T14:05:23.025369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:23.025404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:23.025416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:23.034740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0] Write session: try to update token
2025-10-10T14:05:23.034805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:23.118448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:23.118489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:23.118505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:23.118517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:23.118528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:23.118568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:23.118597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:23.118623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:23.118650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:23.118889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:23.118922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:23.118936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:23.120050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:23.121628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:23.121709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:23.121787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:23.121863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:23.189586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId: src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:23.231679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:23.467802Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:23.518627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:23.518692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:23.518795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:23.518811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:23.518871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593939149959280:6849]
2025-10-10T14:05:23.519072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:23.519438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:23.525308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:23.531578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593940727879214:6504]
2025-10-10T14:05:23.531736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:23.531895Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:05:23.532403Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 5 consumer shared/user session shared/user_1_5_5644318080921466875_v1 is DEAD
2025-10-10T14:05:23.537385Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559593579950599617:6501] disconnected; active server actors: 1
2025-10-10T14:05:23.537431Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559593579950599617:6501] client user disconnected session shared/user_1_5_5644318080921466875_v1
2025-10-10T14:05:23.541179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 501 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0
2025-10-10T14:05:23.541460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 501 sessionId: src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0 is DEAD
2025-10-10T14:05:23.545945Z :ERROR: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:05:23.546444Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:05:23.546477Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:05:23.546515Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Reconnecting session to cluster  in 0.008365s
2025-10-10T14:05:23.549344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:23.549387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0] Write session will restart in 0.006829s
2025-10-10T14:05:23.549503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0] Write session: Do CDS request
2025-10-10T14:05:23.549535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:23.567060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:23.569556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:23.569587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 502
2025-10-10T14:05:23.573525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:23.573691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:23.573714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:23.573725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:23.574270Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Successfully connected. Initializing session
2025-10-10T14:05:23.574734Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:05:23.574750Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 6
2025-10-10T14:05:23.576632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 502 sessionId:  describe result for acl check
2025-10-10T14:05:23.576749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:23.576759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:23.576771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:23.576787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593945022846558:7612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:23.579716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593945022846558:7612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:23.581276Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 6 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:05:23.581485Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 read init: from# ipv6:[::1]:40068, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:05:23.582427Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 auth for : user
2025-10-10T14:05:23.589438Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 Handle describe topics response
2025-10-10T14:05:23.589604Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 auth is DEAD
2025-10-10T14:05:23.589688Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:05:23.591250Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:05:23.592007Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got InitResponse. ReadSessionId: shared/user_1_6_7174296375807937715_v1
2025-10-10T14:05:23.594126Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559593945022846573:7613] connected; active server actors: 1
2025-10-10T14:05:23.594682Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559593945022846573:7613] session shared/user_1_6_7174296375807937715_v1
2025-10-10T14:05:23.594731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:05:23.594783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:05:23.594825Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_6_7174296375807937715_v1" (Sender=[1:7559593945022846556:7613], Pipe=[1:7559593945022846573:7613], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:05:23.594858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:05:23.594913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:05:23.594966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_6_7174296375807937715_v1" (Sender=[1:7559593945022846556:7613], Pipe=[1:7559593945022846573:7613], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:05:23.595021Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_6_7174296375807937715_v1" sender [1:7559593945022846556:7613] lock partition 0 for ReadingSession "shared/user_1_6_7174296375807937715_v1" (Sender=[1:7559593945022846556:7613], Pipe=[1:7559593945022846573:7613], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-10T14:05:23.595066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:05:23.595092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000158s
2025-10-10T14:05:23.595936Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_6_7174296375807937715_v1" ClientId: "user" PipeClient { RawX1: 7559593945022846573 RawX2: 4503603922345405 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:05:23.596019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:05:23.605149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593945022846558:7612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:23.620413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593945022846558:7612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:23.620456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593945022846558:7612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:23.620475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593945022846558:7612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:23.620505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:23.641685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:05:23.641735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-10-10T14:05:23.686610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:23.692878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:23.693873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:23.693893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:23.693940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:23.694241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:23.694438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593943444926687:6852]
2025-10-10T14:05:23.696806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:23.702384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:23.702656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:23.704111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:23.704468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:23.704477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:23.704486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:23.704494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:23.704503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:23.704510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:23.704518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:23.704526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:23.704534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:23.704542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:23.704550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:23.704560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:23.704611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:23.704728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:23.704780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:23.704829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:23.704883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:23.704935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:23.704988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:23.705039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:23.705089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:23.705162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:23.705211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:23.705257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:23.705305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:23.705377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:23.705445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:23.705507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:23.705567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:23.705628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:23.705679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:23.705738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:23.705808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:23.705868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:23.705921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:23.705980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:23.706036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:23.706095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:23.706143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:23.714125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:23.714221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:23.714291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:23.714345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:23.714410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:23.714468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:23.714527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:23.714578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:23.714638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:23.715124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:23.783750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:23.816242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:23.816288Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:23.816305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:23.816326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:23.816349Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 501 [2:7559593943444926687:6852]
2025-10-10T14:05:23.816405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:23.816463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:23.816479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:23.816493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:23.816505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:23.816556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:23.816578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:23.816599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:23.826570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:23.826609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:23.826638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:23.826652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:23.826665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:23.826983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:23.827005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:23.827155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:23.827365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:23.827610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:23.827741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:23.827828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593945022846604:7612], now have 1 active actors on pipe
2025-10-10T14:05:23.827855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593945022846584:7619], now have 1 active actors on pipe
2025-10-10T14:05:23.827878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593945022846545:2442], now have 1 active actors on pipe
2025-10-10T14:05:23.827904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593943444926681:6852]
2025-10-10T14:05:23.827920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593943444926681:6852]
2025-10-10T14:05:23.827935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593943444926681:6852]
2025-10-10T14:05:23.827948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593943444926681:6852]
2025-10-10T14:05:23.827994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:23.828081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:23.828283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:23.828302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:23.828431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593943444926681:6852]
2025-10-10T14:05:23.828454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:23.828483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:23.828499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:23.828511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:23.828523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:23.828545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:23.828173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 501
2025-10-10T14:05:23.828279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 501, pipe: [1:7559593945022846584:7619]
2025-10-10T14:05:23.828400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 501
2025-10-10T14:05:23.830639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:23.830679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:23.830756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:23.830770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:23.830806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_6_7174296375807937715_v1 on pipe: [1:7559593945022846584:7619]
2025-10-10T14:05:23.830942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:23.830974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:23.830992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:23.831004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:23.831039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:23.831083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:23.831130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:23.831152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:23.831163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:23.831236Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_6_7174296375807937715_v1
2025-10-10T14:05:23.831250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:23.831479Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:05:23.831573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:23.831629Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:05:23.832201Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_6_7174296375807937715_v1:1 with generation 501
2025-10-10T14:05:23.839001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 12 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:05:23.839142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:05:23.841259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25b60b8a-2a5ebc4e-95416a07-ab5aec46_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:23.840559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 502 partition: 0 MaxSeqNo: 36 sessionId: src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0
2025-10-10T14:05:23.840137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:23.840178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:23.840253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:23.855511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:05:23.855595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:05:23.855622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:23.855634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:23.855645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:23.855675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:05:23.855732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:05:23.856348Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1760104766000 SizeLag: 18742722 WriteTimestampEstimateMS: 1760105123827 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:05:23.856397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-10T14:05:23.856463Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 sending to client partition status
2025-10-10T14:05:23.917413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:23.917453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:23.917466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:23.920293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0] Write session: try to update token
2025-10-10T14:05:23.920350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:24.082270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:24.082299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:24.082309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:24.082360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:24.082374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:24.082388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:24.082400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:24.082409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:24.082443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593943444926681:6852]
2025-10-10T14:05:24.082468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593943444926681:6852]
2025-10-10T14:05:24.082494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593943444926681:6852]
2025-10-10T14:05:24.082516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593943444926681:6852]
2025-10-10T14:05:24.082641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:24.082668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:24.082679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:24.083790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:24.085236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:24.085268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:24.085300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:24.085328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:24.152063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId: src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:24.178204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:24.291032Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:24.293569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:24.293607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:24.296885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_6_7174296375807937715_v1
2025-10-10T14:05:24.296933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:24.298597Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_6_7174296375807937715_v1
2025-10-10T14:05:24.300621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:24.300667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:24.306252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593945022846584:7619]
2025-10-10T14:05:24.306334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:24.318869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 502 reason: error at write: Disconnected sessionId: src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0
2025-10-10T14:05:24.319130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 502 sessionId: src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0 is DEAD
2025-10-10T14:05:24.325015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:24.325079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0] Write session will restart in 0.009077s
2025-10-10T14:05:24.325206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0] Write session: Do CDS request
2025-10-10T14:05:24.325243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:24.341116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:24.345263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:24.345289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 503
2025-10-10T14:05:24.355865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:24.356010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:24.356027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:24.356037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:24.357582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 503 sessionId:  describe result for acl check
2025-10-10T14:05:24.357676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:24.357686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:24.357696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:24.357712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593949317814002:7629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:24.360569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593949317814002:7629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:24.393646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593949317814002:7629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:24.398117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:24.405487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:24.406442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:24.406461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:24.406512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:24.406833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:24.407026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593947739894091:6868]
2025-10-10T14:05:24.410161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:24.409526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593949317814050:7619]
2025-10-10T14:05:24.415445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:24.415779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:24.417297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:24.417676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:24.417685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:24.417692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:24.417699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:24.417706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:24.417713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:24.417720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:24.417727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:24.417736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:24.417742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:24.417750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:24.417758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:24.417827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:24.417937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:24.417981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:24.418025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:24.418064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:24.418109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:24.418149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:24.418194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:24.418236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:24.418312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:24.418380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:24.418442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:24.418490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:24.418558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:24.418615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:24.418668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:24.418713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:24.418764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:24.418812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:24.418892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:24.418943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:24.418995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:24.419042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:24.419094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:24.419141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:24.419194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:24.419242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:24.419319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:24.419369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:24.419422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:24.419465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:24.419535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:24.419588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:24.419660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:24.419711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:24.419775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:24.420254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:24.418898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593949317814002:7629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:24.419482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593949317814002:7629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:24.419503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593949317814002:7629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:24.419547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:24.460774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:24.514020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:24.514075Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:24.514097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:24.514118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:24.514141Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 502 [2:7559593947739894091:6868]
2025-10-10T14:05:24.514204Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:24.514476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:24.514493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:24.514507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:24.514519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:24.514572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:24.514594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:24.514618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:24.515958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:24.515974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:24.515990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:24.516005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:24.516017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:24.516299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:24.516319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:24.516483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:24.516690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:24.516940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:24.517072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:24.517169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:24.517187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:24.517203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:24.517217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:24.517264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:24.517351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:24.517551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:24.517571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:24.517705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:24.517728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:24.519592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 502
2025-10-10T14:05:24.519680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 502, pipe: [1:7559593949317814050:7619]
2025-10-10T14:05:24.519755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 502
2025-10-10T14:05:24.522351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 503 partition: 0 MaxSeqNo: 36 sessionId: src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0
2025-10-10T14:05:24.522922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9214b5e4-f2e6c102-908f205e-676c6b46_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:24.518080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:24.518104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:24.518116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:24.518129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:24.518156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:24.519917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593949317814057:7629], now have 1 active actors on pipe
2025-10-10T14:05:24.519951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593949317814050:7619], now have 1 active actors on pipe
2025-10-10T14:05:24.519976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593949317813975:2442], now have 1 active actors on pipe
2025-10-10T14:05:24.520458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:24.520485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:24.520571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:24.520601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:24.520624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:24.520641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:24.520688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:24.520734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:24.520804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:24.522054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:24.522070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:24.522119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:24.564178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0] Write session: try to update token
2025-10-10T14:05:24.569295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:24.765573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:24.765611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:24.765624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:24.765673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:24.765684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:24.765694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:24.765703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:24.765712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:24.765739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:24.765758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:24.765788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:24.765804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:24.765981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:24.766011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:24.766023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:24.766900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:24.766939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:24.766974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:24.767007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:24.774769Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:24.836868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId: src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:24.859608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:24.998628Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:25.028566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:25.028625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:25.028703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:25.028719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:25.028766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593947739894085:6868]
2025-10-10T14:05:25.029142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:25.029597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:25.033647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:25.035308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593949317814050:7619]
2025-10-10T14:05:25.035432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:25.042662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 503 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0
2025-10-10T14:05:25.043289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 503 sessionId: src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0 is DEAD
2025-10-10T14:05:25.046943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:25.046980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0] Write session will restart in 0.009187s
2025-10-10T14:05:25.047082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0] Write session: Do CDS request
2025-10-10T14:05:25.047114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:25.064948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:25.064973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 504
2025-10-10T14:05:25.065902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:25.066555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:25.066688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:25.066704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:25.066714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:25.069160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 504 sessionId:  describe result for acl check
2025-10-10T14:05:25.069279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:25.069290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:25.069301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:25.069318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593953612781401:7637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:25.071871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593953612781401:7637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:25.115831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593953612781401:7637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:25.132178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593953612781456:7619]
2025-10-10T14:05:25.132893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:25.136747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593953612781401:7637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:25.136786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593953612781401:7637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:25.136805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593953612781401:7637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:25.136837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:25.138314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:25.139377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:25.139397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:25.139446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:25.139748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:25.139950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593952034861480:6873]
2025-10-10T14:05:25.142753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:25.148739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:25.149016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:25.150341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:25.150716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:25.150726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:25.150734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:25.150741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:25.150748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:25.150755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:25.150761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:25.150767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:25.150774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.150781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.150788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.150796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.150841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:25.150948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:25.150997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:25.151042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:25.151294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:25.151345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:25.151401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:25.151445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:25.151490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.151535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.151580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.151622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.151667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:25.151729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:25.151788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:25.151853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:25.151902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:25.151953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:25.151999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:25.152044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:25.152090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:25.152149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:25.152191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:25.152241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:25.152289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:25.152340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:25.152383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:25.152434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:25.152478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.152530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.152574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.152627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.152668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.152720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.152763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.152815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.153287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:25.192908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:25.231170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:25.231221Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:25.231240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:25.231263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:25.231288Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 503 [2:7559593952034861480:6873]
2025-10-10T14:05:25.231345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:25.231404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:25.231420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:25.231431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:25.231444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:25.231493Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:25.231515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:25.231538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:25.232968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.232985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.233000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.233017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.233029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:25.234422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 503, pipe: [1:7559593953612781456:7619]
2025-10-10T14:05:25.234532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 503
2025-10-10T14:05:25.234607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 503
2025-10-10T14:05:25.239756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:25.239808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.240003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.240247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.240559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.240714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:25.240821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593953612781456:7619], now have 1 active actors on pipe
2025-10-10T14:05:25.240853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593953612781461:7637], now have 1 active actors on pipe
2025-10-10T14:05:25.240881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593953612781388:2442], now have 1 active actors on pipe
2025-10-10T14:05:25.240948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:25.240976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:25.241041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593952034861473:6873]
2025-10-10T14:05:25.241060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593952034861473:6873]
2025-10-10T14:05:25.241077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593952034861473:6873]
2025-10-10T14:05:25.241094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593952034861473:6873]
2025-10-10T14:05:25.241156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:25.241249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:25.241289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:25.241304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:25.241317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:25.241330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:25.241446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:25.241465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:25.241533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:25.241567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:25.241586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:25.241597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:25.241639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:25.241690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:25.241850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593952034861473:6873]
2025-10-10T14:05:25.241884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:25.241933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:25.242275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:25.250175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:25.250223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:25.250315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:25.254040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 504 partition: 0 MaxSeqNo: 36 sessionId: src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0
2025-10-10T14:05:25.254897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aa0aabc-8e09331c-9f2cee0-eb133770_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:25.323331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0] Write session: try to update token
2025-10-10T14:05:25.323392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:25.337253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:25.337291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:25.337304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:25.407994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:25.417614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:25.417650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:25.417664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:25.417676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:25.417719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593952034861473:6873]
2025-10-10T14:05:25.417750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593952034861473:6873]
2025-10-10T14:05:25.417776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593952034861473:6873]
2025-10-10T14:05:25.417817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593952034861473:6873]
2025-10-10T14:05:25.417984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:25.418012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.418026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:25.421247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:25.421301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:25.421335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:25.421368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:25.426187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:25.549859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId: src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:25.588128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:25.638845Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:25.641817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:25.641862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:25.645286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:25.644515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593953612781456:7619]
2025-10-10T14:05:25.644617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:25.644629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:25.679233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:25.682950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 504 reason: error at write: Disconnected sessionId: src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0
2025-10-10T14:05:25.683263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 504 sessionId: src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0 is DEAD
2025-10-10T14:05:25.684700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:25.684761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0] Write session will restart in 0.008940s
2025-10-10T14:05:25.684922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0] Write session: Do CDS request
2025-10-10T14:05:25.685001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:25.700079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:25.701615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:25.701643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 505
2025-10-10T14:05:25.709251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:25.709446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:25.709468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:25.709478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:25.715082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:25.717525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:25.718438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:25.718459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:25.718399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 505 sessionId:  describe result for acl check
2025-10-10T14:05:25.718511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:25.718822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:25.718533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:25.719036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593952034861586:6883]
2025-10-10T14:05:25.718544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:25.718553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:25.718574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593953612781550:7649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:25.721854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:25.721664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593953612781550:7649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:25.723210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:25.723499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:25.725171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:25.725600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:25.725611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:25.725619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:25.725631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:25.725643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:25.725651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:25.725659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:25.725667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:25.725675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.725682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.725689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.725697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.725758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:25.725913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:25.725976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:25.726031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:25.726082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:25.726140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:25.726201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:25.726261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:25.726312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.726372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.727856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.727945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.728003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:25.728083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:25.728158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:25.728229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:25.728298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:25.728367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:25.728435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:25.728502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:25.728561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:25.728627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:25.728686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:25.728756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:25.728818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:25.728889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:25.728942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:25.729005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:25.729065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.729167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.729225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.729298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.729362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.729419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.729481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.729551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.730102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:25.733013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593953612781550:7649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:25.753320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593953612781578:7619]
2025-10-10T14:05:25.763472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:25.779288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593953612781550:7649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:25.779329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593953612781550:7649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:25.779347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593953612781550:7649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:25.779381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:25.780349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:25.780390Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:25.780407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:25.780425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:25.780446Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 504 [2:7559593952034861586:6883]
2025-10-10T14:05:25.780504Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:25.780557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:25.780570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:25.780581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:25.780592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:25.780637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:25.780657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:25.780679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:25.793002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.793037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.793051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.793064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.793075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:25.794458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:25.794491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:25.794639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:25.794829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:25.795070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:25.795193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:25.795239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593953612781506:2442], now have 1 active actors on pipe
2025-10-10T14:05:25.795265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593953612781585:7649], now have 1 active actors on pipe
2025-10-10T14:05:25.795286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593953612781578:7619], now have 1 active actors on pipe
2025-10-10T14:05:25.795354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593952034861581:6883]
2025-10-10T14:05:25.795370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593952034861581:6883]
2025-10-10T14:05:25.795384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593952034861581:6883]
2025-10-10T14:05:25.795399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593952034861581:6883]
2025-10-10T14:05:25.795441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:25.795525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:25.795712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:25.795728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:25.795852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593952034861581:6883]
2025-10-10T14:05:25.795874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:25.797312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 504
2025-10-10T14:05:25.797389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 504, pipe: [1:7559593953612781578:7619]
2025-10-10T14:05:25.796055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:25.796077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:25.796089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:25.796101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:25.796124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:25.797494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 504
2025-10-10T14:05:25.798070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:25.798104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:25.798193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:25.798224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:25.798243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:25.798255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:25.798292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:25.798333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:25.798599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:25.799926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:25.799955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:25.800023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:25.800388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 505 partition: 0 MaxSeqNo: 36 sessionId: src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0
2025-10-10T14:05:25.804156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcc988e-d3cd677c-4ae3adec-8d747020_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:25.862976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0] Write session: try to update token
2025-10-10T14:05:25.863048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:25.881441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:25.881474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:25.881485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:26.039050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:26.039086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:26.039101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:26.039113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:26.039124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:26.039160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593952034861581:6883]
2025-10-10T14:05:26.039184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593952034861581:6883]
2025-10-10T14:05:26.039209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593952034861581:6883]
2025-10-10T14:05:26.039231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593952034861581:6883]
2025-10-10T14:05:26.039395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:26.039410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:26.039420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:26.039461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:26.039485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:26.039497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:26.040564Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:26.043827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:26.043872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:26.043912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:26.043942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:26.101296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId: src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:26.152977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:26.229100Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:26.231211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:26.231243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:26.234642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:26.234785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:26.234799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:26.237154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593953612781578:7619]
2025-10-10T14:05:26.235883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:26.248173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 505 reason: error at write: Disconnected sessionId: src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0
2025-10-10T14:05:26.248462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 505 sessionId: src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0 is DEAD
2025-10-10T14:05:26.252252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:26.252292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0] Write session will restart in 0.006814s
2025-10-10T14:05:26.252401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0] Write session: Do CDS request
2025-10-10T14:05:26.252435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:26.270210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:26.270237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 506
2025-10-10T14:05:26.276297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:26.279567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:26.279703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:26.279718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:26.279728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:26.281563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 506 sessionId:  describe result for acl check
2025-10-10T14:05:26.281685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:26.281697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:26.281706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:26.281722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593957907748921:7657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:26.294406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593957907748921:7657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:26.340135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593957907748961:7619]
2025-10-10T14:05:26.344740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593957907748921:7657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:26.372433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:26.371506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593957907748921:7657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:26.371544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593957907748921:7657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:26.371562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593957907748921:7657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:26.371594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:26.378539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:26.379408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:26.379426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:26.379470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:26.379729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:26.379911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593956329828992:6893]
2025-10-10T14:05:26.382324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:26.389566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:26.389927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:26.391538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:26.391904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:26.391914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:26.391921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:26.391928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:26.391935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:26.391943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:26.391951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:26.391959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:26.391966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:26.391973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:26.391981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:26.391989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:26.392040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:26.392162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:26.392217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:26.392270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:26.392320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:26.392374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:26.392424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:26.392480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:26.392530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:26.392581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:26.392631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:26.392683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:26.392727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:26.392803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:26.392868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:26.392930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:26.392987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:26.393048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:26.393098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:26.393175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:26.393230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:26.393294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:26.393347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:26.393410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:26.393465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:26.393524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:26.393577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:26.393633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:26.393685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:26.393744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:26.393794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:26.393874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:26.393928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:26.393986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:26.394039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:26.394097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:26.394608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:26.464702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:26.479219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:26.479272Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:26.479293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:26.479316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:26.479341Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 505 [2:7559593956329828992:6893]
2025-10-10T14:05:26.479405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:26.479472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:26.479491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:26.479505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:26.479516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:26.479564Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:26.479587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:26.479610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:26.481040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:26.481058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:26.481073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:26.481088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:26.481101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:26.481388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:26.481408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:26.484128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 505
2025-10-10T14:05:26.484219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 505
2025-10-10T14:05:26.484291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 505, pipe: [1:7559593957907748961:7619]
2025-10-10T14:05:26.481573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:26.481805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:26.482077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:26.482211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:26.482292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.482308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.482321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.482336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.482381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:26.482470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:26.482806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:26.482819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:26.482830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:26.482843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:26.485042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:26.485071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:26.485268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593957907748987:7657], now have 1 active actors on pipe
2025-10-10T14:05:26.485295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593957907748907:2442], now have 1 active actors on pipe
2025-10-10T14:05:26.485319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593957907748961:7619], now have 1 active actors on pipe
2025-10-10T14:05:26.485369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:26.485394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:26.485449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.485482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:26.485603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:26.485635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:26.485654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:26.485666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:26.485702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:26.485743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:26.485847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:26.485956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:26.488725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:26.488761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:26.488836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:26.489291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 506 partition: 0 MaxSeqNo: 36 sessionId: src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0
2025-10-10T14:05:26.490921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c1ba9b2-456d27db-803476a2-4452b6c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:26.539186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0] Write session: try to update token
2025-10-10T14:05:26.539244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:26.697888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:26.697916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:26.697927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:26.697936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:26.697944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:26.697976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.698000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.698023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.698043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.698200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:26.698213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:26.698223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:26.698312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:26.698336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:26.698347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:26.699369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:26.701288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:26.701324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:26.701360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:26.701392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:26.732835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId: src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:26.762302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:26.863950Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:26.905240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:26.905292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:26.905372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:26.905387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:26.905429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593956329828985:6893]
2025-10-10T14:05:26.906367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:26.908219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:26.909479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:26.913323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:26.913492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593957907748961:7619]
2025-10-10T14:05:26.960315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 506 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0
2025-10-10T14:05:26.960695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 506 sessionId: src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0 is DEAD
2025-10-10T14:05:26.962173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:26.962238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0] Write session will restart in 0.008374s
2025-10-10T14:05:26.962361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0] Write session: Do CDS request
2025-10-10T14:05:26.962384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:26.993905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:26.994549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:26.994582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 507
2025-10-10T14:05:26.994912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:26.995062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:26.995092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:26.995103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:26.996634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 507 sessionId:  describe result for acl check
2025-10-10T14:05:26.996765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:26.996787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:26.996797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:26.996816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593957907749067:7666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:26.999826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593957907749067:7666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:27.008493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:27.011119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:27.013418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593962202716388:7619]
2025-10-10T14:05:27.012034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:27.012072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:27.012127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:27.012483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:27.012694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593960624796380:6896]
2025-10-10T14:05:27.015324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:27.019452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593957907749067:7666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:27.017001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:27.017304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:27.018741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:27.019120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:27.019130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:27.019139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:27.019148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:27.019157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:27.019165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:27.019172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:27.019180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:27.019187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.019194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.019203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.019209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.019262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:27.019379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:27.019431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:27.019480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:27.019526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:27.019577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:27.019625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:27.019673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:27.019721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.019769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.019817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.019879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.019931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:27.020002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:27.020064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:27.020134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:27.020193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:27.020252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:27.020303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:27.020360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:27.020423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:27.020482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:27.020533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:27.020590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:27.020645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:27.020704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:27.020752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:27.020813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:27.020866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.020923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.020973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.021049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.021104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.024380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.024469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.024539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.025076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:27.035837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593957907749067:7666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:27.035893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593957907749067:7666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:27.035913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593957907749067:7666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:27.035957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:27.085425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:27.137483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:27.137535Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:27.137556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:27.137578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:27.137603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 506 [2:7559593960624796380:6896]
2025-10-10T14:05:27.137669Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:27.137736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:27.137752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:27.137765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:27.137778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:27.137843Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:27.137869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:27.137893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:27.139729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.139765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.139784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.139801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.139815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:27.140150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:27.140173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.140355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.140587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.140876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.141022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:27.141103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.141121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.143308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.143342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.143398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:27.143516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:27.143731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:27.143750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:27.143806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593962202716388:7619], now have 1 active actors on pipe
2025-10-10T14:05:27.143833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593957907749023:2442], now have 1 active actors on pipe
2025-10-10T14:05:27.143857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593962202716402:7666], now have 1 active actors on pipe
2025-10-10T14:05:27.143988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.144010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:27.144239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:27.144252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:27.144265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:27.144277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:27.145027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 506, pipe: [1:7559593962202716388:7619]
2025-10-10T14:05:27.144302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:27.145550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 506
2025-10-10T14:05:27.150791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 506
2025-10-10T14:05:27.149446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:27.149486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:27.149566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:27.149602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:27.149621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:27.149631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:27.149667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:27.149711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:27.149755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:27.157871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:27.157916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:27.157992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:27.158457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 507 partition: 0 MaxSeqNo: 36 sessionId: src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0
2025-10-10T14:05:27.163798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 672 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 15769614 MessagesInflight: 10 }
2025-10-10T14:05:27.163927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd5b786-ec2637ba-78ebaccc-9994dce3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:27.224163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0] Write session: try to update token
2025-10-10T14:05:27.224219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:27.253637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:27.253665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:27.253678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:27.253731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:27.253747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:27.253788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.253925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:27.254161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:27.278859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:27.280041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:27.286442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:27.287842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:27.329926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:27.330375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:27.375278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:27.375316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:27.375330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:27.375386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:27.375402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:27.375417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:27.375429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:27.375441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:27.375485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.375514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.375541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.375567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593960624796375:6896]
2025-10-10T14:05:27.375722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:27.375750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.375762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:27.378653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:27.378729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:27.378790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:27.378853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:27.412278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:27.487908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId: src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:27.511295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:27.604057Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:27.613053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:27.613102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:27.614459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:27.617851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:27.617996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:27.627370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 507 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0
2025-10-10T14:05:27.627865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 507 sessionId: src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0 is DEAD
2025-10-10T14:05:27.629557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:27.629605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0] Write session will restart in 0.007045s
2025-10-10T14:05:27.629715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0] Write session: Do CDS request
2025-10-10T14:05:27.629748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:27.648342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:27.664920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593962202716388:7619]
2025-10-10T14:05:27.665114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:27.665144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 508
2025-10-10T14:05:27.666040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:27.666173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:27.666198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:27.666207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:27.669951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 508 sessionId:  describe result for acl check
2025-10-10T14:05:27.670073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:27.670084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:27.670094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:27.670112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593962202716445:7682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:27.672886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593962202716445:7682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:27.686292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593962202716445:7682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:27.718276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593962202716445:7682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:27.718316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593962202716445:7682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:27.718333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593962202716445:7682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:27.718364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:27.729511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:27.730046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:27.730818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:27.730836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:27.730880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:27.731123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:27.731305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593960624796491:6905]
2025-10-10T14:05:27.734154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:27.735216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:27.735440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:27.736812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:27.737162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:27.737171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:27.737179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:27.737188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:27.737195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:27.737204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:27.737211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:27.737218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:27.737226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.737234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.737241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.737250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.737299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:27.737416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:27.737467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:27.737518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:27.737570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:27.737620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:27.737670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:27.737734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:27.737783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.737859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.737908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.737954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.737998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:27.738070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:27.738139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:27.738200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:27.738256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:27.738313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:27.738360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:27.738419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:27.738471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:27.738526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:27.738579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:27.738635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:27.738863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:27.738932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:27.738992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:27.739059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:27.739118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.739175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.739227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.739287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.739341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.739400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.739453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.739510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.740018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:27.769259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593962202716524:7619]
2025-10-10T14:05:27.787550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:27.810996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:27.811051Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:27.811072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:27.811093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:27.811117Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 507 [2:7559593960624796491:6905]
2025-10-10T14:05:27.811178Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:27.811242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:27.817210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:27.817232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:27.817244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:27.817310Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:27.817336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:27.817368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:27.849086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 507, pipe: [1:7559593962202716524:7619]
2025-10-10T14:05:27.849193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 507
2025-10-10T14:05:27.849269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 507
2025-10-10T14:05:27.848022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.848049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.848058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.848068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.848075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:27.849437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:27.849458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:27.849613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:27.849819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:27.850082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:27.850201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:27.850244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593962202716524:7619], now have 1 active actors on pipe
2025-10-10T14:05:27.850272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593962202716503:7682], now have 1 active actors on pipe
2025-10-10T14:05:27.850298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593962202716429:2442], now have 1 active actors on pipe
2025-10-10T14:05:27.850406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:27.850430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:27.850469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:27.850484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:27.850497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:27.850511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:27.850549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:27.850633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:27.850686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:27.850699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:27.850712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:27.850724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:27.850831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:27.850851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:27.850920Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:27.850949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:27.850969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:27.850980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:27.851017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:27.851056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:27.851188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:27.851219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:27.851266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:27.851835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:27.854519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 508 partition: 0 MaxSeqNo: 36 sessionId: src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0
2025-10-10T14:05:27.854039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:27.854077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:27.854153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:27.858029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a52217de-3660a0d0-f5a6f66a-39bcf8bc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:27.920013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0] Write session: try to update token
2025-10-10T14:05:27.920074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:27.918223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:27.918258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:27.918269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:28.033298Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 5 CurrentSessionLifetimeMs: 362631 BytesRead: 29286416 MessagesRead: 13 BytesReadCompressed: 29286416 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-10-10T14:05:28.157645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:28.157674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:28.157687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:28.157805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:28.157820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:28.157835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:28.157847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:28.157873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:28.157907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:28.157935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:28.157961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:28.157988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:28.158071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:28.158107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:28.158139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:28.158170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:28.211015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId: src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:28.223237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:28.223286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:28.223299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:28.224303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:28.302102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:28.572231Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:28.582988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:28.583023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:28.583072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593960624796485:6905]
2025-10-10T14:05:28.583233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:28.583260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:28.585260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593962202716524:7619]
2025-10-10T14:05:28.585359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:28.585372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:28.589269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:28.583583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:28.591438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:28.680157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:28.684204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593966497683907:7619]
2025-10-10T14:05:28.686818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 508 reason: error at write: Disconnected sessionId: src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0
2025-10-10T14:05:28.687198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 508 sessionId: src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0 is DEAD
2025-10-10T14:05:28.688443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:28.688510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0] Write session will restart in 0.008832s
2025-10-10T14:05:28.688674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0] Write session: Do CDS request
2025-10-10T14:05:28.688719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:28.689699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:28.692183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:28.692223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:28.692308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:28.693024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:28.693489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593964919763898:6916]
2025-10-10T14:05:28.704713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:28.705967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:28.709355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:28.709386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 509
2025-10-10T14:05:28.710717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:28.711015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:28.714776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:28.714925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:28.714941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:28.714951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:28.712759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:28.713143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:28.713154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:28.713161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:28.713169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:28.713176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:28.713184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:28.713192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:28.713200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:28.713209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:28.713217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:28.713225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:28.713233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:28.713288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:28.713403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:28.713453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:28.713503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:28.713556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:28.713607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:28.713659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:28.713719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:28.713767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:28.713813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:28.713858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:28.713917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:28.713963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:28.714034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:28.714093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:28.714146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:28.714192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:28.714242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:28.714281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:28.714329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:28.714370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:28.714420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:28.714460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:28.714518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:28.714585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:28.714649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:28.714695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:28.714744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:28.714785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:28.714833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:28.714873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:28.714923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:28.714964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:28.715013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:28.715051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:28.715098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:28.715489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:28.718484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 509 sessionId:  describe result for acl check
2025-10-10T14:05:28.718617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:28.718628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:28.718639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:28.718656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593966497683914:7692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:28.722359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593966497683914:7692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:28.747920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593966497683914:7692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:28.751656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:28.763230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593966497683914:7692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:28.763273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593966497683914:7692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:28.763294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593966497683914:7692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:28.763330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:28.765808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:28.765852Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:28.765881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:28.765902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:28.765925Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 508 [2:7559593964919763898:6916]
2025-10-10T14:05:28.765985Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:28.766038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:28.766053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:28.766067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:28.766079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:28.766123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:28.766144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:28.766166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:28.767355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:28.767371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:28.767384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:28.767401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:28.767412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:28.767669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:28.767686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:28.767840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:28.768046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:28.768295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:28.768431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:28.768514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593966497683907:7619], now have 1 active actors on pipe
2025-10-10T14:05:28.768542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593966497683857:2442], now have 1 active actors on pipe
2025-10-10T14:05:28.768568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593966497683944:7692], now have 1 active actors on pipe
2025-10-10T14:05:28.768594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593964919763893:6916]
2025-10-10T14:05:28.768611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593964919763893:6916]
2025-10-10T14:05:28.768626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593964919763893:6916]
2025-10-10T14:05:28.768639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593964919763893:6916]
2025-10-10T14:05:28.768684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:28.768771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:28.768970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:28.768988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:28.769113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593964919763893:6916]
2025-10-10T14:05:28.769184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:28.769198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:28.769210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:28.769222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:28.769281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:28.769372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:28.770113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 508
2025-10-10T14:05:28.770198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 508, pipe: [1:7559593966497683907:7619]
2025-10-10T14:05:28.770269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 508
2025-10-10T14:05:28.770833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:28.770875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:28.770970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:28.771001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:28.771022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:28.771034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:28.771071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:28.771113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:28.771163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:28.779740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:28.779791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:28.779878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:28.781356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 509 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0
2025-10-10T14:05:28.783002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac7923e-40b161ae-b2e8e25b-24dc1b23_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:28.833983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0] Write session: try to update token
2025-10-10T14:05:28.834043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:28.990626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:28.990659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:28.990672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:28.990730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:28.990747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:28.990762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:28.990773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:28.990787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:28.990826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593964919763893:6916]
2025-10-10T14:05:28.990853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593964919763893:6916]
2025-10-10T14:05:28.990880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593964919763893:6916]
2025-10-10T14:05:28.990905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593964919763893:6916]
2025-10-10T14:05:28.991054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:28.991085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:28.991096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:28.993222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:28.993275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:28.993311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:28.993345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:28.993963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:29.004575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId: src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:29.055857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:29.237490Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:29.239456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:29.239491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:29.242496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593966497683907:7619]
2025-10-10T14:05:29.242583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:29.242732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:29.242749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:29.242877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:29.275864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:29.275972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0] Write session will restart in 0.007246s
2025-10-10T14:05:29.276213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0] Write session: Do CDS request
2025-10-10T14:05:29.276286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:29.273936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 509 reason: error at write: Disconnected sessionId: src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0
2025-10-10T14:05:29.274263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 509 sessionId: src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0 is DEAD
2025-10-10T14:05:29.294647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:29.294743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:29.294796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 510
2025-10-10T14:05:29.316782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:29.316950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:29.316966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:29.316975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:29.320755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 510 sessionId:  describe result for acl check
2025-10-10T14:05:29.320890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:29.320900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:29.320910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:29.320926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593970792651306:7700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:29.323652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593970792651306:7700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:29.342722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593970792651306:7700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:29.346363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:29.348114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593970792651351:7619]
2025-10-10T14:05:29.358584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:29.359588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593970792651306:7700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:29.359621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593970792651306:7700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:29.359641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593970792651306:7700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:29.359670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:29.359465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:29.359495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:29.359540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:29.360023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:29.360231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593969214731307:6919]
2025-10-10T14:05:29.362654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:29.364064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:29.364308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:29.365818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:29.366205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:29.366215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:29.366222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:29.366245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:29.366251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:29.366258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:29.366265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:29.366272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:29.366280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.366287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.366295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.366302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.366351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:29.366464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:29.366511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:29.366558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:29.366604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:29.366651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:29.366694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:29.366738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:29.366783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.366829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.366874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.366918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.366959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:29.367025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:29.367088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:29.367144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:29.367197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:29.367255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:29.367301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:29.367357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:29.367407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:29.367461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:29.367509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:29.367564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:29.367610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:29.367660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:29.367706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:29.367759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:29.367808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.367863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.367912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.367966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.368017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.368072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.368118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.368176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.368642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:29.412876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:29.440809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:29.440851Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:29.440868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:29.440887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:29.440909Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 509 [2:7559593969214731307:6919]
2025-10-10T14:05:29.440964Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:29.441016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:29.441031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:29.441043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:29.441054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:29.441101Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:29.441122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:29.441639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:29.444268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.444298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.444314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.444327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.444338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:29.444618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:29.444635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.444779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.444976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.445242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.445380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:29.445448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.445464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.445479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.445493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.445533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:29.445614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:29.446252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:29.446272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:29.446286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:29.446297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:29.447606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:29.447634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:29.447791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593970792651267:2442], now have 1 active actors on pipe
2025-10-10T14:05:29.447816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593970792651351:7619], now have 1 active actors on pipe
2025-10-10T14:05:29.447839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593970792651358:7700], now have 1 active actors on pipe
2025-10-10T14:05:29.447861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.447893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:29.448209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:29.449375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 509
2025-10-10T14:05:29.449470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 509, pipe: [1:7559593970792651351:7619]
2025-10-10T14:05:29.449556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 509
2025-10-10T14:05:29.450854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:29.450891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:29.450966Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:29.450998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:29.451015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:29.451027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:29.451074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:29.451119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:29.451167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:29.455136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:29.455175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:29.455250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:29.455674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 510 partition: 0 MaxSeqNo: 36 sessionId: src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0
2025-10-10T14:05:29.456568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ede8f8-ae433c7a-54ebdaf-7d0321e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:29.502032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0] Write session: try to update token
2025-10-10T14:05:29.502086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:29.609221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:29.609276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:29.609301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:29.609322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:29.609347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:29.609405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.609453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.609499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.609549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.609810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:29.609839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:29.609863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:29.609869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:29.609900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:29.609944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:29.609991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:29.610059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:29.610103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.610123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:29.636099Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:29.694377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId: src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:29.743303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:29.789644Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:29.822682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:29.822727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:29.822780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:29.822794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:29.822830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593969214731291:6919]
2025-10-10T14:05:29.824376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:29.824857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:29.828742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:29.829026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593970792651351:7619]
2025-10-10T14:05:29.829178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:29.908325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:29.908389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0] Write session will restart in 0.006911s
2025-10-10T14:05:29.907617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 510 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0
2025-10-10T14:05:29.908499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0] Write session: Do CDS request
2025-10-10T14:05:29.907915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 510 sessionId: src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0 is DEAD
2025-10-10T14:05:29.908529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:29.920503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:29.928012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:29.928039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 511
2025-10-10T14:05:29.929563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:29.932227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:29.932378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:29.932396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:29.932406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:29.932510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593970792651439:7619]
2025-10-10T14:05:29.937536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:29.938419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:29.938449Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:29.938495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:29.938766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:29.938957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593969214731404:6929]
2025-10-10T14:05:29.941889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:29.935082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 511 sessionId:  describe result for acl check
2025-10-10T14:05:29.935201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:29.935214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:29.935224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:29.935240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593970792651441:7711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:29.944379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:29.944628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:29.945984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:29.946311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:29.946320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:29.946328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:29.946337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:29.946344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:29.946351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:29.946358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:29.946366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:29.946373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.946381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.946388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.946397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.946447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:29.946563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:29.946617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:29.946670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:29.946721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:29.946783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:29.946832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:29.946879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:29.946927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.946977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.947055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.947105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.947145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:29.947217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:29.947282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:29.947347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:29.947402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:29.947459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:29.947510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:29.947570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:29.947618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:29.947673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:29.947720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:29.947776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:29.947826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:29.947881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:29.947931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:29.947987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:29.948047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.948102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:29.948149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.948203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:29.948251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.948309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:29.948359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.948418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:29.948889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:29.943640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593970792651441:7711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:29.960261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593970792651441:7711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:29.980506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593970792651441:7711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:29.980554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593970792651441:7711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:29.980574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593970792651441:7711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:29.980606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:30.017173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:30.065318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:30.065368Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:30.065387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:30.065408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:30.065431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 510 [2:7559593969214731404:6929]
2025-10-10T14:05:30.065491Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:30.065553Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:30.065569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:30.065582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:30.065594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:30.065646Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:30.065669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:30.065693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:30.067332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.067352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:30.067368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:30.067385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:30.067397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:30.067680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:30.067702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.067872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:30.068096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:30.068394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:30.068527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:30.068605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593969214731397:6929]
2025-10-10T14:05:30.068624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593969214731397:6929]
2025-10-10T14:05:30.068637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593969214731397:6929]
2025-10-10T14:05:30.068651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593969214731397:6929]
2025-10-10T14:05:30.068687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:30.068768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:30.068845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:30.068861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:30.068874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:30.068886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:30.068971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:30.068991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:30.069202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593970792651478:7711], now have 1 active actors on pipe
2025-10-10T14:05:30.069234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593970792651439:7619], now have 1 active actors on pipe
2025-10-10T14:05:30.069256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593970792651391:2442], now have 1 active actors on pipe
2025-10-10T14:05:30.069279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593969214731397:6929]
2025-10-10T14:05:30.069310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:30.069607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:30.069206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 510
2025-10-10T14:05:30.069285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 510, pipe: [1:7559593970792651439:7619]
2025-10-10T14:05:30.069352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 510
2025-10-10T14:05:30.070291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:30.070328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:30.070427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:30.070465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:30.070484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:30.070494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:30.070531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:30.070586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:30.070639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:30.073631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:30.073667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:30.073720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:30.074016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 511 partition: 0 MaxSeqNo: 36 sessionId: src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0
2025-10-10T14:05:30.074766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1a2c70-2a7aa0ab-67675aab-3d1a163d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:30.099385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0] Write session: try to update token
2025-10-10T14:05:30.099430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:30.192548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:30.192580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:30.192592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:30.192647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:30.192663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:30.192679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:30.192692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:30.192704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:30.192742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593969214731397:6929]
2025-10-10T14:05:30.192774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593969214731397:6929]
2025-10-10T14:05:30.192800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593969214731397:6929]
2025-10-10T14:05:30.192823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593969214731397:6929]
2025-10-10T14:05:30.192963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:30.192989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.193002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:30.193652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:30.193702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:30.193736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:30.193770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:30.206279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:30.293437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId: src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:30.375465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:30.449092Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:30.451097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:30.451143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:30.463748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:30.463913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:30.463928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:30.469328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593970792651439:7619]
2025-10-10T14:05:30.486910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:30.486978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0] Write session will restart in 0.006224s
2025-10-10T14:05:30.487126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0] Write session: Do CDS request
2025-10-10T14:05:30.487176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:30.485642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 511 reason: error at write: Disconnected sessionId: src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0
2025-10-10T14:05:30.485955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 511 sessionId: src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0 is DEAD
2025-10-10T14:05:30.497077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:30.497105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 512
2025-10-10T14:05:30.503823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:30.509853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:30.511378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:30.511522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:30.511538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:30.511547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:30.518436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 512 sessionId:  describe result for acl check
2025-10-10T14:05:30.518562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:30.518574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:30.518585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:30.518603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593975087618809:7719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:30.529935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593975087618809:7719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:30.589704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593975087618861:7619]
2025-10-10T14:05:30.592487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593975087618809:7719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:30.601964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:30.610321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:30.611267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:30.611303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:30.611360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:30.611655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:30.611859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593973509698816:6939]
2025-10-10T14:05:30.614386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:30.616009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:30.616271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:30.617742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:30.618123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:30.618133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:30.618142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:30.618149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:30.618157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:30.618165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:30.618173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:30.618181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:30.618189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.618197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:30.618204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:30.618212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:30.618266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:30.618390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:30.618448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:30.618504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:30.618556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:30.618611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:30.618665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:30.618718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:30.618769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.618821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:30.618872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:30.618926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:30.618972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:30.619050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:30.619119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:30.619181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:30.619234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:30.619298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:30.619349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:30.619412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:30.619466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:30.619529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:30.619577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:30.619634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:30.619689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:30.619751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:30.619798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:30.619859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:30.619921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.619984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.620036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:30.620096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:30.620155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:30.620213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:30.620264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:30.620324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:30.620831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:30.676948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593975087618809:7719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:30.677006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593975087618809:7719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:30.677025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593975087618809:7719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:30.677060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:30.695045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:30.718107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:30.718158Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:30.718179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:30.718199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:30.718224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 511 [2:7559593973509698816:6939]
2025-10-10T14:05:30.718289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:30.718348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:30.718370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:30.718382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:30.718396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:30.718445Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:30.718468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:30.718490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:30.719801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.719830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:30.719845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:30.719859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:30.719871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:30.720138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:30.720164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.720322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:30.720545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:30.720806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:30.720931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:30.721014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593975087618885:7719], now have 1 active actors on pipe
2025-10-10T14:05:30.721040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593975087618861:7619], now have 1 active actors on pipe
2025-10-10T14:05:30.721065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593975087618795:2442], now have 1 active actors on pipe
2025-10-10T14:05:30.721091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:30.721108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:30.721265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 511
2025-10-10T14:05:30.721349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 511, pipe: [1:7559593975087618861:7619]
2025-10-10T14:05:30.721423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 511
2025-10-10T14:05:30.745164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:30.745265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:30.745324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:30.745488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:30.745615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:30.745642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:30.745657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:30.745671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:30.745731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:30.745763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:30.745841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:30.745866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:30.746046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:30.746085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:30.746160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:30.746198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:30.746219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:30.746221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:30.746231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:30.746267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:30.746307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:30.746448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:30.752951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:30.753006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:30.753098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:30.755257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 512 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0
2025-10-10T14:05:30.756095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de1624e-6d05b05a-b108e518-863fc9d8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:30.822985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:30.823016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:30.823028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:30.839770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0] Write session: try to update token
2025-10-10T14:05:30.839829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:30.955247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:30.955280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:30.955292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:30.955347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:30.955363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:30.955380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:30.955393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:30.955404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:30.955441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:30.955468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:30.955493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:30.955516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:30.955610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:30.955644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:30.955679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:30.955711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:30.972325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:30.972377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:30.972391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:30.973520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:31.073736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId: src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:31.122126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:31.279518Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:31.308714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:31.308762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:31.308819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:31.308834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:31.308871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593973509698809:6939]
2025-10-10T14:05:31.309448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:31.313064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:31.311482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:31.311509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:31.377553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 512 reason: error at write: Disconnected sessionId: src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0
2025-10-10T14:05:31.377880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 512 sessionId: src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0 is DEAD
2025-10-10T14:05:31.385320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:31.385363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0] Write session will restart in 0.009910s
2025-10-10T14:05:31.385462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0] Write session: Do CDS request
2025-10-10T14:05:31.385490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:31.400466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593975087618861:7619]
2025-10-10T14:05:31.400542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:31.403345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:31.403373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 513
2025-10-10T14:05:31.408257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:31.408962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:31.409106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:31.409137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:31.409149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:31.414149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 513 sessionId:  describe result for acl check
2025-10-10T14:05:31.414283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:31.414294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:31.414304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:31.414320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593979382586286:7737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:31.416899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593979382586286:7737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:31.428103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:31.428663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:31.429504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:31.429536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:31.429585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:31.429859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:31.430074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593977804666227:6949]
2025-10-10T14:05:31.432356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:31.436883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593979382586286:7737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:31.447415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:31.447664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:31.449021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:31.449413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:31.449424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:31.449431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:31.449439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:31.449447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:31.449453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:31.449460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:31.449468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:31.449475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:31.449483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:31.449492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:31.449500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:31.449552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:31.449666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:31.449715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:31.449763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:31.449812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:31.449861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:31.449908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:31.449974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:31.450021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:31.450068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:31.450117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:31.450167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:31.450212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:31.450285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:31.450346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:31.450402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:31.450451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:31.450506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:31.450555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:31.450612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:31.450665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:31.450721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:31.450771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:31.450823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:31.450873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:31.450929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:31.450978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:31.451034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:31.451103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:31.451157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:31.451203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:31.451264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:31.451317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:31.451372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:31.451420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:31.451494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:31.454790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:31.478286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593979382586286:7737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:31.478327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593979382586286:7737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:31.478347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593979382586286:7737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:31.478381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:31.494466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:31.497365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593979382586321:7619]
2025-10-10T14:05:31.538232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:31.538277Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:31.538300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:31.538319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:31.538343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 512 [2:7559593977804666227:6949]
2025-10-10T14:05:31.538401Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:31.538458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:31.538474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:31.538488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:31.538500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:31.538547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:31.538570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:31.538593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:31.540807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:31.540826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:31.540842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:31.540858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:31.540871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:31.542495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 512
2025-10-10T14:05:31.542607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 512
2025-10-10T14:05:31.542669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 512, pipe: [1:7559593979382586321:7619]
2025-10-10T14:05:31.544459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:31.544491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:31.544628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:31.544813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:31.545238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:31.545366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:31.545456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593979382586319:7737], now have 1 active actors on pipe
2025-10-10T14:05:31.545481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593979382586321:7619], now have 1 active actors on pipe
2025-10-10T14:05:31.545501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593979382586273:2442], now have 1 active actors on pipe
2025-10-10T14:05:31.545573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:31.545595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:31.545634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:31.545650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:31.545667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:31.545680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:31.545721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:31.545802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:31.546003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:31.546021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:31.546083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:31.546128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:31.546146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:31.546157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:31.546190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:31.546232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:31.546360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:31.546381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:31.546425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:31.552251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 513 partition: 0 MaxSeqNo: 36 sessionId: src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0
2025-10-10T14:05:31.547112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:31.547132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:31.547144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:31.547156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:31.547180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:31.549422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:31.549451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:31.549536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:31.552965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ad6e6c-6ba304b4-6976e91e-98e31fd8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:31.606538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0] Write session: try to update token
2025-10-10T14:05:31.606596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:31.638931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:31.638959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:31.638970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:31.798107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:31.798148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:31.798163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:31.798176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:31.798187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:31.798223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:31.798251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:31.798277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:31.798300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:31.798483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:31.798497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:31.798509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:31.801622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:31.801673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:31.801705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:31.801739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:31.849216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:31.849274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:31.849288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:31.850426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:31.886549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId: src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:31.922567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:32.063306Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:32.099890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:32.099924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:32.099967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593977804666222:6949]
2025-10-10T14:05:32.100118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:32.100143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:32.101568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:32.102944Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:32.103197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:32.103335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:32.103347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:32.109506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593979382586321:7619]
2025-10-10T14:05:32.123035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 513 reason: error at write: Disconnected sessionId: src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0
2025-10-10T14:05:32.123329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 513 sessionId: src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0 is DEAD
2025-10-10T14:05:32.125551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:32.125605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0] Write session will restart in 0.008589s
2025-10-10T14:05:32.125807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0] Write session: Do CDS request
2025-10-10T14:05:32.125865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:32.142682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:32.145300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:32.145330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 514
2025-10-10T14:05:32.145744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:32.145874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:32.145892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:32.145902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:32.154467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 514 sessionId:  describe result for acl check
2025-10-10T14:05:32.154626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:32.154638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:32.154649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:32.154666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593983677553679:7746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:32.157543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593983677553679:7746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:32.184980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593983677553679:7746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:32.202636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:32.207421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593983677553679:7746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:32.207465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593983677553679:7746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:32.207484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593983677553679:7746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:32.207517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:32.212828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593983677553745:7619]
2025-10-10T14:05:32.209331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:32.210239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:32.210260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:32.210304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:32.210592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:32.210785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593982099633649:6959]
2025-10-10T14:05:32.215751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:32.225892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:32.226227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:32.227742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:32.228126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:32.228135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:32.228143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:32.228151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:32.228160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:32.228168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:32.228176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:32.228183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:32.228191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:32.228200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:32.228209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:32.228217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:32.228272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:32.228397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:32.228454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:32.228512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:32.228566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:32.228623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:32.228681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:32.228737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:32.228791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:32.228843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:32.228896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:32.228950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:32.228998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:32.229074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:32.233479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:32.233597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:32.233681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:32.233748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:32.233807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:32.233872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:32.233957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:32.234026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:32.234088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:32.234153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:32.234209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:32.234285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:32.234346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:32.234407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:32.234464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:32.234524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:32.234578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:32.234641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:32.234694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:32.234755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:32.234843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:32.234909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:32.235442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:32.293449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
E1010 14:05:32.447415143  229155 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-10T14:05:32.487896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:32.487942Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:32.487959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:32.487978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:32.488000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 513 [2:7559593982099633649:6959]
2025-10-10T14:05:32.488052Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:32.488110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:32.488125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:32.488137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:32.488148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:32.488196Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:32.488218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:32.488256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:32.490047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:32.490075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:32.490089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:32.490102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:32.490114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:32.490387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:32.490405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:32.490558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:32.490759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:32.491007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:32.491140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:32.491211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593982099633644:6959]
2025-10-10T14:05:32.491226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593982099633644:6959]
2025-10-10T14:05:32.491241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593982099633644:6959]
2025-10-10T14:05:32.491254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593982099633644:6959]
2025-10-10T14:05:32.491296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:32.491379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:32.491566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:32.491583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:32.491705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593982099633644:6959]
2025-10-10T14:05:32.491724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:32.492558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:32.492580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:32.492592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:32.492605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:32.492629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:32.492980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 513, pipe: [1:7559593983677553745:7619]
2025-10-10T14:05:32.493098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 513
2025-10-10T14:05:32.493215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 513
2025-10-10T14:05:32.493996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593983677553745:7619], now have 1 active actors on pipe
2025-10-10T14:05:32.494030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593983677553743:7746], now have 1 active actors on pipe
2025-10-10T14:05:32.494056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593983677553663:2442], now have 1 active actors on pipe
2025-10-10T14:05:32.494102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:32.494123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:32.494229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:32.494259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:32.494276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:32.494286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:32.494320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:32.494360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:32.494411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:32.496849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:32.496885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:32.496957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:32.498289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 514 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0
2025-10-10T14:05:32.501342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c3a9df-e4eb2bfd-b20dce1a-9221c510_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:32.570857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0] Write session: try to update token
2025-10-10T14:05:32.570920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:32.591963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:32.591998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:32.592012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:32.675077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:32.675113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:32.675128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:32.675140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:32.675153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:32.675191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593982099633644:6959]
2025-10-10T14:05:32.675222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593982099633644:6959]
2025-10-10T14:05:32.675250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593982099633644:6959]
2025-10-10T14:05:32.675274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593982099633644:6959]
2025-10-10T14:05:32.675430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:32.675458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:32.675470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:32.675707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:32.675741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:32.675776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:32.675808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:32.682742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:32.785455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId: src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:32.830474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:32.928006Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:32.934558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:32.934603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:32.937916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593983677553745:7619]
2025-10-10T14:05:32.938032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:32.938046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:32.956437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:32.956482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0] Write session will restart in 0.006939s
2025-10-10T14:05:32.956584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0] Write session: Do CDS request
2025-10-10T14:05:32.956613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:32.954227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:32.955420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 514 reason: error at write: Disconnected sessionId: src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0
2025-10-10T14:05:32.955737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 514 sessionId: src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0 is DEAD
2025-10-10T14:05:32.990820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:33.006504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:33.047402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593987972521103:7619]
2025-10-10T14:05:33.047442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:33.047455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 515
2025-10-10T14:05:33.048088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:33.048231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:33.048250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:33.048262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:33.072095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 515 sessionId:  describe result for acl check
2025-10-10T14:05:33.072176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:33.072187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:33.072198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:33.072217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593987972521108:7759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:33.075054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593987972521108:7759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:33.089080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593987972521108:7759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:33.130368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593987972521108:7759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:33.130418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593987972521108:7759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:33.130437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593987972521108:7759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:33.130480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:33.151159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:33.155225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:33.156109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:33.156139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:33.156184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:33.156444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:33.156640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593986394601064:6964]
2025-10-10T14:05:33.158965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:33.160843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:33.161083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:33.162393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:33.162747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:33.162756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:33.162764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:33.162772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:33.162778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:33.162785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:33.162793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:33.162800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:33.162808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:33.162815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:33.162824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:33.162832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:33.162881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:33.162995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:33.163044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:33.163094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:33.163142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:33.163190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:33.163238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:33.163285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:33.163333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:33.163380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:33.163427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:33.163476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:33.163515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:33.163582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:33.163641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:33.163700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:33.163750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:33.163810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:33.163859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:33.163917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:33.163967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:33.164026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:33.164074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:33.164131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:33.164181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:33.164238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:33.164282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:33.164335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:33.164385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:33.164439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:33.164481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:33.164533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:33.164584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:33.164637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:33.164685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:33.164740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:33.166486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:33.221441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:33.264924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:33.264971Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:33.264989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:33.265006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:33.265028Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 514 [2:7559593986394601064:6964]
2025-10-10T14:05:33.265085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:33.265162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:33.265183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:33.265195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:33.265208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:33.265258Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:33.265281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:33.265304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:33.271577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:33.271616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:33.271632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:33.271646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:33.271658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:33.272108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:33.272139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:33.272290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:33.272504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:33.272756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:33.272879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:33.273185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 514
2025-10-10T14:05:33.272962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593983677553790:2442], now have 1 active actors on pipe
2025-10-10T14:05:33.272988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593987972521103:7619], now have 1 active actors on pipe
2025-10-10T14:05:33.273274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 514, pipe: [1:7559593987972521103:7619]
2025-10-10T14:05:33.273011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593987972521159:7759], now have 1 active actors on pipe
2025-10-10T14:05:33.273348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 514
2025-10-10T14:05:33.273036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.273051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.273066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.273080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.273112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:33.273222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:33.273410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:33.273428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:33.273481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:33.273509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:33.273521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:33.273532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:33.273558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.273581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:33.273601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:33.273749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:33.273787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:33.273863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:33.273899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:33.273918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:33.273928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:33.273991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:33.274032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:33.274081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:33.277584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:33.277622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:33.277697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:33.279712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 515 partition: 0 MaxSeqNo: 36 sessionId: src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0
2025-10-10T14:05:33.280433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c13f1e1-65e9d999-2401e425-ed58ac3f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:33.333965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0] Write session: try to update token
2025-10-10T14:05:33.334024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:33.369282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:33.369320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:33.369332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:33.543224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:33.543265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:33.543278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:33.543340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:33.543356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:33.543371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:33.543384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:33.543395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:33.543431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.543461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.543490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.543517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.543729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:33.543758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:33.543771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:33.544507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:33.544561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:33.544597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:33.544631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:33.544856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:33.578075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId: src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:33.623380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:33.842897Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:33.853756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:33.853811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:33.853890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:33.853906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:33.853965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593986394601058:6964]
2025-10-10T14:05:33.854269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:33.854650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:33.859084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:33.859349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593987972521103:7619]
2025-10-10T14:05:33.859441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:33.866597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 515 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0
2025-10-10T14:05:33.868474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:33.868517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0] Write session will restart in 0.009360s
2025-10-10T14:05:33.868621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0] Write session: Do CDS request
2025-10-10T14:05:33.868653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:33.873641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 515 sessionId: src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0 is DEAD
2025-10-10T14:05:33.888144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:33.890307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:33.890391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 516
2025-10-10T14:05:33.891314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:33.891589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:33.891625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:33.891650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:33.895652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 516 sessionId:  describe result for acl check
2025-10-10T14:05:33.895896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:33.895922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:33.895945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:33.895983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593987972521223:7767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:33.903078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593987972521223:7767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:33.916799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593987972521223:7767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:33.944103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593987972521223:7767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:33.944149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593987972521223:7767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:33.944182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593987972521223:7767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:33.944218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:33.961274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593987972521281:7619]
2025-10-10T14:05:34.000742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:34.007561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:34.008532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:34.008554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:34.008605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:34.008926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:34.009143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593990689568480:6979]
2025-10-10T14:05:34.012105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:34.013338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:34.013590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:34.015011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:34.015393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:34.015403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:34.015411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:34.015420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:34.015428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:34.015436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:34.015443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:34.015452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:34.015460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.015469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.015477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.015485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.015536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:34.015689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:34.015750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:34.015806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:34.015860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:34.015916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:34.015962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:34.016017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:34.016071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.016127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.016177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.016229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.016276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:34.016407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:34.016552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:34.016637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:34.016708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:34.016772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:34.016827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:34.016890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:34.016947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:34.017008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:34.017059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:34.018295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:34.018384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:34.018516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:34.018643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:34.018727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:34.018809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.018880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.018938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.018997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.019052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.019116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.019169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.019232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.019931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:34.058811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:34.139092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:34.139141Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:34.139162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:34.139184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:34.139211Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 515 [2:7559593990689568480:6979]
2025-10-10T14:05:34.139272Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:34.139339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:34.139357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:34.139370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:34.139383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:34.139433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:34.139455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:34.139478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:34.142192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.142222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.142236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.142252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.142263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:34.142556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:34.142577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.142738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.142939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.143190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.143318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:34.143395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.143411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.143425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.143438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.143482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:34.143572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:34.143771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:34.143790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:34.143928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.143949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:34.146683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 515, pipe: [1:7559593987972521281:7619]
2025-10-10T14:05:34.146795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 515
2025-10-10T14:05:34.146870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 515
2025-10-10T14:05:34.144651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:34.144674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:34.144687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:34.144699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:34.144724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:34.157485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593987972521281:7619], now have 1 active actors on pipe
2025-10-10T14:05:34.157544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593987972521264:7767], now have 1 active actors on pipe
2025-10-10T14:05:34.157568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593987972521216:2442], now have 1 active actors on pipe
2025-10-10T14:05:34.157649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:34.157674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:34.157783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:34.157821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:34.157840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:34.157851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:34.157896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:34.157959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:34.158014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:34.161314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:34.161370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:34.161453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:34.161903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 516 partition: 0 MaxSeqNo: 36 sessionId: src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0
2025-10-10T14:05:34.165000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16e91752-ba6c2eca-ae41e7ec-b71f5a83_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:34.213276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0] Write session: try to update token
2025-10-10T14:05:34.213339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:34.291108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:34.291140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:34.291154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:34.291278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:34.291296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:34.291332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:34.291344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:34.291357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:34.291395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.291423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.291451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.291476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.296238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:34.296291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:34.296329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:34.296363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:34.317887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:34.317955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.317968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:34.319038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:34.410728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId: src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:34.507335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:34.614162Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:34.615974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:34.615997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:34.616044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593986394601179:6979]
2025-10-10T14:05:34.616211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:34.616238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:34.618335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593987972521281:7619]
2025-10-10T14:05:34.618438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:34.618452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:34.625405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:34.616614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:34.628276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:34.682086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 516 reason: error at write: Disconnected sessionId: src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0
2025-10-10T14:05:34.682385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 516 sessionId: src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0 is DEAD
2025-10-10T14:05:34.687765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:34.687820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0] Write session will restart in 0.009880s
2025-10-10T14:05:34.688010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0] Write session: Do CDS request
2025-10-10T14:05:34.688059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:34.703235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:34.704896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:34.704926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 517
2025-10-10T14:05:34.705379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:34.705495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:34.705511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:34.705522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:34.707029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 517 sessionId:  describe result for acl check
2025-10-10T14:05:34.707156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:34.707168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:34.707184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:34.707204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593992267488683:7776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:34.712601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593992267488683:7776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:34.717567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593992267488690:7619]
2025-10-10T14:05:34.734042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:34.737686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593992267488683:7776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:34.747141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593992267488683:7776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:34.747181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593992267488683:7776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:34.747200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593992267488683:7776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:34.747231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:34.746062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:34.747053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:34.747073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:34.747121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:34.747402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:34.747590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593990689568589:6983]
2025-10-10T14:05:34.750243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:34.757684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:34.757995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:34.759420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:34.759793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:34.759801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:34.759808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:34.759816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:34.759823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:34.759831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:34.759842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:34.759850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:34.759861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.759869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.759876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.759884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.759936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:34.760051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:34.760106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:34.760159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:34.760208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:34.760254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:34.760301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:34.760349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:34.760398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.760449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.760499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.760545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.760590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:34.760661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:34.760724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:34.760780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:34.760830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:34.760887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:34.760938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:34.760994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:34.761045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:34.761103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:34.762054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:34.762135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:34.762197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:34.762259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:34.762311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:34.762372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:34.762429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.762488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.762538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.762598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.762648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.762708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.762764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.762824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.763348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:34.808735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:34.833272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:34.833324Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:34.833342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:34.833363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:34.833389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 516 [2:7559593990689568589:6983]
2025-10-10T14:05:34.833447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:34.833512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:34.833529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:34.833541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:34.833552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:34.833602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:34.833625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:34.833650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:34.840254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.840295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.840308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.840321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.840334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:34.840630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:34.840647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:34.840792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:34.840977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:34.842820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:34.842153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 516
2025-10-10T14:05:34.842285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 516
2025-10-10T14:05:34.842362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 516, pipe: [1:7559593992267488690:7619]
2025-10-10T14:05:34.842960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:34.843060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593992267488715:7776], now have 1 active actors on pipe
2025-10-10T14:05:34.843086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593992267488625:2442], now have 1 active actors on pipe
2025-10-10T14:05:34.843109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593992267488690:7619], now have 1 active actors on pipe
2025-10-10T14:05:34.843161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:34.843184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:34.843244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:34.843259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:34.843272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:34.843285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:34.843325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:34.843411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:34.843594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:34.843612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:34.843677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:34.843710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:34.843728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:34.843739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:34.843777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:34.843823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:34.843961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:34.843982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:34.844025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:34.845241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:34.845254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:34.845266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:34.845277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:34.845301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:34.849615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:34.849656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:34.849739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:34.851255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 517 partition: 0 MaxSeqNo: 36 sessionId: src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0
2025-10-10T14:05:34.852154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0623ef7-5cc8189b-229c1aaf-e4b0bbcf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:34.903701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0] Write session: try to update token
2025-10-10T14:05:34.903766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:34.933526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:34.933561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:34.933573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:35.073529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:35.073560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:35.073573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:35.073634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:35.073649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:35.073661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:35.073672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:35.073682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:35.073716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:35.073742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:35.073768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:35.073792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:35.074010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:35.074038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:35.074049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:35.074505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:35.074541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:35.074570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:35.074597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:35.122331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:35.232575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId: src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:35.264162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:35.486397Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:35.518699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:35.518739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:35.518793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:35.518808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:35.518845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593990689568584:6983]
2025-10-10T14:05:35.519568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:35.521166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:35.521194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:35.542470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:35.578245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:35.578287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0] Write session will restart in 0.006173s
2025-10-10T14:05:35.578396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0] Write session: Do CDS request
2025-10-10T14:05:35.578428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:35.574444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:35.574595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593992267488690:7619]
2025-10-10T14:05:35.574667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 517 reason: error at write: Disconnected sessionId: src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0
2025-10-10T14:05:35.574975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 517 sessionId: src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0 is DEAD
2025-10-10T14:05:35.591246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:35.620891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:35.620921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 518
2025-10-10T14:05:35.624505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:35.624640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:35.624657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:35.624667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:35.630500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 518 sessionId:  describe result for acl check
2025-10-10T14:05:35.630630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:35.630639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:35.630648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:35.630665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559593996562456092:7787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:35.636000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559593996562456092:7787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:35.655628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559593996562456092:7787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:35.671450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:35.674299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559593996562456092:7787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:35.674337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559593996562456092:7787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:35.674357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559593996562456092:7787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:35.674389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:35.675767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:35.676612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:35.676632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:35.676672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:35.676942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:35.677152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593994984536000:6993]
2025-10-10T14:05:35.679455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:35.681005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559593996562456144:7619]
2025-10-10T14:05:35.681789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:35.682097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:35.683426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:35.683769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:35.683778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:35.683786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:35.683793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:35.683800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:35.683808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:35.683815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:35.683822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:35.683830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:35.683837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:35.683845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:35.683853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:35.683901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:35.684013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:35.684063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:35.684113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:35.684156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:35.684206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:35.684255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:35.684306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:35.684359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:35.684409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:35.684456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:35.684503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:35.684543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:35.684612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:35.684671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:35.684732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:35.684782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:35.684843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:35.684892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:35.684946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:35.684997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:35.685050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:35.685099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:35.686216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:35.686294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:35.686356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:35.686408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:35.686464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:35.686514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:35.686571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:35.686618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:35.686674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:35.686722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:35.686781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:35.686831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:35.686884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:35.687379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:35.737503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:35.765420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:35.765465Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:35.765483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:35.765502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:35.765524Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 517 [2:7559593994984536000:6993]
2025-10-10T14:05:35.765585Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:35.765641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:35.765655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:35.765668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:35.765680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:35.765732Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:35.765755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:35.765777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:35.791238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:35.791271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:35.791283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:35.791294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:35.791305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:35.791586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:35.791605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:35.791755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:35.791945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:35.792183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:35.792304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:35.792376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:35.792392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:35.792405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:35.792419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:35.792463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:35.792542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:35.792730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:35.792747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:35.792866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:35.792884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:35.793215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:35.793228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:35.793239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:35.793252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:35.793275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:35.794775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 517
2025-10-10T14:05:35.794873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 517
2025-10-10T14:05:35.794973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 517, pipe: [1:7559593996562456144:7619]
2025-10-10T14:05:35.801264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593996562456144:7619], now have 1 active actors on pipe
2025-10-10T14:05:35.801320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593996562456065:2442], now have 1 active actors on pipe
2025-10-10T14:05:35.801344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559593996562456140:7787], now have 1 active actors on pipe
2025-10-10T14:05:35.801408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:35.801431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:35.801524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:35.801559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:35.801577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:35.801586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:35.801621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:35.801663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:35.801713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:35.808347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:35.808394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:35.808481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:35.809497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 518 partition: 0 MaxSeqNo: 36 sessionId: src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0
2025-10-10T14:05:35.810468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16924b45-f00d08b6-8b33c060-8b48dbfa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:35.890726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0] Write session: try to update token
2025-10-10T14:05:35.890790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0] Send 10 message(s) (0 left), first sequence number is 37
E1010 14:05:35.969147047  107557 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:05:35.978516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:35.978553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:35.978565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:35.978622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:35.978636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:35.978650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:35.978662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:35.978674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:35.978712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:35.978741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:35.978768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:35.978791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:35.979005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:35.979032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:35.979043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:35.980822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:35.980864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:35.980901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:35.980932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:35.981604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:35.984536Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:05:36.080812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId: src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:36.102069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:36.126971Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:36.151466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:36.151522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:36.151592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:36.151607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:36.151649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593994984535995:6993]
2025-10-10T14:05:36.151934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:36.152282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:36.153183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:36.153208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:36.157903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:36.158057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559593996562456144:7619]
2025-10-10T14:05:36.163786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 518 reason: error at write: Disconnected sessionId: src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0
2025-10-10T14:05:36.165517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:36.165554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0] Write session will restart in 0.006554s
2025-10-10T14:05:36.165649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0] Write session: Do CDS request
2025-10-10T14:05:36.165677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:36.168341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 518 sessionId: src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0 is DEAD
2025-10-10T14:05:36.178803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:36.178844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 519
2025-10-10T14:05:36.179273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:36.180102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:36.180401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:36.180448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:36.180467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:36.182333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 519 sessionId:  describe result for acl check
2025-10-10T14:05:36.182459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:36.182477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:36.182487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:36.182504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594000857423500:7796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:36.185183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594000857423500:7796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:36.196565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594000857423500:7796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:36.217221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:36.222261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:36.223163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:36.223183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:36.223229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:36.223508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:36.222448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594000857423500:7796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:36.222489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594000857423500:7796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:36.222508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594000857423500:7796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:36.222542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:36.223715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593999279503415:7002]
2025-10-10T14:05:36.226241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:36.227304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:36.227571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:36.228952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:36.229325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:36.229336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:36.229343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:36.229350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:36.229359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:36.229368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:36.229375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:36.229383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:36.229392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.229400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.229409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.229417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.229472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:36.229603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:36.229664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:36.229721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:36.229776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:36.229829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:36.229900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:36.229957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:36.230011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.230066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.230122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.230173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.230217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:36.230296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:36.230364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:36.230430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:36.230492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:36.230556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:36.230612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:36.231559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:36.231643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:36.231710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:36.231771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:36.231856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:36.231919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:36.231987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:36.232046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:36.232125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:36.232190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.232264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.232332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.232405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.232470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.232543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.232703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.232776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.233332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:36.261895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594000857423578:7619]
2025-10-10T14:05:36.263350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:36.278707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:36.278759Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:36.278778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:36.278800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:36.278823Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 518 [2:7559593999279503415:7002]
2025-10-10T14:05:36.278884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:36.278946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:36.278961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:36.278974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:36.278987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:36.279035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:36.279057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:36.279079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:36.280501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.280519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.280535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.280550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.280563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:36.280850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:36.280870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.281026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.281474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 518
2025-10-10T14:05:36.281563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 518
2025-10-10T14:05:36.281639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 518, pipe: [1:7559594000857423578:7619]
2025-10-10T14:05:36.281790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.282060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.282180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:36.282270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594000857423572:7796], now have 1 active actors on pipe
2025-10-10T14:05:36.282296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594000857423487:2442], now have 1 active actors on pipe
2025-10-10T14:05:36.282318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594000857423578:7619], now have 1 active actors on pipe
2025-10-10T14:05:36.282344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.282359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.282373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.282385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.282429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:36.282508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:36.282717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:36.282719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:36.282734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:36.282736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:36.282748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:36.282759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:36.282862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.282884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:36.282934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:36.282989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:36.283013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:36.283163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41f2853b-fd2d4367-abf686e1-580fd417_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:36.283195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:36.283212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:36.283223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:36.283258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:36.283296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:36.283367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:36.285739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:36.285778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:36.285880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:36.287156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|659a5b8c-41aee6fb-785f97cf-f772cc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|41f2853b-fd2d4367-abf686e1-580fd417_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:36.286393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 519 partition: 0 MaxSeqNo: 36 sessionId: src_id|41f2853b-fd2d4367-abf686e1-580fd417_0
2025-10-10T14:05:36.310262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f2853b-fd2d4367-abf686e1-580fd417_0] Write session: try to update token
2025-10-10T14:05:36.310319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f2853b-fd2d4367-abf686e1-580fd417_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:36.412093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId: src_id|41f2853b-fd2d4367-abf686e1-580fd417_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:36.444903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:36.444931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:36.444940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:36.444985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:36.444996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:36.445008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:36.445017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:36.445026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:36.445053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.445072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.445089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.445105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.445248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:36.445268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:36.445288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.445289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:36.445296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:36.445320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:36.445367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:36.446179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:36.459170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:36.635298Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:36.655550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:36.655608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:36.655695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:36.655711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:36.655756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593999279503410:7002]
2025-10-10T14:05:36.655902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:36.656427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:36.657540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:36.661371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594000857423578:7619]
2025-10-10T14:05:36.661480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:36.673275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 519 reason: status is not ok: tablet will be restarted right now sessionId: src_id|41f2853b-fd2d4367-abf686e1-580fd417_0
2025-10-10T14:05:36.673608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 519 sessionId: src_id|41f2853b-fd2d4367-abf686e1-580fd417_0 is DEAD
2025-10-10T14:05:36.680547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f2853b-fd2d4367-abf686e1-580fd417_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:36.680594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f2853b-fd2d4367-abf686e1-580fd417_0] Write session will restart in 0.008651s
2025-10-10T14:05:36.680712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f2853b-fd2d4367-abf686e1-580fd417_0] Write session: Do CDS request
2025-10-10T14:05:36.680746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f2853b-fd2d4367-abf686e1-580fd417_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:36.710030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f2853b-fd2d4367-abf686e1-580fd417_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:36.711679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:36.711720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 520
2025-10-10T14:05:36.726300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:36.726467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:36.726484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:36.726494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:36.727934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 520 sessionId:  describe result for acl check
2025-10-10T14:05:36.728047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:36.728059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:36.728071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:36.728088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594000857423628:7803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:36.731098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594000857423628:7803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:36.759421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:36.761486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594000857423664:7619]
2025-10-10T14:05:36.767040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594000857423628:7803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:36.769248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:36.770181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:36.770202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:36.770248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:36.770530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:36.770725Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559593999279503523:7006]
2025-10-10T14:05:36.775061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:36.779135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:36.779432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:36.780812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:36.781214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:36.781224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:36.781233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:36.781241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:36.781249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:36.781258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:36.781277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:36.781285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:36.781295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.781303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.781312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.781322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.781380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:36.781510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:36.781576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:36.781632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:36.781688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:36.781745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:36.781800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:36.781871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:36.781925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.781981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.782034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.782084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.782133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:36.782207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:36.782279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:36.782340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:36.782394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:36.782458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:36.782511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:36.782571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:36.782626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:36.782686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:36.782737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:36.782797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:36.782851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:36.782907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:36.782960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:36.783021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:36.783075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.783135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.783187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.783246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.783300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.783361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.783410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.783471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.783984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:36.799091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594000857423628:7803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:36.799131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594000857423628:7803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:36.799150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594000857423628:7803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:36.799182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:36.848507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:36.879816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:36.879865Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:36.879882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:36.879900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:36.879923Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 519 [2:7559593999279503523:7006]
2025-10-10T14:05:36.879980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:36.880033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:36.880048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:36.880061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:36.880071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:36.880125Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:36.880148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:36.880169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:36.886669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.886711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.886728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.886743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.886756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:36.887047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:36.887066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:36.887217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:36.887409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:36.887653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:36.887777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:36.887848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:36.887864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:36.887879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:36.887892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:36.887939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:36.888020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:36.888209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:36.888228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:36.888358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:36.888378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:36.888625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:36.888639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:36.888651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:36.888663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:36.888685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:36.890327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 519, pipe: [1:7559594000857423664:7619]
2025-10-10T14:05:36.890458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 519
2025-10-10T14:05:36.890547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 519
2025-10-10T14:05:36.892375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594000857423664:7619], now have 1 active actors on pipe
2025-10-10T14:05:36.892427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594000857423687:7803], now have 1 active actors on pipe
2025-10-10T14:05:36.892452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594000857423594:2442], now have 1 active actors on pipe
2025-10-10T14:05:36.894384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:36.894428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:36.894528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|346fd246-667f8b37-871f09b5-377e774d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:36.894563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:36.894582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:36.894595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:36.894632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:36.894677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:36.894731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:36.900428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:36.900477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:36.900563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:36.901528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 520 partition: 0 MaxSeqNo: 36 sessionId: src_id|346fd246-667f8b37-871f09b5-377e774d_0
2025-10-10T14:05:36.902661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f2853b-fd2d4367-abf686e1-580fd417_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|346fd246-667f8b37-871f09b5-377e774d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:36.981350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|346fd246-667f8b37-871f09b5-377e774d_0] Write session: try to update token
2025-10-10T14:05:36.981413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|346fd246-667f8b37-871f09b5-377e774d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:36.981689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:36.981722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:36.981735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:37.169855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:37.169911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:37.169930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:37.170132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:37.170160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:37.170186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:37.170210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:37.170232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:37.170279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:37.170330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:37.170366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:37.170408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:37.173333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:37.173390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:37.173424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:37.173456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:37.210824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:37.210868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:37.210876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:37.211913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:37.214408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId: src_id|346fd246-667f8b37-871f09b5-377e774d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:37.247119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:37.376439Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:37.379450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:37.379485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:37.379529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559593999279503516:7006]
2025-10-10T14:05:37.379679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:37.379706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:37.379928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:37.380899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:37.381978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:37.382021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:37.407481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:37.407613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 520 reason: error at write: Disconnected sessionId: src_id|346fd246-667f8b37-871f09b5-377e774d_0
2025-10-10T14:05:37.407915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 520 sessionId: src_id|346fd246-667f8b37-871f09b5-377e774d_0 is DEAD
2025-10-10T14:05:37.410149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346fd246-667f8b37-871f09b5-377e774d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:37.410208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346fd246-667f8b37-871f09b5-377e774d_0] Write session will restart in 0.007480s
2025-10-10T14:05:37.410309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346fd246-667f8b37-871f09b5-377e774d_0] Write session: Do CDS request
2025-10-10T14:05:37.410338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346fd246-667f8b37-871f09b5-377e774d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:37.424594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594000857423664:7619]
2025-10-10T14:05:37.432542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:37.432581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 521
2025-10-10T14:05:37.437294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|346fd246-667f8b37-871f09b5-377e774d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:37.441176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:37.441332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:37.441351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:37.441360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:37.444650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 521 sessionId:  describe result for acl check
2025-10-10T14:05:37.444841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:37.444863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:37.444885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:37.444913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594005152391054:7816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:37.447909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594005152391054:7816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:37.490591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594005152391054:7816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:37.509184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:37.513931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594005152391054:7816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:37.513978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594005152391054:7816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:37.513996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594005152391054:7816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:37.514029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:37.514254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:37.515151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:37.515169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:37.515212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:37.515485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:37.515670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594003574470946:7014]
2025-10-10T14:05:37.522167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:37.525382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594005152391120:7619]
2025-10-10T14:05:37.529871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:37.530158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:37.531571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:37.531944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:37.531954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:37.531963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:37.531970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:37.531978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:37.531985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:37.531993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:37.532001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:37.532007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:37.532014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:37.532021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:37.532027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:37.532082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:37.532206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:37.532261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:37.532313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:37.532361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:37.532413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:37.532466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:37.532515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:37.532565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:37.532618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:37.532671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:37.532722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:37.532768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:37.532843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:37.532909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:37.532975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:37.533029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:37.533089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:37.533983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:37.534068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:37.534128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:37.534187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:37.534240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:37.534301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:37.534355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:37.534414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:37.534466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:37.534524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:37.534576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:37.534634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:37.534685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:37.534746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:37.534797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:37.534854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:37.534904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:37.534962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:37.535466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:37.572679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:37.606443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:37.606493Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:37.606512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:37.606531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:37.606555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 520 [2:7559594003574470946:7014]
2025-10-10T14:05:37.606613Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:37.606672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:37.606687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:37.606700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:37.606712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:37.606762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:37.606785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:37.606806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:37.654828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:37.654857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:37.654868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:37.654879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:37.654889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:37.655163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:37.655178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:37.655323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:37.655503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:37.655718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:37.655833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:37.655903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.655919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.655932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.655946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.655978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:37.656055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:37.656243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:37.656259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:37.656381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.656401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:37.659123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 520
2025-10-10T14:05:37.659215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 520
2025-10-10T14:05:37.659288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 520, pipe: [1:7559594005152391120:7619]
2025-10-10T14:05:37.657204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:37.657230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:37.657242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:37.657254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:37.657281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:37.658897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594005152391116:7816], now have 1 active actors on pipe
2025-10-10T14:05:37.658929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594005152391032:2442], now have 1 active actors on pipe
2025-10-10T14:05:37.658954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594005152391120:7619], now have 1 active actors on pipe
2025-10-10T14:05:37.659654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:37.659686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:37.659791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|676cab38-917ce3d4-4f1b983f-74af7730_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:37.659834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:37.659853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:37.659865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:37.659903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:37.662973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 521 partition: 0 MaxSeqNo: 36 sessionId: src_id|676cab38-917ce3d4-4f1b983f-74af7730_0
2025-10-10T14:05:37.664289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|346fd246-667f8b37-871f09b5-377e774d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|676cab38-917ce3d4-4f1b983f-74af7730_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:37.659957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:37.660021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:37.661528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:37.661556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:37.661634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:37.696243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:37.696284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:37.696326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.696472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:37.697833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:37.708966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:37.710171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:37.711267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:37.712389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:37.714675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:37.715004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:37.715026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:37.715040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:37.715097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:37.717977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|676cab38-917ce3d4-4f1b983f-74af7730_0] Write session: try to update token
2025-10-10T14:05:37.718024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|676cab38-917ce3d4-4f1b983f-74af7730_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:37.868255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:37.868293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:37.868305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:37.868360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:37.868377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:37.868393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:37.868406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:37.868419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:37.868461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.868488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.868512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.868536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594003574470941:7014]
2025-10-10T14:05:37.868695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:37.868730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:37.868744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:37.869926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:37.869971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:37.870001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:37.870030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:37.870804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:37.889791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId: src_id|676cab38-917ce3d4-4f1b983f-74af7730_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:37.937033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:38.044053Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:38.045630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:38.045662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:38.047568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:38.047595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:38.049311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:38.049847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:38.049511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594005152391120:7619]
2025-10-10T14:05:38.103396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 521 reason: error at write: Disconnected sessionId: src_id|676cab38-917ce3d4-4f1b983f-74af7730_0
2025-10-10T14:05:38.103706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 521 sessionId: src_id|676cab38-917ce3d4-4f1b983f-74af7730_0 is DEAD
2025-10-10T14:05:38.107927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676cab38-917ce3d4-4f1b983f-74af7730_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:38.107974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676cab38-917ce3d4-4f1b983f-74af7730_0] Write session will restart in 0.008132s
2025-10-10T14:05:38.108084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676cab38-917ce3d4-4f1b983f-74af7730_0] Write session: Do CDS request
2025-10-10T14:05:38.108115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676cab38-917ce3d4-4f1b983f-74af7730_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:38.124002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:38.124032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 522
2025-10-10T14:05:38.124686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|676cab38-917ce3d4-4f1b983f-74af7730_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:38.125345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:38.125495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:38.125514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:38.125524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:38.126825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 522 sessionId:  describe result for acl check
2025-10-10T14:05:38.126923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:38.126940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:38.126949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:38.126965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594009447358522:7824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:38.128741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594009447358522:7824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:38.130339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:38.137548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:38.138396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:38.138415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:38.138460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:38.138730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:38.138917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594007869438360:7025]
2025-10-10T14:05:38.141537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:38.142607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594009447358522:7824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:38.143822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:38.144082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:38.145383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:38.145704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:38.145712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:38.145719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:38.145726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:38.145733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:38.145740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:38.145746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:38.145753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:38.145760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.145766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.145774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.145780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.145843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:38.145955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:38.146005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:38.146054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:38.146098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:38.146150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:38.146193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:38.146240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:38.146286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.146330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.146378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.146424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.146464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:38.146532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:38.146589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:38.146647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:38.146701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:38.146739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:38.146770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:38.146806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:38.146838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:38.146874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:38.146904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:38.146940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:38.146970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:38.147008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:38.147040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:38.147078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:38.147111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.147148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.147178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.147214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.147248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.147284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.147314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.147351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.147646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:38.150267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594009447358553:7619]
2025-10-10T14:05:38.156630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594009447358522:7824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:38.156671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594009447358522:7824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:38.156691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594009447358522:7824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:38.156722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:38.179361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:38.195729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:38.195780Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:38.195800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:38.195821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:38.195847Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 521 [2:7559594007869438360:7025]
2025-10-10T14:05:38.195907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:38.195971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:38.195989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:38.196004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:38.196017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:38.196065Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:38.196088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:38.196112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:38.199878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.199910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.199927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.199944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.199957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:38.200201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:38.200227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.200387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.200606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.200872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.201008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:38.201083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.201103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.201118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.201146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.201192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:38.201281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:38.201478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:38.201503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:38.201612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:38.201638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.201646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:38.201659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:38.201663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:38.201672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:38.201700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:38.201719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594009447358553:7619], now have 1 active actors on pipe
2025-10-10T14:05:38.201745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594009447358464:2442], now have 1 active actors on pipe
2025-10-10T14:05:38.202985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 521, pipe: [1:7559594009447358553:7619]
2025-10-10T14:05:38.203095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 521
2025-10-10T14:05:38.203183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 521
2025-10-10T14:05:38.205068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594009447358558:7824], now have 1 active actors on pipe
2025-10-10T14:05:38.205177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:38.205206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:38.205293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5c1629c-686981fc-880c2184-6aeb5434_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:38.205328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:38.205348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:38.205361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:38.205403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:38.205454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:38.205502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:38.209102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:38.209161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:38.209240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:38.209879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 522 partition: 0 MaxSeqNo: 36 sessionId: src_id|d5c1629c-686981fc-880c2184-6aeb5434_0
2025-10-10T14:05:38.210758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|676cab38-917ce3d4-4f1b983f-74af7730_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d5c1629c-686981fc-880c2184-6aeb5434_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:38.291374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c1629c-686981fc-880c2184-6aeb5434_0] Write session: try to update token
2025-10-10T14:05:38.291442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c1629c-686981fc-880c2184-6aeb5434_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:38.378867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:38.378901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:38.378950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.379072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:38.379087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:38.379099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:38.379229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:38.381047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:38.382468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:38.382663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:38.384273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:38.386764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:38.388394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:38.468285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:38.468451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:38.468467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:38.468482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:38.468494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:38.468505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:38.468557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.468584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.468608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.468631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594007869438355:7025]
2025-10-10T14:05:38.468774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:38.468802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.468813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:38.469840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:38.470893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:38.470930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:38.470966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:38.470999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:38.483442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId: src_id|d5c1629c-686981fc-880c2184-6aeb5434_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:38.550446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:38.672652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:38.677115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:38.677193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:38.677946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:38.680385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:38.682569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594009447358553:7619]
2025-10-10T14:05:38.682762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:38.692518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 522 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d5c1629c-686981fc-880c2184-6aeb5434_0
2025-10-10T14:05:38.692803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 522 sessionId: src_id|d5c1629c-686981fc-880c2184-6aeb5434_0 is DEAD
2025-10-10T14:05:38.693302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c1629c-686981fc-880c2184-6aeb5434_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:38.693361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c1629c-686981fc-880c2184-6aeb5434_0] Write session will restart in 0.005030s
2025-10-10T14:05:38.693515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c1629c-686981fc-880c2184-6aeb5434_0] Write session: Do CDS request
2025-10-10T14:05:38.693555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c1629c-686981fc-880c2184-6aeb5434_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:38.709730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:38.709758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 523
2025-10-10T14:05:38.716837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c1629c-686981fc-880c2184-6aeb5434_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:38.717744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:38.718078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:38.718126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:38.718151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:38.726427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 523 sessionId:  describe result for acl check
2025-10-10T14:05:38.726558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:38.726570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:38.726580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:38.726596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594009447358604:7830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:38.733619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594009447358604:7830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:38.756465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594009447358604:7830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:38.766555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:38.771311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:38.772157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:38.772174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:38.772219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:38.772497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:38.772684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594007869438485:7035]
2025-10-10T14:05:38.774933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:38.776982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:38.777230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:38.778443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:38.778756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:38.778764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:38.778772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:38.778779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:38.778786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:38.778794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:38.778802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:38.778810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:38.778817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.778824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.778831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.778838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.778883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:38.778985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:38.779034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:38.779080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:38.779128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:38.779175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:38.779219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:38.779262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:38.779307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.779354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.779400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.779445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.779488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:38.779554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:38.779610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:38.779661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:38.779710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:38.779764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:38.779811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:38.779863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:38.779909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:38.779962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:38.780006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:38.780057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:38.780107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:38.780162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:38.780209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:38.780265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:38.780316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.780368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.780413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.780465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.780513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.780565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.780613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.780668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.782646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:38.781238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594009447358681:7619]
2025-10-10T14:05:38.782364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594009447358604:7830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:38.782390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594009447358604:7830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:38.782408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594009447358604:7830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:38.782436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:38.818722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:38.856933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:38.857465Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:38.857493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:38.857513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:38.857536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 522 [2:7559594007869438485:7035]
2025-10-10T14:05:38.857592Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:38.857648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:38.857663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:38.857677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:38.857688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:38.857734Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:38.857754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:38.857790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:38.869287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.869320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.869336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.869350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.869360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:38.869649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:38.869667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:38.869838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:38.870301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:38.870556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:38.870683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:38.870759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594007869438479:7035]
2025-10-10T14:05:38.870776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594007869438479:7035]
2025-10-10T14:05:38.870790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594007869438479:7035]
2025-10-10T14:05:38.870803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594007869438479:7035]
2025-10-10T14:05:38.870834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:38.870921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:38.871007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:38.871022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:38.871034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:38.871048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:38.871108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:38.871126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:38.871281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594009447358681:7619], now have 1 active actors on pipe
2025-10-10T14:05:38.871306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594009447358589:2442], now have 1 active actors on pipe
2025-10-10T14:05:38.871331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594009447358684:7830], now have 1 active actors on pipe
2025-10-10T14:05:38.871353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594007869438479:7035]
2025-10-10T14:05:38.871388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:38.871982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 522, pipe: [1:7559594009447358681:7619]
2025-10-10T14:05:38.872090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 522
2025-10-10T14:05:38.872175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 522
2025-10-10T14:05:38.872059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:38.872921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:38.872954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:38.873035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:38.873069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:38.873087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:38.873098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:38.873157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:38.873203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:38.873255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:38.877319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:38.877367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:38.877458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:38.880639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 523 partition: 0 MaxSeqNo: 36 sessionId: src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0
2025-10-10T14:05:38.883875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c1629c-686981fc-880c2184-6aeb5434_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:38.968523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0] Write session: try to update token
2025-10-10T14:05:38.968578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:39.018024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:39.018054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:39.018063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:39.018112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:39.018125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:39.018137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:39.018146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:39.018156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:39.018186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594007869438479:7035]
2025-10-10T14:05:39.018210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594007869438479:7035]
2025-10-10T14:05:39.018229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594007869438479:7035]
2025-10-10T14:05:39.018249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594007869438479:7035]
2025-10-10T14:05:39.018404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:39.018427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:39.018437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:39.019797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:39.019842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:39.019874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:39.019903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:39.045720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:39.213225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId: src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:39.275946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:39.289838Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:39.297660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:39.297707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:39.302828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594009447358681:7619]
2025-10-10T14:05:39.302901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:39.303015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:39.303027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:39.306055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:39.412334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594013742326082:7619]
2025-10-10T14:05:39.412426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 523 reason: error at write: Disconnected sessionId: src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0
2025-10-10T14:05:39.412710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 523 sessionId: src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0 is DEAD
2025-10-10T14:05:39.416047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:39.416086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0] Write session will restart in 0.005049s
2025-10-10T14:05:39.416186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0] Write session: Do CDS request
2025-10-10T14:05:39.416215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:39.418440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:39.428894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:39.436789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:39.436822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 524
2025-10-10T14:05:39.437454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:39.437576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:39.437591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:39.437600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:39.438741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:39.439653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:39.439685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:39.439727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:39.439986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:39.440346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594012164405899:7042]
2025-10-10T14:05:39.442670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:39.444233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 524 sessionId:  describe result for acl check
2025-10-10T14:05:39.444358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:39.444369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:39.444379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:39.444395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594013742326090:7843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:39.447092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594013742326090:7843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:39.448444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:39.448809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:39.450223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:39.450586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:39.450596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:39.450604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:39.450612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:39.450620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:39.450628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:39.450636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:39.450644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:39.450651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:39.450659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:39.450666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:39.450675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:39.450727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:39.450851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:39.450908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:39.450962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:39.451010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:39.451060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:39.451110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:39.451160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:39.451208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:39.451260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:39.451310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:39.451359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:39.451402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:39.451475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:39.451539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:39.451603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:39.451659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:39.451721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:39.451773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:39.451833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:39.451886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:39.451949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:39.452002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:39.453215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:39.453291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:39.453355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:39.453406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:39.453463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:39.453517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:39.453573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:39.453622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:39.453679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:39.453731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:39.453804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:39.453852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:39.453906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:39.454393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:39.467805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594013742326090:7843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:39.492702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594013742326090:7843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:39.492741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594013742326090:7843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:39.492762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594013742326090:7843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:39.492795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:39.506594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:39.544956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:39.546159Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:39.546191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:39.546210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:39.546231Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 523 [2:7559594012164405899:7042]
2025-10-10T14:05:39.546287Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:39.546338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:39.546353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:39.546364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:39.546375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:39.546419Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:39.546441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:39.546463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:39.548614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:39.548630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:39.548646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:39.548660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:39.548672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:39.548932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:39.548951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:39.549099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:39.551817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 523, pipe: [1:7559594013742326082:7619]
2025-10-10T14:05:39.551912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 523
2025-10-10T14:05:39.551992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 523
2025-10-10T14:05:39.550706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:39.550952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:39.551072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:39.551158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594013742326024:2442], now have 1 active actors on pipe
2025-10-10T14:05:39.551181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594013742326122:7843], now have 1 active actors on pipe
2025-10-10T14:05:39.551202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594013742326082:7619], now have 1 active actors on pipe
2025-10-10T14:05:39.551225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.551239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.551253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.551267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.551306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:39.551387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:39.551600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:39.551616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:39.551734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.551756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:39.552020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:39.552034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:39.552046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:39.552058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:39.552082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:39.561229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:39.561273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:39.561356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:39.561389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:39.561408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:39.561419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:39.561457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:39.561503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:39.561550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:39.568505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 524 partition: 0 MaxSeqNo: 36 sessionId: src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0
2025-10-10T14:05:39.567006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:39.567056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:39.567139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:39.569637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c10e0f3-ccf36085-c623b729-1150ca19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:39.595990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0] Write session: try to update token
2025-10-10T14:05:39.596051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:39.623581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:39.623615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:39.623655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.623778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:39.625692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:39.626880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:39.628295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:39.631115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:39.650074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:39.652077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:39.652457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:39.652471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:39.652484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:39.652536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:39.749946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:39.749978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:39.749991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:39.819835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:39.819870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:39.819882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:39.819893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:39.819902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:39.819944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.819970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.819993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.820017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594012164405892:7042]
2025-10-10T14:05:39.820172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:39.820542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:39.820563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:39.821333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:39.821366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:39.821393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:39.821418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:39.821807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:39.845237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId: src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:39.881545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:40.077102Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:40.079429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:40.079473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:40.080729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:40.087728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:40.088015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:40.089272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594013742326082:7619]
2025-10-10T14:05:40.196255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:40.196345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0] Write session will restart in 0.008144s
2025-10-10T14:05:40.196565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0] Write session: Do CDS request
2025-10-10T14:05:40.196639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:40.195257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 524 reason: status is not ok: tablet will be restarted right now sessionId: src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0
2025-10-10T14:05:40.195613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 524 sessionId: src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0 is DEAD
2025-10-10T14:05:40.205579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594018037293487:7619]
2025-10-10T14:05:40.212503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:40.212542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 525
2025-10-10T14:05:40.216872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:40.218061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:40.218210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:40.218226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:40.218236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:40.219638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 525 sessionId:  describe result for acl check
2025-10-10T14:05:40.219751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:40.219762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:40.219773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:40.219789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594018037293508:7851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:40.236142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594018037293508:7851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:40.259504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594018037293508:7851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:40.284229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594018037293508:7851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:40.284272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594018037293508:7851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:40.284292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594018037293508:7851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:40.284328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:40.343350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:40.362597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:40.363759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:40.363786Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:40.363835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:40.364136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:40.364344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594016459373333:7048]
2025-10-10T14:05:40.366730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:40.372165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:40.372597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:40.374099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:40.374499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:40.374509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:40.374518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:40.374525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:40.374533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:40.374541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:40.374550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:40.374558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:40.374565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:40.374573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:40.374580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:40.374587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:40.374645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:40.374770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:40.374826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:40.374880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:40.374931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:40.374987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:40.375040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:40.375092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:40.375145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:40.375203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:40.375257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:40.375309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:40.375358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:40.375438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:40.375511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:40.375575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:40.375630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:40.375693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:40.375749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:40.375810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:40.375866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:40.375928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:40.375981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:40.376044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:40.376097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:40.376155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:40.376205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:40.376261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:40.376312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:40.376370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:40.376421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:40.376481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:40.376536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:40.376594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:40.376645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:40.376704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:40.391751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:40.441158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:40.483688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:40.483736Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:40.483754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:40.483774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:40.483797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 524 [2:7559594016459373333:7048]
2025-10-10T14:05:40.483852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:40.483907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:40.483922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:40.483934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:40.483946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:40.490110Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:40.490153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:40.490176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:40.562222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:40.562268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:40.562283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:40.562299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:40.562311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:40.562609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:40.562626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:40.562778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:40.562989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:40.563230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:40.563350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:40.563425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:40.563440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:40.563454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:40.563468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:40.563516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:40.563604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:40.563788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:40.563808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:40.563936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:40.563960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:40.564838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:40.564857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:40.564869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:40.564880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:40.564903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:40.565708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594018037293541:7851], now have 1 active actors on pipe
2025-10-10T14:05:40.565758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594018037293452:2442], now have 1 active actors on pipe
2025-10-10T14:05:40.565783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594018037293487:7619], now have 1 active actors on pipe
2025-10-10T14:05:40.569294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 524
2025-10-10T14:05:40.569396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 524
2025-10-10T14:05:40.569460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 524, pipe: [1:7559594018037293487:7619]
2025-10-10T14:05:40.570062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:40.570101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:40.570204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6007c221-64b67c13-93762558-7afd543d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:40.570240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:40.570259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:40.570271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:40.570320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:40.570362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:40.570412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:40.582265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:40.582312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:40.582395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:40.582956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 525 partition: 0 MaxSeqNo: 36 sessionId: src_id|6007c221-64b67c13-93762558-7afd543d_0
2025-10-10T14:05:40.584662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|596eaf23-2641c612-2089c0f7-fe8bb88f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6007c221-64b67c13-93762558-7afd543d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:40.592446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:40.592474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:40.592489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:40.635767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007c221-64b67c13-93762558-7afd543d_0] Write session: try to update token
2025-10-10T14:05:40.635824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007c221-64b67c13-93762558-7afd543d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:40.791572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:40.791592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:40.791600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:40.791647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:40.791661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:40.791671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:40.791679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:40.791687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:40.791711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:40.791730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:40.791747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:40.791762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:40.791923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:40.791943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:40.791949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:40.794278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:40.794323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:40.794353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:40.794383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:40.805622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:40.838324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId: src_id|6007c221-64b67c13-93762558-7afd543d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:40.898743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:41.102572Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:41.127028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:41.127084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:41.127165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:41.127182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:41.127234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594016459373328:7048]
2025-10-10T14:05:41.127838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:41.130807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:41.133967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:41.133992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:41.167694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 525 reason: error at write: Disconnected sessionId: src_id|6007c221-64b67c13-93762558-7afd543d_0
2025-10-10T14:05:41.168025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 525 sessionId: src_id|6007c221-64b67c13-93762558-7afd543d_0 is DEAD
2025-10-10T14:05:41.170284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007c221-64b67c13-93762558-7afd543d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:41.170322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007c221-64b67c13-93762558-7afd543d_0] Write session will restart in 0.007444s
2025-10-10T14:05:41.170431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007c221-64b67c13-93762558-7afd543d_0] Write session: Do CDS request
2025-10-10T14:05:41.170460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007c221-64b67c13-93762558-7afd543d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:41.197955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007c221-64b67c13-93762558-7afd543d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:41.235209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:41.250482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594018037293487:7619]
2025-10-10T14:05:41.250675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:41.250690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 526
2025-10-10T14:05:41.255624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:41.255789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:41.255807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:41.255817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:41.266708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 526 sessionId:  describe result for acl check
2025-10-10T14:05:41.266847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:41.266858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:41.266868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:41.266886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594022332260950:7864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:41.270001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594022332260950:7864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:41.296107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:41.303177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594022332260950:7864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:41.314638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:41.315669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:41.315688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:41.315736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:41.316156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:41.316606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594020754340760:7063]
2025-10-10T14:05:41.319814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:41.326664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:41.326952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:41.328390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:41.328796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:41.328808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:41.328815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:41.328824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:41.328832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:41.328840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:41.328849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:41.328859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:41.328866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:41.328875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:41.328883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:41.328892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:41.328951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:41.329085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:41.329168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:41.329227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:41.329282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:41.329337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:41.329393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:41.329449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:41.329499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:41.329555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:41.329613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:41.329670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:41.329730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:41.329808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:41.329879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:41.329946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:41.330005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:41.330072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:41.330129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:41.330193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:41.330253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:41.330317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:41.330374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:41.330439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:41.330496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:41.330563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:41.330615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:41.330677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:41.330737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:41.330796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:41.330858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:41.330923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:41.330976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:41.331039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:41.331095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:41.331161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:41.341212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:41.359088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594022332260994:7619]
2025-10-10T14:05:41.415640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594022332260950:7864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:41.415687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594022332260950:7864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:41.415706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594022332260950:7864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:41.415739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:41.502285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:41.530879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:41.530942Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:41.530964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:41.530987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:41.531014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 525 [2:7559594020754340760:7063]
2025-10-10T14:05:41.531078Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:41.531148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:41.531164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:41.531178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:41.531190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:41.531243Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:41.531267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:41.531289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:41.532685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:41.532704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:41.532720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:41.532736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:41.532749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:41.534554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 525, pipe: [1:7559594022332260994:7619]
2025-10-10T14:05:41.534659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 525
2025-10-10T14:05:41.534740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 525
2025-10-10T14:05:41.535219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:41.535249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:41.535428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:41.535636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:41.535891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:41.536031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:41.536079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594022332260994:7619], now have 1 active actors on pipe
2025-10-10T14:05:41.536105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594022332260935:2442], now have 1 active actors on pipe
2025-10-10T14:05:41.536130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594022332261009:7864], now have 1 active actors on pipe
2025-10-10T14:05:41.536232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:41.536257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:41.536297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.536314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.536328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.536342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.536381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:41.536465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:41.536658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:41.536675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:41.536751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66864dbf-9b814791-28590e60-22d78ace_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:41.536815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:41.536834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:41.536846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:41.536881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:41.536924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:41.537075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.537100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:41.537159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:41.537817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:41.537835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:41.537862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:41.537876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:41.537903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:41.539693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:41.539725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:41.539814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:41.541140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 526 partition: 0 MaxSeqNo: 36 sessionId: src_id|66864dbf-9b814791-28590e60-22d78ace_0
2025-10-10T14:05:41.542011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007c221-64b67c13-93762558-7afd543d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66864dbf-9b814791-28590e60-22d78ace_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:41.581200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66864dbf-9b814791-28590e60-22d78ace_0] Write session: try to update token
2025-10-10T14:05:41.581260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66864dbf-9b814791-28590e60-22d78ace_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:41.615527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:41.615562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:41.615605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.615739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:41.616223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:41.635001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:41.636178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:41.644261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:41.645571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:41.646890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:41.647155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:41.647164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:41.647172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:41.647216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:41.792489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:41.792514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:41.792525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:41.793356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId: src_id|66864dbf-9b814791-28590e60-22d78ace_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:41.826028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:41.838782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:41.838809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:41.838823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:41.838834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:41.838844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:41.838881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.838907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.838930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.838954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594020754340754:7063]
2025-10-10T14:05:41.839156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:41.839183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:41.839218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:41.839247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:41.839260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:41.840156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:41.840192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:41.840224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:41.840254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:41.841246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:42.014502Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:42.030779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:42.035574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:42.040604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594022332260994:7619]
2025-10-10T14:05:42.040754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:42.122147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66864dbf-9b814791-28590e60-22d78ace_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:42.122224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66864dbf-9b814791-28590e60-22d78ace_0] Write session will restart in 0.009986s
2025-10-10T14:05:42.122442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66864dbf-9b814791-28590e60-22d78ace_0] Write session: Do CDS request
2025-10-10T14:05:42.122486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66864dbf-9b814791-28590e60-22d78ace_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:42.121247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 526 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66864dbf-9b814791-28590e60-22d78ace_0
2025-10-10T14:05:42.121612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 526 sessionId: src_id|66864dbf-9b814791-28590e60-22d78ace_0 is DEAD
2025-10-10T14:05:42.142157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66864dbf-9b814791-28590e60-22d78ace_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:42.148554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594026627228391:7619]
2025-10-10T14:05:42.148647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:42.148683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 527
2025-10-10T14:05:42.149515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:42.149655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:42.149690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:42.149702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:42.154775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 527 sessionId:  describe result for acl check
2025-10-10T14:05:42.154913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:42.154925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:42.154937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:42.154955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594026627228403:7876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:42.158104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594026627228403:7876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:42.198194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:42.200560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:42.201574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:42.201605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:42.201658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:42.201996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:42.202209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594025049308193:7075]
2025-10-10T14:05:42.208159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594026627228403:7876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:42.224032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:42.227445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:42.227714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:42.229225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:42.229590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:42.229599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:42.229607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:42.229615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:42.229623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:42.229631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:42.229639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:42.229647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:42.229655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.229663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.229686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.229695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.229750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:42.229874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:42.229932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:42.229987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:42.230040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:42.234309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594026627228403:7876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:42.234354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594026627228403:7876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:42.234374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594026627228403:7876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:42.234423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:42.236207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:42.236284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:42.236336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:42.236388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.236446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.236513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.236564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.236618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:42.236689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:42.236756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:42.236815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:42.236870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:42.236928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:42.236994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:42.237055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:42.237109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:42.237181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:42.237232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:42.237296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:42.237347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:42.237407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:42.237459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:42.237522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:42.237575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.237636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.237702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.237768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.237818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.237880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.237927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.237983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.238479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:42.383596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:42.402113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:42.402161Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:42.402179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:42.402200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:42.402224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 526 [2:7559594025049308193:7075]
2025-10-10T14:05:42.402284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:42.402344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:42.402360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:42.402372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:42.402383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:42.402430Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:42.402454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:42.402477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:42.406582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.406605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.406619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.406635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.406646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:42.406971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:42.406988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.407135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.407333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.407581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.407700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:42.407787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594026627228391:7619], now have 1 active actors on pipe
2025-10-10T14:05:42.407811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594026627228439:7876], now have 1 active actors on pipe
2025-10-10T14:05:42.407835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594026627228343:2442], now have 1 active actors on pipe
2025-10-10T14:05:42.408528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 526, pipe: [1:7559594026627228391:7619]
2025-10-10T14:05:42.407862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594025049308188:7075]
2025-10-10T14:05:42.407880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594025049308188:7075]
2025-10-10T14:05:42.408633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 526
2025-10-10T14:05:42.408703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 526
2025-10-10T14:05:42.407893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594025049308188:7075]
2025-10-10T14:05:42.407910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594025049308188:7075]
2025-10-10T14:05:42.407955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:42.408038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:42.408244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:42.408263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:42.408389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594025049308188:7075]
2025-10-10T14:05:42.408409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:42.408526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:42.408541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:42.408554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:42.408567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:42.408592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:42.410924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:42.410962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:42.411075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:42.411107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:42.411125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:42.411137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:42.411175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:42.411219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:42.411273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:42.414707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:42.414749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:42.414835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:42.419700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 527 partition: 0 MaxSeqNo: 36 sessionId: src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0
2025-10-10T14:05:42.424681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66864dbf-9b814791-28590e60-22d78ace_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:42.472528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0] Write session: try to update token
2025-10-10T14:05:42.472587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:42.571912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:42.571944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:42.571958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:42.572016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:42.572033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:42.572048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:42.572061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:42.572073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:42.572114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594025049308188:7075]
2025-10-10T14:05:42.572142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594025049308188:7075]
2025-10-10T14:05:42.572169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594025049308188:7075]
2025-10-10T14:05:42.572194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594025049308188:7075]
2025-10-10T14:05:42.572356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:42.572386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.572399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:42.572578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:42.572615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:42.572649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:42.572681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:42.573984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:42.693498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId: src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:42.723063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:42.755234Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:42.758104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:42.758143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:42.763704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594026627228391:7619]
2025-10-10T14:05:42.763812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:42.763824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:42.771321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:42.846751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 527 reason: error at write: Disconnected sessionId: src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0
2025-10-10T14:05:42.847113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 527 sessionId: src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0 is DEAD
2025-10-10T14:05:42.850030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:42.850071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0] Write session will restart in 0.007028s
2025-10-10T14:05:42.850169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0] Write session: Do CDS request
2025-10-10T14:05:42.850198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:42.864492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:42.870620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:42.871323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:42.871460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594026627228548:7619]
2025-10-10T14:05:42.871526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:42.871540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 528
2025-10-10T14:05:42.872159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:42.872296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:42.872312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:42.872321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:42.874119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 528 sessionId:  describe result for acl check
2025-10-10T14:05:42.874242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:42.874255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:42.874265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:42.874283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594026627228553:7888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:42.876989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594026627228553:7888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:42.877445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:42.878378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:42.878397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:42.878445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:42.878735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:42.878924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594025049308316:7082]
2025-10-10T14:05:42.881462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:42.886959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594026627228553:7888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:42.889551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:42.889937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:42.891393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:42.891720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:42.891730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:42.891738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:42.891745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:42.891753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:42.891760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:42.891768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:42.891778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:42.891784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.891792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.891800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.891808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.891858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:42.891979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:42.892036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:42.892088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:42.892137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:42.892192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:42.892242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:42.892294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:42.892345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.892395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.892444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.892496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.892537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:42.892611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:42.892674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:42.892733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:42.892790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:42.892851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:42.892906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:42.892966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:42.893018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:42.893077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:42.896421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:42.896533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:42.896600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:42.896662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:42.896718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:42.896782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:42.896839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.896905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.896962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.897025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.897081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.897159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.897213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.897274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.897807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:42.897669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594026627228553:7888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:42.897712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594026627228553:7888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:42.897730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594026627228553:7888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:42.897765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:42.935016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:42.948669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:42.948713Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:42.948731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:42.948751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:42.948773Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 527 [2:7559594025049308316:7082]
2025-10-10T14:05:42.948829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:42.948890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:42.948905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:42.948919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:42.948931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:42.948978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:42.949003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:42.949027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:42.951511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.951535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.951551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.951566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.951578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:42.951852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:42.951874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:42.952020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:42.952207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:42.952439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:42.952559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:42.952649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594026627228583:7888], now have 1 active actors on pipe
2025-10-10T14:05:42.952682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594026627228547:2442], now have 1 active actors on pipe
2025-10-10T14:05:42.952706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594026627228548:7619], now have 1 active actors on pipe
2025-10-10T14:05:42.952729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:42.952744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:42.952759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:42.952774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:42.952810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:42.952891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:42.953077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:42.953095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:42.953177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:42.953191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:42.953203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:42.953216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:42.953363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:42.953389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:42.953565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:42.954733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 527, pipe: [1:7559594026627228548:7619]
2025-10-10T14:05:42.954851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 527
2025-10-10T14:05:42.954933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 527
2025-10-10T14:05:42.955556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:42.955592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:42.955694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb9dd03-86a038ef-a24056b-c59059d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:42.955737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:42.955755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:42.955767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:42.955802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:42.955845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:42.955897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:42.957338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 528 partition: 0 MaxSeqNo: 36 sessionId: src_id|fb9dd03-86a038ef-a24056b-c59059d_0
2025-10-10T14:05:42.958331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68ec0bb-dab52f6f-fd376185-839aacbc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fb9dd03-86a038ef-a24056b-c59059d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:42.956836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:42.956879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:42.956955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:43.028117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9dd03-86a038ef-a24056b-c59059d_0] Write session: try to update token
2025-10-10T14:05:43.028184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9dd03-86a038ef-a24056b-c59059d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:43.048305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:43.048339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:43.048354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:43.261317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId: src_id|fb9dd03-86a038ef-a24056b-c59059d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:43.288368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:43.300398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:43.300428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:43.300441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:43.300496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:43.300509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:43.300522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:43.300533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:43.300544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:43.300579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:43.300604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:43.300628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:43.300651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:43.300900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:43.300939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:43.300974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:43.301000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:43.301013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:43.301306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:43.301350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:43.301381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:43.301413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:43.303177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:43.484959Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:43.539148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:43.539176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:43.539221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594025049308309:7082]
2025-10-10T14:05:43.539557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:43.540244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:43.540944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594026627228548:7619]
2025-10-10T14:05:43.541034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:43.541046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:43.545343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:43.553386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 528 reason: error at write: Disconnected sessionId: src_id|fb9dd03-86a038ef-a24056b-c59059d_0
2025-10-10T14:05:43.553719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 528 sessionId: src_id|fb9dd03-86a038ef-a24056b-c59059d_0 is DEAD
2025-10-10T14:05:43.559849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9dd03-86a038ef-a24056b-c59059d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:43.559907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9dd03-86a038ef-a24056b-c59059d_0] Write session will restart in 0.006513s
2025-10-10T14:05:43.560016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9dd03-86a038ef-a24056b-c59059d_0] Write session: Do CDS request
2025-10-10T14:05:43.560051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9dd03-86a038ef-a24056b-c59059d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:43.575180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9dd03-86a038ef-a24056b-c59059d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:43.596613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:43.596645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 529
2025-10-10T14:05:43.597415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:43.597555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:43.597572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:43.597583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:43.600686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 529 sessionId:  describe result for acl check
2025-10-10T14:05:43.600812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:43.600822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:43.600830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:43.600848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594030922195942:7898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:43.603636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594030922195942:7898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:43.636627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594030922195942:7898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:43.637571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594030922196013:7619]
2025-10-10T14:05:43.647902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:43.652859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:43.653721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:43.653743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:43.653779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:43.654002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:43.654134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594029344275738:7088]
2025-10-10T14:05:43.655773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:43.657876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:43.658071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:43.659376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:43.659714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:43.659723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:43.659730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:43.659738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:43.659745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:43.659753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:43.659761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:43.659768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:43.659776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:43.659783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:43.659790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:43.659797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:43.659899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:43.660015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:43.660065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:43.660111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:43.660158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:43.660207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:43.660254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:43.660300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:43.660366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:43.660416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:43.660460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:43.660523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:43.660568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:43.660636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:43.660700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:43.660756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:43.660828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:43.660884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:43.660946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:43.661004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:43.661052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:43.661106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:43.661204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:43.661263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:43.661317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:43.661373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:43.661420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:43.661475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:43.661525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:43.661585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:43.661675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:43.661732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:43.661781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:43.661837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:43.661886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:43.661944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:43.662446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:43.665982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594030922195942:7898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:43.666029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594030922195942:7898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:43.666046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594030922195942:7898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:43.666076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:43.725984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:43.760587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:43.760632Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:43.760648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:43.760669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:43.760691Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 528 [2:7559594029344275738:7088]
2025-10-10T14:05:43.760745Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:43.760803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:43.760818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:43.760832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:43.760843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:43.760891Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:43.760913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:43.760934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:43.763386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:43.767187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:43.767217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:43.767232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:43.767244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:43.767734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:43.767759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:43.767906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:43.768095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:43.768330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:43.768451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:43.768522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594029344275732:7088]
2025-10-10T14:05:43.768535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594029344275732:7088]
2025-10-10T14:05:43.768548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594029344275732:7088]
2025-10-10T14:05:43.768561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594029344275732:7088]
2025-10-10T14:05:43.768602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:43.768679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:43.768859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:43.768876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:43.768992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594029344275732:7088]
2025-10-10T14:05:43.769012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:43.769214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:43.769228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:43.769241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:43.769254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:43.769278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:43.772471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 528, pipe: [1:7559594030922196013:7619]
2025-10-10T14:05:43.772609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 528
2025-10-10T14:05:43.772684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 528
2025-10-10T14:05:43.777597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594030922196025:7898], now have 1 active actors on pipe
2025-10-10T14:05:43.777654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594030922195926:2442], now have 1 active actors on pipe
2025-10-10T14:05:43.777679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594030922196013:7619], now have 1 active actors on pipe
2025-10-10T14:05:43.777734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:43.777757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:43.777849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:43.777881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:43.777900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:43.777912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:43.777949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:43.777991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:43.778040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:43.778854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:43.778957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:43.779028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:43.779367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 529 partition: 0 MaxSeqNo: 36 sessionId: src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0
2025-10-10T14:05:43.781390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb9dd03-86a038ef-a24056b-c59059d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:43.860704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:43.860732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:43.860743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:43.865341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0] Write session: try to update token
2025-10-10T14:05:43.865402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:43.972736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:43.972769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:43.972780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:43.972836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:43.972850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:43.972864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:43.972875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:43.972886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:43.972920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594029344275732:7088]
2025-10-10T14:05:43.972946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594029344275732:7088]
2025-10-10T14:05:43.972968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594029344275732:7088]
2025-10-10T14:05:43.972989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594029344275732:7088]
2025-10-10T14:05:43.973103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:43.973144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:43.973171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:43.973199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:43.974719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:43.974786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:43.974804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:43.995355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:44.093225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId: src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:44.119105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:44.185169Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:44.187059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:44.187089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:44.195151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:44.195179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:44.197307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:44.197468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594030922196013:7619]
2025-10-10T14:05:44.203741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 529 reason: error at write: Disconnected sessionId: src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0
2025-10-10T14:05:44.204097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 529 sessionId: src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0 is DEAD
2025-10-10T14:05:44.209390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:44.209436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0] Write session will restart in 0.006598s
2025-10-10T14:05:44.209544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0] Write session: Do CDS request
2025-10-10T14:05:44.209575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:44.220747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:44.220284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:44.220329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 530
2025-10-10T14:05:44.221409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:44.221557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:44.221582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:44.221593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:44.223534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 530 sessionId:  describe result for acl check
2025-10-10T14:05:44.223655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:44.223666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:44.223675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:44.223692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594035217163358:7903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:44.226351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594035217163358:7903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:44.260784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594035217163358:7903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:44.278447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:44.301692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594035217163435:7619]
2025-10-10T14:05:44.304948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:44.305938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:44.306808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:44.306828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:44.306876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:44.307145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:44.307326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594033639243183:7103]
2025-10-10T14:05:44.311016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594035217163358:7903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:44.311061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594035217163358:7903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:44.311077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594035217163358:7903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:44.311108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:44.313359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:44.314509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:44.314731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:44.316019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:44.316337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:44.316344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:44.316351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:44.316357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:44.316364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:44.316370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:44.316376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:44.316382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:44.316389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:44.316394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:44.316401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:44.316407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:44.316454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:44.316558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:44.316601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:44.316644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:44.316690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:44.316732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:44.316775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:44.316816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:44.316857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:44.316902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:44.316945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:44.316990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:44.317027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:44.317093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:44.317176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:44.317229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:44.318069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:44.318136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:44.318185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:44.318236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:44.318283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:44.318332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:44.318379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:44.318428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:44.318472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:44.318525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:44.318569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:44.318619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:44.318664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:44.318714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:44.318758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:44.318809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:44.318856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:44.318905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:44.318949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:44.319014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:44.319430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:44.355222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:44.370299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:44.370346Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:44.370368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:44.370389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:44.370416Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 529 [2:7559594033639243183:7103]
2025-10-10T14:05:44.370473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:44.370543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:44.370560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:44.370572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:44.370585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:44.370635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:44.370658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:44.370681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:44.400423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:44.400450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:44.400462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:44.400474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:44.400485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:44.400749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:44.400765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:44.400884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:44.401039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:44.402699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 529
2025-10-10T14:05:44.402777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 529
2025-10-10T14:05:44.402839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 529, pipe: [1:7559594035217163435:7619]
2025-10-10T14:05:44.403335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:44.403456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:44.403565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594035217163440:7903], now have 1 active actors on pipe
2025-10-10T14:05:44.403587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594035217163346:2442], now have 1 active actors on pipe
2025-10-10T14:05:44.403606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594035217163435:7619], now have 1 active actors on pipe
2025-10-10T14:05:44.403647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:44.403671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:44.403723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:44.403738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:44.403751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:44.403762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:44.403793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:44.403876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:44.404043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:44.404059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:44.404122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:44.404153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:44.404169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:44.404180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:44.404217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:44.404263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:44.404404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:44.404421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:44.404458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:44.406013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:44.406033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:44.406046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:44.406058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:44.406080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:44.410120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 530 partition: 0 MaxSeqNo: 36 sessionId: src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0
2025-10-10T14:05:44.410979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a9b9ae9-8670bdc-adee0d94-8900f399_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:44.409538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:44.409567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:44.409652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:44.468844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0] Write session: try to update token
2025-10-10T14:05:44.468903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:44.469368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:44.469405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:44.469416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:44.620710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:44.620743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:44.620753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:44.620869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:44.620882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:44.620894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:44.620902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:44.620911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:44.620949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:44.620972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:44.620995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:44.621015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:44.621310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:44.621357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:44.621392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:44.621426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:44.664005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:44.664053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:44.664064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:44.665776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:44.719155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId: src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:44.746057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:45.028591Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:45.037151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:45.037185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:45.037236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594033639243177:7103]
2025-10-10T14:05:45.037400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:45.037423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:45.037800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:45.039242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:45.043137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594035217163435:7619]
2025-10-10T14:05:45.043320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:45.043344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:45.135223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:45.150175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594039512130809:7619]
2025-10-10T14:05:45.150697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 530 reason: error at write: Disconnected sessionId: src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0
2025-10-10T14:05:45.151064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 530 sessionId: src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0 is DEAD
2025-10-10T14:05:45.155679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:45.155713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0] Write session will restart in 0.006379s
2025-10-10T14:05:45.155820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0] Write session: Do CDS request
2025-10-10T14:05:45.155850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:45.169846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:45.170483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:45.170515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 531
2025-10-10T14:05:45.174403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:45.174554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:45.174572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:45.174583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:45.180070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 531 sessionId:  describe result for acl check
2025-10-10T14:05:45.180206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:45.180215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:45.180225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:45.180242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594039512130866:7916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:45.194366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594039512130866:7916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:45.195777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:45.203542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:45.204440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:45.204460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:45.204511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:45.204783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:45.204981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594037934210611:7106]
2025-10-10T14:05:45.207234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:45.209243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594039512130866:7916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:45.213566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:45.213831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:45.215063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:45.215387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:45.215394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:45.215401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:45.215408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:45.215415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:45.215421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:45.215428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:45.215435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:45.215441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:45.215447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:45.215453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:45.215460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:45.215504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:45.215611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:45.215660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:45.215703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:45.215745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:45.215790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:45.215834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:45.215877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:45.215920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:45.215967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:45.216011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:45.216056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:45.216097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:45.216158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:45.216214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:45.216265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:45.216312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:45.216364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:45.216408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:45.216458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:45.216505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:45.216556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:45.216598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:45.216653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:45.216703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:45.216754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:45.216797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:45.216848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:45.216898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:45.216951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:45.216997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:45.217048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:45.217092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:45.220688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594039512130866:7916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:45.220730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594039512130866:7916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:45.220747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594039512130866:7916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:45.220778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:45.229297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:45.229387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:45.229452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:45.229925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:45.277931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:45.295046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:45.295092Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:45.295107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:45.295126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:45.295152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 530 [2:7559594037934210611:7106]
2025-10-10T14:05:45.295205Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:45.295269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:45.295285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:45.295298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:45.295311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:45.295362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:45.295385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:45.295407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:45.314282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:45.314313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:45.314327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:45.314340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:45.314352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:45.314661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:45.314680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:45.314831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:45.315032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:45.315261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:45.315400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:45.315481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.315498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.315512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.315525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.315568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:45.315653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:45.315837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:45.315853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:45.315995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.316017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:45.317044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:45.317064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:45.317075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:45.317086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:45.317112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:45.319681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594039512130809:7619], now have 1 active actors on pipe
2025-10-10T14:05:45.319717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594039512130898:7916], now have 1 active actors on pipe
2025-10-10T14:05:45.319750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594039512130798:2442], now have 1 active actors on pipe
2025-10-10T14:05:45.322911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:45.322953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:45.323056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:45.323094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:45.323115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:45.323126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:45.323171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:45.323219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:45.323271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:45.321347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 530, pipe: [1:7559594039512130809:7619]
2025-10-10T14:05:45.321472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 530
2025-10-10T14:05:45.321549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 530
2025-10-10T14:05:45.330529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:45.330575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:45.330655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:45.333793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73926678-9f78cdd7-57adcb73-b02ca24e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:45.331135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 531 partition: 0 MaxSeqNo: 36 sessionId: src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0
2025-10-10T14:05:45.381317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:45.381346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:45.381358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:45.386549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0] Write session: try to update token
2025-10-10T14:05:45.386606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:45.554111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:45.554150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:45.554162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:45.554281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:45.554297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:45.554315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:45.554328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:45.554342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:45.554381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.554412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.554439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.554463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.555501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:45.555546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:45.555582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:45.555616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:45.597875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:45.597918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:45.597932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:45.599086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:45.667607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId: src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:45.727024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:45.858086Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:45.860781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:45.860810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:45.860858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594037934210603:7106]
2025-10-10T14:05:45.861031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:45.861061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:45.861335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:45.862414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:45.864840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:45.864989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594039512130809:7619]
2025-10-10T14:05:45.865076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:45.893011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 531 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0
2025-10-10T14:05:45.896103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:45.896152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0] Write session will restart in 0.008227s
2025-10-10T14:05:45.896261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0] Write session: Do CDS request
2025-10-10T14:05:45.896293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:45.893421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 531 sessionId: src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0 is DEAD
2025-10-10T14:05:45.914553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:45.914587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 532
2025-10-10T14:05:45.917474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:45.918159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:45.918312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:45.918328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:45.918341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:45.920370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 532 sessionId:  describe result for acl check
2025-10-10T14:05:45.920500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:45.920510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:45.920521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:45.920538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594039512130948:7925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:45.923925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594039512130948:7925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:45.947609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594039512130948:7925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:45.968506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594039512130948:7925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:45.968549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594039512130948:7925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:45.968567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594039512130948:7925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:45.968599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:45.969282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594039512130978:7619]
2025-10-10T14:05:46.062883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:46.070935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:46.071870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:46.071890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:46.071940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:46.072218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:46.072417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594042229178044:7118]
2025-10-10T14:05:46.074735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:46.079346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:46.079604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:46.080904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:46.081262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:46.081271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:46.081278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:46.081285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:46.081293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:46.081300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:46.081308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:46.081314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:46.081320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:46.081327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:46.081334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:46.081341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:46.081386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:46.081485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:46.081529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:46.081586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:46.081632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:46.081675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:46.081714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:46.081753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:46.081794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:46.081837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:46.081881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:46.081924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:46.081966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:46.082027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:46.082083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:46.082132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:46.082177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:46.082224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:46.082266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:46.082318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:46.082364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:46.082411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:46.082453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:46.082498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:46.082543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:46.082592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:46.082634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:46.082685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:46.082733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:46.082800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:46.082839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:46.082886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:46.082931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:46.082979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:46.083021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:46.083069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:46.083468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:46.157277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:46.236578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:46.236627Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:46.236645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:46.236666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:46.236692Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 531 [2:7559594042229178044:7118]
2025-10-10T14:05:46.236752Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:46.236821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:46.236838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:46.236853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:46.236868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:46.236919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:46.236941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:46.236967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:46.242363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:46.242390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:46.242405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:46.242417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:46.242427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:46.242727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:46.242744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:46.242881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:46.243059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:46.243276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:46.243408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:46.243493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.243509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.243523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.243536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.243581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:46.243667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:46.243839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:46.243855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:46.243991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.244011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:46.244792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:46.244809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:46.244819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:46.244831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:46.244854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:46.248388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594039512130977:7925], now have 1 active actors on pipe
2025-10-10T14:05:46.248436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594039512130978:7619], now have 1 active actors on pipe
2025-10-10T14:05:46.248461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594039512130937:2442], now have 1 active actors on pipe
2025-10-10T14:05:46.253156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 531
2025-10-10T14:05:46.253261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 531, pipe: [1:7559594039512130978:7619]
2025-10-10T14:05:46.253348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 531
2025-10-10T14:05:46.257003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:46.257049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:46.257174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b0e196-7cb21fcc-3617119c-88881e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:46.257212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:46.257232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:46.257244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:46.257283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:46.257329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:46.257381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:46.262147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:46.262205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:46.262294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:46.266926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bffd4fb-603331c0-335ae668-5fad07c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b0e196-7cb21fcc-3617119c-88881e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:46.266096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 532 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b0e196-7cb21fcc-3617119c-88881e3_0
2025-10-10T14:05:46.337597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:46.337635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:46.337649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:46.397822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0e196-7cb21fcc-3617119c-88881e3_0] Write session: try to update token
2025-10-10T14:05:46.397886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0e196-7cb21fcc-3617119c-88881e3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:46.594948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:46.594978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:46.594990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:46.595049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:46.595064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:46.595076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:46.595087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:46.595099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:46.595134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.595160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.595182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.595202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.595401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:46.595426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:46.595437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:46.595542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:46.595568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:46.595596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:46.595622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:46.602807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:46.643547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId: src_id|4b0e196-7cb21fcc-3617119c-88881e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:46.666971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:46.784373Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:46.808899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:46.808952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:46.809039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:46.809053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:46.809093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594042229178038:7118]
2025-10-10T14:05:46.809359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:46.810144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:46.813594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:46.813620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:46.824169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 532 reason: error at write: Disconnected sessionId: src_id|4b0e196-7cb21fcc-3617119c-88881e3_0
2025-10-10T14:05:46.824774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 532 sessionId: src_id|4b0e196-7cb21fcc-3617119c-88881e3_0 is DEAD
2025-10-10T14:05:46.830062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0e196-7cb21fcc-3617119c-88881e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:46.830092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0e196-7cb21fcc-3617119c-88881e3_0] Write session will restart in 0.006226s
2025-10-10T14:05:46.830186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0e196-7cb21fcc-3617119c-88881e3_0] Write session: Do CDS request
2025-10-10T14:05:46.830215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0e196-7cb21fcc-3617119c-88881e3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:46.847502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0e196-7cb21fcc-3617119c-88881e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:46.850607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594039512130978:7619]
2025-10-10T14:05:46.850760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:46.869775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:46.869815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 533
2025-10-10T14:05:46.871244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:46.871376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:46.871394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:46.871411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:46.884579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 533 sessionId:  describe result for acl check
2025-10-10T14:05:46.884884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:46.884912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:46.884945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:46.884995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594043807098403:7940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:46.909265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594043807098403:7940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:46.925922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594043807098403:7940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:46.950635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594043807098403:7940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:46.950678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594043807098403:7940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:46.950700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594043807098403:7940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:46.950735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:46.953984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594043807098489:7619]
2025-10-10T14:05:46.983362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:46.998049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:46.999018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:46.999038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:46.999084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:46.999361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:46.999553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594042229178174:7126]
2025-10-10T14:05:47.006035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:47.017548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:47.017841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:47.019231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:47.019623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:47.019631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:47.019637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:47.019644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:47.019651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:47.019658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:47.019663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:47.019669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:47.019677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:47.019683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:47.019690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:47.019698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:47.019746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:47.019852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:47.019900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:47.019948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:47.019995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:47.020045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:47.020096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:47.020140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:47.020187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:47.020246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:47.020300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:47.020353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:47.020405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:47.020483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:47.020555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:47.020623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:47.020681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:47.020743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:47.020798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:47.020859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:47.020918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:47.020973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:47.021022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:47.021075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:47.024175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:47.024288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:47.024349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:47.024407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:47.024462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:47.024514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:47.024576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:47.024639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:47.024688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:47.024742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:47.024789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:47.024845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:47.025326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:47.129372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:47.255674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:47.255723Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:47.255740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:47.255763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:47.255791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 532 [2:7559594042229178174:7126]
2025-10-10T14:05:47.255847Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:47.255911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:47.255927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:47.255940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:47.255953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:47.256006Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:47.256030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:47.256053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:47.266396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:47.266428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:47.266443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:47.266459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:47.266471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:47.266790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:47.266811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:47.266978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:47.267176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:47.267421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:47.267541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:47.267625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.267642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.267656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.267669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.267706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:47.267796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:47.267998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:47.268017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:47.268160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.268184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:47.269312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:47.269327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:47.269339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:47.269351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:47.269379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:47.271752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 532
2025-10-10T14:05:47.271833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 532, pipe: [1:7559594043807098489:7619]
2025-10-10T14:05:47.271906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 532
2025-10-10T14:05:47.283844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594043807098487:7940], now have 1 active actors on pipe
2025-10-10T14:05:47.283884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594043807098489:7619], now have 1 active actors on pipe
2025-10-10T14:05:47.283906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594043807098387:2442], now have 1 active actors on pipe
2025-10-10T14:05:47.283967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:47.283992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:47.284089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:47.284130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:47.284147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:47.284159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:47.284196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:47.284243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:47.284292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:47.293654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:47.293697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:47.293785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:47.294666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 533 partition: 0 MaxSeqNo: 36 sessionId: src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0
2025-10-10T14:05:47.298485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b0e196-7cb21fcc-3617119c-88881e3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:47.360756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0] Write session: try to update token
2025-10-10T14:05:47.360825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:47.531654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:47.531690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:47.531701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:47.531758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:47.531771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:47.531808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.531932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:47.533321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:47.533872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:47.574320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:47.575691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:47.576980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:47.594704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:47.595252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:47.666446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:47.666475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:47.666487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:47.666540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:47.666554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:47.666567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:47.666579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:47.666589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:47.666628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.666656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.666679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.666704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594042229178166:7126]
2025-10-10T14:05:47.666839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:47.666866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:47.666878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:47.667943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:47.669415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:47.669456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:47.669494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:47.669549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:47.785275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId: src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:47.835732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:48.065829Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:48.123206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:48.123252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:48.124342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:48.124503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:48.124514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:48.127345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:48.196326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 533 reason: error at write: Disconnected sessionId: src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0
2025-10-10T14:05:48.201579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:48.201619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0] Write session will restart in 0.007798s
2025-10-10T14:05:48.201710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0] Write session: Do CDS request
2025-10-10T14:05:48.201739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:48.196780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 533 sessionId: src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0 is DEAD
2025-10-10T14:05:48.220833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:48.223230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594043807098489:7619]
2025-10-10T14:05:48.225736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:48.225763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 534
2025-10-10T14:05:48.226162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:48.226288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:48.226304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:48.226315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:48.227774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 534 sessionId:  describe result for acl check
2025-10-10T14:05:48.227886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:48.227896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:48.227904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:48.227921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594052397033206:7957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:48.230493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594052397033206:7957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:48.250094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:48.255143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594052397033206:7957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:48.261469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:48.262330Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:48.262347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:48.262391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:48.262643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:48.262823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594050819112919:7139]
2025-10-10T14:05:48.264791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:48.269863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:48.270154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:48.271445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:48.271789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:48.271798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:48.271804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:48.271811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:48.271818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:48.271824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:48.271830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:48.271836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:48.271842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.271849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.271856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.271861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.271905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:48.272007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:48.272051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:48.272095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:48.272137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:48.272184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:48.272226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:48.272270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:48.272314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.272380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.272423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.272462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.272503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:48.272565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:48.272620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:48.272671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:48.272716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:48.272764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:48.272806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:48.272855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:48.272901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:48.272947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:48.272988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:48.273039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:48.273084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:48.271667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594052397033206:7957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:48.271713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594052397033206:7957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:48.271732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594052397033206:7957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:48.271765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:48.277307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:48.277417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:48.277512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:48.277575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.277635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.277692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.277743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.277790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.277842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.277885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.277934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.278361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:48.308622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:48.330175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594052397033248:7619]
2025-10-10T14:05:48.330891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:48.330928Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:48.330944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:48.330962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:48.330984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 533 [2:7559594050819112919:7139]
2025-10-10T14:05:48.331038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:48.331095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:48.331110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:48.331122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:48.331132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:48.331182Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:48.331205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:48.331227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:48.332554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.332569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.332582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.332597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.332607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:48.332865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:48.332881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.333015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.333206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.341764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.341892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:48.341995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594052397033143:2442], now have 1 active actors on pipe
2025-10-10T14:05:48.342019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594052397033244:7957], now have 1 active actors on pipe
2025-10-10T14:05:48.342046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594050819112914:7139]
2025-10-10T14:05:48.342062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594050819112914:7139]
2025-10-10T14:05:48.342074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594050819112914:7139]
2025-10-10T14:05:48.342086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594050819112914:7139]
2025-10-10T14:05:48.342124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:48.342206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:48.342375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:48.342391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:48.342533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594050819112914:7139]
2025-10-10T14:05:48.342554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:48.343023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:48.343041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:48.343054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:48.343064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:48.343086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:48.399324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 533
2025-10-10T14:05:48.399499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 533
2025-10-10T14:05:48.401696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:48.401737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:48.401837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:48.401876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:48.401897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:48.401907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:48.401947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:48.401995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:48.402046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:48.409611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:48.409654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:48.409710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594052397033248:7619], now have 1 active actors on pipe
2025-10-10T14:05:48.409765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:48.410186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 533, pipe: [1:7559594052397033248:7619]
2025-10-10T14:05:48.410334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 534 partition: 0 MaxSeqNo: 36 sessionId: src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0
2025-10-10T14:05:48.413657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beb28bf-8e7b57e0-c96d4926-81a01f34_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:48.437259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:48.437290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:48.437301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:48.487857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0] Write session: try to update token
2025-10-10T14:05:48.487923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:48.508672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:48.508706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:48.508719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:48.508733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:48.508746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:48.508784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594050819112914:7139]
2025-10-10T14:05:48.508814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594050819112914:7139]
2025-10-10T14:05:48.508842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594050819112914:7139]
2025-10-10T14:05:48.508869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594050819112914:7139]
2025-10-10T14:05:48.509024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:48.509054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.509066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:48.509273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:48.509316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:48.509348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:48.509386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:48.514801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:48.653418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId: src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:48.696933Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:48.699196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:48.700565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:48.700827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594052397033248:7619]
2025-10-10T14:05:48.700954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:48.700977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:48.714250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:48.714296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0] Write session will restart in 0.007611s
2025-10-10T14:05:48.714407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0] Write session: Do CDS request
2025-10-10T14:05:48.714439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:48.709442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 534 reason: error at write: Disconnected sessionId: src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0
2025-10-10T14:05:48.709782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 534 sessionId: src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0 is DEAD
2025-10-10T14:05:48.728730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:48.729900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:48.729932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 535
2025-10-10T14:05:48.730237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:48.730352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:48.730368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:48.730378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:48.732545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 535 sessionId:  describe result for acl check
2025-10-10T14:05:48.732684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:48.732696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:48.732706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:48.732722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594052397033301:7966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:48.747008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594052397033301:7966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:48.766195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594052397033301:7966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:48.798285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594052397033301:7966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:48.798327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594052397033301:7966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:48.798346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594052397033301:7966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:48.798377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:48.799461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594052397033392:7619]
2025-10-10T14:05:48.820166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:48.835990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:48.836976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:48.836997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:48.837045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:48.837379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:48.837593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594050819113050:7149]
2025-10-10T14:05:48.843788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:48.850510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:48.850814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:48.852018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:48.852276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:48.852281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:48.852287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:48.852292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:48.852298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:48.852302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:48.852308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:48.852313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:48.852318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.852322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.852327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.852333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.852371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:48.852481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:48.852536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:48.852591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:48.852646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:48.852703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:48.852754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:48.852808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:48.852859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.852917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.852970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.853023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.857319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:48.857450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:48.857559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:48.857632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:48.857699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:48.857772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:48.857832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:48.857899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:48.857964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:48.858036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:48.858095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:48.858158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:48.858216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:48.858287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:48.858351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:48.858412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:48.858468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.858531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.858583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.858656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.858717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.858781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.858839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.858905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.859500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:48.891341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:48.908579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:48.908799Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:48.908825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:48.908849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:48.908874Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 534 [2:7559594050819113050:7149]
2025-10-10T14:05:48.908942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:48.909011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:48.909028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:48.909044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:48.909059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:48.909113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:48.909155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:48.909180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:48.910634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.910654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.910672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.910689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.910701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:48.911084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:48.911108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:48.911289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:48.911521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:48.912203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 534
2025-10-10T14:05:48.912315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 534
2025-10-10T14:05:48.912381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 534, pipe: [1:7559594052397033392:7619]
2025-10-10T14:05:48.912785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:48.912962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:48.913067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594052397033287:2442], now have 1 active actors on pipe
2025-10-10T14:05:48.913096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594052397033390:7966], now have 1 active actors on pipe
2025-10-10T14:05:48.913139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594052397033392:7619], now have 1 active actors on pipe
2025-10-10T14:05:48.913214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:48.913239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:48.913283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594050819113045:7149]
2025-10-10T14:05:48.913301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594050819113045:7149]
2025-10-10T14:05:48.913318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594050819113045:7149]
2025-10-10T14:05:48.913335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594050819113045:7149]
2025-10-10T14:05:48.913379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:48.913415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:48.913440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:48.913453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:48.913477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:48.913484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:48.913715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:48.913732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:48.913805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:48.913835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:48.913858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:48.913871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:48.913918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:48.913960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:48.914103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594050819113045:7149]
2025-10-10T14:05:48.914142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:48.914168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:48.914204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:48.915787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:48.915834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:48.915927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:48.916284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 535 partition: 0 MaxSeqNo: 36 sessionId: src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0
2025-10-10T14:05:48.917298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4129ea44-3e578b46-a39f184f-ae5e1b9d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:48.968256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0] Write session: try to update token
2025-10-10T14:05:48.968507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:49.051176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:49.051208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:49.051221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:49.051282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:49.051301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:49.051316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:49.051330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:49.051343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:49.051387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594050819113045:7149]
2025-10-10T14:05:49.051419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594050819113045:7149]
2025-10-10T14:05:49.051449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594050819113045:7149]
2025-10-10T14:05:49.051474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594050819113045:7149]
2025-10-10T14:05:49.051641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:49.051673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.051687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:49.054220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:49.054270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:49.054305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:49.054337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:49.061938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:49.171201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId: src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:49.200450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:49.222204Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:49.225286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:49.225328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:49.230806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:49.230830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:49.231991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:49.232183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594052397033392:7619]
2025-10-10T14:05:49.238831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 535 reason: error at write: Disconnected sessionId: src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0
2025-10-10T14:05:49.239191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 535 sessionId: src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0 is DEAD
2025-10-10T14:05:49.247290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:49.247332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0] Write session will restart in 0.007638s
2025-10-10T14:05:49.247437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0] Write session: Do CDS request
2025-10-10T14:05:49.247475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:49.262487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:49.262532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 536
2025-10-10T14:05:49.264024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:49.262719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:49.265604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:49.265846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:49.265878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:49.265896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:49.269272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 536 sessionId:  describe result for acl check
2025-10-10T14:05:49.269403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:49.269415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:49.269426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:49.269443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594056692000725:7971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:49.272364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594056692000725:7971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:49.295510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594056692000725:7971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:49.313004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594056692000725:7971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:49.313047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594056692000725:7971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:49.313078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594056692000725:7971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:49.313110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:49.330959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:49.334069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594056692000813:7619]
2025-10-10T14:05:49.349558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:49.350501Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:49.350522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:49.350577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:49.350873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:49.351070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594055114080484:7154]
2025-10-10T14:05:49.353371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:49.354432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:49.354650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:49.356005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:49.356354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:49.356364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:49.356372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:49.356381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:49.356389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:49.356397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:49.356404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:49.356412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:49.356422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.356430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.356438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.356446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.356499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:49.356625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:49.356678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:49.356732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:49.356782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:49.356834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:49.356883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:49.356933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:49.356986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.357040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.357089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.357177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.357226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:49.357299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:49.357363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:49.357421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:49.357492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:49.357548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:49.357599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:49.357659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:49.357711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:49.357772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:49.357820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:49.357880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:49.357931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:49.357991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:49.358041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:49.358107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:49.358160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.358214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.358262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.358333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.358393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.358455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.358509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.358569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.359064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:49.390615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:49.422067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:49.422249Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:49.422271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:49.422291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:49.422314Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 535 [2:7559594055114080484:7154]
2025-10-10T14:05:49.422372Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:49.422428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:49.422442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:49.422457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:49.422470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:49.422517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:49.422540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:49.422561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:49.424819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.424837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.424851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.424866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.424878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:49.425166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:49.425185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.425336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.425553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.425802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.425928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:49.426001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594055114080466:7154]
2025-10-10T14:05:49.426018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594055114080466:7154]
2025-10-10T14:05:49.426031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594055114080466:7154]
2025-10-10T14:05:49.426044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594055114080466:7154]
2025-10-10T14:05:49.426226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:49.426239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:49.426251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:49.426266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:49.427287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:49.427393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:49.427596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:49.427616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:49.427666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594056692000813:7619], now have 1 active actors on pipe
2025-10-10T14:05:49.427690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594056692000807:7971], now have 1 active actors on pipe
2025-10-10T14:05:49.427714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594056692000711:2442], now have 1 active actors on pipe
2025-10-10T14:05:49.427838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594055114080466:7154]
2025-10-10T14:05:49.427869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:49.428257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:49.430711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 535, pipe: [1:7559594056692000813:7619]
2025-10-10T14:05:49.430825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 535
2025-10-10T14:05:49.430899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 535
2025-10-10T14:05:49.434295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:49.434339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:49.434444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:49.434482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:49.434502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:49.434514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:49.434553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:49.434599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:49.434655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:49.435426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:49.435453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:49.435520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:49.435903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 536 partition: 0 MaxSeqNo: 36 sessionId: src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0
2025-10-10T14:05:49.442956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e86b78-6c922ff8-4bd569c7-303d21d4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:49.504484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0] Write session: try to update token
2025-10-10T14:05:49.504540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:49.518323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:49.518349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:49.518369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:49.573730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:49.573769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:49.573787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:49.573800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:49.573813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:49.573851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594055114080466:7154]
2025-10-10T14:05:49.573879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594055114080466:7154]
2025-10-10T14:05:49.573907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594055114080466:7154]
2025-10-10T14:05:49.573933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594055114080466:7154]
2025-10-10T14:05:49.574089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:49.574120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.574134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:49.575531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:49.577696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:49.577740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:49.577774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:49.577809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:49.685878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId: src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:49.721229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:49.735743Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:49.739744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:49.739787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:49.742676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594056692000813:7619]
2025-10-10T14:05:49.742959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:49.742974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:49.759317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 536 reason: error at write: Disconnected sessionId: src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0
2025-10-10T14:05:49.759627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 536 sessionId: src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0 is DEAD
2025-10-10T14:05:49.761363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:49.761423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0] Write session will restart in 0.009470s
2025-10-10T14:05:49.761551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0] Write session: Do CDS request
2025-10-10T14:05:49.761578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:49.775754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:49.775871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:49.817485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:49.817740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:49.817754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 537
2025-10-10T14:05:49.818300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:49.818410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:49.818426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:49.818436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:49.819870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 537 sessionId:  describe result for acl check
2025-10-10T14:05:49.819979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:49.819990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:49.819999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:49.820013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594056692000909:7983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:49.822637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594056692000909:7983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:49.835089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594056692000909:7983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:49.843672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594056692000958:7619]
2025-10-10T14:05:49.854437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:49.864328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594056692000909:7983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:49.864371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594056692000909:7983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:49.864389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594056692000909:7983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:49.864421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:49.867167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:49.868100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:49.868120Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:49.868169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:49.868443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:49.868622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594055114080595:7161]
2025-10-10T14:05:49.870985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:49.872322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:49.872562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:49.873985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:49.874318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:49.874327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:49.874335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:49.874342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:49.874350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:49.874359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:49.874366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:49.874374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:49.874380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.874388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.874394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.874401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.874449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:49.874559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:49.874608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:49.874659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:49.874704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:49.874754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:49.874802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:49.874847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:49.874898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.874945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.874991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.875040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.875083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:49.875151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:49.875211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:49.875266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:49.875319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:49.875376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:49.875424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:49.875480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:49.875529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:49.875583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:49.875630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:49.875689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:49.875738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:49.875795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:49.875841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:49.875896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:49.875944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.876001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.876049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.876105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.876151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.876204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.876252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.876305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.876798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:49.929347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:49.967175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:49.967219Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:49.967237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:49.967257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:49.967278Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 536 [2:7559594055114080595:7161]
2025-10-10T14:05:49.967334Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:49.967396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:49.967411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:49.967424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:49.967435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:49.967484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:49.967506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:49.967529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:49.971620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 536
2025-10-10T14:05:49.971728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 536
2025-10-10T14:05:49.971790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 536, pipe: [1:7559594056692000958:7619]
2025-10-10T14:05:49.970394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.970421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.970436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.970451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.970462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:49.970749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:49.970768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:49.970923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:49.971124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:49.971364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:49.971504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:49.971594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594056692000964:7983], now have 1 active actors on pipe
2025-10-10T14:05:49.971620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594056692000958:7619], now have 1 active actors on pipe
2025-10-10T14:05:49.971644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594056692000904:2442], now have 1 active actors on pipe
2025-10-10T14:05:49.971673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:49.971688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:49.971702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:49.971718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:49.971763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:49.971798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:49.971814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:49.971827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:49.971840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:49.971846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:49.972033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:49.972053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:49.972184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:49.972217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:49.972277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:49.972301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:49.972323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:49.972478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:49.972519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:49.972545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:49.972564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:49.972608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:49.972649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:49.972723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:49.980901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:49.980951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:49.981050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:49.981524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 537 partition: 0 MaxSeqNo: 36 sessionId: src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0
2025-10-10T14:05:49.982236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0ee07af-1c0af4dd-cc7d4c66-b4eee10b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:50.006325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0] Write session: try to update token
2025-10-10T14:05:50.006382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:50.166422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:50.166455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:50.166468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:50.166583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:50.166598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:50.166612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:50.166623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:50.166633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:50.166666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:50.166691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:50.166716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:50.166740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:50.167432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:50.167468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:50.167497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:50.167525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:50.203792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:50.203838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:50.203852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:50.204945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:50.242221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId: src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:50.266872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1010 14:05:50.281696473  112381 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:05:50.393891Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:50.412476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:50.412508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:50.412552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594055114080589:7161]
2025-10-10T14:05:50.412669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:50.412703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:50.412726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:50.418388Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:50.423507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:50.423532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:50.425415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594056692000958:7619]
2025-10-10T14:05:50.425581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:50.439991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 537 reason: error at write: Disconnected sessionId: src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0
2025-10-10T14:05:50.440316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 537 sessionId: src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0 is DEAD
2025-10-10T14:05:50.442068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:50.442103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0] Write session will restart in 0.007068s
2025-10-10T14:05:50.442207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0] Write session: Do CDS request
2025-10-10T14:05:50.442241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:50.453237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:50.453281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:50.453314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 538
2025-10-10T14:05:50.453819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:50.453937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:50.453951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:50.453964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:50.455613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 538 sessionId:  describe result for acl check
2025-10-10T14:05:50.455735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:50.455745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:50.455756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:50.455772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594060986968303:7991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:50.458777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594060986968303:7991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:50.502436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594060986968303:7991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:50.524444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594060986968303:7991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:50.524493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594060986968303:7991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:50.524514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594060986968303:7991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:50.524545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:50.525720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:50.526106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594060986968401:7619]
2025-10-10T14:05:50.534279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:50.535275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:50.535295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:50.535343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:50.535656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:50.535858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594059409048045:7172]
2025-10-10T14:05:50.538902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:50.540124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:50.540358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:50.541784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:50.542379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:50.542395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:50.542404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:50.542411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:50.542419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:50.542426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:50.542432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:50.542440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:50.542446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:50.542455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:50.542463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:50.542471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:50.542525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:50.542650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:50.542705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:50.542760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:50.542814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:50.542866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:50.543336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:50.543398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:50.543450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:50.543504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:50.543555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:50.543605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:50.543655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:50.543734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:50.543798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:50.543862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:50.543917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:50.543974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:50.544027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:50.544084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:50.544138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:50.544196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:50.544249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:50.544313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:50.544365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:50.544426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:50.544474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:50.544536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:50.544593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:50.544654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:50.544707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:50.544767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:50.544820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:50.544878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:50.544928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:50.544989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:50.545556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:50.634028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:50.653427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:50.653481Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:50.653503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:50.653527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:50.653554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 537 [2:7559594059409048045:7172]
2025-10-10T14:05:50.653632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:50.653706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:50.656169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 537, pipe: [1:7559594060986968401:7619]
2025-10-10T14:05:50.653724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:50.656294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 537
2025-10-10T14:05:50.653737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:50.656369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 537
2025-10-10T14:05:50.653749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:50.653802Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:50.653826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:50.653849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:50.655207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:50.655225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:50.655242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:50.655258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:50.655271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:50.655575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:50.655608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:50.655784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:50.656019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:50.656279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:50.656411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:50.656504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594060986968401:7619], now have 1 active actors on pipe
2025-10-10T14:05:50.656532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594060986968400:7991], now have 1 active actors on pipe
2025-10-10T14:05:50.656556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594060986968296:2442], now have 1 active actors on pipe
2025-10-10T14:05:50.656582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:50.656598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:50.656614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:50.656630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:50.656778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:50.656791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:50.656803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:50.656816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:50.665431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:50.665613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:50.665871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:50.665890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:50.665971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:50.665998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:50.666174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:50.666216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:50.666293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:50.666300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:50.666327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:50.666349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:50.666363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:50.666402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:50.666446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:50.666602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:50.675796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:50.675844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:50.675939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:50.678946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 538 partition: 0 MaxSeqNo: 36 sessionId: src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0
2025-10-10T14:05:50.681774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3c8414c-7d704e0f-a30aedc9-184116a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:50.749393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0] Write session: try to update token
2025-10-10T14:05:50.749468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:50.758128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:50.758158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:50.758185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:50.892972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:50.893008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:50.893022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:50.893034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:50.893046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:50.893082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:50.893110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:50.893361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:50.893393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:50.893633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:50.893646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:50.893657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:50.893701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:50.893726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:50.893738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:50.893976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:50.894012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:50.894053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:50.894080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:50.902636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:50.970363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId: src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0 grpc read done: success: 1 data:  write_request[data omitted]
E1010 14:05:50.986934638  107740 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:05:51.026025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:51.029312Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:05:51.070911Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:51.083942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:51.083998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:51.084067Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:51.084082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:51.084126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594059409048039:7172]
2025-10-10T14:05:51.086360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:51.090706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:51.090736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:51.093165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:51.093331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594060986968401:7619]
2025-10-10T14:05:51.094105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:51.123280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 538 reason: error at write: Disconnected sessionId: src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0
2025-10-10T14:05:51.123648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 538 sessionId: src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0 is DEAD
2025-10-10T14:05:51.135122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:51.135173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0] Write session will restart in 0.006887s
2025-10-10T14:05:51.135285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0] Write session: Do CDS request
2025-10-10T14:05:51.135318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:51.148216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:51.148248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 539
2025-10-10T14:05:51.148939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:51.151191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:51.151355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:51.151389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:51.151403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:51.152894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 539 sessionId:  describe result for acl check
2025-10-10T14:05:51.153025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:51.153036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:51.153046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:51.153064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594065281935746:7998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:51.161332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594065281935746:7998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:51.176784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594065281935746:7998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:51.191903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594065281935777:7619]
2025-10-10T14:05:51.192644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594065281935746:7998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:51.192674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594065281935746:7998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:51.192695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594065281935746:7998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:51.192726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:51.262304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:51.270107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:51.271084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:51.271105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:51.271151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:51.271423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:51.271615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594063704015470:7180]
2025-10-10T14:05:51.274088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:51.275194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:51.275413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:51.276648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:51.276959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:51.276969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:51.276976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:51.276984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:51.276992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:51.276999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:51.277006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:51.277014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:51.277022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.277029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.277038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.277048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.277096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:51.277227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:51.277276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:51.277324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:51.277371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:51.277441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:51.277486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:51.277535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:51.277582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.277632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.277678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.277726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.277766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:51.277833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:51.277894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:51.277960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:51.278012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:51.278071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:51.278119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:51.278175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:51.278266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:51.278322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:51.278367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:51.278423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:51.278487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:51.278544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:51.278591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:51.278645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:51.278697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.278784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.278837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.278895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.278948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.279004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.279052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.279116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.279616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:51.323363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:51.347833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:51.347884Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:51.347904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:51.347922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:51.347946Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 538 [2:7559594063704015470:7180]
2025-10-10T14:05:51.348005Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:51.348062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:51.348077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:51.348090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:51.348103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:51.348149Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:51.348172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:51.348194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:51.351461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.351487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.351501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.351515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.351528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:51.351802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:51.351822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.351967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.352164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.352401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.352527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:51.352599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.352615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.352629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.352644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.352689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:51.352767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:51.352821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:51.352835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:51.352846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:51.352857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:51.352954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:51.352974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:51.353221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.353259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:51.353320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594065281935736:2442], now have 1 active actors on pipe
2025-10-10T14:05:51.353347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594065281935777:7619], now have 1 active actors on pipe
2025-10-10T14:05:51.353371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594065281935780:7998], now have 1 active actors on pipe
2025-10-10T14:05:51.357020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 538
2025-10-10T14:05:51.357111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 538, pipe: [1:7559594065281935777:7619]
2025-10-10T14:05:51.357203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 538
2025-10-10T14:05:51.357273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:51.359541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:51.359573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:51.359651Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db666c62-7df09685-1097ff0a-19d528da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:51.359683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:51.359702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:51.359713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:51.359745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:51.359788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:51.359835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:51.365283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:51.365326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:51.365423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:51.367563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 539 partition: 0 MaxSeqNo: 36 sessionId: src_id|db666c62-7df09685-1097ff0a-19d528da_0
2025-10-10T14:05:51.369688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c836088a-5171a38a-96fd0d88-32a3d6f6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|db666c62-7df09685-1097ff0a-19d528da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:51.418637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db666c62-7df09685-1097ff0a-19d528da_0] Write session: try to update token
2025-10-10T14:05:51.418695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db666c62-7df09685-1097ff0a-19d528da_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:51.622554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:51.622587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:51.622597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:51.622651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:51.622663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:51.622673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:51.622680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:51.622688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:51.622718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.622739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.622756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.622772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.622973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:51.622998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.623008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:51.624265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:51.624344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:51.624377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:51.624404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:51.624431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:51.652715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId: src_id|db666c62-7df09685-1097ff0a-19d528da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:51.713467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:51.833822Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:51.852202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:51.852242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:51.850233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:51.850283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:51.850354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:51.850368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:51.850412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594063704015465:7180]
2025-10-10T14:05:51.850858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:51.851034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:51.896450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594065281935777:7619]
2025-10-10T14:05:51.896535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:51.908168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 539 reason: error at write: Disconnected sessionId: src_id|db666c62-7df09685-1097ff0a-19d528da_0
2025-10-10T14:05:51.908499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 539 sessionId: src_id|db666c62-7df09685-1097ff0a-19d528da_0 is DEAD
2025-10-10T14:05:51.909716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db666c62-7df09685-1097ff0a-19d528da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:51.909750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db666c62-7df09685-1097ff0a-19d528da_0] Write session will restart in 0.007884s
2025-10-10T14:05:51.909846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db666c62-7df09685-1097ff0a-19d528da_0] Write session: Do CDS request
2025-10-10T14:05:51.909875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db666c62-7df09685-1097ff0a-19d528da_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:51.929033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db666c62-7df09685-1097ff0a-19d528da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:51.929638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:51.929666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 540
2025-10-10T14:05:51.930009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:51.930130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:51.930145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:51.930156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:51.931601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 540 sessionId:  describe result for acl check
2025-10-10T14:05:51.931718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:51.931728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:51.931737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:51.931754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594065281935985:8015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:51.934690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594065281935985:8015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:51.940794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:51.945551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:51.947968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594065281935985:8015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:51.946406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:51.946435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:51.946492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:51.946768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:51.946976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594063704015620:7189]
2025-10-10T14:05:51.949349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:51.950539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:51.950795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:51.952131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:51.952461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:51.952469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:51.952476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:51.952485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:51.952493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:51.952501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:51.952509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:51.952516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:51.952524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.952531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.952537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.952543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.952591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:51.952695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:51.952735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:51.952774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:51.952811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:51.952849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:51.952886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:51.952924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:51.952963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.953000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.953037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.953072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.953100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:51.953190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:51.953255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:51.953313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:51.953368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:51.953441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:51.953494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:51.953549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:51.953599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:51.953660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:51.953710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:51.953772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:51.953820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:51.953881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:51.953930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:51.953986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:51.954045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.954104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:51.954152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.954218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:51.954271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.954335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:51.954390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.954453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:51.954803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:51.974512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594065281935985:8015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:51.974556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594065281935985:8015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:51.974578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594065281935985:8015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:51.974614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:51.991336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:51.997610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594065281936020:7619]
2025-10-10T14:05:52.028383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:52.028434Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:52.028454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:52.028479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:52.028504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 539 [2:7559594063704015620:7189]
2025-10-10T14:05:52.028570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:52.028637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:52.028655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:52.028668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:52.028681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:52.028735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:52.028757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:52.028782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:52.030739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.030771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:52.030788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:52.030803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:52.030816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:52.031124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:52.031143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.031314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:52.031546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:52.031816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:52.031951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:52.032035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.032053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.032068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.032083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.032134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:52.032225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:52.032430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:52.032450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:52.032593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.032620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:52.032875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:52.032889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:52.032904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:52.032917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:52.032941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:52.034038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594065281935927:2442], now have 1 active actors on pipe
2025-10-10T14:05:52.034074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594065281936020:7619], now have 1 active actors on pipe
2025-10-10T14:05:52.034099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594065281936018:8015], now have 1 active actors on pipe
2025-10-10T14:05:52.034641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 539
2025-10-10T14:05:52.034707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 539, pipe: [1:7559594065281936020:7619]
2025-10-10T14:05:52.034761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 539
2025-10-10T14:05:52.035030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:52.035062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:52.035138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:52.035172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:52.035192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:52.035204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:52.035241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:52.035284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:52.035335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:52.036642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:52.036673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:52.036740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:52.037031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 540 partition: 0 MaxSeqNo: 36 sessionId: src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0
2025-10-10T14:05:52.038936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db666c62-7df09685-1097ff0a-19d528da_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:52.089027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:52.089065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:52.089108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.089254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:52.091128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:52.092816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:52.096020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0] Write session: try to update token
2025-10-10T14:05:52.096074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:52.115161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:52.117988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:52.119225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:52.120669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:52.121167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:52.128972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:52.129003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:52.129015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:52.244466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:52.244503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:52.244521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:52.244534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:52.244548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:52.244596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.244628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.244654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.244681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594063704015615:7189]
2025-10-10T14:05:52.244876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:52.244895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:52.244907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:52.248120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:52.248171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:52.248208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:52.248242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:52.255440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:52.255505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.255519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:52.256635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:52.275522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId: src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:52.300044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:52.443388Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:52.444805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:52.444848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:52.446558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:52.446748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594065281936020:7619]
2025-10-10T14:05:52.446850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:52.446872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:52.448407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:52.528533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 540 reason: error at write: Disconnected sessionId: src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0
2025-10-10T14:05:52.528840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 540 sessionId: src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0 is DEAD
2025-10-10T14:05:52.530266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:52.530301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0] Write session will restart in 0.009952s
2025-10-10T14:05:52.530403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0] Write session: Do CDS request
2025-10-10T14:05:52.530435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:52.544642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594069576903404:7619]
2025-10-10T14:05:52.546851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:52.548029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:52.548055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 541
2025-10-10T14:05:52.548717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:52.548835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:52.548850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:52.548859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:52.552005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 541 sessionId:  describe result for acl check
2025-10-10T14:05:52.552092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:52.552099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:52.552105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:52.552116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594069576903409:8021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:52.554128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594069576903409:8021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:52.556283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:52.567049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594069576903409:8021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:52.564478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:52.565476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:52.565498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:52.565543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:52.565838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:52.566038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594067998983047:7195]
2025-10-10T14:05:52.568937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:52.573430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:52.574110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:52.575634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:52.579023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594069576903409:8021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:52.579064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594069576903409:8021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:52.579083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594069576903409:8021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:52.579121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:52.580825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:52.580846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:52.580853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:52.580861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:52.580869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:52.580877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:52.580884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:52.580891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:52.580899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.580906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:52.580913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:52.580921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:52.580979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:52.581115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:52.581188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:52.581241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:52.581299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:52.581352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:52.581438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:52.581493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:52.581550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.581609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:52.581664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:52.581720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:52.581774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:52.581853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:52.581921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:52.581987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:52.582046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:52.582109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:52.582166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:52.582231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:52.582289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:52.582353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:52.582403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:52.582463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:52.582511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:52.582568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:52.582630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:52.582690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:52.582747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.582809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.582865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:52.582925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:52.582980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:52.583047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:52.583100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:52.583162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:52.583651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:52.616952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:52.630971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:52.631017Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:52.631036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:52.631058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:52.631084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 540 [2:7559594067998983047:7195]
2025-10-10T14:05:52.631146Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:52.631210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:52.631228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:52.631240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:52.631254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:52.631302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:52.631324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:52.631348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:52.651761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.651789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:52.651803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:52.651816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:52.651828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:52.652109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:52.652127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.652284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:52.652481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:52.652720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:52.652842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:52.652917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:52.652933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:52.652947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:52.652961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:52.653104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:52.653117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:52.653149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:52.653161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:52.654145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:52.654256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:52.654461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:52.654479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:52.654540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594069576903328:2442], now have 1 active actors on pipe
2025-10-10T14:05:52.654567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594069576903404:7619], now have 1 active actors on pipe
2025-10-10T14:05:52.654602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594069576903440:8021], now have 1 active actors on pipe
2025-10-10T14:05:52.654733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:52.654765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:52.655186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:52.656733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 540
2025-10-10T14:05:52.656833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 540, pipe: [1:7559594069576903404:7619]
2025-10-10T14:05:52.656911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 540
2025-10-10T14:05:52.668806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:52.668860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:52.668954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:52.668990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:52.669011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:52.669025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:52.669066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:52.669113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:52.669200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:52.671525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:52.671567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:52.671656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:52.672079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 541 partition: 0 MaxSeqNo: 36 sessionId: src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0
2025-10-10T14:05:52.673963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882af9ed-b7e4e76a-80b30188-5d85f282_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:52.733399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:52.733431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:52.733444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:52.752519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0] Write session: try to update token
2025-10-10T14:05:52.752584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:52.927477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:52.927507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:52.927520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:52.927530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:52.927540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:52.927572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:52.927596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:52.927620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:52.927641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:52.927792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:52.927805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:52.927815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:52.927915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:52.927942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:52.927952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:52.928860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:52.928897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:52.928936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:52.928969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:52.930583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:52.957456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId: src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:53.034992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:53.154756Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:53.168595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:53.168647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:53.168717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:53.168731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:53.168771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594067998983041:7195]
2025-10-10T14:05:53.169201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:53.169397Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:53.173289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:53.173505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594069576903404:7619]
2025-10-10T14:05:53.173613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:53.195544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 541 reason: status is not ok: tablet will be restarted right now sessionId: src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0
2025-10-10T14:05:53.195870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 541 sessionId: src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0 is DEAD
2025-10-10T14:05:53.197843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:53.197912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0] Write session will restart in 0.005531s
2025-10-10T14:05:53.198070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0] Write session: Do CDS request
2025-10-10T14:05:53.198121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:53.230855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:53.253516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:53.253554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 542
2025-10-10T14:05:53.256257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:53.256388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:53.256403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:53.256414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:53.257930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 542 sessionId:  describe result for acl check
2025-10-10T14:05:53.258051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:53.258063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:53.258073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:53.258091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594073871870799:8033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:53.260794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594073871870799:8033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:53.274829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594073871870814:7619]
2025-10-10T14:05:53.283390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594073871870799:8033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:53.307858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594073871870799:8033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:53.307900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594073871870799:8033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:53.307917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594073871870799:8033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:53.307949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:53.331896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:53.346225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:53.347170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:53.347191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:53.347240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:53.347526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:53.347714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594072293950494:7203]
2025-10-10T14:05:53.351989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:53.355780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:53.356062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:53.357534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:53.357926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:53.357936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:53.357943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:53.357951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:53.357959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:53.357967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:53.357974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:53.357982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:53.357990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:53.357998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:53.358007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:53.358015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:53.358066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:53.358186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:53.358244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:53.358299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:53.358347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:53.358400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:53.358452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:53.358507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:53.358562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:53.358619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:53.358666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:53.358718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:53.358764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:53.358840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:53.358908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:53.358969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:53.359021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:53.359081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:53.359161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:53.359224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:53.359277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:53.359337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:53.359385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:53.359443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:53.359508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:53.359570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:53.359623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:53.359681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:53.359734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:53.359792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:53.359843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:53.359902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:53.359953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:53.360013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:53.360065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:53.360124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:53.360620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:53.445398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:53.463189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:53.463235Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:53.463254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:53.463287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:53.463311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 541 [2:7559594072293950494:7203]
2025-10-10T14:05:53.463371Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:53.463445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:53.463462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:53.463475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:53.463912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:53.463978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:53.464004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:53.464028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:53.471031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 541
2025-10-10T14:05:53.471134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 541
2025-10-10T14:05:53.471196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 541, pipe: [1:7559594073871870814:7619]
2025-10-10T14:05:53.469485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:53.469515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:53.469531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:53.469545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:53.469558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:53.469836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:53.469857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:53.470007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:53.470220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:53.470463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:53.470585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:53.470668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594073871870783:2442], now have 1 active actors on pipe
2025-10-10T14:05:53.470694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594073871870875:8033], now have 1 active actors on pipe
2025-10-10T14:05:53.470719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594073871870814:7619], now have 1 active actors on pipe
2025-10-10T14:05:53.470745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.470760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.470774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.470788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.470830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:53.470912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:53.471097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:53.471114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:53.471238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.471259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:53.471381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:53.471396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:53.471409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:53.471421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:53.471447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:53.475933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:53.475972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:53.476060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e56c187e-802d089d-51860151-b5a329b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:53.476097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:53.476116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:53.476129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:53.476165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:53.476210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:53.476261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:53.481045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:53.481089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:53.481191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:53.481673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 542 partition: 0 MaxSeqNo: 36 sessionId: src_id|e56c187e-802d089d-51860151-b5a329b8_0
2025-10-10T14:05:53.483512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daaffdcf-7840aaaa-a324f68b-5ffc84b9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e56c187e-802d089d-51860151-b5a329b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:53.529564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c187e-802d089d-51860151-b5a329b8_0] Write session: try to update token
2025-10-10T14:05:53.529621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c187e-802d089d-51860151-b5a329b8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:53.641577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:05:53.641636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-10-10T14:05:53.706904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:53.706942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:53.706953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:53.707070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:53.707089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:53.707102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:53.707114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:53.707125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:53.707158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.707184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.707208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.707231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.709236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:53.709285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:53.709318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:53.709381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:53.748141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId: src_id|e56c187e-802d089d-51860151-b5a329b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:53.755086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:53.755132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:53.755144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:53.756171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:53.792100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:53.943868Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:53.983870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:53.983906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:53.983953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594072293950488:7203]
2025-10-10T14:05:53.984103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:53.984128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:53.984318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:53.986115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:53.986317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594073871870814:7619]
2025-10-10T14:05:53.986396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:53.986457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-10-10T14:05:53.986556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:53.986568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:53.997414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c187e-802d089d-51860151-b5a329b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:53.997485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c187e-802d089d-51860151-b5a329b8_0] Write session will restart in 0.006254s
2025-10-10T14:05:53.997641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c187e-802d089d-51860151-b5a329b8_0] Write session: Do CDS request
2025-10-10T14:05:53.997687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c187e-802d089d-51860151-b5a329b8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:53.994549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 542 reason: error at write: Disconnected sessionId: src_id|e56c187e-802d089d-51860151-b5a329b8_0
2025-10-10T14:05:53.994923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 542 sessionId: src_id|e56c187e-802d089d-51860151-b5a329b8_0 is DEAD
2025-10-10T14:05:54.032069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c187e-802d089d-51860151-b5a329b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:54.037010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:54.037043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 543
2025-10-10T14:05:54.037801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:54.037958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:54.037975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:54.037985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:54.039493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 543 sessionId:  describe result for acl check
2025-10-10T14:05:54.039622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:54.039634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:54.039651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:54.039670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594078166838255:8042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:54.042505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594078166838255:8042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:54.063439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594078166838255:8042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:54.086517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594078166838317:7619]
2025-10-10T14:05:54.087685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594078166838255:8042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:54.087717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594078166838255:8042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:54.087737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594078166838255:8042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:54.087769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:54.139479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:54.146918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:54.147850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:54.147872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:54.147918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:54.148205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:54.148404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594076588917928:7215]
2025-10-10T14:05:54.150880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:54.155678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:54.155965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:54.157378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:54.157734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:54.157742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:54.157750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:54.157758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:54.157767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:54.157774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:54.157782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:54.157789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:54.157797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.157803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.157811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.157818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.157869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:54.157982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:54.158034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:54.158085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:54.158136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:54.158187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:54.158236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:54.158283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:54.158330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.158378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.158423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.158470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.158510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:54.158583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:54.158650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:54.159521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:54.159604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:54.170242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:54.170370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:54.170469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:54.170538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:54.170616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:54.170672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:54.170739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:54.170797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:54.170865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:54.170917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:54.170983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:54.171043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.171108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.171164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.171241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.171299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.171361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.171416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.171480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.172017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:54.223432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:54.255871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:54.255922Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:54.255939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:54.255960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:54.255986Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 542 [2:7559594076588917928:7215]
2025-10-10T14:05:54.256045Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:54.256112Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:54.256128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:54.256142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:54.256154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:54.256201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:54.256224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:54.256246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:54.320998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.321035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.321049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.321059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.321071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:54.322958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 542
2025-10-10T14:05:54.323055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 542, pipe: [1:7559594078166838317:7619]
2025-10-10T14:05:54.323131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 542
2025-10-10T14:05:54.325805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:54.325842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.326002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.326181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.326420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.326531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:54.326574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594073871870945:2442], now have 1 active actors on pipe
2025-10-10T14:05:54.326599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594078166838317:7619], now have 1 active actors on pipe
2025-10-10T14:05:54.326623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594078166838329:8042], now have 1 active actors on pipe
2025-10-10T14:05:54.326694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594076588917923:7215]
2025-10-10T14:05:54.326709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594076588917923:7215]
2025-10-10T14:05:54.326722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594076588917923:7215]
2025-10-10T14:05:54.326736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594076588917923:7215]
2025-10-10T14:05:54.326777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:54.326862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:54.327037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:54.327054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:54.327180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594076588917923:7215]
2025-10-10T14:05:54.327199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:54.327323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:54.327339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:54.327349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:54.327360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:54.327388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:54.331867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:54.331913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:54.332087Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:05:54.332204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:54.332237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:54.332257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:54.332267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:54.332306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:54.332350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:54.332401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:54.333156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 13 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:05:54.333319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:05:54.335093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:54.335129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:54.335206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:54.335659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 543 partition: 0 MaxSeqNo: 36 sessionId: src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0
2025-10-10T14:05:54.336856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56c187e-802d089d-51860151-b5a329b8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:54.357242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:54.357271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:54.357282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:54.411387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0] Write session: try to update token
2025-10-10T14:05:54.411449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:54.510309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:54.510345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:54.510357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:54.510414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:54.510430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:54.510444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:54.510457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:54.510469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:54.510506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594076588917923:7215]
2025-10-10T14:05:54.510536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594076588917923:7215]
2025-10-10T14:05:54.510561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594076588917923:7215]
2025-10-10T14:05:54.510586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594076588917923:7215]
2025-10-10T14:05:54.510730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:54.510758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.510771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:54.511294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:54.511332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:54.511365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:54.511396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:54.545783Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:54.681253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId: src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:54.724608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:54.854491Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:54.858258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:54.858303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:54.862398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:54.864201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:54.864243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:54.900843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:54.900892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0] Write session will restart in 0.009668s
2025-10-10T14:05:54.900998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0] Write session: Do CDS request
2025-10-10T14:05:54.901027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:54.898705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 543 reason: error at write: Disconnected sessionId: src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0
2025-10-10T14:05:54.899108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 543 sessionId: src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0 is DEAD
2025-10-10T14:05:54.914953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:54.915096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594078166838317:7619]
2025-10-10T14:05:54.920427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:54.918328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:54.918372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 544
2025-10-10T14:05:54.921211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:54.921389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:54.921409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:54.921421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:54.922953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 544 sessionId:  describe result for acl check
2025-10-10T14:05:54.923101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:54.923113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:54.923123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:54.923142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594078166838411:8054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:54.931820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594078166838411:8054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:54.957052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594078166838411:8054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:54.972677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:54.973215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:54.974286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:54.974304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:54.974363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:54.974630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:54.974830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594076588918091:7226]
2025-10-10T14:05:54.977252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:54.982229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:54.982487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:54.983855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:54.984187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:54.984196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:54.984202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:54.984210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:54.984216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:54.984223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:54.984230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:54.984238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:54.984244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.984250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.984257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.984263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.984309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:54.984409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:54.984461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:54.984511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:54.984556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:54.984600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:54.984645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:54.984688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:54.984730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.984776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.984848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.984893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.984936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:54.985000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:54.985056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:54.985113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:54.990655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:54.990740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:54.990792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:54.990847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:54.990896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:54.990948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:54.990993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:54.991046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:54.991091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:54.991138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:54.991199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:54.991248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:54.991296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.991344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:54.991388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.991441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:54.991487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.991547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:54.991591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.991641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:54.992071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:55.010513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594078166838411:8054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:55.010560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594078166838411:8054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:55.010578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594078166838411:8054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:55.010619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:55.017823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594082461805816:7619]
2025-10-10T14:05:55.027705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:55.071085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:55.071141Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:55.071159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:55.071179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:55.071208Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 543 [2:7559594076588918091:7226]
2025-10-10T14:05:55.071267Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:55.071339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:55.071358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:55.071372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:55.071383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:55.071437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:55.071460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:55.071483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:55.072856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:55.072874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:55.072886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:55.072901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:55.072913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:55.074289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 543, pipe: [1:7559594082461805816:7619]
2025-10-10T14:05:55.074394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 543
2025-10-10T14:05:55.074469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 543
2025-10-10T14:05:55.083681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:55.083718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:55.083863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:55.084051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:55.084273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:55.084383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:55.084501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594082461805816:7619], now have 1 active actors on pipe
2025-10-10T14:05:55.084527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594078166838407:2442], now have 1 active actors on pipe
2025-10-10T14:05:55.084548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594082461805814:8054], now have 1 active actors on pipe
2025-10-10T14:05:55.084633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:55.084653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:55.084699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.084714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.084727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.084740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.084785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:55.084843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:55.084860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:55.084869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:55.084873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:55.084883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:55.085045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:55.085063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:55.085157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:55.085193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:55.085213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:55.085223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:55.085263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:55.085321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:55.085467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.085500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:55.085548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:55.086457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:55.105396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:55.105445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:55.105568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:55.108056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 544 partition: 0 MaxSeqNo: 36 sessionId: src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0
2025-10-10T14:05:55.108997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3878b259-90defc13-87a2e3aa-1204e3ba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:55.182857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:55.182888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:55.182901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:55.182956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:55.182970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:55.183005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.183124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:55.185091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:55.190413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:55.191612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:55.193600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:55.195020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:55.204163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0] Write session: try to update token
2025-10-10T14:05:55.204221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:55.218975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:55.219449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:55.281357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:55.281397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:55.281412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:55.371200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:55.371234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:55.371250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:55.371261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:55.371271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:55.371314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.371341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.371364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.371387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594076588918086:7226]
2025-10-10T14:05:55.371534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:55.371562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:55.371574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:55.372589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:55.373330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:55.373360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:55.373388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:55.373413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:55.402417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId: src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:55.431548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:55.595719Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:55.601597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:55.601644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:55.606037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:55.605645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594082461805816:7619]
2025-10-10T14:05:55.605734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:55.605864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:55.605876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:55.705868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594082461805904:7619]
2025-10-10T14:05:55.737117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 544 reason: error at write: Disconnected sessionId: src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0
2025-10-10T14:05:55.737499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 544 sessionId: src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0 is DEAD
2025-10-10T14:05:55.741670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:55.741711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0] Write session will restart in 0.005659s
2025-10-10T14:05:55.741820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0] Write session: Do CDS request
2025-10-10T14:05:55.741851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:55.761816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:55.763144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:55.763173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 545
2025-10-10T14:05:55.763444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:55.763959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:55.764085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:55.764101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:55.764110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:55.765584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 545 sessionId:  describe result for acl check
2025-10-10T14:05:55.765698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:55.765708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:55.765716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:55.765734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594082461805935:8064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:55.768324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594082461805935:8064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:55.764577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:55.765462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:55.765479Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:55.765524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:55.765811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:55.766000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594080883885530:7237]
2025-10-10T14:05:55.768001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:55.769373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:55.769605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:55.770827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:55.771160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:55.771168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:55.771176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:55.771182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:55.771188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:55.771195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:55.771201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:55.771207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:55.771214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:55.771219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:55.771225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:55.771231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:55.771275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:55.771382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:55.771427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:55.771468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:55.771509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:55.771564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:55.771609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:55.771651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:55.771696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:55.771740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:55.771778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:55.771822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:55.771860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:55.771921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:55.771988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:55.772043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:55.772090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:55.772146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:55.772193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:55.772246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:55.772290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:55.772342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:55.772386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:55.772447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:55.772493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:55.772542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:55.772583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:55.772639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:55.772686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:55.772737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:55.772780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:55.772830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:55.772874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:55.772924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:55.772979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:55.773032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:55.776018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:55.795121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594082461805935:8064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:55.821456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594082461805935:8064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:55.821499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594082461805935:8064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:55.821517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594082461805935:8064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:55.821556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:55.831579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:55.859764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:55.859810Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:55.859828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:55.859847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:55.859872Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 544 [2:7559594080883885530:7237]
2025-10-10T14:05:55.859929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:55.859994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:55.860009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:55.860022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:55.860033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:55.860082Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:55.860113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:55.860136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:55.892194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:55.892223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:55.892233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:55.892244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:55.892255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:55.892538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:55.892552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:55.892682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:55.892841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:55.893035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:55.893564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:55.893643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:55.893658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:55.893670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:55.893682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:55.893717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:55.893799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594082461805904:7619], now have 1 active actors on pipe
2025-10-10T14:05:55.893831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594082461805967:8064], now have 1 active actors on pipe
2025-10-10T14:05:55.893850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594082461805847:2442], now have 1 active actors on pipe
2025-10-10T14:05:55.893875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:55.894048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:55.894566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 544, pipe: [1:7559594082461805904:7619]
2025-10-10T14:05:55.894065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:55.894670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 544
2025-10-10T14:05:55.894189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:55.894736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 544
2025-10-10T14:05:55.894223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:55.894978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:55.894991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:55.895001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:55.895012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:55.895039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:55.895938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:55.895980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:55.896069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1a49f6e-87629224-4d82904d-161de63a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:55.896105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:55.896136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:55.896147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:55.896186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:55.896235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:55.896284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:55.899696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:55.899740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:55.899811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:55.901087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 545 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1a49f6e-87629224-4d82904d-161de63a_0
2025-10-10T14:05:55.910697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2adf9ca-20f2a1ad-d6743aa7-5fc5b1eb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1a49f6e-87629224-4d82904d-161de63a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:55.962180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:55.962209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:55.962220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:56.005375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a49f6e-87629224-4d82904d-161de63a_0] Write session: try to update token
2025-10-10T14:05:56.005444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a49f6e-87629224-4d82904d-161de63a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:56.306818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:56.306849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:56.306860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:56.306919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:56.306932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:56.306943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:56.306952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:56.306963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:56.306997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:56.307021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:56.307041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:56.307061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:56.307166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:56.307195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:56.307222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:56.307246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:56.307270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:56.307295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:56.307305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:56.308512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:56.392612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId: src_id|f1a49f6e-87629224-4d82904d-161de63a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:56.465921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:56.624400Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:56.643645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:56.643691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:56.643752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:56.643767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:56.643806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594080883885525:7237]
2025-10-10T14:05:56.644719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:56.647149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594082461805904:7619]
2025-10-10T14:05:56.647260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:56.647273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:56.654783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:56.723795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 545 reason: error at write: Disconnected sessionId: src_id|f1a49f6e-87629224-4d82904d-161de63a_0
2025-10-10T14:05:56.724169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 545 sessionId: src_id|f1a49f6e-87629224-4d82904d-161de63a_0 is DEAD
2025-10-10T14:05:56.725801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a49f6e-87629224-4d82904d-161de63a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:56.725839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a49f6e-87629224-4d82904d-161de63a_0] Write session will restart in 0.008856s
2025-10-10T14:05:56.725951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a49f6e-87629224-4d82904d-161de63a_0] Write session: Do CDS request
2025-10-10T14:05:56.725984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a49f6e-87629224-4d82904d-161de63a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:56.743655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a49f6e-87629224-4d82904d-161de63a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:56.789826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594086756773394:7619]
2025-10-10T14:05:56.789872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:56.789885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 546
2025-10-10T14:05:56.790070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:56.797359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:56.797552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:56.797570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:56.797584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:56.800010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 546 sessionId:  describe result for acl check
2025-10-10T14:05:56.800145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:56.800156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:56.800166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:56.800184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594086756773400:8079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:56.804140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594086756773400:8079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:56.804706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:56.809512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:56.810491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:56.810523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:56.810575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:56.810864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:56.811055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594085178852974:7247]
2025-10-10T14:05:56.823212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:56.822031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594086756773400:8079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:56.824519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:56.824731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:56.826071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:56.826394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:56.826401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:56.826408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:56.826414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:56.826421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:56.826428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:56.826436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:56.826443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:56.826450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:56.826456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:56.826462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:56.826469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:56.826513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:56.826617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:56.826664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:56.826710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:56.826756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:56.826802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:56.826846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:56.826894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:56.826938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:56.826983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:56.827031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:56.827076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:56.827113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:56.827175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:56.827230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:56.827288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:56.827337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:56.827391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:56.827434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:56.827489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:56.827539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:56.827592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:56.827634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:56.827684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:56.827732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:56.827786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:56.827828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:56.827880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:56.827929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:56.827981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:56.828026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:56.828079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:56.828126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:56.828182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:56.828224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:56.828276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:56.828696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:56.859754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594086756773400:8079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:56.859802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594086756773400:8079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:56.859821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594086756773400:8079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:56.859854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:56.873502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:56.900289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:56.900646Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:56.900669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:56.900690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:56.900713Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 545 [2:7559594085178852974:7247]
2025-10-10T14:05:56.900768Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:56.900830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:56.900845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:56.900858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:56.900869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:56.900922Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:56.900945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:56.900967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:56.902948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:56.902964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:56.902978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:56.902991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:56.903003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:56.903285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:56.903300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:56.903450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:56.903627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:56.903848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:56.903960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:56.904036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:56.904050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:56.904063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:56.904076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:56.904214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:56.904226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:56.904237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:56.904250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:56.906745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:56.906854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:56.907037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:56.907053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:56.907101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594086756773435:8079], now have 1 active actors on pipe
2025-10-10T14:05:56.907124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594086756773396:2442], now have 1 active actors on pipe
2025-10-10T14:05:56.907144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594086756773394:7619], now have 1 active actors on pipe
2025-10-10T14:05:56.907187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:56.907206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:56.907355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:56.907410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:56.906274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 545
2025-10-10T14:05:56.906380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 545
2025-10-10T14:05:56.906445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 545, pipe: [1:7559594086756773394:7619]
2025-10-10T14:05:56.910242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:56.910344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:56.910389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:56.910408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:56.910418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:56.910456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:56.910501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:56.910681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:56.918362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:56.918407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:56.918496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:56.919008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 546 partition: 0 MaxSeqNo: 36 sessionId: src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0
2025-10-10T14:05:56.921829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1a49f6e-87629224-4d82904d-161de63a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:56.994424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0] Write session: try to update token
2025-10-10T14:05:56.994483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:57.004755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:57.004791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:57.004827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:57.004926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:57.005276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:57.005289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:57.005300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:57.005364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:57.027541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:57.037367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:57.038900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:57.040417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:57.057244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:57.057806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:57.106626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:57.106655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:57.106668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:57.256107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:57.256142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:57.256153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:57.256211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:57.256224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:57.256237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:57.256247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:57.256257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:57.256298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:57.256324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:57.256347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:57.256368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594085178852969:7247]
2025-10-10T14:05:57.256519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:57.256544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:57.256554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:57.258001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:57.258037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:57.258063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:57.258088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:57.269510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:57.361230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId: src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:57.455765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:57.583094Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:57.585980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:57.586020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:57.587864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594086756773394:7619]
2025-10-10T14:05:57.587959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:57.587971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:57.595207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:57.607617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:57.607761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 546 reason: error at write: Disconnected sessionId: src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0
2025-10-10T14:05:57.608089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 546 sessionId: src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0 is DEAD
2025-10-10T14:05:57.617418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:57.617460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0] Write session will restart in 0.007927s
2025-10-10T14:05:57.617559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0] Write session: Do CDS request
2025-10-10T14:05:57.617591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:57.638054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:57.676544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:57.676580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 547
2025-10-10T14:05:57.684293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:57.692278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594091051740810:7619]
2025-10-10T14:05:57.698999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:57.699033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:57.699044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:57.703432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 547 sessionId:  describe result for acl check
2025-10-10T14:05:57.703558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:57.703567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:57.703576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:57.703592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594091051740838:8086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:57.707937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594091051740838:8086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:57.725524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594091051740838:8086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:57.734892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:57.745984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:57.746912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:57.746933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:57.746978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:57.747257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:57.747449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594089473820433:7254]
2025-10-10T14:05:57.751104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594091051740838:8086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:57.751149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594091051740838:8086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:57.751167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594091051740838:8086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:57.751198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:57.753108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:57.754535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:57.754775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:57.755966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:57.756276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:57.756286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:57.756294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:57.756301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:57.756307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:57.756313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:57.756319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:57.756327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:57.756333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:57.756340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:57.756346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:57.756353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:57.756396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:57.756499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:57.756544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:57.756587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:57.756632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:57.756678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:57.756721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:57.756767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:57.756811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:57.756857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:57.756902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:57.756945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:57.756984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:57.757050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:57.757106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:57.757175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:57.757239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:57.757293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:57.757335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:57.757386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:57.757434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:57.757483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:57.757525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:57.757575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:57.757621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:57.757669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:57.757715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:57.757767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:57.757810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:57.757861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:57.757904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:57.757954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:57.757999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:57.758046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:57.758087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:57.758136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:57.758550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:57.839765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:57.872302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:57.872350Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:57.872369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:57.872389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:57.872415Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 546 [2:7559594089473820433:7254]
2025-10-10T14:05:57.872470Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:57.872538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:57.872554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:57.872566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:57.872577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:57.872625Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:57.872649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:57.872674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:57.878352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:57.878377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:57.878391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:57.878405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:57.878416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:57.878693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:57.878710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:57.878854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:57.879030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:57.879259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:57.879379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:57.879453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:57.879468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:57.879480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:57.879492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:57.879534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:57.879616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:57.879786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:57.879803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:57.879940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:57.879959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:57.882424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 546, pipe: [1:7559594091051740810:7619]
2025-10-10T14:05:57.882528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 546
2025-10-10T14:05:57.882602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 546
2025-10-10T14:05:57.880756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:57.880774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:57.880785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:57.880797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:57.880821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:57.891014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594091051740810:7619], now have 1 active actors on pipe
2025-10-10T14:05:57.891062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594091051740890:8086], now have 1 active actors on pipe
2025-10-10T14:05:57.891082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594091051740769:2442], now have 1 active actors on pipe
2025-10-10T14:05:57.891147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:57.891170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:57.891287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d602bae-287e0957-456a90c2-af1c6a46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:57.891325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:57.891346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:57.891358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:57.891399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:57.891452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:57.891502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:57.892481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:57.892506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:57.892569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:57.892939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 547 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d602bae-287e0957-456a90c2-af1c6a46_0
2025-10-10T14:05:57.895805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78a86316-4268a528-fe7c4ee8-5d5c4f28_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d602bae-287e0957-456a90c2-af1c6a46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:57.969751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:57.969780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:57.969792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:57.974209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d602bae-287e0957-456a90c2-af1c6a46_0] Write session: try to update token
2025-10-10T14:05:57.974263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d602bae-287e0957-456a90c2-af1c6a46_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:58.110716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:58.110757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:58.110774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:58.110784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:58.110796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:58.110833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:58.110861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:58.110885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:58.110906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:58.111135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:58.111147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:58.111157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:58.111202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:58.111228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:58.111239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:58.111455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:58.111491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:58.111554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:58.111609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:58.134562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:58.188541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId: src_id|2d602bae-287e0957-456a90c2-af1c6a46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:58.256628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:58.381377Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:58.410796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:58.410843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:58.410905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:58.410917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:58.410956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594089473820427:7254]
2025-10-10T14:05:58.411764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:58.412687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:58.413283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594091051740810:7619]
2025-10-10T14:05:58.413387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:58.413398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:58.413492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:58.428128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 547 reason: error at write: Disconnected sessionId: src_id|2d602bae-287e0957-456a90c2-af1c6a46_0
2025-10-10T14:05:58.428410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 547 sessionId: src_id|2d602bae-287e0957-456a90c2-af1c6a46_0 is DEAD
2025-10-10T14:05:58.433607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d602bae-287e0957-456a90c2-af1c6a46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:58.433655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d602bae-287e0957-456a90c2-af1c6a46_0] Write session will restart in 0.009743s
2025-10-10T14:05:58.433775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d602bae-287e0957-456a90c2-af1c6a46_0] Write session: Do CDS request
2025-10-10T14:05:58.433812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d602bae-287e0957-456a90c2-af1c6a46_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:58.448802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d602bae-287e0957-456a90c2-af1c6a46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:58.449348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:58.449379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 548
2025-10-10T14:05:58.449772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:58.449902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:58.449917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:58.449927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:58.452672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 548 sessionId:  describe result for acl check
2025-10-10T14:05:58.452853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:58.452870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:58.452891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:58.452920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594095346708233:8095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:58.455291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594095346708233:8095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:58.495460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594095346708233:8095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:58.515053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594095346708282:7619]
2025-10-10T14:05:58.545246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594095346708233:8095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:58.545292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594095346708233:8095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:58.545311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594095346708233:8095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:58.545345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:58.572581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:58.578953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:58.579959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:58.579981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:58.580034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:58.580340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:58.580542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594093768787866:7260]
2025-10-10T14:05:58.583189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:58.593794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:58.594077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:58.595468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:58.595824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:58.595833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:58.595842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:58.595849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:58.595857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:58.595865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:58.595872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:58.595881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:58.595888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:58.595895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:58.595903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:58.595911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:58.595963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:58.596083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:58.596140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:58.596193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:58.596247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:58.596298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:58.596349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:58.596400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:58.596450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:58.596502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:58.596555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:58.596606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:58.596651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:58.596726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:58.596794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:58.596855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:58.596910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:58.596973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:58.597024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:58.597084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:58.598202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:58.598286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:58.598346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:58.598407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:58.598461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:58.598521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:58.598569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:58.598624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:58.598677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:58.598735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:58.598785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:58.598844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:58.598896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:58.598957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:58.599007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:58.599065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:58.599612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:58.649757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:58.683449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:58.683521Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:58.683540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:58.683561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:58.683587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 547 [2:7559594093768787866:7260]
2025-10-10T14:05:58.683649Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:58.683722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:58.683738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:58.683752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:58.683764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:58.683821Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:58.683845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:58.683867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:58.686268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:58.686286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:58.686299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:58.686312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:58.686324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:58.693412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 547
2025-10-10T14:05:58.693538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 547
2025-10-10T14:05:58.693605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 547, pipe: [1:7559594095346708282:7619]
2025-10-10T14:05:58.701625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:58.701662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:58.701825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:58.702014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:58.702242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:58.702376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:58.702429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594095346708224:2442], now have 1 active actors on pipe
2025-10-10T14:05:58.702456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594095346708324:8095], now have 1 active actors on pipe
2025-10-10T14:05:58.702479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594095346708282:7619], now have 1 active actors on pipe
2025-10-10T14:05:58.702609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:58.702631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:58.702673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:58.702688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:58.702700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:58.702712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:58.702759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:58.702839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:58.703012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:58.703031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:58.703106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1c98d59-edd0e001-46601110-7c339142_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:58.703142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:58.703161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:58.703171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:58.703212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:58.703260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:58.703404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:58.703424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:58.703472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:58.703620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:58.703645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:58.703660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:58.703674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:58.703709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:58.709613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:58.709666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:58.709764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:58.713612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 548 partition: 0 MaxSeqNo: 36 sessionId: src_id|b1c98d59-edd0e001-46601110-7c339142_0
2025-10-10T14:05:58.717403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d602bae-287e0957-456a90c2-af1c6a46_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b1c98d59-edd0e001-46601110-7c339142_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:58.784633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c98d59-edd0e001-46601110-7c339142_0] Write session: try to update token
2025-10-10T14:05:58.784687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c98d59-edd0e001-46601110-7c339142_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:58.782093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:58.782126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:58.782139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:58.885443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:58.885473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:58.885488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:59.013607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId: src_id|b1c98d59-edd0e001-46601110-7c339142_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:59.030945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:59.030974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:59.030987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:59.030998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:59.031010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:59.031045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:59.031072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:59.031096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:59.031118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:59.031270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:59.031282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:59.031293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:59.031392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:59.031418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:59.031430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:59.032258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:59.032297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:59.032331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:59.032361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:59.032520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:59.068732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:59.256226Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:59.282831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:59.282884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:59.282968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:59.282985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:59.283028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594093768787860:7260]
2025-10-10T14:05:59.283891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:59.284705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:59.287696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:05:59.298531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594095346708282:7619]
2025-10-10T14:05:59.298622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 548 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b1c98d59-edd0e001-46601110-7c339142_0
2025-10-10T14:05:59.298978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 548 sessionId: src_id|b1c98d59-edd0e001-46601110-7c339142_0 is DEAD
2025-10-10T14:05:59.301652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c98d59-edd0e001-46601110-7c339142_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:05:59.301716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c98d59-edd0e001-46601110-7c339142_0] Write session will restart in 0.005875s
2025-10-10T14:05:59.301828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c98d59-edd0e001-46601110-7c339142_0] Write session: Do CDS request
2025-10-10T14:05:59.301874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c98d59-edd0e001-46601110-7c339142_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:59.313884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c98d59-edd0e001-46601110-7c339142_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:59.337551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:59.340854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:59.340887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 549
2025-10-10T14:05:59.341778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:59.341904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:59.341920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:59.341929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:59.349635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 549 sessionId:  describe result for acl check
2025-10-10T14:05:59.349836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:59.349855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:59.349875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:59.349906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594099641675703:8108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:59.354405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594099641675703:8108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:59.381370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594099641675703:8108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:05:59.397057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594099641675796:7619]
2025-10-10T14:05:59.419884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594099641675703:8108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:05:59.419931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594099641675703:8108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:05:59.419949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594099641675703:8108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:05:59.419980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:05:59.423359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:05:59.437502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:05:59.438392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:05:59.438420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:05:59.438468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:05:59.438728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:05:59.438902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594098063755318:7275]
2025-10-10T14:05:59.441047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:05:59.447381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:05:59.447683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:05:59.449108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:05:59.449578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:59.449587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:59.449595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:59.449604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:59.449611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:59.449620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:59.449626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:59.449635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:59.449642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:59.449651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:59.449660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:59.449668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:59.449722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:59.449842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:59.449896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:59.449948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:59.450000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:59.450055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:59.450105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:59.450157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:59.450210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:59.450264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:59.450314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:59.450366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:59.450414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:59.450489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:05:59.450555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:59.450618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:05:59.450675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:59.450734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:05:59.450787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:59.450847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:05:59.450903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:59.450965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:05:59.451016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:59.451076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:05:59.451126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:59.451189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:05:59.451240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:59.452449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:05:59.452529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:59.452593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:59.452643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:59.452702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:59.452757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:59.452818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:59.452867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:59.452925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:59.453477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:05:59.497562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:05:59.512006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:05:59.512048Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:05:59.512065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:05:59.512085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:05:59.512107Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 548 [2:7559594098063755318:7275]
2025-10-10T14:05:59.512164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:05:59.512216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:05:59.512230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:59.512241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:59.512252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:59.512297Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:05:59.512320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:05:59.512339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:05:59.519068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:59.519101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:59.519115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:59.519131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:59.519143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:05:59.519442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:05:59.519468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:59.519610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:05:59.519812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:05:59.520064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:05:59.520196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:05:59.520282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594099641675804:8108], now have 1 active actors on pipe
2025-10-10T14:05:59.520312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594099641675686:2442], now have 1 active actors on pipe
2025-10-10T14:05:59.520341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594099641675796:7619], now have 1 active actors on pipe
2025-10-10T14:05:59.520372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.520392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.520408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.520421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.520457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:05:59.520488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:05:59.520505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:05:59.520513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:05:59.520521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:05:59.520543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:05:59.520746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:05:59.520770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:05:59.520895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.520929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:05:59.520938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:05:59.521356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 548
2025-10-10T14:05:59.521448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 548
2025-10-10T14:05:59.521514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 548, pipe: [1:7559594099641675796:7619]
2025-10-10T14:05:59.522066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:59.522100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:59.522185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:05:59.522219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:59.522242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:59.522255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:05:59.522288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:59.522327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:05:59.522380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:59.522959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:59.522984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:59.523043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:05:59.523334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 549 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0
2025-10-10T14:05:59.525361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c98d59-edd0e001-46601110-7c339142_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:05:59.579254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0] Write session: try to update token
2025-10-10T14:05:59.579309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:05:59.584486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:05:59.592761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:59.592828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.592975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:05:59.594057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:05:59.597455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:05:59.600367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:59.601455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:59.602637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:05:59.604083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:05:59.604532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:05:59.611012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:05:59.611042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:05:59.611053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:05:59.660110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:05:59.668452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:05:59.668484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:05:59.668494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:05:59.668505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:05:59.668550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.668579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.668607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.668632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594098063755312:7275]
2025-10-10T14:05:59.668795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:05:59.668821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:05:59.668834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:05:59.669602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:05:59.669637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:05:59.669665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:05:59.669692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:05:59.684571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:05:59.728495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId: src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:05:59.782947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:05:59.865598Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:05:59.867643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:05:59.867693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:05:59.870342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:05:59.873757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:05:59.873814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:05:59.877378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:05:59.877661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594099641675796:7619]
2025-10-10T14:05:59.951168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 549 reason: error at write: Disconnected sessionId: src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0
2025-10-10T14:05:59.952358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 549 sessionId: src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0 is DEAD
2025-10-10T14:05:59.953480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:05:59.953528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0] Write session will restart in 0.006432s
2025-10-10T14:05:59.953635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0] Write session: Do CDS request
2025-10-10T14:05:59.953665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:05:59.966324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:05:59.966356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 550
2025-10-10T14:05:59.967264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:59.967812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:05:59.967956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:05:59.967974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:05:59.967985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:05:59.969550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 550 sessionId:  describe result for acl check
2025-10-10T14:05:59.969681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:05:59.969693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:05:59.969704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:05:59.969723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594099641675901:8116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:05:59.972688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594099641675901:8116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:05:59.981719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594099641675932:7619]
2025-10-10T14:05:59.990752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594099641675901:8116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:00.001667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:00.007022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:00.008033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:00.008065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:00.008111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:00.007749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594099641675901:8116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:00.007798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594099641675901:8116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:00.007823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594099641675901:8116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:00.007862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:00.008399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:00.008632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594102358722759:7281]
2025-10-10T14:06:00.010959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:00.014194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:00.014467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:00.016311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:00.016672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:00.016682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:00.016689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:00.016697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:00.016705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:00.016711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:00.016720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:00.016727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:00.016733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.016740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.016747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.016754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.016806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:00.017340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:00.017402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:00.017454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:00.017507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:00.017559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:00.017610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:00.017665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:00.017717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.017770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.017820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.017869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.017919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:00.017994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:00.018060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:00.018124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:00.018175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:00.018235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:00.018286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:00.018364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:00.018419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:00.018480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:00.018527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:00.018588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:00.018640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:00.018702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:00.018754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:00.018817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:00.018872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.018932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.018982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.019039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.019093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.019150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.019200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.019259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.019732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:00.075240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:00.097527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:00.097574Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:00.097595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:00.097616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:00.097641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 549 [2:7559594102358722759:7281]
2025-10-10T14:06:00.097703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:00.097768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:00.097784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:00.097797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:00.097809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:00.097858Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:00.097881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:00.097902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:00.102222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 549
2025-10-10T14:06:00.102336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 549
2025-10-10T14:06:00.102419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 549, pipe: [1:7559594099641675932:7619]
2025-10-10T14:06:00.099798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.099819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.099835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.099848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.099860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:00.100160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:00.100181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.100338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.100532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.100772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.100896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:00.100970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594098063755457:7281]
2025-10-10T14:06:00.100986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594098063755457:7281]
2025-10-10T14:06:00.101000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594098063755457:7281]
2025-10-10T14:06:00.101013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594098063755457:7281]
2025-10-10T14:06:00.101060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:00.101309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:00.101325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:00.101339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:00.101354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:00.103160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:00.103370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:00.103387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:00.103540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594103936643252:8116], now have 1 active actors on pipe
2025-10-10T14:06:00.103567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594099641675839:2442], now have 1 active actors on pipe
2025-10-10T14:06:00.103591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594099641675932:7619], now have 1 active actors on pipe
2025-10-10T14:06:00.103643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:00.103666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:00.103718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594098063755457:7281]
2025-10-10T14:06:00.103757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:00.103883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:00.103917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:00.103936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:00.103947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:00.103983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:00.104024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:00.104116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:00.104226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:00.107855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 550 partition: 0 MaxSeqNo: 36 sessionId: src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0
2025-10-10T14:06:00.107394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:00.107433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:00.107515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:00.108631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb09d0d7-d9ded461-8b9f413a-d205e095_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:00.161358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0] Write session: try to update token
2025-10-10T14:06:00.161421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:00.200664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:00.200689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:00.200699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:00.244749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:00.244784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:00.244798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:00.244813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:00.244827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:00.244867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594098063755457:7281]
2025-10-10T14:06:00.244897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594098063755457:7281]
2025-10-10T14:06:00.244925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594098063755457:7281]
2025-10-10T14:06:00.244950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594098063755457:7281]
2025-10-10T14:06:00.245062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:00.245101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:00.245106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:00.245162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:00.245195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:00.246067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.246105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:00.260740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:00.351122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId: src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:00.393411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:00.451863Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:00.464197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:00.464453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:00.466405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:00.466560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594099641675932:7619]
2025-10-10T14:06:00.466642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:00.466660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:00.474207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:00.506530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 550 reason: error at write: Disconnected sessionId: src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0
2025-10-10T14:06:00.506856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 550 sessionId: src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0 is DEAD
2025-10-10T14:06:00.509602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:00.509643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0] Write session will restart in 0.007005s
2025-10-10T14:06:00.510114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0] Write session: Do CDS request
2025-10-10T14:06:00.510147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:00.523659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:00.523713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 551
2025-10-10T14:06:00.524306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:00.525600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:00.525824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:00.525851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:00.525869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:00.527854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 551 sessionId:  describe result for acl check
2025-10-10T14:06:00.527963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:00.527971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:00.527977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:00.527989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594103936643317:8122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:00.530533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594103936643317:8122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:00.563162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594103936643317:8122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:00.574266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594103936643397:7619]
2025-10-10T14:06:00.577294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:00.584828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594103936643317:8122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:00.584871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594103936643317:8122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:00.584889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594103936643317:8122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:00.584922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:00.588625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:00.589563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:00.589592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:00.589639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:00.589926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:00.590117Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594102358722900:7289]
2025-10-10T14:06:00.592797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:00.594020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:00.594265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:00.595485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:00.595756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:00.595762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:00.595767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:00.595773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:00.595778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:00.595783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:00.595787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:00.595793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:00.595798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.595803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.595809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.595814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.595851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:00.595949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:00.595992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:00.596035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:00.596077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:00.596116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:00.596157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:00.596196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:00.596231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.596265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.596300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.596336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.596363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:00.596414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:00.596457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:00.596497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:00.596534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:00.596587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:00.596636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:00.596691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:00.596732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:00.596778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:00.596826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:00.596875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:00.596911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:00.597171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:00.597237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:00.597298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:00.597356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.597415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.597464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.597525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.597579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.597641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.597691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.597750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.598166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:00.634950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:00.659784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:00.659825Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:00.659845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:00.659866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:00.659888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 550 [2:7559594102358722900:7289]
2025-10-10T14:06:00.659951Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:00.660012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:00.660027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:00.660040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:00.660052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:00.660102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:00.660126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:00.660159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:00.661989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.662016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.662033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.662048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.662060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:00.662347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:00.662372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.662521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:00.662690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:00.662911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:00.663043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:00.663114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.663134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.663150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.663164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.663207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:00.663310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:00.663505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:00.663528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:00.663694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.663724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:00.663978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:00.663996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:00.664010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:00.664022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:00.664046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:00.664632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594103936643282:2442], now have 1 active actors on pipe
2025-10-10T14:06:00.664674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594103936643403:8122], now have 1 active actors on pipe
2025-10-10T14:06:00.664699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594103936643397:7619], now have 1 active actors on pipe
2025-10-10T14:06:00.665332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 550
2025-10-10T14:06:00.665460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 550
2025-10-10T14:06:00.665534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 550, pipe: [1:7559594103936643397:7619]
2025-10-10T14:06:00.666455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:00.666493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:00.666585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:00.666621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:00.666640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:00.666652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:00.666689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:00.666737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:00.666787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:00.667255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:00.667284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:00.667347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:00.667614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 551 partition: 0 MaxSeqNo: 36 sessionId: src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0
2025-10-10T14:06:00.668295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbe4a78-730bf05b-4f9dfb97-ea2d1ded_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:00.735180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:00.735209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:00.735245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.735370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:00.735570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:00.742144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0] Write session: try to update token
2025-10-10T14:06:00.742206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:00.745579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:00.750299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:00.751613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:00.752871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:00.776656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:00.806801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:00.806832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:00.806842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:00.806958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:00.863641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:00.863667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:00.863678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:00.863686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:00.863695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:00.863723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.863741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.863758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.863774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594102358722893:7289]
2025-10-10T14:06:00.863882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:00.863902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:00.863910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:00.864815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:00.869279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:00.869347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:00.869387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:00.869432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:00.916453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId: src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:00.939086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:01.078221Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:01.080914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:01.080961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:01.086094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:01.083564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:01.083718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:01.083731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:01.132863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 551 reason: error at write: Disconnected sessionId: src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0
2025-10-10T14:06:01.149915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 551 sessionId: src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0 is DEAD
2025-10-10T14:06:01.153346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:01.153386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0] Write session will restart in 0.005868s
2025-10-10T14:06:01.153489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0] Write session: Do CDS request
2025-10-10T14:06:01.153518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:01.164732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:01.188746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594103936643397:7619]
2025-10-10T14:06:01.197463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:01.197497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 552
2025-10-10T14:06:01.197966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:01.198103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:01.198120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:01.198131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:01.201252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 552 sessionId:  describe result for acl check
2025-10-10T14:06:01.201420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:01.201431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:01.201441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:01.201459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594108231610799:8134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:01.204100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594108231610799:8134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:01.221512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594108231610799:8134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:01.235735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594108231610799:8134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:01.235780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594108231610799:8134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:01.235799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594108231610799:8134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:01.235829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:01.234106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:01.238965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:01.239720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:01.239734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:01.239779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:01.240008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:01.240162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594106653690354:7298]
2025-10-10T14:06:01.241722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:01.245346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:01.245630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:01.247149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:01.247523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:01.247532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:01.247541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:01.247549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:01.247556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:01.247564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:01.247574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:01.247582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:01.247590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:01.247598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:01.247605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:01.247613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:01.247664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:01.247781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:01.247838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:01.247892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:01.247940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:01.247992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:01.248039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:01.248090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:01.248144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:01.248195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:01.248242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:01.248296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:01.248341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:01.248414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:01.248477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:01.248539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:01.248595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:01.248652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:01.248703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:01.248764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:01.248814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:01.248872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:01.248920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:01.248977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:01.249028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:01.249083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:01.249163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:01.249222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:01.249275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:01.249330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:01.249390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:01.249448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:01.249506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:01.249564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:01.249614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:01.249672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:01.250170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:01.292810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594108231610875:7619]
2025-10-10T14:06:01.299090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:01.318375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:01.318418Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:01.318435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:01.318455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:01.318478Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 551 [2:7559594106653690354:7298]
2025-10-10T14:06:01.318538Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:01.318600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:01.318614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:01.318628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:01.318639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:01.318687Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:01.318710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:01.318734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:01.321167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:01.321197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:01.321214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:01.321230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:01.321243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:01.321551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:01.321581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:01.321748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:01.321962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:01.322223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:01.322359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:01.322442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594108231610858:8134], now have 1 active actors on pipe
2025-10-10T14:06:01.322469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594108231610740:2442], now have 1 active actors on pipe
2025-10-10T14:06:01.322493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594108231610875:7619], now have 1 active actors on pipe
2025-10-10T14:06:01.322521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.322538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.322554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.322568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.322611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:01.322701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:01.322716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:01.322743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:01.322757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:01.322770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:01.322905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:01.322924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:01.323053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.323086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:01.323186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:01.324807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 551
2025-10-10T14:06:01.324901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 551
2025-10-10T14:06:01.324966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 551, pipe: [1:7559594108231610875:7619]
2025-10-10T14:06:01.326279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:01.326337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:01.326452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|604ea850-4581e738-1d9d9-213f384c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:01.326491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:01.326510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:01.326522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:01.326563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:01.326613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:01.326671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:01.327240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:01.327269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:01.327346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:01.327683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 552 partition: 0 MaxSeqNo: 36 sessionId: src_id|604ea850-4581e738-1d9d9-213f384c_0
2025-10-10T14:06:01.328726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa1c8ede-1a011e40-4de220b4-ec3b4d73_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|604ea850-4581e738-1d9d9-213f384c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:01.387734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|604ea850-4581e738-1d9d9-213f384c_0] Write session: try to update token
2025-10-10T14:06:01.387788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|604ea850-4581e738-1d9d9-213f384c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:01.454295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:01.454322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:01.454348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.454434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:01.454443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:01.454451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:01.454496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:01.457082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:01.478986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:01.480230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:01.482536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:01.484535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:01.488240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:01.488668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:01.552902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:01.552938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:01.552954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:01.552969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:01.552982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:01.553027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.553056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.553083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.553142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594106653690348:7298]
2025-10-10T14:06:01.553326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:01.553340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:01.553353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:01.553401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:01.553429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:01.553442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:01.554764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:01.556134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:01.556182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:01.556217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:01.556254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:01.570992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId: src_id|604ea850-4581e738-1d9d9-213f384c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:01.597414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:01.979903Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:02.046203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:02.046253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:02.050464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:02.050504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:02.053369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:02.053697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594108231610875:7619]
2025-10-10T14:06:02.054525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:02.070009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 552 reason: error at write: Disconnected sessionId: src_id|604ea850-4581e738-1d9d9-213f384c_0
2025-10-10T14:06:02.070430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 552 sessionId: src_id|604ea850-4581e738-1d9d9-213f384c_0 is DEAD
2025-10-10T14:06:02.077379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604ea850-4581e738-1d9d9-213f384c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:02.077430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604ea850-4581e738-1d9d9-213f384c_0] Write session will restart in 0.006686s
2025-10-10T14:06:02.077544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604ea850-4581e738-1d9d9-213f384c_0] Write session: Do CDS request
2025-10-10T14:06:02.077579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604ea850-4581e738-1d9d9-213f384c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:02.090388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|604ea850-4581e738-1d9d9-213f384c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:02.101273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:02.101303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 553
2025-10-10T14:06:02.102250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:02.102377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:02.102394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:02.102404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:02.103789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 553 sessionId:  describe result for acl check
2025-10-10T14:06:02.103902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:02.103912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:02.103922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:02.103940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594112526578224:8145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:02.106726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594112526578224:8145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:02.153329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594112526578245:7619]
2025-10-10T14:06:02.163328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594112526578224:8145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:02.180748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594112526578224:8145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:02.180788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594112526578224:8145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:02.180805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594112526578224:8145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:02.180840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:02.246832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:02.256251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:02.257188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:02.257208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:02.257256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:02.257544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:02.257747Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594110948657814:7310]
2025-10-10T14:06:02.260368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:02.264577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:02.264855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:02.266319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:02.266705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:02.266715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:02.266723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:02.266731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:02.266738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:02.266748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:02.266755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:02.266763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:02.266772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.266780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.266788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.266796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.266850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:02.266971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:02.267028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:02.267094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:02.267146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:02.267199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:02.267253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:02.267304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:02.267354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.267411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.267461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.267514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.267558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:02.267635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:02.267702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:02.267763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:02.267823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:02.267889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:02.267940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:02.267999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:02.268054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:02.268112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:02.268161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:02.268222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:02.268277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:02.270039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:02.270137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:02.270211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:02.270277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.270342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.270407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.270474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.270529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.270590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.270642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.270701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.271208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:02.321676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:02.338933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:02.338983Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:02.339003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:02.339025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:02.339051Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 552 [2:7559594110948657814:7310]
2025-10-10T14:06:02.339114Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:02.339338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:02.339355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:02.339369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:02.339383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:02.339435Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:02.339460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:02.339483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:02.342395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.342429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.342446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.342461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.342474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:02.342783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:02.342802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.342962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.343451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.343709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.343837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:02.343916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.343930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.343946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.343960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.344011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:02.344097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:02.344185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:02.344201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:02.344216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:02.344229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:02.344298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:02.344317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:02.344507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.344537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:02.344547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:02.344647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594112526578245:7619], now have 1 active actors on pipe
2025-10-10T14:06:02.344675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594112526578256:8145], now have 1 active actors on pipe
2025-10-10T14:06:02.344699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594112526578215:2442], now have 1 active actors on pipe
2025-10-10T14:06:02.353288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 552, pipe: [1:7559594112526578245:7619]
2025-10-10T14:06:02.353415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 552
2025-10-10T14:06:02.353497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 552
2025-10-10T14:06:02.357799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:02.357844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:02.357949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:02.357988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:02.358007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:02.358018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:02.358060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:02.358109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:02.358161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:02.358846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:02.358867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:02.358931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:02.359393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 553 partition: 0 MaxSeqNo: 36 sessionId: src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0
2025-10-10T14:06:02.361171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604ea850-4581e738-1d9d9-213f384c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:02.435045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:02.435079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:02.435091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:02.461926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0] Write session: try to update token
2025-10-10T14:06:02.461986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:02.546433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:02.546468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:02.546482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:02.546493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:02.546505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:02.546541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.546566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.546592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.546616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.546829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:02.546842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:02.546852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:02.546894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:02.546920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.546932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:02.547641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:02.547674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:02.547703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:02.547731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:02.548010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:02.649156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId: src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:02.682080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:02.725327Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:02.740935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594112526578245:7619]
2025-10-10T14:06:02.741037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:02.738949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:02.739005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:02.739078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:02.739096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:02.739141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594110948657809:7310]
2025-10-10T14:06:02.739424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:02.739803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:02.752042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:02.752186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 553 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0
2025-10-10T14:06:02.752479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 553 sessionId: src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0 is DEAD
2025-10-10T14:06:02.754859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:02.754919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0] Write session will restart in 0.006205s
2025-10-10T14:06:02.755103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0] Write session: Do CDS request
2025-10-10T14:06:02.755159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:02.783915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:02.785483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:02.785515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 554
2025-10-10T14:06:02.785888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:02.786010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:02.786030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:02.786042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:02.787970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 554 sessionId:  describe result for acl check
2025-10-10T14:06:02.788083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:02.788094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:02.788103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:02.788121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594112526578396:8158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:02.790828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594112526578396:8158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:02.809085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594112526578396:8158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:02.840499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594112526578396:8158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:02.840549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594112526578396:8158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:02.840570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594112526578396:8158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:02.840602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:02.841867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594112526578500:7619]
2025-10-10T14:06:02.870782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:02.878082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:02.878776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:02.878805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:02.878843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:02.879053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:02.879216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594110948657963:7317]
2025-10-10T14:06:02.880735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:02.888509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:02.888809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:02.890424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:02.890825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:02.890834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:02.890842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:02.890849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:02.890857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:02.890865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:02.890872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:02.890879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:02.890885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.890894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.890902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.890909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.890959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:02.891078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:02.891130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:02.891185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:02.891236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:02.891284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:02.891333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:02.891380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:02.891426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.891478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.891527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.891579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.891623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:02.891694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:02.891757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:02.892561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:02.892635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:02.892698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:02.892746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:02.892803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:02.892853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:02.892912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:02.892964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:02.893019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:02.893105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:02.893187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:02.893237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:02.893299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:02.893353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.893409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:02.893458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.893514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:02.893567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.893626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:02.893673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.893730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:02.894215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:02.950535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:02.978574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:02.985230Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:02.985272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:02.985294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:02.985320Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 553 [2:7559594110948657963:7317]
2025-10-10T14:06:02.985387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:02.985458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:02.985475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:02.985489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:02.985501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:02.985552Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:02.985577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:02.985601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:03.018971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.018999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:03.019012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:03.019023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:03.019033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:03.019316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:03.019332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.019465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:03.019636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:03.019845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:03.019954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:03.020034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594110948657958:7317]
2025-10-10T14:06:03.020049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594110948657958:7317]
2025-10-10T14:06:03.020063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594110948657958:7317]
2025-10-10T14:06:03.020076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594110948657958:7317]
2025-10-10T14:06:03.020121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:03.020206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:03.020387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:03.020403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:03.020539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594110948657958:7317]
2025-10-10T14:06:03.020560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:03.023645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 553
2025-10-10T14:06:03.023727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 553, pipe: [1:7559594112526578500:7619]
2025-10-10T14:06:03.023819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 553
2025-10-10T14:06:03.021852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:03.021872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:03.021884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:03.021896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:03.021920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:03.025819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594112526578498:8158], now have 1 active actors on pipe
2025-10-10T14:06:03.025856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594112526578500:7619], now have 1 active actors on pipe
2025-10-10T14:06:03.025878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594112526578382:2442], now have 1 active actors on pipe
2025-10-10T14:06:03.025924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:03.025948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:03.026040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:03.026075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:03.026093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:03.026103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:03.026139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:03.026183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:03.026230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:03.028767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:03.028798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:03.028873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:03.030259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 554 partition: 0 MaxSeqNo: 36 sessionId: src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0
2025-10-10T14:06:03.031538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7db2021-3c94e240-cae30fff-6b72a88c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:03.079787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0] Write session: try to update token
2025-10-10T14:06:03.079852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:03.084463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:03.084497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:03.084513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:03.141229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:03.141266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:03.141281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:03.141294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:03.141316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:03.141380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594110948657958:7317]
2025-10-10T14:06:03.141421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594110948657958:7317]
2025-10-10T14:06:03.141448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594110948657958:7317]
2025-10-10T14:06:03.141473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594110948657958:7317]
2025-10-10T14:06:03.141639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:03.141670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.141683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:03.142122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:03.142163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:03.142196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:03.142226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:03.164792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:03.268239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId: src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0 grpc read done: success: 1 data:  write_request[data omitted]
E1010 14:06:03.306257353  107558 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:06:03.318705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:03.329332Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:06:03.354596Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:03.356419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:03.356465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:03.366426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:03.366453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:03.369877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594112526578500:7619]
2025-10-10T14:06:03.370026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:03.374807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 554 reason: error at write: Disconnected sessionId: src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0
2025-10-10T14:06:03.375105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 554 sessionId: src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0 is DEAD
2025-10-10T14:06:03.375737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:03.375774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0] Write session will restart in 0.007974s
2025-10-10T14:06:03.375874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0] Write session: Do CDS request
2025-10-10T14:06:03.375906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:03.390230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:03.393575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:03.392862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:03.392891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 555
2025-10-10T14:06:03.393289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:03.393400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:03.393416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:03.393426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:03.395380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 555 sessionId:  describe result for acl check
2025-10-10T14:06:03.395482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:03.395493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:03.395502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:03.395517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594116821545842:8166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:03.398600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594116821545842:8166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:03.410381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594116821545842:8166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:03.468719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594116821545842:8166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:03.468766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594116821545842:8166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:03.468783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594116821545842:8166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:03.468816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:03.473299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594116821545953:7619]
2025-10-10T14:06:03.489920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:03.505486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:03.506425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:03.506446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:03.506494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:03.506777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:03.506963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594115243625408:7323]
2025-10-10T14:06:03.509937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:03.515471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:03.515760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:03.517190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:03.517561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:03.517569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:03.517577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:03.517584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:03.517591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:03.517598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:03.517605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:03.517612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:03.517620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.517628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:03.517635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:03.517643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:03.517697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:03.517823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:03.517878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:03.517928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:03.517976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:03.518024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:03.518075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:03.518123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:03.518175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.518227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:03.518276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:03.518330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:03.518374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:03.518454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:03.518522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:03.518581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:03.518634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:03.518692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:03.518744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:03.518802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:03.518857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:03.518918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:03.518967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:03.519024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:03.520206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:03.520281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:03.520335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:03.520397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:03.520453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.520513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.520562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:03.520620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:03.520672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:03.520731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:03.520777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:03.520833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:03.521375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:03.555030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:03.582096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:03.582147Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:03.582168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:03.582192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:03.582218Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 554 [2:7559594115243625408:7323]
2025-10-10T14:06:03.582282Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:03.582348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:03.582364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:03.582379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:03.582393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:03.582442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:03.582465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:03.582488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:03.586329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 554
2025-10-10T14:06:03.583840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.586344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 554
2025-10-10T14:06:03.583869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:03.586415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 554, pipe: [1:7559594116821545953:7619]
2025-10-10T14:06:03.583886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:03.583902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:03.583914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:03.584214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:03.584235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.584398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:03.584617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:03.584873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:03.585004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:03.585100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594115243625403:7323]
2025-10-10T14:06:03.585117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594115243625403:7323]
2025-10-10T14:06:03.586967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594115243625403:7323]
2025-10-10T14:06:03.586989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594115243625403:7323]
2025-10-10T14:06:03.587016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:03.587087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:03.587279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:03.587297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:03.587348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594116821545831:2442], now have 1 active actors on pipe
2025-10-10T14:06:03.587374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594116821545944:8166], now have 1 active actors on pipe
2025-10-10T14:06:03.587399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594116821545953:7619], now have 1 active actors on pipe
2025-10-10T14:06:03.587451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:03.587474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:03.587630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594115243625403:7323]
2025-10-10T14:06:03.587655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:03.587731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:03.587764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:03.587782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:03.587794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:03.587827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:03.587869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:03.588010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:03.588517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:03.588530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:03.588544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:03.588556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:03.588580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:03.591570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 555 partition: 0 MaxSeqNo: 36 sessionId: src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0
2025-10-10T14:06:03.591120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:03.591154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:03.591227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:03.597710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|435f9a74-d4b6ba7d-ccf00bed-ba6d4320_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:03.658047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0] Write session: try to update token
2025-10-10T14:06:03.658110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:03.711683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:03.711708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:03.711716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:03.711772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:03.711790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:03.711803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:03.711812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:03.711821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:03.711848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594115243625403:7323]
2025-10-10T14:06:03.711867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594115243625403:7323]
2025-10-10T14:06:03.711884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594115243625403:7323]
2025-10-10T14:06:03.711900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594115243625403:7323]
2025-10-10T14:06:03.711995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:03.712015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:03.712022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:03.712290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:03.712329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:03.712361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:03.712390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:03.715093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:03.867869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId: src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:03.911013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:04.169743Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:04.217996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:04.218037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:04.226170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:04.226327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:04.226339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:04.248701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 555 reason: error at write: Disconnected sessionId: src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0
2025-10-10T14:06:04.249050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 555 sessionId: src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0 is DEAD
2025-10-10T14:06:04.249514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:04.249554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0] Write session will restart in 0.009539s
2025-10-10T14:06:04.249662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0] Write session: Do CDS request
2025-10-10T14:06:04.249697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:04.258555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:04.264701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:04.285687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594116821545953:7619]
2025-10-10T14:06:04.285789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:04.285803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 556
2025-10-10T14:06:04.288636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:04.288765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:04.288786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:04.288797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:04.292578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 556 sessionId:  describe result for acl check
2025-10-10T14:06:04.292681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:04.292691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:04.292699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:04.292715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594121116513319:8179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:04.302718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594121116513319:8179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:04.342362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594121116513319:8179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:04.379520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594121116513319:8179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:04.379573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594121116513319:8179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:04.379593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594121116513319:8179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:04.379629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:04.390375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594121116513425:7619]
2025-10-10T14:06:04.394530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:04.405994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:04.406867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:04.406887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:04.406930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:04.407195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:04.407394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594119538592880:7333]
2025-10-10T14:06:04.409975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:04.417570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:04.417875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:04.419338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:04.419705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:04.419714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:04.419722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:04.419732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:04.419740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:04.419747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:04.419754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:04.419762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:04.419770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:04.419779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:04.419785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:04.419793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:04.419845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:04.419961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:04.420014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:04.420077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:04.420144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:04.420197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:04.420245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:04.420299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:04.420350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:04.420405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:04.420456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:04.420507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:04.420553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:04.420626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:04.420691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:04.420750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:04.420807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:04.420867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:04.420918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:04.420978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:04.421064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:04.421119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:04.427797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:04.427903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:04.427964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:04.428023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:04.428091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:04.428154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:04.428211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:04.428276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:04.428332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:04.428394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:04.428446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:04.428504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:04.428559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:04.428617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:04.429157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:04.490026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:04.557387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:04.557435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:04.557454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:04.557473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:04.557497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 555 [2:7559594119538592880:7333]
2025-10-10T14:06:04.557556Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:04.557616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:04.557632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:04.557645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:04.557657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:04.557707Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:04.557732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:04.557755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:04.562028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:04.562056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:04.562072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:04.562086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:04.562102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:04.562400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:04.562419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:04.562573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:04.562774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:04.563020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:04.563140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:04.563222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:04.563238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:04.563251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:04.563265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:04.563313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:04.563410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:04.563605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:04.563622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:04.563783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:04.563807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:04.565180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:04.565194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:04.565209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:04.565222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:04.565248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:04.566988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 555, pipe: [1:7559594121116513425:7619]
2025-10-10T14:06:04.567137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 555
2025-10-10T14:06:04.567239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 555
2025-10-10T14:06:04.571897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 556 partition: 0 MaxSeqNo: 36 sessionId: src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0
2025-10-10T14:06:04.570475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594121116513425:7619], now have 1 active actors on pipe
2025-10-10T14:06:04.570524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594121116513421:8179], now have 1 active actors on pipe
2025-10-10T14:06:04.570551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594121116513305:2442], now have 1 active actors on pipe
2025-10-10T14:06:04.570611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:04.570637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:04.570732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:04.570766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:04.570784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:04.570796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:04.570831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:04.570875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:04.570929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:04.571522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:04.571544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:04.571608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:04.573569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34cc98a9-f302ec28-3e8a27a6-6b23a99c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:04.660405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:04.660458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:04.660475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:04.681382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0] Write session: try to update token
2025-10-10T14:06:04.681438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:04.784832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:04.784869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:04.784886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:04.784901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:04.784913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:04.784953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:04.784985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:04.785033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:04.785060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:04.785447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:04.785477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:04.785502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:04.785592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:04.785643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:04.785665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:04.786076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:04.786142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:04.786206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:04.786270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:04.806610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:04.881075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId: src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:04.904500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:04.993907Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:05.054312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:05.054357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:05.054417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:05.054431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:05.054471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594119538592874:7333]
2025-10-10T14:06:05.056051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:05.056657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:05.061368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:05.061396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:05.063790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:05.064095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594121116513425:7619]
2025-10-10T14:06:05.073020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 556 reason: error at write: Disconnected sessionId: src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0
2025-10-10T14:06:05.073360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 556 sessionId: src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0 is DEAD
2025-10-10T14:06:05.077361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:05.077402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0] Write session will restart in 0.009461s
2025-10-10T14:06:05.077508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0] Write session: Do CDS request
2025-10-10T14:06:05.077550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:05.094020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:05.099196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:05.099231Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 557
2025-10-10T14:06:05.104654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:05.104831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:05.104848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:05.104858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:05.107229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 557 sessionId:  describe result for acl check
2025-10-10T14:06:05.107355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:05.107366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:05.107376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:05.107391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594125411480782:8188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:05.110314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594125411480782:8188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:05.128784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594125411480782:8188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:05.160822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594125411480840:7619]
2025-10-10T14:06:05.162589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594125411480782:8188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:05.162632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594125411480782:8188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:05.162648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594125411480782:8188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:05.162679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:05.209359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:05.226503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:05.233840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:05.233878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:05.233953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:05.234389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:05.234601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594123833560315:7342]
2025-10-10T14:06:05.237453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:05.245221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:05.245519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:05.246760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:05.247078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:05.247084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:05.247092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:05.247099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:05.247105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:05.247112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:05.247117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:05.247123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:05.247130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.247136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.247142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.247148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.247195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:05.247298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:05.247341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:05.247386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:05.247429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:05.247473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:05.247516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:05.247559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:05.247608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.247653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.247693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.247736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.247778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:05.247839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:05.247894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:05.247945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:05.247990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:05.248039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:05.248082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:05.248133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:05.248181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:05.248230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:05.248272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:05.248322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:05.248662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:05.248719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:05.248762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:05.248810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:05.248854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.248903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.248946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.249012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.249055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.249105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.249165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.249217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.249646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:05.281314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:05.300748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:05.300795Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:05.300815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:05.300838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:05.300865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 556 [2:7559594123833560315:7342]
2025-10-10T14:06:05.300929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:05.301012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:05.301028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:05.301041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:05.301053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:05.301106Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:05.301150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:05.301175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:05.305446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.305467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.305481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.305494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.305505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:05.305804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:05.305821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.305966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.306143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.306363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.306469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:05.306553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.306570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.306583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.306595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.306626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:05.306710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:05.306718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:05.306734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:05.306746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:05.306756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:05.306883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:05.306907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:05.307071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594125411480840:7619], now have 1 active actors on pipe
2025-10-10T14:06:05.307095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594125411480772:2442], now have 1 active actors on pipe
2025-10-10T14:06:05.307113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594125411480844:8188], now have 1 active actors on pipe
2025-10-10T14:06:05.307132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.307166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:05.307371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:05.309956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:05.310006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:05.310092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:05.310130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:05.310149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:05.310160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:05.310199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:05.310246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:05.310294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:05.309259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 556, pipe: [1:7559594125411480840:7619]
2025-10-10T14:06:05.309362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 556
2025-10-10T14:06:05.309436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 556
2025-10-10T14:06:05.311893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:05.311919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:05.311988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:05.313379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc54dc80-fcaa8138-b72d7401-9593d40b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:05.312401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 557 partition: 0 MaxSeqNo: 36 sessionId: src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0
2025-10-10T14:06:05.377461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0] Write session: try to update token
2025-10-10T14:06:05.377524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:05.594639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId: src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:05.601767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:05.601796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:05.601804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:05.601847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:05.601858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:05.601866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:05.601874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:05.601881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:05.601913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.601946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.601969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.601994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.602147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:05.602172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.602172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:05.602184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:05.602205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:05.602244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:05.602278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:05.603320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:05.632637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:05.775462Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:05.795043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:05.795097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:05.795170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:05.795186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:05.795229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594123833560309:7342]
2025-10-10T14:06:05.795652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:05.795951Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:05.799504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:05.839199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 557 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0
2025-10-10T14:06:05.839502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 557 sessionId: src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0 is DEAD
2025-10-10T14:06:05.845498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:05.845538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0] Write session will restart in 0.006675s
2025-10-10T14:06:05.845642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0] Write session: Do CDS request
2025-10-10T14:06:05.845675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:05.869797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:05.896388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594125411480840:7619]
2025-10-10T14:06:05.896459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:05.896550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:05.896570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 558
2025-10-10T14:06:05.897600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:05.897759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:05.897775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:05.897786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:05.906543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 558 sessionId:  describe result for acl check
2025-10-10T14:06:05.906686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:05.906697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:05.906708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:05.906724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594125411481021:8201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:05.922613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594125411481021:8201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:05.944118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594125411481021:8201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:05.947443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:05.953687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:05.954573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:05.954592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:05.954638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:05.954903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:05.955078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594123833560473:7352]
2025-10-10T14:06:05.960092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:05.962521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594125411481021:8201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:05.962568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594125411481021:8201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:05.962586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594125411481021:8201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:05.962616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:05.965453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:05.965739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:05.967084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:05.967420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:05.967427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:05.967434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:05.967441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:05.967449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:05.967456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:05.967463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:05.967469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:05.967475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.967482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.967489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.967496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.967541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:05.967646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:05.967699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:05.967750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:05.967798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:05.967849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:05.967895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:05.967942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:05.967991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.968040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.968087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.968135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.968177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:05.968245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:05.968303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:05.968358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:05.968408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:05.968464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:05.968510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:05.968564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:05.968610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:05.968665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:05.968714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:05.968768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:05.968816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:05.968873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:05.968920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:05.968990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:05.969037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.969089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:05.971126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.971219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:05.971274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.971340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:05.971385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.971434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:05.971882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:05.995915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594125411481074:7619]
2025-10-10T14:06:06.014333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:06.031727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:06.031779Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:06.031796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:06.031815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:06.031842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 557 [2:7559594123833560473:7352]
2025-10-10T14:06:06.031897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:06.031963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:06.031979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:06.031992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:06.032003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:06.032054Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:06.032078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:06.032100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:06.035409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.035443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:06.035459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:06.035473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:06.035484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:06.035782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:06.035801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.035947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:06.036142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:06.036365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:06.036484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:06.036566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594123833560468:7352]
2025-10-10T14:06:06.036582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594123833560468:7352]
2025-10-10T14:06:06.036596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594123833560468:7352]
2025-10-10T14:06:06.036609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594123833560468:7352]
2025-10-10T14:06:06.036661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:06.036749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:06.036940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:06.036976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:06.037118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594123833560468:7352]
2025-10-10T14:06:06.038046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:06.038064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:06.038076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:06.038087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:06.039142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 557
2025-10-10T14:06:06.039229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 557, pipe: [1:7559594125411481074:7619]
2025-10-10T14:06:06.039302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 557
2025-10-10T14:06:06.040843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:06.041001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594125411481070:8201], now have 1 active actors on pipe
2025-10-10T14:06:06.041027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594125411481074:7619], now have 1 active actors on pipe
2025-10-10T14:06:06.041050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594125411481008:2442], now have 1 active actors on pipe
2025-10-10T14:06:06.041098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:06.041137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:06.041313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:06.041351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:06.041370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:06.041381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:06.041423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:06.041471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:06.041549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:06.041997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:06.044510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:06.044541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:06.044621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:06.045056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 558 partition: 0 MaxSeqNo: 36 sessionId: src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0
2025-10-10T14:06:06.047029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76128ab1-e09b8814-2561bd58-d31c63d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:06.101070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0] Write session: try to update token
2025-10-10T14:06:06.101142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:06.134607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:06.134636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:06.134645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:06.215521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:06.215559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:06.215573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:06.215587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:06.215600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:06.215642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594123833560468:7352]
2025-10-10T14:06:06.215672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594123833560468:7352]
2025-10-10T14:06:06.215699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594123833560468:7352]
2025-10-10T14:06:06.215722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594123833560468:7352]
2025-10-10T14:06:06.215885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:06.215915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.215927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:06.216174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:06.216213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:06.216244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:06.216270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:06.228978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:06.313372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId: src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:06.382832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:06.448493Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:06.451800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:06.451844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:06.457440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:06.538285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:06.620002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:06.620088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0] Write session will restart in 0.007977s
2025-10-10T14:06:06.620270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0] Write session: Do CDS request
2025-10-10T14:06:06.620328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:06.617963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594125411481074:7619]
2025-10-10T14:06:06.618051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:06.618599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 558 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0
2025-10-10T14:06:06.618973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 558 sessionId: src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0 is DEAD
2025-10-10T14:06:06.638893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:06.640918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:06.641260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 559
2025-10-10T14:06:06.640743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:06.641653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:06.642480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:06.642500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:06.642559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:06.642906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:06.643150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594128128527934:7361]
2025-10-10T14:06:06.648104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:06.649868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:06.650221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:06.651728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:06.652095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:06.652104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:06.652111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:06.652119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:06.652125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:06.652133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:06.652141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:06.652149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:06.652157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.652164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:06.652172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:06.652181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:06.652235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:06.652353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:06.652404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:06.652457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:06.652507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:06.653141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:06.653222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:06.653269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:06.653317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.653367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:06.653415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:06.653463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:06.653513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:06.653584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:06.653654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:06.653723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:06.653779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:06.653834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:06.653883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:06.653940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:06.653994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:06.654049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:06.654096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:06.654151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:06.654215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:06.654278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:06.654323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:06.654382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:06.654433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.654492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.654538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:06.654598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:06.654648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:06.654702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:06.654746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:06.654803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:06.655241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:06.659223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:06.659519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:06.659539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:06.659562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:06.667899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 559 sessionId:  describe result for acl check
2025-10-10T14:06:06.668049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:06.668062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:06.668074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:06.668093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594129706448491:8209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:06.671231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594129706448491:8209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:06.694270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594129706448491:8209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:06.721440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594129706448515:7619]
2025-10-10T14:06:06.724453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594129706448491:8209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:06.724499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594129706448491:8209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:06.724516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594129706448491:8209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:06.724545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:06.740330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:06.792369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:06.792418Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:06.792433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:06.792454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:06.792478Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 558 [2:7559594128128527934:7361]
2025-10-10T14:06:06.792534Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:06.792603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:06.792619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:06.792632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:06.792645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:06.792701Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:06.792724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:06.792746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:06.794935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.794961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:06.794975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:06.794990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:06.795001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:06.795293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:06.795310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.795451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:06.795622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:06.795839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:06.795951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:06.796032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594128128527928:7361]
2025-10-10T14:06:06.796047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594128128527928:7361]
2025-10-10T14:06:06.796059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594128128527928:7361]
2025-10-10T14:06:06.796072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594128128527928:7361]
2025-10-10T14:06:06.796118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:06.796197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:06.796374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:06.796392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:06.796540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594128128527928:7361]
2025-10-10T14:06:06.796561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:06.797480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:06.797498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:06.797509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:06.797518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:06.797542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:06.799130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 558, pipe: [1:7559594129706448515:7619]
2025-10-10T14:06:06.799231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 558
2025-10-10T14:06:06.799306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 558
2025-10-10T14:06:06.801303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594129706448515:7619], now have 1 active actors on pipe
2025-10-10T14:06:06.801339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594129706448480:2442], now have 1 active actors on pipe
2025-10-10T14:06:06.801365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594129706448520:8209], now have 1 active actors on pipe
2025-10-10T14:06:06.801440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:06.801463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:06.801547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:06.801592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:06.801611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:06.801621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:06.801660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:06.801712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:06.801758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:06.805388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:06.805431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:06.805513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:06.809529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 559 partition: 0 MaxSeqNo: 36 sessionId: src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0
2025-10-10T14:06:06.814303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fae9bf0-78024288-8df90ad3-4f6f163a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:06.880449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0] Write session: try to update token
2025-10-10T14:06:06.880514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:06.893625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:06.893655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:06.893668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:06.980697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:06.980733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:06.980747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:06.980760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:06.980773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:06.980814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594128128527928:7361]
2025-10-10T14:06:06.980843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594128128527928:7361]
2025-10-10T14:06:06.980871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594128128527928:7361]
2025-10-10T14:06:06.980893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594128128527928:7361]
2025-10-10T14:06:06.981070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:06.981103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:06.981116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:06.981803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:06.981848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:06.981885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:06.981918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:06.984207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:07.089974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId: src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:07.110871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:07.195562Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:07.198578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:07.198625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:07.205157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594129706448515:7619]
2025-10-10T14:06:07.205243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:07.205362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:07.205373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:07.224175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 559 reason: error at write: Disconnected sessionId: src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0
2025-10-10T14:06:07.224478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 559 sessionId: src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0 is DEAD
2025-10-10T14:06:07.225844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:07.225901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0] Write session will restart in 0.007939s
2025-10-10T14:06:07.226072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0] Write session: Do CDS request
2025-10-10T14:06:07.226117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:07.239852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:07.239888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 560
2025-10-10T14:06:07.241858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:07.242577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:07.242744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:07.242762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:07.242774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:07.246384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:07.244574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 560 sessionId:  describe result for acl check
2025-10-10T14:06:07.244723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:07.244734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:07.244744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:07.244762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594134001415870:8217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:07.248318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594134001415870:8217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:07.277877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594134001415870:8217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:07.305228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594134001415957:7619]
2025-10-10T14:06:07.310377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594134001415870:8217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:07.310416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594134001415870:8217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:07.310434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594134001415870:8217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:07.310462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:07.329670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:07.332918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:07.333881Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:07.333903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:07.333953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:07.334249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:07.334442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594132423495391:7371]
2025-10-10T14:06:07.336871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:07.338716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:07.338984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:07.340413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:07.340784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:07.340794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:07.340802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:07.340811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:07.340819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:07.340827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:07.340834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:07.340842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:07.340850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:07.340858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:07.340866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:07.340873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:07.340947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:07.341070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:07.341140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:07.341195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:07.341247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:07.341303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:07.341356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:07.341407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:07.341457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:07.341508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:07.341558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:07.341611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:07.341657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:07.341730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:07.341797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:07.341858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:07.341910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:07.341969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:07.342018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:07.342076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:07.342130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:07.342193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:07.342243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:07.342301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:07.342354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:07.342413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:07.342459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:07.342512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:07.342565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:07.342621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:07.342671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:07.342725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:07.342777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:07.342835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:07.342886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:07.342946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:07.343431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:07.390254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:07.404129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:07.404175Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:07.404194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:07.404214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:07.404238Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 559 [2:7559594132423495391:7371]
2025-10-10T14:06:07.404299Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:07.404363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:07.404379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:07.404391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:07.404402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:07.404450Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:07.404475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:07.404497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:07.406169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:07.406199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:07.406215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:07.406233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:07.406246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:07.406540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:07.406559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:07.406717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:07.406930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:07.407170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:07.407263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:07.407337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.407352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.407367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.407380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.407425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:07.407511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:07.407711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:07.407730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:07.407857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.407878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:07.409836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:07.409857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:07.409871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:07.409883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:07.409907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:07.412359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 559, pipe: [1:7559594134001415957:7619]
2025-10-10T14:06:07.412472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 559
2025-10-10T14:06:07.412544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 559
2025-10-10T14:06:07.413764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594134001415957:7619], now have 1 active actors on pipe
2025-10-10T14:06:07.413800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594134001415979:8217], now have 1 active actors on pipe
2025-10-10T14:06:07.413824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594134001415857:2442], now have 1 active actors on pipe
2025-10-10T14:06:07.415518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:07.415549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:07.415636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:07.415667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:07.415685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:07.415697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:07.415733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:07.415773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:07.415822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:07.416640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:07.416663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:07.416721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:07.418154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64863a0f-4a9cfcb3-e32614c0-7388e7f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:07.417406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 560 partition: 0 MaxSeqNo: 36 sessionId: src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0
2025-10-10T14:06:07.503819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0] Write session: try to update token
2025-10-10T14:06:07.503874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:07.670174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:07.670200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:07.670212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:07.670264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:07.670281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:07.670293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:07.670304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:07.670315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:07.670350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.670375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.670396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.670418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.670536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:07.670588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:07.670603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:07.670626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:07.670630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:07.670642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:07.670654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:07.679765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId: src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:07.688093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:07.771968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:07.928146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:07.941278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:07.941328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:07.941393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:07.941409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:07.941453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594132423495385:7371]
2025-10-10T14:06:07.943635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:07.946121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:07.945448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594134001415957:7619]
2025-10-10T14:06:07.945584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:07.945598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:07.969081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:07.969284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 560 reason: error at write: Disconnected sessionId: src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0
2025-10-10T14:06:07.969589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 560 sessionId: src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0 is DEAD
2025-10-10T14:06:07.973641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:07.973689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0] Write session will restart in 0.006413s
2025-10-10T14:06:07.973791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0] Write session: Do CDS request
2025-10-10T14:06:07.973824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:07.992425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:07.996760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:07.996789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 561
2025-10-10T14:06:07.997427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:07.997546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:07.997562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:07.997571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:07.999444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 561 sessionId:  describe result for acl check
2025-10-10T14:06:07.999550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:07.999561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:07.999570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:07.999586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594134001416056:8230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:08.002291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594134001416056:8230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:08.016550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594134001416056:8230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:08.041084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594134001416056:8230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:08.041150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594134001416056:8230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:08.041172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594134001416056:8230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:08.041209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:08.044638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:08.049396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:08.050377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:08.050409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:08.050460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:08.050788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:08.051006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594136718462852:7380]
2025-10-10T14:06:08.049856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594138296383462:7619]
2025-10-10T14:06:08.055179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:08.060586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:08.060872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:08.062509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:08.062909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:08.062919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:08.062927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:08.062936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:08.062944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:08.062952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:08.062961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:08.062970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:08.062978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.062985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.062992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.063002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.063055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:08.063183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:08.063247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:08.063304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:08.063358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:08.063411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:08.063461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:08.063514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:08.063568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.063624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.063678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.063728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.063774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:08.063855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:08.063923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:08.063985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:08.064039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:08.064105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:08.064157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:08.064215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:08.064270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:08.064331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:08.064382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:08.064441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:08.064494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:08.064552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:08.064602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:08.064665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:08.064720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.064778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.064830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.064890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.064965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.065023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.065072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.068388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.069054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:08.103893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:08.142761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:08.142811Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:08.142830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:08.142851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:08.142875Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 560 [2:7559594136718462852:7380]
2025-10-10T14:06:08.142935Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:08.143000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:08.143017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:08.143029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:08.143041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:08.143439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:08.143475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:08.143497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:08.145674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.145706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.145720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.145735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.145747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:08.146043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:08.146071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.146231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.146432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.146673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.146805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:08.146896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594134001416044:2442], now have 1 active actors on pipe
2025-10-10T14:06:08.146922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594138296383459:8230], now have 1 active actors on pipe
2025-10-10T14:06:08.146946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594138296383462:7619], now have 1 active actors on pipe
2025-10-10T14:06:08.146970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.146985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.147000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.147013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.147051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:08.147131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:08.147323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:08.147341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:08.147462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.147482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:08.148116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:08.148153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:08.148166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:08.148179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:08.148209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:08.153392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 560
2025-10-10T14:06:08.153532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 560
2025-10-10T14:06:08.153611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 560, pipe: [1:7559594138296383462:7619]
2025-10-10T14:06:08.154136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:08.154189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:08.154273Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:08.154323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:08.154349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:08.154361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:08.154400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:08.154457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:08.154516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:08.158705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 561 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0
2025-10-10T14:06:08.158147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:08.158192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:08.158293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:08.161505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68f56f8-c8481ca6-e43e3252-5c9707ca_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:08.192744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0] Write session: try to update token
2025-10-10T14:06:08.192804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:08.348245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId: src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:08.384360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:08.384391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:08.384402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:08.384519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:08.384535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:08.384549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:08.384562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:08.384574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:08.384609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.384641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.384668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.384692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.384792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:08.384821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:08.384852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:08.384881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:08.425301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:08.425346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.425358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:08.438442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:08.444476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:08.591079Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:08.593727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:08.593757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:08.593804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594136718462846:7380]
2025-10-10T14:06:08.593947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:08.593974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:08.594319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:08.595450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:08.599372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:08.599428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:08.691885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 561 reason: error at write: Disconnected sessionId: src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0
2025-10-10T14:06:08.692594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:08.692679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0] Write session will restart in 0.008709s
2025-10-10T14:06:08.692807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0] Write session: Do CDS request
2025-10-10T14:06:08.692842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:08.692239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 561 sessionId: src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0 is DEAD
2025-10-10T14:06:08.708101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:08.735115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:08.740355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:08.743200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:08.743240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:08.743302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:08.743704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:08.743910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594136718463001:7384]
2025-10-10T14:06:08.746378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:08.748609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:08.749218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:08.751394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:08.751666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594138296383462:7619]
2025-10-10T14:06:08.752274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:08.752290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 562
2025-10-10T14:06:08.751504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:08.751930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:08.751939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:08.751948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:08.751957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:08.751966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:08.751973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:08.751981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:08.751989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:08.751996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.752004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.752010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.752018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.752076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:08.752203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:08.752262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:08.752314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:08.752365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:08.752416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:08.752467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:08.752520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:08.753435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.753510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.753559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.753620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.753672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:08.753428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:08.753559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:08.753575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:08.753585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:08.753961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:08.754041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:08.754115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:08.754176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:08.754236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:08.754291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:08.754362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:08.754417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:08.754487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:08.754539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:08.754610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:08.754665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:08.754727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:08.754776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:08.754834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:08.754891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.754948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.755037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 562 sessionId:  describe result for acl check
2025-10-10T14:06:08.754999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.755060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.755163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:08.755115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.755174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:08.755172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.755184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:08.755224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.755201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594138296383583:8236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:08.755281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.755781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:08.759042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594138296383583:8236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:08.766772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594138296383583:8236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:08.790357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:08.786606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594138296383583:8236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:08.786652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594138296383583:8236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:08.786671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594138296383583:8236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:08.786703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:08.820460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:08.820496Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:08.820512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:08.820526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:08.820542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 561 [2:7559594136718463001:7384]
2025-10-10T14:06:08.820584Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:08.820632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:08.820645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:08.820657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:08.820669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:08.820710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:08.820727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:08.820744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:08.824468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 561
2025-10-10T14:06:08.824570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 561
2025-10-10T14:06:08.823064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.823089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.823105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.823116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.823125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:08.823380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:08.823399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:08.823553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:08.823763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:08.823933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:08.824014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:08.824071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594138296383613:8236], now have 1 active actors on pipe
2025-10-10T14:06:08.824088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594138296383578:2442], now have 1 active actors on pipe
2025-10-10T14:06:08.824107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:08.824119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:08.824129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:08.824138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:08.824168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:08.824225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:08.824224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:08.824244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:08.824257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:08.824269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:08.824385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:08.824398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:08.824520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:08.824541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:08.824601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:08.824658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:08.824679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:08.824764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:08.824795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:08.824816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:08.824826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:08.824856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:08.824901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:08.824933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:08.830417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:08.830455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:08.830539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:08.831585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 562 partition: 0 MaxSeqNo: 36 sessionId: src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0
2025-10-10T14:06:08.834302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f94017a-a7dc5ebb-66214050-80e3ca4c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:08.851689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594138296383633:7619]
2025-10-10T14:06:08.854592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 561, pipe: [1:7559594138296383633:7619]
2025-10-10T14:06:08.854574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594138296383633:7619], now have 1 active actors on pipe
2025-10-10T14:06:08.883833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:08.883865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:08.883878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:08.897253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0] Write session: try to update token
2025-10-10T14:06:08.897321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:09.004248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:09.004279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:09.004294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:09.004306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:09.004317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:09.004352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:09.004376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:09.004400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:09.004423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:09.004554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:09.004579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:09.004603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:09.004625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:09.004639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:09.004651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:09.004664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:09.004707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:09.004730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:09.004742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:09.017938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:09.081497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId: src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:09.120192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:09.212961Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:09.236687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:09.236734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:09.236800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:09.236816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:09.236860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594136718462996:7384]
2025-10-10T14:06:09.237092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:09.238452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:09.238478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:09.238727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594138296383633:7619]
2025-10-10T14:06:09.238862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:09.249618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:09.302881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 562 reason: error at write: Disconnected sessionId: src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0
2025-10-10T14:06:09.303182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 562 sessionId: src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0 is DEAD
2025-10-10T14:06:09.305549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:09.305594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0] Write session will restart in 0.007839s
2025-10-10T14:06:09.305717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0] Write session: Do CDS request
2025-10-10T14:06:09.305751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:09.318167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:09.318196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 563
2025-10-10T14:06:09.326207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:09.326973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:09.327118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:09.327134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:09.327145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:09.332001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 563 sessionId:  describe result for acl check
2025-10-10T14:06:09.332141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:09.332153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:09.332164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:09.332183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594142591351009:8245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:09.334969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594142591351009:8245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:09.338868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594142591351022:7619]
2025-10-10T14:06:09.361203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594142591351009:8245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:09.378817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594142591351009:8245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:09.378867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594142591351009:8245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:09.378885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594142591351009:8245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:09.378917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:09.383200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:09.393976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:09.394818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:09.394830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:09.394863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:09.395080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:09.395276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594141013430460:7394]
2025-10-10T14:06:09.398642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:09.400539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:09.400759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:09.402055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:09.402377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:09.402385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:09.402394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:09.402400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:09.402407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:09.402414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:09.402420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:09.402426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:09.402433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:09.402440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:09.402447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:09.402455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:09.402508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:09.402616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:09.402666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:09.402713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:09.402758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:09.402805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:09.402849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:09.402894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:09.402938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:09.402983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:09.403029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:09.403075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:09.403117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:09.403183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:09.403237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:09.403293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:09.403341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:09.403394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:09.403440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:09.403491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:09.403539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:09.404467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:09.404528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:09.404585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:09.404637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:09.404693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:09.404741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:09.404793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:09.404842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:09.404914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:09.404963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:09.405018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:09.405067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:09.405121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:09.405190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:09.405246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:09.405703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:09.463134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:09.478408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:09.478453Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:09.478470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:09.478489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:09.478513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 562 [2:7559594141013430460:7394]
2025-10-10T14:06:09.478575Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:09.478638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:09.478654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:09.478668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:09.478679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:09.478730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:09.478755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:09.478777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:09.508291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:09.508322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:09.508333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:09.508346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:09.508356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:09.508621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:09.508643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:09.508782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:09.508988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:09.509234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:09.509361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:09.509444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.509460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.509474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.509487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.509527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:09.509605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:09.509790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:09.509813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:09.509932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.509958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:09.510871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:09.510898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:09.510912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:09.510923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:09.510951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:09.511914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594142591350951:2442], now have 1 active actors on pipe
2025-10-10T14:06:09.511956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594142591351022:7619], now have 1 active actors on pipe
2025-10-10T14:06:09.511980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594142591351083:8245], now have 1 active actors on pipe
2025-10-10T14:06:09.514433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:09.514476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:09.514555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:09.514595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:09.514612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:09.514623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:09.514659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:09.513632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 562
2025-10-10T14:06:09.513733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 562, pipe: [1:7559594142591351022:7619]
2025-10-10T14:06:09.513810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 562
2025-10-10T14:06:09.514705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:09.514763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:09.515733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:09.515772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:09.515840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:09.517434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd46f175-2d6cbbad-a5bf92f8-1165be19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:09.516554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 563 partition: 0 MaxSeqNo: 36 sessionId: src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0
2025-10-10T14:06:09.579644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0] Write session: try to update token
2025-10-10T14:06:09.579708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:09.582395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:09.582430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:09.582443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:09.693628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:09.693691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:09.693719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:09.693751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:09.693794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:09.694356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.694432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.694494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.694545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.694845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:09.694877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:09.694901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:09.695106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:09.695165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:09.695188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:09.695338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:09.695371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:09.695405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:09.695436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:09.714200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:09.755289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId: src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:09.774994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:09.903380Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:09.936332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:09.936638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:09.936715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:09.936729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:09.936771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594141013430454:7394]
2025-10-10T14:06:09.939825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:09.942609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:09.940384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:09.940529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594142591351022:7619]
2025-10-10T14:06:09.940604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:09.940615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:10.010734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:10.010793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0] Write session will restart in 0.007213s
2025-10-10T14:06:10.010943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0] Write session: Do CDS request
2025-10-10T14:06:10.010988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:10.009996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 563 reason: error at write: Disconnected sessionId: src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0
2025-10-10T14:06:10.010309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 563 sessionId: src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0 is DEAD
2025-10-10T14:06:10.039151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:10.051043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594146886318494:7619]
2025-10-10T14:06:10.051091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:10.051106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 564
2025-10-10T14:06:10.051839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:10.051975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:10.051992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:10.052002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:10.054704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 564 sessionId:  describe result for acl check
2025-10-10T14:06:10.054818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:10.054829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:10.054839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:10.054855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594146886318497:8257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:10.057707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594146886318497:8257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:10.084919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594146886318497:8257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:10.115993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:10.119124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594146886318497:8257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:10.119171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594146886318497:8257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:10.119191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594146886318497:8257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:10.119223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:10.121034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:10.121963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:10.121990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:10.122041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:10.122352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:10.122560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594145308397924:7403]
2025-10-10T14:06:10.125036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:10.126828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:10.127073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:10.128404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:10.128763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:10.128773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:10.128781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:10.128789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:10.128797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:10.128806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:10.128815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:10.128822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:10.128829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.128837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.128862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.128870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.128923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:10.129043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:10.129094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:10.129163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:10.129212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:10.129264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:10.129315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:10.129364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:10.129414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.129468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.129519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.129570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.129618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:10.129698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:10.129763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:10.129824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:10.129880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:10.129939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:10.129992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:10.130098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:10.130163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:10.130226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:10.130278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:10.130339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:10.130393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:10.130457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:10.130513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:10.130576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:10.130631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.130691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.130742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.130805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.130857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.130915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.130966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.131024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.131527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:10.192540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:10.225323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:10.225370Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:10.225389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:10.225408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:10.225431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 563 [2:7559594145308397924:7403]
2025-10-10T14:06:10.225485Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:10.225541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:10.225557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:10.225568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:10.225580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:10.225626Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:10.225647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:10.225670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:10.228226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.228256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.228271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.228286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.228298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:10.228589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:10.228607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.228760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.228976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.229242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.229370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:10.229449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594145308397918:7403]
2025-10-10T14:06:10.229465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594145308397918:7403]
2025-10-10T14:06:10.229478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594145308397918:7403]
2025-10-10T14:06:10.229492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594145308397918:7403]
2025-10-10T14:06:10.229528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:10.229616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:10.229750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:10.229765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:10.229777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:10.229789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:10.229810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:10.229830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:10.229984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594145308397918:7403]
2025-10-10T14:06:10.230022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:10.230076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594146886318561:8257], now have 1 active actors on pipe
2025-10-10T14:06:10.230102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594146886318494:7619], now have 1 active actors on pipe
2025-10-10T14:06:10.230123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594142591351136:2442], now have 1 active actors on pipe
2025-10-10T14:06:10.230298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:10.235085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 563
2025-10-10T14:06:10.235169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 563, pipe: [1:7559594146886318494:7619]
2025-10-10T14:06:10.235244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 563
2025-10-10T14:06:10.240654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:10.240698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:10.240802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:10.240837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:10.240873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:10.240885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:10.240921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:10.240969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:10.241023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:10.254113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:10.254159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:10.254241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:10.258570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 564 partition: 0 MaxSeqNo: 36 sessionId: src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0
2025-10-10T14:06:10.261689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2d64821-3e4afafd-edb8deea-7860c8b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:10.326001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0] Write session: try to update token
2025-10-10T14:06:10.326062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:10.328407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:10.328436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:10.328449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:10.468688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:10.468724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:10.468736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:10.468794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:10.468809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:10.468824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:10.468850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:10.468862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:10.468897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594145308397918:7403]
2025-10-10T14:06:10.468925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594145308397918:7403]
2025-10-10T14:06:10.468953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594145308397918:7403]
2025-10-10T14:06:10.468977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594145308397918:7403]
2025-10-10T14:06:10.469150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:10.469182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.469194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:10.469446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:10.469481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:10.469514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:10.469548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:10.470431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:10.533709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId: src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:10.567071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:10.644447Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:10.647182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:10.647226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:10.652779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:10.652824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:10.653780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594146886318494:7619]
2025-10-10T14:06:10.653942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:10.664066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 564 reason: error at write: Disconnected sessionId: src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0
2025-10-10T14:06:10.664314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 564 sessionId: src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0 is DEAD
2025-10-10T14:06:10.669481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:10.669574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0] Write session will restart in 0.008672s
2025-10-10T14:06:10.669830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0] Write session: Do CDS request
2025-10-10T14:06:10.669875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:10.686901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:10.687467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:10.687499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 565
2025-10-10T14:06:10.687813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:10.687940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:10.687970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:10.687980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:10.689784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 565 sessionId:  describe result for acl check
2025-10-10T14:06:10.689912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:10.689924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:10.689934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:10.689951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594146886318607:8265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:10.694449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594146886318607:8265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:10.694894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:10.710084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594146886318607:8265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:10.731413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594146886318607:8265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:10.731466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594146886318607:8265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:10.731486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594146886318607:8265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:10.731518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:10.756611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594146886318723:7619]
2025-10-10T14:06:10.773425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:10.775752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:10.776533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:10.776547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:10.776582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:10.776776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:10.776944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594145308398100:7411]
2025-10-10T14:06:10.778499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:10.779480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:10.779709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:10.781085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:10.781472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:10.781480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:10.781488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:10.781503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:10.781510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:10.781518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:10.781525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:10.781533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:10.781541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.781549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.781556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.781564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.781630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:10.781741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:10.781782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:10.781821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:10.781861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:10.781914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:10.781966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:10.782018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:10.782068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.782123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.782177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.782231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.782277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:10.782352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:10.782423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:10.782489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:10.782545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:10.782609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:10.782663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:10.782723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:10.782778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:10.782837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:10.782887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:10.782947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:10.782992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:10.783034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:10.783066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:10.783110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:10.783149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.783192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.783230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.783291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.783346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.783407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.783459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.783519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.783898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:10.819699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:10.844294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:10.844348Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:10.844367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:10.844386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:10.844408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 564 [2:7559594145308398100:7411]
2025-10-10T14:06:10.844467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:10.844524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:10.844539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:10.844551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:10.844563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:10.844614Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:10.844636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:10.844657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:10.887412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.887441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.887452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.887463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.887473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:10.887753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:10.887768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:10.887896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:10.888061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:10.888279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:10.888398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:10.888467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594145308398095:7411]
2025-10-10T14:06:10.888483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594145308398095:7411]
2025-10-10T14:06:10.888497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594145308398095:7411]
2025-10-10T14:06:10.888509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594145308398095:7411]
2025-10-10T14:06:10.888553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:10.888635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:10.888838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:10.888855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:10.888979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594145308398095:7411]
2025-10-10T14:06:10.888999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:10.891885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:10.891913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:10.891926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:10.891937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:10.891965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:10.897300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 564, pipe: [1:7559594146886318723:7619]
2025-10-10T14:06:10.897401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 564
2025-10-10T14:06:10.897469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 564
2025-10-10T14:06:10.897605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594146886318723:7619], now have 1 active actors on pipe
2025-10-10T14:06:10.897643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594146886318664:8265], now have 1 active actors on pipe
2025-10-10T14:06:10.897665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594146886318594:2442], now have 1 active actors on pipe
2025-10-10T14:06:10.898765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:10.898804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:10.898902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:10.898942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:10.898961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:10.898973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:10.899014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:10.899062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:10.899114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:10.905226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:10.905267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:10.905358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:10.905860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 565 partition: 0 MaxSeqNo: 36 sessionId: src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0
2025-10-10T14:06:10.907946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f8aef7-782e29f8-6d5526f9-56fc5607_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:10.949384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:10.949416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:10.949428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:10.968299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0] Write session: try to update token
2025-10-10T14:06:10.968360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:11.030460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:11.030494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:11.030506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:11.030518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:11.030532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:11.030567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594145308398095:7411]
2025-10-10T14:06:11.030593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594145308398095:7411]
2025-10-10T14:06:11.030618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594145308398095:7411]
2025-10-10T14:06:11.030639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594145308398095:7411]
2025-10-10T14:06:11.030783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:11.030810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:11.030822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:11.032051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:11.033148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:11.033196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:11.033228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:11.033258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:11.205018Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:11.212951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594146886318723:7619]
2025-10-10T14:06:11.213062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:11.213193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId: src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:11.270438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:11.270476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:11.281063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 565 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0
2025-10-10T14:06:11.281410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 565 sessionId: src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0 is DEAD
2025-10-10T14:06:11.285880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:06:11.285929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0] Write session will restart in 0.008772s
2025-10-10T14:06:11.286044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0] Write session: Do CDS request
2025-10-10T14:06:11.286086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:11.301037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:11.301098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 566
2025-10-10T14:06:11.305043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:11.305786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:11.305939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:11.305956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:11.305966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:11.308452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 566 sessionId:  describe result for acl check
2025-10-10T14:06:11.308602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:11.308616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:11.308628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:11.308652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594151181286107:8272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:11.309416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594151181286108:7619]
2025-10-10T14:06:11.311740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594151181286107:8272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:11.333248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594151181286107:8272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:11.344636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594151181286107:8272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:11.344686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594151181286107:8272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:11.344706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594151181286107:8272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:11.344739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:11.352479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:11.355371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:11.356328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:11.356350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:11.356401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:11.356708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:11.356956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594149603365557:7417]
2025-10-10T14:06:11.359556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:11.360770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:11.361025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:11.362423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:11.362836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:11.362847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:11.362857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:11.362866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:11.362873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:11.362881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:11.362888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:11.362897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:11.362906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:11.362915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:11.362924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:11.362931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:11.362990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:11.363122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:11.363185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:11.363241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:11.363298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:11.363354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:11.363413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:11.363470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:11.363524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:11.363580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:11.363725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:11.363791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:11.363839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:11.363916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:11.363986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:11.364053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:11.364109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:11.364311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:11.364374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:11.364442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:11.364498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:11.364562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:11.364617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:11.364682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:11.364753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:11.364841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:11.364899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:11.364961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:11.365019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:11.365084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:11.365156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:11.365229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:11.365290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:11.365355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:11.365414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:11.365479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:11.366008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:11.404548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:11.418027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:11.418077Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:11.418096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:11.418117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:11.418140Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 565 [2:7559594149603365557:7417]
2025-10-10T14:06:11.418203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:11.418265Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:11.418280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:11.418293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:11.418306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:11.418354Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:11.418377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:11.418398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:11.420163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:11.420192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:11.420208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:11.420225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:11.420238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:11.420517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:11.420536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:11.420706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:11.420939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:11.421230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:11.421370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:11.421445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.421462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.421478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.421493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.421535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:11.421625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:11.421832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:11.421850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:11.421982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.422004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:11.422758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:11.422780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:11.422794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:11.422807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:11.422833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:11.424114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594151181286059:2442], now have 1 active actors on pipe
2025-10-10T14:06:11.424151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594151181286108:7619], now have 1 active actors on pipe
2025-10-10T14:06:11.424178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594151181286195:8272], now have 1 active actors on pipe
2025-10-10T14:06:11.425483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 565
2025-10-10T14:06:11.425585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 565, pipe: [1:7559594151181286108:7619]
2025-10-10T14:06:11.425670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 565
2025-10-10T14:06:11.426164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:11.426199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:11.426274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:11.426309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:11.426328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:11.426340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:11.426378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:11.426422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:11.426475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:11.427380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:11.427411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:11.427479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:11.427900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 566 partition: 0 MaxSeqNo: 36 sessionId: src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0
2025-10-10T14:06:11.431910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c88cba9-7a4a074f-4356eef3-e89f2bc5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:11.478991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0] Write session: try to update token
2025-10-10T14:06:11.479050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:11.596959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:11.596987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:11.596999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:11.597109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:11.597141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:11.597154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:11.597164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:11.597174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:11.597208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.597236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.597260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.597285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.598698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:11.598738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:11.598767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:11.598796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:11.619176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:11.619257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:11.619292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:11.633775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:11.705880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId: src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:11.747909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:11.836195Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:11.840397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:11.840539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:11.840551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:11.839504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:11.839536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:11.839582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594149603365552:7417]
2025-10-10T14:06:11.839738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:11.839764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:11.839875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:11.845175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:11.899951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594151181286108:7619]
2025-10-10T14:06:11.900078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 566 reason: error at write: Disconnected sessionId: src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0
2025-10-10T14:06:11.900383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 566 sessionId: src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0 is DEAD
2025-10-10T14:06:11.905333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:11.905377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0] Write session will restart in 0.008195s
2025-10-10T14:06:11.905477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0] Write session: Do CDS request
2025-10-10T14:06:11.905507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:11.920985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:11.947012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:11.947042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 567
2025-10-10T14:06:11.950558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:11.950699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:11.950715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:11.950724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:11.953258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 567 sessionId:  describe result for acl check
2025-10-10T14:06:11.953376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:11.953386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:11.953395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:11.953411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594151181286328:8285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:11.956181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594151181286328:8285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:11.966743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594151181286328:8285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:11.987832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594151181286328:8285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:11.987877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594151181286328:8285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:11.987898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594151181286328:8285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:11.987929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:11.991922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:11.998458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594151181286382:7619]
2025-10-10T14:06:12.005535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:12.006430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:12.006450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:12.006496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:12.006791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:12.007007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594153898333007:7426]
2025-10-10T14:06:12.009666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:12.010836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:12.011070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:12.012357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:12.012705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:12.012714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:12.012723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:12.012731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:12.012739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:12.012746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:12.012754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:12.012760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:12.012768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.012775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.012783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.012804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.012857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:12.012978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:12.013035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:12.013095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:12.013166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:12.013223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:12.013276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:12.013328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:12.013378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.013429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.013487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.013541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.013591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:12.013677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:12.013745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:12.013810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:12.013868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:12.013931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:12.013981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:12.014039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:12.014093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:12.014153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:12.014203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:12.014265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:12.014315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:12.014376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:12.014429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:12.014488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:12.014541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.014602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.014654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.014714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.014766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.014827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.014878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.014934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.016774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:12.063620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:12.078716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:12.078767Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:12.078785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:12.078807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:12.078835Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 566 [2:7559594153898333007:7426]
2025-10-10T14:06:12.078891Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:12.078963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:12.078980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:12.078992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:12.079003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:12.079053Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:12.079076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:12.079098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:12.105354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.105386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.105397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.105407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.105418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:12.105730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:12.105750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.105891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.106054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.106254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.106356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:12.106446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594151181286382:7619], now have 1 active actors on pipe
2025-10-10T14:06:12.106469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594151181286233:2442], now have 1 active actors on pipe
2025-10-10T14:06:12.106488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594151181286379:8285], now have 1 active actors on pipe
2025-10-10T14:06:12.106525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594149603365704:7426]
2025-10-10T14:06:12.106541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594149603365704:7426]
2025-10-10T14:06:12.106553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594149603365704:7426]
2025-10-10T14:06:12.106258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 566
2025-10-10T14:06:12.106565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594149603365704:7426]
2025-10-10T14:06:12.106608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:12.106353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 566, pipe: [1:7559594151181286382:7619]
2025-10-10T14:06:12.106694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:12.106444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 566
2025-10-10T14:06:12.106783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:12.106800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:12.106812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:12.106825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:12.106864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:12.106881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:12.107021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594149603365704:7426]
2025-10-10T14:06:12.107054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:12.107088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:12.107117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:12.107137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:12.107313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:12.107348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:12.107363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:12.107373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:12.107411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:12.107453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:12.107517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:12.115182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 567 partition: 0 MaxSeqNo: 36 sessionId: src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0
2025-10-10T14:06:12.117441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bad16691-66cf93ef-3a365a69-1a556ef5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:12.113316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:12.113366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:12.113474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:12.154047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0] Write session: try to update token
2025-10-10T14:06:12.154109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:12.199444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:12.199476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:12.199488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:12.199548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:12.199565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:12.199581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:12.199593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:12.199605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:12.199642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594149603365704:7426]
2025-10-10T14:06:12.199672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594149603365704:7426]
2025-10-10T14:06:12.199701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594149603365704:7426]
2025-10-10T14:06:12.199726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594149603365704:7426]
2025-10-10T14:06:12.199883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:12.199911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.199923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:12.200990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:12.202444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:12.202502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:12.202539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:12.202571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:12.337230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId: src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:12.348380Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:12.353265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594151181286382:7619]
2025-10-10T14:06:12.353442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:12.366435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:12.366464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:12.412680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 567 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0
2025-10-10T14:06:12.413083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 567 sessionId: src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0 is DEAD
2025-10-10T14:06:12.420096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:06:12.420165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0] Write session will restart in 0.007984s
2025-10-10T14:06:12.420329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0] Write session: Do CDS request
2025-10-10T14:06:12.420381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:12.435466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:12.435504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 568
2025-10-10T14:06:12.435770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:12.436425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:12.436575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:12.436591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:12.436603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:12.443602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 568 sessionId:  describe result for acl check
2025-10-10T14:06:12.443737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:12.443750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:12.443760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:12.443778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594155476253739:8294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:12.446605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594155476253739:8294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:12.451915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594155476253755:7619]
2025-10-10T14:06:12.468710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594155476253739:8294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:12.494496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594155476253739:8294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:12.494541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594155476253739:8294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:12.494560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594155476253739:8294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:12.494592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:12.511867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:12.523582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:12.524498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:12.524518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:12.524568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:12.524890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:12.525098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594153898333170:7437]
2025-10-10T14:06:12.527528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:12.542421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:12.542721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:12.544164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:12.544543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:12.544553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:12.544561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:12.544568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:12.544575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:12.544582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:12.544590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:12.544597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:12.544603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.544612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.544619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.544626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.544677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:12.544824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:12.544879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:12.544932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:12.544983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:12.545034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:12.545087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:12.545985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:12.546055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.546108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.546159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.546206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.546258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:12.546331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:12.546399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:12.546460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:12.546516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:12.546574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:12.546626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:12.546686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:12.546740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:12.546804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:12.546857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:12.546920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:12.546979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:12.547043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:12.547093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:12.547153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:12.547213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.547272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.547325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.547387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.547442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.547508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.547560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.547618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.548122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:12.605118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:12.624164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:12.624983Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:12.625008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:12.625027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:12.625050Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 567 [2:7559594153898333170:7437]
2025-10-10T14:06:12.625106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:12.625175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:12.625188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:12.625201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:12.625213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:12.625260Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:12.625283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:12.625305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:12.627636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.627652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.627667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.627682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.627694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:12.629418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 567
2025-10-10T14:06:12.629494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 567, pipe: [1:7559594155476253755:7619]
2025-10-10T14:06:12.629592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 567
2025-10-10T14:06:12.632064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:12.632102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.632260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:12.632486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:12.632741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:12.632892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:12.632941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594155476253705:2442], now have 1 active actors on pipe
2025-10-10T14:06:12.632971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594155476253839:8294], now have 1 active actors on pipe
2025-10-10T14:06:12.632998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594155476253755:7619], now have 1 active actors on pipe
2025-10-10T14:06:12.633053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:12.633079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:12.633203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:12.633217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:12.633232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:12.633246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:12.633285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:12.633392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|708663fb-390620a0-80e508a1-8e5197ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:12.633422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:12.633440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:12.633452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:12.633487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:12.633529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:12.633589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:12.633783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:12.633802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:12.633941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:12.633999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:12.634019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:12.634848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:12.634881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:12.634894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:12.634906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:12.634932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:12.636982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:12.637017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:12.637106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:12.638725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 568 partition: 0 MaxSeqNo: 36 sessionId: src_id|708663fb-390620a0-80e508a1-8e5197ba_0
2025-10-10T14:06:12.643008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7648928c-b040373c-e9268c4f-8a4c6f9a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|708663fb-390620a0-80e508a1-8e5197ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:12.705073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708663fb-390620a0-80e508a1-8e5197ba_0] Write session: try to update token
2025-10-10T14:06:12.705148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708663fb-390620a0-80e508a1-8e5197ba_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:12.859155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:12.859191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:12.859203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:12.859258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:12.859274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:12.859288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:12.859300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:12.859312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:12.859348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:12.859379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:12.859406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:12.859432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:12.859647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:12.859675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:12.859688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:12.860922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:12.861307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:12.861378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:12.861409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:12.861441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:12.897679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId: src_id|708663fb-390620a0-80e508a1-8e5197ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:12.921324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:13.018197Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:13.034357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:13.034407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:13.034515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:13.034532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:13.034578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594153898333164:7437]
2025-10-10T14:06:13.035227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:13.035890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:13.035923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:13.037568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594155476253755:7619]
2025-10-10T14:06:13.037722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:13.039865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:13.049764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 568 reason: error at write: Disconnected sessionId: src_id|708663fb-390620a0-80e508a1-8e5197ba_0
2025-10-10T14:06:13.050088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 568 sessionId: src_id|708663fb-390620a0-80e508a1-8e5197ba_0 is DEAD
2025-10-10T14:06:13.052651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708663fb-390620a0-80e508a1-8e5197ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:13.052687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708663fb-390620a0-80e508a1-8e5197ba_0] Write session will restart in 0.005702s
2025-10-10T14:06:13.052801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708663fb-390620a0-80e508a1-8e5197ba_0] Write session: Do CDS request
2025-10-10T14:06:13.052833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708663fb-390620a0-80e508a1-8e5197ba_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:13.074510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|708663fb-390620a0-80e508a1-8e5197ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:13.075932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:13.075981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 569
2025-10-10T14:06:13.087524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:13.087692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:13.087719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:13.087732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:13.089956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 569 sessionId:  describe result for acl check
2025-10-10T14:06:13.090097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:13.090107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:13.090116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:13.090135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594159771221194:8302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:13.093245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594159771221194:8302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:13.114837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594159771221194:8302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:13.141253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594159771221280:7619]
2025-10-10T14:06:13.153879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594159771221194:8302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:13.153925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594159771221194:8302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:13.153944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594159771221194:8302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:13.153979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:13.191185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:13.202416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:13.203190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:13.203204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:13.203235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:13.203454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:13.203638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594158193300641:7445]
2025-10-10T14:06:13.205375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:13.212086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:13.212388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:13.213849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:13.214630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:13.214648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:13.214655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:13.214663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:13.214671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:13.214679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:13.214686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:13.214694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:13.214702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.214710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.214717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.214725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.214780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:13.214909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:13.214964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:13.215019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:13.215075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:13.215131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:13.215184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:13.215234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:13.215286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.215339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.215395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.215445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.215494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:13.215571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:13.215643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:13.215705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:13.215763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:13.215825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:13.215876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:13.215936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:13.215994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:13.216055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:13.216107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:13.216167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:13.216224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:13.216285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:13.216334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:13.216399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:13.216454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.216513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.216567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.216627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.216679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.216739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.216810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.216867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.217408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:13.253585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:13.290779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:13.290841Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:13.290862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:13.290905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:13.290947Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 568 [2:7559594158193300641:7445]
2025-10-10T14:06:13.291026Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:13.291099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:13.291133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:13.291150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:13.291162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:13.291216Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:13.291246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:13.291270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:13.359440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.359473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.359488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.359502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.359515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:13.359837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:13.359857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.360019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.360220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.360457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.360582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:13.360669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.360684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.360699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.360713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.360782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:13.360868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:13.361064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:13.361081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:13.361905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:13.361932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:13.361944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:13.361956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:13.363604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.363651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:13.363714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594159771221280:7619], now have 1 active actors on pipe
2025-10-10T14:06:13.363741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594159771221176:2442], now have 1 active actors on pipe
2025-10-10T14:06:13.363766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594159771221303:8302], now have 1 active actors on pipe
2025-10-10T14:06:13.363830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:13.363861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:13.364045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:13.364087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:13.364106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:13.364118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:13.364156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:13.364206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:13.364285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:13.364398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:13.363011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 568, pipe: [1:7559594159771221280:7619]
2025-10-10T14:06:13.363124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 568
2025-10-10T14:06:13.363209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 568
2025-10-10T14:06:13.373296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:13.373341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:13.373430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:13.373796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 569 partition: 0 MaxSeqNo: 36 sessionId: src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0
2025-10-10T14:06:13.379248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|708663fb-390620a0-80e508a1-8e5197ba_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:13.390677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:13.390708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:13.390721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:13.416872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0] Write session: try to update token
2025-10-10T14:06:13.416921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:13.543062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:13.543101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:13.543115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:13.543128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:13.543142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:13.543180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.543210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.543238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.543261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.543368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:13.543408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:13.543436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:13.543443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:13.543451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:13.543464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:13.543473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:13.543573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:13.543603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.543616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:13.544702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:13.587086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId: src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:13.609523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:13.758523Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:13.799666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:13.799718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:13.799788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:13.799803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:13.799843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594158193300636:7445]
2025-10-10T14:06:13.801799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:13.801830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:13.801271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:13.801924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:13.819437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594159771221280:7619]
2025-10-10T14:06:13.819544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:13.819677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 569 reason: error at write: Disconnected sessionId: src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0
2025-10-10T14:06:13.819988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 569 sessionId: src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0 is DEAD
2025-10-10T14:06:13.825344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:13.825390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0] Write session will restart in 0.007692s
2025-10-10T14:06:13.825496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0] Write session: Do CDS request
2025-10-10T14:06:13.825534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:13.843999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:13.845295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:13.845331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 570
2025-10-10T14:06:13.845685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:13.845817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:13.845841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:13.845850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:13.847517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 570 sessionId:  describe result for acl check
2025-10-10T14:06:13.847603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:13.847610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:13.847617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:13.848442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594159771221360:8312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:13.851370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594159771221360:8312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:13.862364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594159771221360:8312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:13.882389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594159771221360:8312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:13.882432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594159771221360:8312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:13.882451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594159771221360:8312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:13.882482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:13.920129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:13.920657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594159771221498:7619]
2025-10-10T14:06:13.926253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:13.927209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:13.927232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:13.927282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:13.927585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:13.927808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594158193300809:7449]
2025-10-10T14:06:13.930285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:13.932392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:13.932668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:13.934088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:13.934475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:13.934484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:13.934491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:13.934500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:13.934507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:13.934514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:13.934522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:13.934530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:13.934538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.934545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.934552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.934560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.934611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:13.934726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:13.934779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:13.934831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:13.934880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:13.934934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:13.934982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:13.935033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:13.935083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.935134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.935182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.935230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.935270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:13.935340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:13.935400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:13.935461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:13.935513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:13.935570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:13.935615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:13.935672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:13.935725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:13.935785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:13.935831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:13.935886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:13.935934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:13.935992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:13.936040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:13.936094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:13.936148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.936205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:13.936256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.936311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:13.936358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.936415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:13.936464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.936522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:13.937016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:13.973569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:13.988611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:13.988660Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:13.988677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:13.988699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:13.988724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 569 [2:7559594158193300809:7449]
2025-10-10T14:06:13.988799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:13.988856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:13.988870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:13.988883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:13.988895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:13.988947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:13.988970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:13.988992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:14.013597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.013630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.013645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.013658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.013671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:14.013961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:14.013978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.014138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.014344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.014611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.014743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:14.014816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594158193300803:7449]
2025-10-10T14:06:14.014832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594158193300803:7449]
2025-10-10T14:06:14.014846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594158193300803:7449]
2025-10-10T14:06:14.014859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594158193300803:7449]
2025-10-10T14:06:14.014893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:14.014978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:14.015150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:14.015164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:14.015166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:14.015176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:14.015183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:14.015187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:14.015305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594158193300803:7449]
2025-10-10T14:06:14.015326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:14.015385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:14.015447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594159771221498:7619], now have 1 active actors on pipe
2025-10-10T14:06:14.015506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594159771221413:8312], now have 1 active actors on pipe
2025-10-10T14:06:14.015528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594159771221353:2442], now have 1 active actors on pipe
2025-10-10T14:06:14.017197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 569, pipe: [1:7559594159771221498:7619]
2025-10-10T14:06:14.017295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 569
2025-10-10T14:06:14.017362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 569
2025-10-10T14:06:14.017844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:14.017879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:14.017966Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:14.018000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:14.018025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:14.018044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:14.018081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:14.018123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:14.018170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:14.018673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:14.018701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:14.018764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:14.019261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 570 partition: 0 MaxSeqNo: 36 sessionId: src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0
2025-10-10T14:06:14.019961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7ef1bd8-5dcec009-a8914d9f-52a9b8dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:14.063355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0] Write session: try to update token
2025-10-10T14:06:14.063414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:14.131315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:14.131349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:14.131364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:14.131422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:14.131437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:14.131452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:14.131466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:14.131478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:14.131515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594158193300803:7449]
2025-10-10T14:06:14.131544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594158193300803:7449]
2025-10-10T14:06:14.131568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594158193300803:7449]
2025-10-10T14:06:14.131591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594158193300803:7449]
2025-10-10T14:06:14.131721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:14.131740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:14.131756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.131768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:14.131778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:14.131817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:14.131875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:14.132908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:14.210873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId: src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:14.230725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:14.280007Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:14.295800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:14.295841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:14.296495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:14.296496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594159771221498:7619]
2025-10-10T14:06:14.296540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:14.296606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:14.299842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:14.348581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 570 reason: error at write: Disconnected sessionId: src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0
2025-10-10T14:06:14.348886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 570 sessionId: src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0 is DEAD
2025-10-10T14:06:14.349661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:14.349724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0] Write session will restart in 0.008725s
2025-10-10T14:06:14.349928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0] Write session: Do CDS request
2025-10-10T14:06:14.349982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:14.368496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:14.368539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 571
2025-10-10T14:06:14.369010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:14.369614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:14.369748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:14.369764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:14.369773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:14.371796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 571 sessionId:  describe result for acl check
2025-10-10T14:06:14.371874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:14.371880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:14.371887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:14.371897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594164066188931:8321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:14.373829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594164066188931:8321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:14.379752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594164066188931:8321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:14.381829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:14.386304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:14.387069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:14.387091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:14.387123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:14.387333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:14.387463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594162488268262:7459]
2025-10-10T14:06:14.389364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:14.390198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:14.390414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:14.391471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:14.391766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:14.391777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:14.391784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:14.391791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:14.391799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:14.391806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:14.391814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:14.391822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:14.391830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.391837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.391846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.391854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.391907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:14.392025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:14.392080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:14.392132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:14.392183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:14.392224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:14.392269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:14.392319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:14.392369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.392997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594164066188931:8321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:14.392419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.392468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.393039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594164066188931:8321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:14.392518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.393058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594164066188931:8321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:14.392561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:14.393088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:14.392629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:14.392692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:14.392764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:14.392818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:14.392877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:14.392968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:14.393030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:14.393083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:14.393167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:14.393219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:14.393274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:14.393326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:14.393382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:14.393435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:14.393490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:14.393550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.393606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.393657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.393714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.393764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.393823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.393868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.393915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.394260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:14.399192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594164066188967:7619]
2025-10-10T14:06:14.430196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:14.443860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:14.443910Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:14.443928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:14.443948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:14.443971Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 570 [2:7559594162488268262:7459]
2025-10-10T14:06:14.444028Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:14.444088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:14.444103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:14.444115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:14.444128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:14.444176Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:14.444199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:14.444220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:14.445737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.445760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.445769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.445778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.445788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:14.445987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:14.446006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.446106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.446252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.446450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.446551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:14.446605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594162488268257:7459]
2025-10-10T14:06:14.446620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594162488268257:7459]
2025-10-10T14:06:14.446631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594162488268257:7459]
2025-10-10T14:06:14.446639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594162488268257:7459]
2025-10-10T14:06:14.446666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:14.446721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:14.446889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:14.446908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:14.447035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594162488268257:7459]
2025-10-10T14:06:14.447055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:14.447277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:14.447292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:14.447300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:14.447308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:14.447323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:14.448149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594164066188967:7619], now have 1 active actors on pipe
2025-10-10T14:06:14.448186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594164066188964:8321], now have 1 active actors on pipe
2025-10-10T14:06:14.448464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 570, pipe: [1:7559594164066188967:7619]
2025-10-10T14:06:14.448209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594164066188823:2442], now have 1 active actors on pipe
2025-10-10T14:06:14.448577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 570
2025-10-10T14:06:14.448660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 570
2025-10-10T14:06:14.451342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 571 partition: 0 MaxSeqNo: 36 sessionId: src_id|57370dd8-631a352f-a0e5121f-9d13c267_0
2025-10-10T14:06:14.449228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:14.449263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:14.449365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57370dd8-631a352f-a0e5121f-9d13c267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:14.449400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:14.449418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:14.449431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:14.449467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:14.449512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:14.449567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:14.450260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:14.450281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:14.450358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:14.454376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a83f024-5eeb97b3-7f38301e-9a72f880_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|57370dd8-631a352f-a0e5121f-9d13c267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:14.495432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57370dd8-631a352f-a0e5121f-9d13c267_0] Write session: try to update token
2025-10-10T14:06:14.495492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57370dd8-631a352f-a0e5121f-9d13c267_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:14.533409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:14.533445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:14.533461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:14.533474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:14.533485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:14.533523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594162488268257:7459]
2025-10-10T14:06:14.533552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594162488268257:7459]
2025-10-10T14:06:14.533575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594162488268257:7459]
2025-10-10T14:06:14.533597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594162488268257:7459]
2025-10-10T14:06:14.533762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:14.533790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.533803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:14.533816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:14.533858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:14.533891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:14.533916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:14.534916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:14.616632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId: src_id|57370dd8-631a352f-a0e5121f-9d13c267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:14.638840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:14.686632Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:14.699430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:14.699473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:14.701297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594164066188967:7619]
2025-10-10T14:06:14.701402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:14.701420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:14.701934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:14.702742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:14.719802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 571 reason: error at write: Disconnected sessionId: src_id|57370dd8-631a352f-a0e5121f-9d13c267_0
2025-10-10T14:06:14.720042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 571 sessionId: src_id|57370dd8-631a352f-a0e5121f-9d13c267_0 is DEAD
2025-10-10T14:06:14.721160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57370dd8-631a352f-a0e5121f-9d13c267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:14.721203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57370dd8-631a352f-a0e5121f-9d13c267_0] Write session will restart in 0.009313s
2025-10-10T14:06:14.721313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57370dd8-631a352f-a0e5121f-9d13c267_0] Write session: Do CDS request
2025-10-10T14:06:14.721353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57370dd8-631a352f-a0e5121f-9d13c267_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:14.736705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57370dd8-631a352f-a0e5121f-9d13c267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:14.736407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:14.736437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 572
2025-10-10T14:06:14.737209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:14.737350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:14.737366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:14.737376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:14.739685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 572 sessionId:  describe result for acl check
2025-10-10T14:06:14.739812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:14.739825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:14.739835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:14.739852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594164066188990:8325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:14.742748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594164066188990:8325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:14.750699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594164066188990:8325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:14.762069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594164066188990:8325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:14.762126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594164066188990:8325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:14.762146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594164066188990:8325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:14.762179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:14.801002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:14.805248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594164066189119:7619]
2025-10-10T14:06:14.809116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:14.810044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:14.810062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:14.810102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:14.810372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:14.810560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594162488268441:7468]
2025-10-10T14:06:14.812596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:14.813605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:14.813840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:14.815126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:14.815433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:14.815447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:14.815456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:14.815464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:14.815473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:14.815480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:14.815488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:14.815496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:14.815504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.815512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.815520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.815528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.815583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:14.815695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:14.815751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:14.815811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:14.815858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:14.815914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:14.815971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:14.816022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:14.816071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.816126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.816176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.816227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.816270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:14.816344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:14.816409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:14.816470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:14.816524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:14.816583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:14.816633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:14.816694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:14.816762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:14.816819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:14.816868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:14.816925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:14.816976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:14.817026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:14.817059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:14.817110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:14.819306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.819368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.819409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.819458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.819498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.819566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.819607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.819664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.820092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:14.847983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:14.863686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:14.863736Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:14.863755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:14.863776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:14.863801Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 571 [2:7559594162488268441:7468]
2025-10-10T14:06:14.863867Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:14.863928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:14.863944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:14.863957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:14.863970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:14.864024Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:14.864048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:14.864070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:14.869055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.869084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.869103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.869117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.869146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:14.869449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:14.869468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.869630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:14.869835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:14.870088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:14.870219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:14.870290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594162488268435:7468]
2025-10-10T14:06:14.870308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594162488268435:7468]
2025-10-10T14:06:14.870321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594162488268435:7468]
2025-10-10T14:06:14.870336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594162488268435:7468]
2025-10-10T14:06:14.870379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:14.870463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:14.870655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:14.870673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:14.870798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594162488268435:7468]
2025-10-10T14:06:14.870819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:14.871543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:14.871572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:14.871583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:14.871595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:14.871619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:14.872467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 571
2025-10-10T14:06:14.872587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594164066188978:2442], now have 1 active actors on pipe
2025-10-10T14:06:14.872624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594164066189033:8325], now have 1 active actors on pipe
2025-10-10T14:06:14.872647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594164066189119:7619], now have 1 active actors on pipe
2025-10-10T14:06:14.872599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 571
2025-10-10T14:06:14.872675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 571, pipe: [1:7559594164066189119:7619]
2025-10-10T14:06:14.873070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:14.873106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:14.873207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d0393c5-1f579629-2996e2ed-1e38679_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:14.873239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:14.873257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:14.873280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:14.873317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:14.873371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:14.873417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:14.876491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:14.876520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:14.876585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:14.876848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 572 partition: 0 MaxSeqNo: 36 sessionId: src_id|9d0393c5-1f579629-2996e2ed-1e38679_0
2025-10-10T14:06:14.881009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57370dd8-631a352f-a0e5121f-9d13c267_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9d0393c5-1f579629-2996e2ed-1e38679_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:14.925883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0393c5-1f579629-2996e2ed-1e38679_0] Write session: try to update token
2025-10-10T14:06:14.925947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0393c5-1f579629-2996e2ed-1e38679_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:14.994128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:14.994159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:14.994171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:14.994229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:14.994244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:14.994258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:14.994270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:14.994282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:14.994319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594162488268435:7468]
2025-10-10T14:06:14.994348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594162488268435:7468]
2025-10-10T14:06:14.994375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594162488268435:7468]
2025-10-10T14:06:14.994401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594162488268435:7468]
2025-10-10T14:06:14.994557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:14.994592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:14.994604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:14.995738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:14.997534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:14.997567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:14.997598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:14.997627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:15.072182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId: src_id|9d0393c5-1f579629-2996e2ed-1e38679_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:15.098000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:15.154289Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:15.156982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:15.157025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:15.159199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594164066189119:7619]
2025-10-10T14:06:15.159282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:15.159406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:15.159419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:15.165679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:15.186829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0393c5-1f579629-2996e2ed-1e38679_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:15.186897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0393c5-1f579629-2996e2ed-1e38679_0] Write session will restart in 0.006770s
2025-10-10T14:06:15.187058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0393c5-1f579629-2996e2ed-1e38679_0] Write session: Do CDS request
2025-10-10T14:06:15.187111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0393c5-1f579629-2996e2ed-1e38679_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:15.185362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 572 reason: error at write: Disconnected sessionId: src_id|9d0393c5-1f579629-2996e2ed-1e38679_0
2025-10-10T14:06:15.185706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 572 sessionId: src_id|9d0393c5-1f579629-2996e2ed-1e38679_0 is DEAD
2025-10-10T14:06:15.201590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0393c5-1f579629-2996e2ed-1e38679_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:15.204505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:15.204551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 573
2025-10-10T14:06:15.205111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:15.205371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:15.205422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:15.205438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:15.207367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 573 sessionId:  describe result for acl check
2025-10-10T14:06:15.207492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:15.207503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:15.207512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:15.207529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594168361156473:8337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:15.210714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594168361156473:8337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:15.220042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594168361156473:8337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:15.240938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594168361156473:8337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:15.240986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594168361156473:8337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:15.241006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594168361156473:8337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:15.241039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:15.261434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594168361156539:7619]
2025-10-10T14:06:15.315475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:15.324797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:15.325782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:15.325802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:15.325853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:15.326179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:15.326377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594166783235885:7470]
2025-10-10T14:06:15.328840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:15.333548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:15.333875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:15.335468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:15.335854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:15.335864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:15.335871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:15.335879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:15.335887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:15.335895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:15.335904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:15.335912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:15.335920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:15.335928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:15.335937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:15.335945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:15.336000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:15.336136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:15.336197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:15.336249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:15.336300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:15.336352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:15.336403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:15.336453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:15.336504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:15.336558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:15.336610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:15.336664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:15.336731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:15.336807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:15.336881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:15.336942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:15.336998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:15.337059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:15.337111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:15.346007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:15.346104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:15.346172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:15.346244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:15.346306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:15.346365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:15.346426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:15.346490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:15.346555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:15.346610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:15.346673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:15.346732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:15.346797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:15.346850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:15.346910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:15.346968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:15.347035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:15.347568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:15.374344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:15.405455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:15.405498Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:15.405517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:15.405536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:15.405559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 572 [2:7559594166783235885:7470]
2025-10-10T14:06:15.405613Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:15.405668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:15.405683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:15.405696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:15.405708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:15.405756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:15.405776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:15.405797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:15.407346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:15.407363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:15.407378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:15.407392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:15.407404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:15.407675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:15.407693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:15.407839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:15.408034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:15.408277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:15.408401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:15.409934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594166783235879:7470]
2025-10-10T14:06:15.409961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594166783235879:7470]
2025-10-10T14:06:15.409978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594166783235879:7470]
2025-10-10T14:06:15.409992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594166783235879:7470]
2025-10-10T14:06:15.410030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:15.410122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594168361156539:7619], now have 1 active actors on pipe
2025-10-10T14:06:15.410151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594168361156511:8337], now have 1 active actors on pipe
2025-10-10T14:06:15.410175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594168361156460:2442], now have 1 active actors on pipe
2025-10-10T14:06:15.410225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:15.410439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:15.410458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:15.410597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594166783235879:7470]
2025-10-10T14:06:15.410620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:15.410182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 572, pipe: [1:7559594168361156539:7619]
2025-10-10T14:06:15.410312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 572
2025-10-10T14:06:15.410382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 572
2025-10-10T14:06:15.411072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:15.411090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:15.411102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:15.411114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:15.411135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:15.412815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:15.412848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:15.412936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:15.412966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:15.412983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:15.412994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:15.413028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:15.413070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:15.413119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:15.413999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:15.414025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:15.414091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:15.414435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 573 partition: 0 MaxSeqNo: 36 sessionId: src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0
2025-10-10T14:06:15.415268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d0393c5-1f579629-2996e2ed-1e38679_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:15.463612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0] Write session: try to update token
2025-10-10T14:06:15.463671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:15.505268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:15.505300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:15.505314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:15.622298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:15.622325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:15.622339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:15.622351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:15.622364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:15.622399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594166783235879:7470]
2025-10-10T14:06:15.622425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594166783235879:7470]
2025-10-10T14:06:15.622450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594166783235879:7470]
2025-10-10T14:06:15.622473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594166783235879:7470]
2025-10-10T14:06:15.622630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:15.622643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:15.622654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:15.622695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:15.622721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:15.622732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:15.623703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:15.623736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:15.623767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:15.623797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:15.624569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:15.750013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId: src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:15.818546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:16.013566Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:16.065956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:16.066002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:16.067716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:16.068114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594168361156539:7619]
2025-10-10T14:06:16.068270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:16.068295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:16.073807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:16.118165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:16.118239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0] Write session will restart in 0.005253s
2025-10-10T14:06:16.118409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0] Write session: Do CDS request
2025-10-10T14:06:16.118459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:16.115126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 573 reason: error at write: Disconnected sessionId: src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0
2025-10-10T14:06:16.115481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 573 sessionId: src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0 is DEAD
2025-10-10T14:06:16.137511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:16.137551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 574
2025-10-10T14:06:16.144913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:16.149652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:16.149804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:16.149819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:16.149831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:16.154292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 574 sessionId:  describe result for acl check
2025-10-10T14:06:16.154430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:16.154440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:16.154451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:16.154470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594172656123986:8347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:16.158797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594172656123986:8347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:16.168493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594172656124013:7619]
2025-10-10T14:06:16.177514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594172656123986:8347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:16.202436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594172656123986:8347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:16.202479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594172656123986:8347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:16.202498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594172656123986:8347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:16.202528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:16.227443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:16.230375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:16.231177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:16.231193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:16.231235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:16.231479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:16.231662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594171078203364:7482]
2025-10-10T14:06:16.233859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:16.235775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:16.235974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:16.237274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:16.237599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:16.237606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:16.237612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:16.237619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:16.237627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:16.237633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:16.237640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:16.237647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:16.237653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.237659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.237666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.237672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.237718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:16.238152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:16.238209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:16.238255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:16.238303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:16.238350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:16.238396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:16.238441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:16.238485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.238531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.238574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.238617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.238659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:16.238721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:16.238778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:16.238833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:16.238892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:16.238943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:16.238986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:16.239037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:16.239083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:16.239135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:16.239178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:16.239230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:16.239273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:16.239328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:16.239370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:16.239422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:16.239466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.239517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.239560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.239613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.239657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.239709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.239751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.239802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.240230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:16.330278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:16.375541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:16.375592Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:16.375614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:16.375635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:16.375659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 573 [2:7559594171078203364:7482]
2025-10-10T14:06:16.375718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:16.375778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:16.375793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:16.375805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:16.375817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:16.375864Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:16.375885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:16.375907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:16.410008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.410038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.410052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.410065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.410075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:16.410359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:16.410379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.410514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.410693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.411640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.411763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:16.411845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594172656124090:8347], now have 1 active actors on pipe
2025-10-10T14:06:16.411869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594172656123951:2442], now have 1 active actors on pipe
2025-10-10T14:06:16.411889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594172656124013:7619], now have 1 active actors on pipe
2025-10-10T14:06:16.411922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.411936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.411949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.411962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.411997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:16.412082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:16.412256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:16.412274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:16.412397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.412418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:16.412529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 573
2025-10-10T14:06:16.412613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 573
2025-10-10T14:06:16.412692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 573, pipe: [1:7559594172656124013:7619]
2025-10-10T14:06:16.413019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:16.413032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:16.413040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:16.413049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:16.413065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:16.414059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:16.414089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:16.414169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:16.414200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:16.414219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:16.414230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:16.414273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:16.414321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:16.414381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:16.417226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:16.417262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:16.417333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:16.417722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 574 partition: 0 MaxSeqNo: 36 sessionId: src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0
2025-10-10T14:06:16.418619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23f6ba0a-f8c8b4ec-86ffa0e4-a8a64069_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:16.475177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:16.475214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:16.475227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:16.480285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0] Write session: try to update token
2025-10-10T14:06:16.480334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:16.607072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:16.607110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:16.607126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:16.607137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:16.607148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:16.607187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.607215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.607239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.607263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.607426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:16.607439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:16.607452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:16.607551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:16.607579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.607592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:16.608295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:16.608335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:16.608370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:16.608420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:16.608753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:16.641324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId: src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:16.662257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:16.770382Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:16.809406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:16.809452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:16.809523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:16.809538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:16.809577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594171078203359:7482]
2025-10-10T14:06:16.810771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594172656124013:7619]
2025-10-10T14:06:16.810816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:16.810830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:16.810859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:16.809837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:16.810208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:16.818547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 574 reason: error at write: Disconnected sessionId: src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0
2025-10-10T14:06:16.819017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 574 sessionId: src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0 is DEAD
2025-10-10T14:06:16.821455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:16.821498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0] Write session will restart in 0.008817s
2025-10-10T14:06:16.821608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0] Write session: Do CDS request
2025-10-10T14:06:16.821641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:16.844100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:16.846547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:16.846576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 575
2025-10-10T14:06:16.846887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:16.847001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:16.847017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:16.847027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:16.848432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 575 sessionId:  describe result for acl check
2025-10-10T14:06:16.848555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:16.848566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:16.848576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:16.848592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594172656124131:8355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:16.855728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594172656124131:8355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:16.868257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594172656124131:8355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:16.889323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594172656124131:8355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:16.889366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594172656124131:8355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:16.889385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594172656124131:8355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:16.889418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:16.910770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594172656124222:7619]
2025-10-10T14:06:16.949908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:16.956051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:16.956999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:16.957018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:16.957064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:16.957376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:16.957573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594171078203534:7490]
2025-10-10T14:06:16.959920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:16.961091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:16.961341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:16.962665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:16.963025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:16.963036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:16.963045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:16.963053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:16.963061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:16.963069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:16.963078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:16.963085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:16.963093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.963100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.963109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.963117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.963175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:16.963304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:16.963363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:16.963422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:16.963468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:16.963515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:16.963569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:16.963625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:16.963680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.963738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.963789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.963839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.963887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:16.963963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:16.964030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:16.964095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:16.964151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:16.964214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:16.964268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:16.964331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:16.964387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:16.964447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:16.964505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:16.964573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:16.964631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:16.964711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:16.964764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:16.964825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:16.964880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.964945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:16.965000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.965063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:16.965116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.965346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:16.965407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.965469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:16.965989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:17.009373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:17.060433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:17.060466Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:17.060479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:17.060492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:17.060509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 574 [2:7559594171078203534:7490]
2025-10-10T14:06:17.060566Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:17.060630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:17.060645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:17.060670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:17.060682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:17.060724Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:17.060746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:17.060771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:17.063853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.063890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:17.063905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:17.063920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:17.063932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:17.064225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:17.064242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.064401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:17.064612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:17.064884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:17.065008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:17.065079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.065094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.065107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.065121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.065545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:17.065654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:17.065853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:17.065873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:17.066011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.066032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:17.066305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:17.066319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:17.066332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:17.066345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:17.066371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:17.072237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594172656124222:7619], now have 1 active actors on pipe
2025-10-10T14:06:17.072290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594172656124175:8355], now have 1 active actors on pipe
2025-10-10T14:06:17.072319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594172656124119:2442], now have 1 active actors on pipe
2025-10-10T14:06:17.072383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:17.072411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:17.072516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:17.072564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:17.072585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:17.072599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:17.069276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 574, pipe: [1:7559594172656124222:7619]
2025-10-10T14:06:17.072641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:17.072703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:17.069397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 574
2025-10-10T14:06:17.072765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:17.069473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 574
2025-10-10T14:06:17.076819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 575 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0
2025-10-10T14:06:17.076221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:17.076268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:17.076355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:17.077581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ece44ddf-86b14398-aa2af0e6-37cd968c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:17.145905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0] Write session: try to update token
2025-10-10T14:06:17.145970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:17.340656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:17.340692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:17.340705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:17.340819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:17.340833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:17.340846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:17.340857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:17.340869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:17.340903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.340931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.340959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.340985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.341078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:17.341116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:17.341169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:17.341198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:17.378970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:17.385912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.385942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:17.401204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:17.420752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId: src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:17.442725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:17.593476Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:17.596554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:17.596586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:17.596629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594171078203529:7490]
2025-10-10T14:06:17.596798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:17.596825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:17.596931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:17.598745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594172656124222:7619]
2025-10-10T14:06:17.598838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:17.598850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:17.606877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:17.638347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 575 reason: error at write: Disconnected sessionId: src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0
2025-10-10T14:06:17.643531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 575 sessionId: src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0 is DEAD
2025-10-10T14:06:17.648403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:17.648435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0] Write session will restart in 0.009224s
2025-10-10T14:06:17.648531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0] Write session: Do CDS request
2025-10-10T14:06:17.648560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:17.666174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:17.667700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:17.673482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:17.673517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 576
2025-10-10T14:06:17.673931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:17.674046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:17.674062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:17.674074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:17.675512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 576 sessionId:  describe result for acl check
2025-10-10T14:06:17.675624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:17.675636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:17.675646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:17.675662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594176951091620:8367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:17.678472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594176951091620:8367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:17.701157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594176951091665:7619]
2025-10-10T14:06:17.709304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594176951091620:8367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:17.734205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594176951091620:8367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:17.734248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594176951091620:8367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:17.734267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594176951091620:8367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:17.734297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:17.748169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:17.750800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:17.751732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:17.751762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:17.751805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:17.752058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:17.752290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594175373171008:7496]
2025-10-10T14:06:17.754539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:17.755414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:17.755628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:17.757076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:17.757432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:17.757452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:17.757460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:17.757468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:17.757480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:17.757487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:17.757494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:17.757501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:17.757509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.757516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:17.757523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:17.757530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:17.757579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:17.757690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:17.757742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:17.757790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:17.757838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:17.757884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:17.757930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:17.757976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:17.758022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.758070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:17.758114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:17.758161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:17.758199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:17.758264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:17.758326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:17.758383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:17.758433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:17.758490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:17.758535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:17.758589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:17.758639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:17.758694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:17.758740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:17.758795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:17.758846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:17.758903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:17.758949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:17.759005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:17.759053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.759108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.759152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:17.759206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:17.759253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:17.759311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:17.759354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:17.759410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:17.759855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:17.805473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:17.821033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:17.821078Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:17.821095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:17.821113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:17.821147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 575 [2:7559594175373171008:7496]
2025-10-10T14:06:17.821201Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:17.821257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:17.821271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:17.821285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:17.821296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:17.821342Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:17.821366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:17.821388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:17.823699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.823715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:17.823730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:17.823745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:17.823756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:17.824443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 575, pipe: [1:7559594176951091665:7619]
2025-10-10T14:06:17.824493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 575
2025-10-10T14:06:17.824555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 575
2025-10-10T14:06:17.824990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:17.825018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.825176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:17.825357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:17.825579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:17.825698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:17.825739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594176951091665:7619], now have 1 active actors on pipe
2025-10-10T14:06:17.825763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594176951091615:2442], now have 1 active actors on pipe
2025-10-10T14:06:17.825787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594176951091744:8367], now have 1 active actors on pipe
2025-10-10T14:06:17.825850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:17.825864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:17.825879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:17.825893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:17.825932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:17.826009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:17.826186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:17.826204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:17.826319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:17.826499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:17.826510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:17.826521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:17.826532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:17.826553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:17.826628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:17.826743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:17.826764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:17.826871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:17.826899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:17.826915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:17.826927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:17.826958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:17.826995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:17.827054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:17.835108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:17.835152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:17.835229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:17.836872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 576 partition: 0 MaxSeqNo: 36 sessionId: src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0
2025-10-10T14:06:17.838831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8ef0f8-1ca2a7ec-b3a1addb-407805c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:17.867112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0] Write session: try to update token
2025-10-10T14:06:17.867168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:17.998417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:17.998450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:17.998461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:17.998514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:17.998529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:17.998541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:17.998553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:17.998566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:17.998599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:17.998627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:17.998655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:17.998678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:17.998795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:17.998841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:17.998871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:17.998903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:17.999812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:17.999852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:17.999865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:18.006167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:18.027478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId: src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:18.052034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:18.147736Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:18.180325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:18.180365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:18.180419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:18.180430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:18.180466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594175373171003:7496]
2025-10-10T14:06:18.181408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:18.182577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594176951091665:7619]
2025-10-10T14:06:18.182652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:18.182769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:18.182779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:18.182205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:18.232238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 576 reason: error at write: Disconnected sessionId: src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0
2025-10-10T14:06:18.232564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 576 sessionId: src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0 is DEAD
2025-10-10T14:06:18.233494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:18.233559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0] Write session will restart in 0.006148s
2025-10-10T14:06:18.233730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0] Write session: Do CDS request
2025-10-10T14:06:18.233766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:18.252755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:18.252792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 577
2025-10-10T14:06:18.254670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:18.255249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:18.255397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:18.255419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:18.255429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:18.257196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 577 sessionId:  describe result for acl check
2025-10-10T14:06:18.257317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:18.257329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:18.257339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:18.257356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594181246059159:8376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:18.260137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594181246059159:8376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:18.285399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594181246059213:7619]
2025-10-10T14:06:18.291178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594181246059159:8376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:18.296716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:18.303797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:18.304949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:18.304971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:18.305023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:18.305351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:18.305562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594179668138492:7510]
2025-10-10T14:06:18.308106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:18.309229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:18.309320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594181246059159:8376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:18.309367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594181246059159:8376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:18.309385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594181246059159:8376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:18.309418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:18.309468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:18.310933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:18.311283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:18.311292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:18.311301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:18.311310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:18.311317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:18.311326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:18.311333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:18.311340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:18.311348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:18.311356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:18.311363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:18.311371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:18.311419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:18.311535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:18.311589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:18.311641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:18.311695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:18.311752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:18.311808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:18.311858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:18.311916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:18.311966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:18.312017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:18.312082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:18.312129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:18.312205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:18.312272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:18.312332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:18.312386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:18.312445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:18.312500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:18.312564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:18.312643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:18.312705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:18.312757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:18.312816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:18.312867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:18.312931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:18.312982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:18.313043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:18.313096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:18.313537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:18.313597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:18.313661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:18.313715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:18.313776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:18.313840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:18.313904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:18.314402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:18.348584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:18.361980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:18.362030Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:18.362048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:18.362070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:18.362095Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 576 [2:7559594179668138492:7510]
2025-10-10T14:06:18.362154Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:18.362225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:18.362242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:18.362254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:18.362266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:18.362314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:18.362339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:18.362362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:18.419296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:18.419323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:18.419334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:18.419346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:18.419356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:18.421326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 576, pipe: [1:7559594181246059213:7619]
2025-10-10T14:06:18.421471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 576
2025-10-10T14:06:18.421585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 576
2025-10-10T14:06:18.426816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:18.426854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:18.426995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:18.427173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:18.427387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:18.427495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:18.427537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594181246059213:7619], now have 1 active actors on pipe
2025-10-10T14:06:18.427561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594181246059236:8376], now have 1 active actors on pipe
2025-10-10T14:06:18.427583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594181246059092:2442], now have 1 active actors on pipe
2025-10-10T14:06:18.427638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:18.427660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:18.427762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.427775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.427788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.427801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.427846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:18.427933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:18.427953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:18.427957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:18.427972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:18.427984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:18.427987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:18.428006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:18.428018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:18.428056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:18.428103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:18.428159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:18.428329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:18.428346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:18.428476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:18.428526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.428552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:18.428794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:18.430890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 577 partition: 0 MaxSeqNo: 36 sessionId: src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0
2025-10-10T14:06:18.431888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c152e2a9-4285e143-b3a22cf3-1398db6b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:18.430394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:18.430429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:18.430510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:18.458613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0] Write session: try to update token
2025-10-10T14:06:18.458677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:18.460581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:18.460628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:18.460640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:06:18.595082862  106846 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:06:18.628055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:18.628096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:18.628109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:18.628171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:18.628184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:18.628199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:18.628210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:18.628221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:18.628262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.628288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.628312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.628333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.628540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:18.628567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:18.628578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:18.629831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:18.629884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:18.629919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:18.629951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:18.641594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:18.653426Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:06:18.665237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId: src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:18.717727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:18.906935Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:18.996541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:18.996592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:18.996675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:18.996689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:18.996729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594179668138487:7510]
2025-10-10T14:06:18.997075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:18.998057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:19.002825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594181246059213:7619]
2025-10-10T14:06:19.002935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:19.018408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:19.018568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 577 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0
2025-10-10T14:06:19.018874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 577 sessionId: src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0 is DEAD
2025-10-10T14:06:19.021740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:19.021810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0] Write session will restart in 0.005024s
2025-10-10T14:06:19.021993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0] Write session: Do CDS request
2025-10-10T14:06:19.022049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:19.036521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:19.050091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:19.050126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 578
2025-10-10T14:06:19.052520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:19.052790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:19.052812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:19.052824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:19.058645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 578 sessionId:  describe result for acl check
2025-10-10T14:06:19.058779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:19.058791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:19.058802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:19.058820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594185541026585:8388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:19.062530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594185541026585:8388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:19.078233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594185541026585:8388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:19.099461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594185541026585:8388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:19.099506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594185541026585:8388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:19.099527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594185541026585:8388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:19.099556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:19.105528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594185541026658:7619]
2025-10-10T14:06:19.154518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:19.158006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:19.158938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:19.158956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:19.159002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:19.159273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:19.159448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594183963105945:7513]
2025-10-10T14:06:19.167415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:19.170142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:19.170397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:19.171638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:19.171957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:19.171964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:19.171971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:19.171977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:19.171984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:19.171991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:19.171998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:19.172004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:19.172010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.172015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.172021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.172028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.172069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:19.172173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:19.172220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:19.172265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:19.172306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:19.172352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:19.172395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:19.172439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:19.172481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.172523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.172565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.172623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.172661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:19.172721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:19.172779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:19.172825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:19.172871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:19.172922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:19.172965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:19.173016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:19.173065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:19.173118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:19.174443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:19.174528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:19.174582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:19.174646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:19.174692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:19.174744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:19.174806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.174858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.174907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.174962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.175011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.175062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.175107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.175157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.175588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:19.208166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:19.295008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:19.295047Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:19.295072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:19.295088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:19.295110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 577 [2:7559594183963105945:7513]
2025-10-10T14:06:19.295157Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:19.295214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:19.295228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:19.295239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:19.295249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:19.295296Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:19.295317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:19.295337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:19.298032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.298055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.298067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.298078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.298087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:19.298336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:19.298350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.298480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.298637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.298830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.298927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:19.298998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.299012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.299024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.299036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.299082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:19.299157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:19.299845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:19.299870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:19.300012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.300031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:19.301260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:19.301281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:19.301290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:19.301300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:19.301323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:19.302124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594185541026575:2442], now have 1 active actors on pipe
2025-10-10T14:06:19.302157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594185541026638:8388], now have 1 active actors on pipe
2025-10-10T14:06:19.302494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 577
2025-10-10T14:06:19.302187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594185541026658:7619], now have 1 active actors on pipe
2025-10-10T14:06:19.302607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 577
2025-10-10T14:06:19.302672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 577, pipe: [1:7559594185541026658:7619]
2025-10-10T14:06:19.313334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:19.313379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:19.313472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c06b7762-f782f4c-730a4913-8797b68c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:19.313507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:19.313525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:19.313537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:19.313575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:19.313623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:19.313666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:19.317336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:19.317383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:19.317468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:19.322257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 578 partition: 0 MaxSeqNo: 36 sessionId: src_id|c06b7762-f782f4c-730a4913-8797b68c_0
2025-10-10T14:06:19.323202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91f5585a-2ca92f9f-20a0223-577f3f6a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c06b7762-f782f4c-730a4913-8797b68c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:19.378300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06b7762-f782f4c-730a4913-8797b68c_0] Write session: try to update token
2025-10-10T14:06:19.378370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06b7762-f782f4c-730a4913-8797b68c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:19.420361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:19.424964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:19.424996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:19.425072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:19.425087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:19.425119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.425248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:19.425265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:19.427081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:19.456312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:19.457570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:19.458776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:19.467846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:19.468985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:19.517230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:19.517260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:19.517271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:19.616184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId: src_id|c06b7762-f782f4c-730a4913-8797b68c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:19.627880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:19.627918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:19.627933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:19.627946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:19.627960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:19.628005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.628032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.628057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.628082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594183963105940:7513]
2025-10-10T14:06:19.628262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:19.628279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:19.628291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:19.628337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:19.628363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.628374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:19.629244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:19.629290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:19.629325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:19.629356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:19.637591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:19.692439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:19.816614Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:19.844122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:19.844179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:19.845276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:19.845444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:19.845457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:19.849321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594185541026658:7619]
2025-10-10T14:06:19.852833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:19.874530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 578 reason: error at write: Disconnected sessionId: src_id|c06b7762-f782f4c-730a4913-8797b68c_0
2025-10-10T14:06:19.874876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 578 sessionId: src_id|c06b7762-f782f4c-730a4913-8797b68c_0 is DEAD
2025-10-10T14:06:19.878169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06b7762-f782f4c-730a4913-8797b68c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:19.878204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06b7762-f782f4c-730a4913-8797b68c_0] Write session will restart in 0.007245s
2025-10-10T14:06:19.878300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06b7762-f782f4c-730a4913-8797b68c_0] Write session: Do CDS request
2025-10-10T14:06:19.878330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06b7762-f782f4c-730a4913-8797b68c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:19.892489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06b7762-f782f4c-730a4913-8797b68c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:19.892036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:19.892068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 579
2025-10-10T14:06:19.893332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:19.893461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:19.893477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:19.893487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:19.894878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 579 sessionId:  describe result for acl check
2025-10-10T14:06:19.894980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:19.894991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:19.895000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:19.895015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594185541026781:8398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:19.903712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594185541026781:8398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:19.924383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594185541026781:8398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:19.943994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594185541026781:8398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:19.944041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594185541026781:8398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:19.944059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594185541026781:8398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:19.944092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:19.949436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594185541026902:7619]
2025-10-10T14:06:19.973638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:19.984663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:19.985635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:19.985664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:19.985710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:19.986011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:19.986206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594183963106151:7525]
2025-10-10T14:06:19.988697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:19.990238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:19.990496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:19.991870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:19.992189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:19.992196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:19.992205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:19.992212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:19.992220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:19.992228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:19.992235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:19.992243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:19.992250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.992257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.992263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.992271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.992324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:19.992439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:19.992494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:19.992545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:19.992616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:19.992669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:19.992723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:19.992772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:19.992821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.993574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.993641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.993695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.993746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:19.993821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:19.993886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:19.993946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:19.994002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:19.994063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:19.994111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:19.994166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:19.994219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:19.994280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:19.994347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:19.994409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:19.994462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:19.994524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:19.994574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:19.994636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:19.994692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.994751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:19.994804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.994864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:19.994916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.994972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:19.995024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.995082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:19.995562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:20.068823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:20.087380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 578, pipe: [1:7559594185541026902:7619]
2025-10-10T14:06:20.087517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 578
2025-10-10T14:06:20.087611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 578
2025-10-10T14:06:20.083152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:20.083201Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:20.083220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:20.083242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:20.083268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 578 [2:7559594183963106151:7525]
2025-10-10T14:06:20.083329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:20.083393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:20.083411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:20.083425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:20.083437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:20.083484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:20.083507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:20.083528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:20.084891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.084910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:20.084927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:20.084942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:20.084955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:20.089081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:20.089117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.089304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:20.089512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:20.089766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:20.089904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:20.089954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594185541026902:7619], now have 1 active actors on pipe
2025-10-10T14:06:20.089983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594185541026766:2442], now have 1 active actors on pipe
2025-10-10T14:06:20.090007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594185541026891:8398], now have 1 active actors on pipe
2025-10-10T14:06:20.090077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.090093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.090108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.090122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.090169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:20.090257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:20.090452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:20.090472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:20.090600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.090622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:20.091327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:20.091347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:20.091359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:20.091372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:20.091399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:20.092684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:20.092716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:20.092793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:20.092826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:20.092845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:20.092855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:20.092890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:20.092934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:20.092982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:20.095681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:20.095720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:20.095800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:20.096179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 579 partition: 0 MaxSeqNo: 36 sessionId: src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0
2025-10-10T14:06:20.101704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06b7762-f782f4c-730a4913-8797b68c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:20.142439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0] Write session: try to update token
2025-10-10T14:06:20.142500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:20.254996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:20.255028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:20.255040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:20.255153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:20.255167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:20.255180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:20.255191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:20.255200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:20.255233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.255260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.255282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.255303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.255440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:20.255474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:20.255503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:20.255534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:20.294574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:20.294622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.294635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:20.295830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:20.342169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId: src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:20.375334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:20.445165Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:20.446939Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:20.446958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:20.447002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594183963106146:7525]
2025-10-10T14:06:20.447147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:20.447171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:20.447307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:20.448368Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:20.449689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594185541026902:7619]
2025-10-10T14:06:20.449858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:20.450049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:20.456176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 579 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0
2025-10-10T14:06:20.456485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 579 sessionId: src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0 is DEAD
2025-10-10T14:06:20.459400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:20.459455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0] Write session will restart in 0.008956s
2025-10-10T14:06:20.459554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0] Write session: Do CDS request
2025-10-10T14:06:20.459587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:20.476151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:20.476186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 580
2025-10-10T14:06:20.476770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:20.482051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:20.482210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:20.482228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:20.482241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:20.484138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 580 sessionId:  describe result for acl check
2025-10-10T14:06:20.484268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:20.484279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:20.484289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:20.484305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594189835994252:8404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:20.487388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594189835994252:8404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:20.506406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594189835994252:8404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:20.543227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594189835994252:8404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:20.543278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594189835994252:8404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:20.543298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594189835994252:8404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:20.543332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:20.553256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594189835994396:7619]
2025-10-10T14:06:20.571406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:20.576724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:20.577598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:20.577617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:20.577659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:20.577930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:20.578130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594188258073617:7533]
2025-10-10T14:06:20.580565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:20.581978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:20.582220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:20.583569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:20.583908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:20.583918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:20.583926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:20.583934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:20.583942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:20.583950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:20.583957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:20.583965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:20.583972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.583979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:20.583986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:20.583993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:20.584042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:20.584161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:20.584230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:20.584296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:20.584347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:20.584398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:20.584447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:20.584498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:20.584544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.584609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:20.584659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:20.584708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:20.584748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:20.584816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:20.584879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:20.584939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:20.584996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:20.585051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:20.585095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:20.585205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:20.585256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:20.585312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:20.585363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:20.585418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:20.585468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:20.585524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:20.585575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:20.585629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:20.585678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.585734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.585793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:20.585852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:20.585909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:20.585967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:20.586014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:20.586073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:20.586552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:20.619036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:20.632609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:20.632653Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:20.632673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:20.632694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:20.632719Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 579 [2:7559594188258073617:7533]
2025-10-10T14:06:20.632781Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:20.632844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:20.632859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:20.632872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:20.632885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:20.632934Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:20.632954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:20.632976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:20.634712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.634731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:20.634747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:20.634762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:20.634774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:20.635048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:20.635066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.635216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:20.635408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:20.635648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:20.635772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:20.635840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.635857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.635872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.635886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.635928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:20.636008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:20.636198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:20.636215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:20.636340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.636359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:20.637366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:20.637387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:20.637401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:20.637414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:20.637440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:20.638048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594189835994240:2442], now have 1 active actors on pipe
2025-10-10T14:06:20.638080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594189835994396:7619], now have 1 active actors on pipe
2025-10-10T14:06:20.638104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594189835994367:8404], now have 1 active actors on pipe
2025-10-10T14:06:20.641401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 579
2025-10-10T14:06:20.641498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 579, pipe: [1:7559594189835994396:7619]
2025-10-10T14:06:20.641570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 579
2025-10-10T14:06:20.643120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:20.643161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:20.643239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:20.643270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:20.643288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:20.643300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:20.643336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:20.643384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:20.643437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:20.643931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:20.643953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:20.644014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:20.644284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 580 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0
2025-10-10T14:06:20.649374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f5a197-2a3973ee-173dc010-b57c44f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:20.689548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0] Write session: try to update token
2025-10-10T14:06:20.689599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:20.736243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:20.736302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:20.736327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:20.803041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:20.803078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:20.803115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.803225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:20.803257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:20.805288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:20.806609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:20.807994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:20.837906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:20.846438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:20.846906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:20.846922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:20.846934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:20.846993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:20.861295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId: src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:20.908463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:20.952784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:20.952837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:20.952877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:20.952890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:20.952904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:20.952916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:20.952927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:20.952964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.952991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.953015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.953045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594188258073611:7533]
2025-10-10T14:06:20.953228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:20.953234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:20.953249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:20.953259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:20.953269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:20.953300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:20.953331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:20.953341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:20.953369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:20.953380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:20.954472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:21.129376Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:21.132062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:06:21.132391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:21.135128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594189835994396:7619]
2025-10-10T14:06:21.135305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:21.238430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594194130961783:7619]
2025-10-10T14:06:21.314371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:21.328296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:21.328321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:21.328388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 580 reason: error at write: Disconnected sessionId: src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0
2025-10-10T14:06:21.328656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 580 sessionId: src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0 is DEAD
2025-10-10T14:06:21.333441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:21.333517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0] Write session will restart in 0.005349s
2025-10-10T14:06:21.333707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0] Write session: Do CDS request
2025-10-10T14:06:21.333766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:21.333527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:21.335041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:21.335072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:21.335151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:21.335717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:21.335920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594192553041100:7542]
2025-10-10T14:06:21.338473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:21.347371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:21.347278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:21.347320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 581
2025-10-10T14:06:21.347915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:21.348062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:21.348087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:21.348098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:21.349625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 581 sessionId:  describe result for acl check
2025-10-10T14:06:21.349756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:21.349776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:21.349786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:21.349802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594194130961870:8420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:21.352637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594194130961870:8420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:21.362646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594194130961870:8420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:21.372886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594194130961870:8420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:21.372934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594194130961870:8420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:21.372952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594194130961870:8420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:21.372984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:21.373612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:21.373870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:21.375137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:21.375477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:21.375486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:21.375493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:21.375500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:21.375507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:21.375516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:21.375523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:21.375531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:21.375538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.375544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.375552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.375560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.375605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:21.375710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:21.375760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:21.375805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:21.375851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:21.375899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:21.375946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:21.375995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:21.376040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.376088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.376132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.376174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.376214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:21.376280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:21.376339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:21.376399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:21.376451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:21.376510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:21.376578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:21.376638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:21.376691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:21.376750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:21.376795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:21.377155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:21.377223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:21.377281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:21.377333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:21.377393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:21.377444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.377503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.377554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.377613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.377666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.377728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.377779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.377839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.378351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:21.403741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:21.440654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:21.440707Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:21.440724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:21.440745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:21.440769Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 580 [2:7559594192553041100:7542]
2025-10-10T14:06:21.440829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:21.440888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:21.440903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:21.440916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:21.440929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:21.440979Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:21.441001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:21.441023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:21.442601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.442632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.442648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.442662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.442675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:21.442975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:21.442997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.443158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.443382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.443648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.443780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:21.443881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594194130961901:8420], now have 1 active actors on pipe
2025-10-10T14:06:21.443909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594194130961736:2442], now have 1 active actors on pipe
2025-10-10T14:06:21.443936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594194130961783:7619], now have 1 active actors on pipe
2025-10-10T14:06:21.443963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.443979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.443994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.444008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.444050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:21.444149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:21.444146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:21.444161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:21.444174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:21.444186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:21.444355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:21.444374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:21.444062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 580
2025-10-10T14:06:21.444512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.444555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:21.444154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 580
2025-10-10T14:06:21.444569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:21.444217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 580, pipe: [1:7559594194130961783:7619]
2025-10-10T14:06:21.444671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:21.444694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:21.444819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|237b6295-8803e739-5c82adb4-9feef51a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:21.444852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:21.444872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:21.444884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:21.444921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:21.444963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:21.445041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:21.452300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:21.452347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:21.452431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:21.455690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 581 partition: 0 MaxSeqNo: 36 sessionId: src_id|237b6295-8803e739-5c82adb4-9feef51a_0
2025-10-10T14:06:21.456730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b1ca5e-2607bd77-94eea626-772f9e9c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|237b6295-8803e739-5c82adb4-9feef51a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:21.518718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|237b6295-8803e739-5c82adb4-9feef51a_0] Write session: try to update token
2025-10-10T14:06:21.518790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|237b6295-8803e739-5c82adb4-9feef51a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:21.541422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:21.541453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:21.541465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:21.609234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:21.609273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:21.609288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:21.609300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:21.609312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:21.609348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.609376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.609401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.609427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.609516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:21.609545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:21.609576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:21.609608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:21.620072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:21.620115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.620127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:21.621216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:21.733363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId: src_id|237b6295-8803e739-5c82adb4-9feef51a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:21.763947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:21.818436Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:21.829399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:21.829453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:21.829524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:21.829542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:21.829588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594192553041094:7542]
2025-10-10T14:06:21.830095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:21.830553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:21.837313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:21.837627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594194130961783:7619]
2025-10-10T14:06:21.837819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:21.844414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 581 reason: status is not ok: tablet will be restarted right now sessionId: src_id|237b6295-8803e739-5c82adb4-9feef51a_0
2025-10-10T14:06:21.845949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 581 sessionId: src_id|237b6295-8803e739-5c82adb4-9feef51a_0 is DEAD
2025-10-10T14:06:21.848268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b6295-8803e739-5c82adb4-9feef51a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:21.848306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b6295-8803e739-5c82adb4-9feef51a_0] Write session will restart in 0.006218s
2025-10-10T14:06:21.848405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b6295-8803e739-5c82adb4-9feef51a_0] Write session: Do CDS request
2025-10-10T14:06:21.848434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b6295-8803e739-5c82adb4-9feef51a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:21.860997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|237b6295-8803e739-5c82adb4-9feef51a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:21.862186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:21.862225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 582
2025-10-10T14:06:21.862638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:21.862776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:21.862793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:21.862804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:21.864296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 582 sessionId:  describe result for acl check
2025-10-10T14:06:21.864422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:21.864439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:21.864450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:21.864469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594194130961940:8427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:21.867705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594194130961940:8427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:21.887839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594194130961940:8427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:21.901543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594194130961940:8427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:21.901587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594194130961940:8427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:21.901607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594194130961940:8427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:21.901638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:21.941263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594194130962073:7619]
2025-10-10T14:06:21.967166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:21.968129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:21.968931Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:21.968950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:21.968999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:21.969291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:21.969485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594192553041278:7553]
2025-10-10T14:06:21.972477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:21.976336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:21.976636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:21.978090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:21.978471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:21.978481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:21.978490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:21.978500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:21.978508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:21.978515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:21.978523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:21.978531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:21.978539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.978547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.978552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.978561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.978616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:21.978744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:21.978800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:21.978854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:21.978902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:21.978956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:21.979009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:21.979061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:21.979115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.979171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.979222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.979283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.979331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:21.979411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:21.979476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:21.979542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:21.979599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:21.979658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:21.979707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:21.979767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:21.979821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:21.979880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:21.979935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:21.981219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:21.981308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:21.981379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:21.981434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:21.981502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:21.981562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.981620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:21.981672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.981733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:21.981787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.981849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:21.981902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.981963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:21.982485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:22.035092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:22.052194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 581
2025-10-10T14:06:22.052270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 581, pipe: [1:7559594194130962073:7619]
2025-10-10T14:06:22.052337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 581
2025-10-10T14:06:22.049502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:22.049538Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:22.049551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:22.049567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:22.049584Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 581 [2:7559594192553041278:7553]
2025-10-10T14:06:22.049628Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:22.049678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:22.049691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:22.049703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:22.049713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:22.049755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:22.049780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:22.049798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:22.050844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.050856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:22.050866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:22.050874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:22.050883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:22.051140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:22.051158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.051315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:22.051510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:22.051753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:22.051897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:22.051983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594194130961996:8427], now have 1 active actors on pipe
2025-10-10T14:06:22.052010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594194130962073:7619], now have 1 active actors on pipe
2025-10-10T14:06:22.052034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594194130961927:2442], now have 1 active actors on pipe
2025-10-10T14:06:22.052059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.052074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.052089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.052101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.052144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:22.052226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:22.052415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:22.052433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:22.052573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.052595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:22.052596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:22.052610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:22.052622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:22.052634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:22.052656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:22.053754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:22.053786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:22.053872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|897dd539-deca4b8-3035758b-182071c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:22.053903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:22.053921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:22.053934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:22.053987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:22.054033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:22.054101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:22.056329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:22.056363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:22.056435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:22.056869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 582 partition: 0 MaxSeqNo: 36 sessionId: src_id|897dd539-deca4b8-3035758b-182071c4_0
2025-10-10T14:06:22.057673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|237b6295-8803e739-5c82adb4-9feef51a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|897dd539-deca4b8-3035758b-182071c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:22.106669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897dd539-deca4b8-3035758b-182071c4_0] Write session: try to update token
2025-10-10T14:06:22.106729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897dd539-deca4b8-3035758b-182071c4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:22.190972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:22.191017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:22.191035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:22.191049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:22.191063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:22.191104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.191136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.191164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.191192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.191426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:22.191444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:22.191458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:22.197267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:22.197318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:22.197351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:22.197381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:22.220549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:22.220600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.220611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:22.221733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:22.317233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId: src_id|897dd539-deca4b8-3035758b-182071c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:22.344712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:22.386776Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:22.389535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:22.389568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:22.389619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594192553041273:7553]
2025-10-10T14:06:22.389772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:22.389801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:22.389993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:22.391078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:22.390967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:22.390998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:22.404936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594194130962073:7619]
2025-10-10T14:06:22.405018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:22.405158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 582 reason: error at write: Disconnected sessionId: src_id|897dd539-deca4b8-3035758b-182071c4_0
2025-10-10T14:06:22.408148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897dd539-deca4b8-3035758b-182071c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:22.408223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897dd539-deca4b8-3035758b-182071c4_0] Write session will restart in 0.009773s
2025-10-10T14:06:22.408406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897dd539-deca4b8-3035758b-182071c4_0] Write session: Do CDS request
2025-10-10T14:06:22.408458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897dd539-deca4b8-3035758b-182071c4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:22.405457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 582 sessionId: src_id|897dd539-deca4b8-3035758b-182071c4_0 is DEAD
2025-10-10T14:06:22.436793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:22.436856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 583
2025-10-10T14:06:22.441983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897dd539-deca4b8-3035758b-182071c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:22.443270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:22.443427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:22.443449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:22.443459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:22.444913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 583 sessionId:  describe result for acl check
2025-10-10T14:06:22.445037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:22.445047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:22.445057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:22.445073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594198425929429:8439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:22.447760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594198425929429:8439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:22.463001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594198425929429:8439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:22.488751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594198425929429:8439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:22.488795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594198425929429:8439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:22.488814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594198425929429:8439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:22.488843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:22.511263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594198425929561:7619]
2025-10-10T14:06:22.524107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:22.528939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:22.529785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:22.529815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:22.529861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:22.530128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:22.530317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594196848008746:7556]
2025-10-10T14:06:22.532669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:22.541953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:22.542217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:22.543789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:22.544173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:22.544183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:22.544190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:22.544199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:22.544207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:22.544215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:22.544224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:22.544232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:22.544240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.544248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:22.544256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:22.544263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:22.544316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:22.544430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:22.544481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:22.544550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:22.544600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:22.544652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:22.544704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:22.544753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:22.544801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.544853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:22.544903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:22.544950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:22.544996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:22.545070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:22.545158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:22.545224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:22.545282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:22.545339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:22.545391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:22.545452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:22.545504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:22.545564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:22.545610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:22.545667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:22.545718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:22.545773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:22.545824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:22.545882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:22.545931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.545985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.546034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:22.546090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:22.546138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:22.546193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:22.546240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:22.546297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:22.546768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:22.583453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:22.598962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:22.599013Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:22.599031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:22.599052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:22.599076Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 582 [2:7559594196848008746:7556]
2025-10-10T14:06:22.599138Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:22.599202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:22.599219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:22.599232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:22.599244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:22.599294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:22.599317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:22.599339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:22.600658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.600675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:22.600692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:22.600708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:22.600719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:22.602392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:22.602423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.602579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:22.602777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:22.603022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:22.603154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:22.602543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 582
2025-10-10T14:06:22.602636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 582, pipe: [1:7559594198425929561:7619]
2025-10-10T14:06:22.602732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 582
2025-10-10T14:06:22.603196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594198425929519:8439], now have 1 active actors on pipe
2025-10-10T14:06:22.603232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594198425929418:2442], now have 1 active actors on pipe
2025-10-10T14:06:22.603256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594198425929561:7619], now have 1 active actors on pipe
2025-10-10T14:06:22.603362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:22.603384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:22.603424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.603439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.603453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.603467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.603505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:22.603589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:22.603779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:22.603798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:22.603867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:22.603895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:22.603913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:22.603925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:22.603957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:22.603998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:22.604128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.604151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:22.604198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:22.604268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:22.604282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:22.604293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:22.604306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:22.604331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:22.616264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:22.616314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:22.616401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:22.621811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 583 partition: 0 MaxSeqNo: 36 sessionId: src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0
2025-10-10T14:06:22.622782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897dd539-deca4b8-3035758b-182071c4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:22.657034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0] Write session: try to update token
2025-10-10T14:06:22.657091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:22.746910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:22.750248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:22.750274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:22.750334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:22.750345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:22.750354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:22.750363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:22.750371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:22.750398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.750416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.750435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.750461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.750606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:22.750625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:22.750634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:22.751597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:22.751739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:22.751760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:22.751781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:22.751800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:22.812580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId: src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:22.835889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:22.925525Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:22.941466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:22.941504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:22.941563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:22.941577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:22.941617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594196848008741:7556]
2025-10-10T14:06:22.943215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:22.944248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:22.945142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:22.945168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:22.949501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:22.949751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594198425929561:7619]
2025-10-10T14:06:22.982270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 583 reason: error at write: Disconnected sessionId: src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0
2025-10-10T14:06:22.982571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 583 sessionId: src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0 is DEAD
2025-10-10T14:06:22.985426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:22.985499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0] Write session will restart in 0.009919s
2025-10-10T14:06:22.985667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0] Write session: Do CDS request
2025-10-10T14:06:22.985714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:23.004015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:23.004056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 584
2025-10-10T14:06:23.004586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:23.009372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:23.009521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:23.009545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:23.009556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:23.010934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 584 sessionId:  describe result for acl check
2025-10-10T14:06:23.011035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:23.011047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:23.011054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:23.011065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594202720896908:8447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:23.013141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594202720896908:8447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:23.035498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594202720896908:8447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:23.050402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594202720897016:7619]
2025-10-10T14:06:23.058075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594202720896908:8447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:23.058121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594202720896908:8447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:23.058134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594202720896908:8447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:23.058158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:23.065458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:23.070185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:23.071131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:23.071166Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:23.071210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:23.071483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:23.071673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594201142976221:7567]
2025-10-10T14:06:23.075642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:23.076760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:23.077020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:23.079054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:23.079442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:23.079451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:23.079459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:23.079467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:23.079474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:23.079483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:23.079490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:23.079498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:23.079505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.079511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.079518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.079524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.079572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:23.079688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:23.079741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:23.079812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:23.079861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:23.079910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:23.079961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:23.080008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:23.080055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.080102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.080149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.080195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.080239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:23.080310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:23.080371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:23.080430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:23.080480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:23.080553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:23.080602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:23.080655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:23.080708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:23.080764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:23.080816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:23.080873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:23.080924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:23.081848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:23.081913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:23.081979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:23.082032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.082200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.082256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.082316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.082368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.082425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.082471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.082527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.083004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:23.109947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:23.124949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:23.126936Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:23.126973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:23.126993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:23.127020Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 583 [2:7559594201142976221:7567]
2025-10-10T14:06:23.127080Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:23.127138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:23.127153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:23.127165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:23.127177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:23.127225Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:23.127246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:23.127268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:23.129704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.129725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.129740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.129755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.129767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:23.130746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 583, pipe: [1:7559594202720897016:7619]
2025-10-10T14:06:23.130824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 583
2025-10-10T14:06:23.130897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 583
2025-10-10T14:06:23.130787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:23.130821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.130974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.131172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.131416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.131544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:23.131592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594198425929599:2442], now have 1 active actors on pipe
2025-10-10T14:06:23.131620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594202720897016:7619], now have 1 active actors on pipe
2025-10-10T14:06:23.131646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594202720897037:8447], now have 1 active actors on pipe
2025-10-10T14:06:23.131716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.131735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.131748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.131762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.131809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:23.131898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:23.132095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:23.132113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:23.132155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:23.132168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:23.132182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:23.132196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:23.132246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.132272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:23.132275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:23.132404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:23.132427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:23.132559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:23.132612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:23.132630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:23.132646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:23.132682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:23.132734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:23.132813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:23.140601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:23.140651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:23.140739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:23.141373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 584 partition: 0 MaxSeqNo: 36 sessionId: src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0
2025-10-10T14:06:23.145720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ae630e4-c8d1ee21-78bd8802-e4edaf62_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:23.216306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0] Write session: try to update token
2025-10-10T14:06:23.216360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:23.302996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:23.303025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:23.303037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:23.303088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:23.303103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:23.303116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:23.303129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:23.303141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:23.303175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.303200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.303226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.303249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.303442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:23.303470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.303481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:23.303643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:23.303674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:23.303703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:23.303731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:23.311395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:23.368334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId: src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:23.395165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:23.466044Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:23.539598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:23.539644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:23.539713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:23.539726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:23.539765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594201142976216:7567]
2025-10-10T14:06:23.540326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:23.545178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:23.540674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:23.540706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:23.542476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594202720897016:7619]
2025-10-10T14:06:23.542645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:23.559973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 584 reason: error at write: Disconnected sessionId: src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0
2025-10-10T14:06:23.560253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 584 sessionId: src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0 is DEAD
2025-10-10T14:06:23.560894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:23.560933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0] Write session will restart in 0.007097s
2025-10-10T14:06:23.561034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0] Write session: Do CDS request
2025-10-10T14:06:23.561064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:23.577702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:23.577512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:23.577556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 585
2025-10-10T14:06:23.578269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:23.578404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:23.578421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:23.578431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:23.582559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 585 sessionId:  describe result for acl check
2025-10-10T14:06:23.582692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:23.582711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:23.582721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:23.582737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594202720897095:8453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:23.586749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594202720897095:8453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:23.615016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594202720897095:8453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:23.633374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594202720897095:8453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:23.633420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594202720897095:8453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:23.633439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594202720897095:8453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:23.633470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:23.642301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594202720897203:7619]
2025-10-10T14:06:23.642385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:06:23.642432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-10-10T14:06:23.678315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:23.688433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:23.694596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:23.694639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:23.694724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:23.695161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:23.695369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594201142976413:7576]
2025-10-10T14:06:23.697865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:23.699290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:23.699557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:23.700894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:23.701265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:23.701273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:23.701279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:23.701285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:23.701292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:23.701298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:23.701305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:23.701312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:23.701319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.701325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.701332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.701339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.701390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:23.701497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:23.701541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:23.701602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:23.701652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:23.701703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:23.701751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:23.701800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:23.701847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.701897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.701949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.701997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.702045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:23.702110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:23.702171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:23.702225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:23.702280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:23.702338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:23.702386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:23.702441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:23.702490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:23.702546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:23.702594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:23.702649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:23.702698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:23.702756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:23.702802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:23.702854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:23.702902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.702951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.702995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.703045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.703100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.703157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.703206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.703260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.703694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:23.725855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:23.738958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:23.739009Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:23.739030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:23.739055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:23.739082Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 584 [2:7559594201142976413:7576]
2025-10-10T14:06:23.739144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:23.739206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:23.739222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:23.739237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:23.739250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:23.739297Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:23.739319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:23.739341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:23.740614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.740647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.740663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.740679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.740692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:23.740953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:23.740972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.741863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 584
2025-10-10T14:06:23.741886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 584
2025-10-10T14:06:23.741957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 584, pipe: [1:7559594202720897203:7619]
2025-10-10T14:06:23.744812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 14 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:06:23.744964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:06:23.742076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:23.742388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:23.742685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:23.742823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:23.742917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594202720897080:2442], now have 1 active actors on pipe
2025-10-10T14:06:23.742947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594202720897175:8453], now have 1 active actors on pipe
2025-10-10T14:06:23.742972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594202720897203:7619], now have 1 active actors on pipe
2025-10-10T14:06:23.743121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:23.743147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:23.743187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594201142976407:7576]
2025-10-10T14:06:23.743204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594201142976407:7576]
2025-10-10T14:06:23.743219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594201142976407:7576]
2025-10-10T14:06:23.743234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594201142976407:7576]
2025-10-10T14:06:23.743272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:23.743361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:23.743561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:23.743579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:23.743617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:23.743633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:23.743647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:23.743659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:23.743724Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:06:23.743862Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:23.743890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:23.743908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:23.743919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:23.743956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:23.743996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:23.744160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594201142976407:7576]
2025-10-10T14:06:23.744194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:23.744248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:23.744266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:23.746810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:23.746846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:23.746933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:23.747479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 585 partition: 0 MaxSeqNo: 36 sessionId: src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0
2025-10-10T14:06:23.748426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cb9c9c4-35daecc9-36d866de-d21b182f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:23.776285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0] Write session: try to update token
2025-10-10T14:06:23.776341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:23.876946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:23.882399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:23.882434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:23.882511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:23.882525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:23.882536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:23.882546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:23.882557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:23.882593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594201142976407:7576]
2025-10-10T14:06:23.882618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594201142976407:7576]
2025-10-10T14:06:23.882641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594201142976407:7576]
2025-10-10T14:06:23.882662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594201142976407:7576]
2025-10-10T14:06:23.882811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:23.882835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:23.882846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:23.883305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:23.883339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:23.883366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:23.883393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:23.923265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:23.940740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId: src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:23.967756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:24.093236Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:24.097746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:24.097789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:24.106604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:24.105605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:24.106835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:24.106851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:24.138029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594202720897203:7619]
2025-10-10T14:06:24.138189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 585 reason: error at write: Disconnected sessionId: src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0
2025-10-10T14:06:24.138522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 585 sessionId: src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0 is DEAD
2025-10-10T14:06:24.141843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:24.141921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0] Write session will restart in 0.009274s
2025-10-10T14:06:24.142093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0] Write session: Do CDS request
2025-10-10T14:06:24.142151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:24.160186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:24.160218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 586
2025-10-10T14:06:24.165975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:24.169392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:24.169571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:24.169589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:24.169600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:24.177692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 586 sessionId:  describe result for acl check
2025-10-10T14:06:24.177883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:24.177906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:24.177917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:24.177938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594207015864600:8464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:24.180988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594207015864600:8464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:24.216940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594207015864600:8464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:24.239223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594207015864720:7619]
2025-10-10T14:06:24.243146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594207015864600:8464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:24.243187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594207015864600:8464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:24.243205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594207015864600:8464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:24.243241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:24.261139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:24.266270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:24.266923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:24.266935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:24.266967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:24.267135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:24.267253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594205437943871:7579]
2025-10-10T14:06:24.269663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:24.273436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:24.273669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:24.275109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:24.275451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:24.275460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:24.275467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:24.275474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:24.275480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:24.275487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:24.275494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:24.275500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:24.275506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.275513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.275519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.275528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.275571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:24.275676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:24.275723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:24.275788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:24.275852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:24.275932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:24.276001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:24.276081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:24.276150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.276201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.276247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.276295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.276346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:24.276411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:24.276482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:24.276533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:24.276580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:24.276631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:24.276674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:24.276724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:24.276773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:24.276823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:24.276866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:24.276912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:24.276956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:24.277008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:24.277077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:24.277510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:24.277606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.277718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.277789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.277869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.277930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.277997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.278054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.278120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.278836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:24.317741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:24.342546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:24.342597Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:24.342614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:24.342635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:24.342659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 585 [2:7559594205437943871:7579]
2025-10-10T14:06:24.342718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:24.342781Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:24.342797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:24.342810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:24.342824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:24.342873Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:24.342896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:24.342919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:24.345956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.345989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.346003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.346019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.346032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:24.346328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:24.346348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.346509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.346716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.346969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.347106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:24.347202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594207015864579:2442], now have 1 active actors on pipe
2025-10-10T14:06:24.347229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594207015864720:7619], now have 1 active actors on pipe
2025-10-10T14:06:24.347252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594207015864725:8464], now have 1 active actors on pipe
2025-10-10T14:06:24.347281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.347298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.347312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.347327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.347377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:24.347460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:24.347662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:24.347680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:24.347813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.347834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:24.349016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:24.349044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:24.349056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:24.349068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:24.349092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:24.349301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 585
2025-10-10T14:06:24.349405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 585, pipe: [1:7559594207015864720:7619]
2025-10-10T14:06:24.349476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 585
2025-10-10T14:06:24.351370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:24.351412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:24.351498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:24.351532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:24.351551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:24.351564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:24.351602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:24.351648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:24.351699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:24.368703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:24.368749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:24.368864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:24.371010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 586 partition: 0 MaxSeqNo: 36 sessionId: src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0
2025-10-10T14:06:24.372123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33a6ab3d-ee6a5740-9d634173-360078d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:24.436398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0] Write session: try to update token
2025-10-10T14:06:24.436443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:24.443309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:24.443338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:24.443349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:24.540356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:24.540416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:24.540460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:24.540482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:24.540506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:24.540562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.540612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.540658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.540709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.540855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:24.540908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:24.540969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:24.541024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:24.541352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:24.541384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.541396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:24.542565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:24.593952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId: src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:24.622372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:24.691980Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:24.707417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:24.707464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:24.707531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:24.707543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:24.707582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594205437943864:7579]
2025-10-10T14:06:24.708306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:24.708762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:24.711896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:24.712277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594207015864720:7619]
2025-10-10T14:06:24.712481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:24.724497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 586 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0
2025-10-10T14:06:24.724799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 586 sessionId: src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0 is DEAD
2025-10-10T14:06:24.729350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:24.729391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0] Write session will restart in 0.008352s
2025-10-10T14:06:24.729485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0] Write session: Do CDS request
2025-10-10T14:06:24.729513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:24.748146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:24.749966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:24.750003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 587
2025-10-10T14:06:24.750577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:24.750706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:24.750736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:24.750748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:24.752126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 587 sessionId:  describe result for acl check
2025-10-10T14:06:24.752243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:24.752254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:24.752262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:24.752279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594207015864785:8473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:24.755926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594207015864785:8473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:24.784015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594207015864785:8473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:24.802930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594207015864785:8473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:24.802969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594207015864785:8473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:24.802986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594207015864785:8473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:24.803016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:24.813244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594207015864878:7619]
2025-10-10T14:06:24.876989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:24.879365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:24.880280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:24.880299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:24.880342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:24.880640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:24.880857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594205437944071:7591]
2025-10-10T14:06:24.883177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:24.885145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:24.885386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:24.886886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:24.887272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:24.887281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:24.887290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:24.887298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:24.887306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:24.887314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:24.887322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:24.887330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:24.887338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.887344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.887352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.887360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.887410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:24.887537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:24.887588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:24.887638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:24.887694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:24.887746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:24.887795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:24.887846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:24.887895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.887944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.887990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.888040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.888082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:24.888147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:24.888214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:24.888275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:24.888327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:24.888391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:24.888471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:24.888530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:24.888601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:24.888660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:24.888711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:24.888770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:24.888830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:24.888890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:24.888941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:24.888996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:24.889048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.889105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.889174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.889240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.889290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.889347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.889398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.889454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.889933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:24.923479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:24.978249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:24.978293Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:24.978310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:24.978333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:24.978359Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 586 [2:7559594205437944071:7591]
2025-10-10T14:06:24.978417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:24.978485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:24.978501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:24.978513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:24.978527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:24.978576Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:24.978598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:24.978620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:24.979949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.979966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.979982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.979995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.980007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:24.980293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:24.980308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:24.980469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:24.980657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:24.980875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:24.980987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:24.981063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:24.981078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:24.981090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:24.981103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:24.981539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:24.981552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:24.981565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:24.981577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:24.982577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 586
2025-10-10T14:06:24.982281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:24.982701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 586
2025-10-10T14:06:24.982384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:24.982704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 586, pipe: [1:7559594207015864878:7619]
2025-10-10T14:06:24.982571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:24.982590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:24.982637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594207015864847:8473], now have 1 active actors on pipe
2025-10-10T14:06:24.982660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594207015864878:7619], now have 1 active actors on pipe
2025-10-10T14:06:24.982679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594207015864772:2442], now have 1 active actors on pipe
2025-10-10T14:06:24.982795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:24.982817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:24.982830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:24.983421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:24.983449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:24.983519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94500603-15b17463-4ae81434-ef0f207c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:24.983551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:24.983569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:24.983578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:24.983615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:24.983658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:24.983700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:24.987800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:24.987840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:24.987918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:24.993495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 587 partition: 0 MaxSeqNo: 36 sessionId: src_id|94500603-15b17463-4ae81434-ef0f207c_0
2025-10-10T14:06:24.996301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a682a463-95f8e244-ca61cb0-9ede2d19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|94500603-15b17463-4ae81434-ef0f207c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:25.026729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94500603-15b17463-4ae81434-ef0f207c_0] Write session: try to update token
2025-10-10T14:06:25.026791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94500603-15b17463-4ae81434-ef0f207c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:25.139442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:25.139464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:25.139474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:25.139482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:25.139491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:25.139526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:25.139545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:25.139561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:25.139579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:25.139676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:25.139719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:25.139749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:25.139757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:25.139761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:25.139773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:25.139785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:25.151277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:25.151343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:25.151356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:25.152268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId: src_id|94500603-15b17463-4ae81434-ef0f207c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:25.152977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:25.176521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:25.306036Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:25.308715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:25.308735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:25.308784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594205437944064:7591]
2025-10-10T14:06:25.308925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:25.308941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:25.308967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:25.309857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:25.309985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594207015864878:7619]
2025-10-10T14:06:25.310076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:25.310222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:25.310235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:25.356736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 587 reason: error at write: Disconnected sessionId: src_id|94500603-15b17463-4ae81434-ef0f207c_0
2025-10-10T14:06:25.357019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 587 sessionId: src_id|94500603-15b17463-4ae81434-ef0f207c_0 is DEAD
2025-10-10T14:06:25.357540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94500603-15b17463-4ae81434-ef0f207c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:25.357567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94500603-15b17463-4ae81434-ef0f207c_0] Write session will restart in 0.009305s
2025-10-10T14:06:25.357646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94500603-15b17463-4ae81434-ef0f207c_0] Write session: Do CDS request
2025-10-10T14:06:25.357678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94500603-15b17463-4ae81434-ef0f207c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:25.378893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94500603-15b17463-4ae81434-ef0f207c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:25.378779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:25.378814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 588
2025-10-10T14:06:25.379625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:25.379751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:25.379767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:25.379778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:25.383215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 588 sessionId:  describe result for acl check
2025-10-10T14:06:25.383341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:25.383351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:25.383361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:25.383377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594211310832301:8479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:25.388135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594211310832301:8479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:25.407810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594211310832301:8479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:25.421942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594211310832402:7619]
2025-10-10T14:06:25.429818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594211310832301:8479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:25.429868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594211310832301:8479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:25.429887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594211310832301:8479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:25.429923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:25.439223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:25.441388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:25.442284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:25.442309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:25.442345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:25.442560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:25.442693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594209732911554:7599]
2025-10-10T14:06:25.444362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:25.445409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:25.445653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:25.446782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:25.447057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:25.447077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:25.447085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:25.447092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:25.447099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:25.447104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:25.447109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:25.447114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:25.447120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:25.447125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:25.447130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:25.447135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:25.447173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:25.447261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:25.447301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:25.447339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:25.447378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:25.447427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:25.447466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:25.447510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:25.447557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:25.447608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:25.447651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:25.447692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:25.447722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:25.447772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:25.447819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:25.447865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:25.447909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:25.447963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:25.448012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:25.448076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:25.448133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:25.448181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:25.448216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:25.448257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:25.448295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:25.448341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:25.448377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:25.448437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:25.448483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:25.448533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:25.448586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:25.448640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:25.448680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:25.448721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:25.448754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:25.448796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:25.451300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:25.488053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:25.503874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:25.503919Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:25.503938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:25.503958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:25.503982Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 587 [2:7559594209732911554:7599]
2025-10-10T14:06:25.504042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:25.504101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:25.504123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:25.504135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:25.504148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:25.504195Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:25.504221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:25.504269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:25.573436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:25.573473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:25.573491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:25.573507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:25.573520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:25.573847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:25.573881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:25.574060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:25.574292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:25.574573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:25.574711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:25.574788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.574810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.574825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.574840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.576622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 587
2025-10-10T14:06:25.576697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 587, pipe: [1:7559594211310832402:7619]
2025-10-10T14:06:25.576770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 587
2025-10-10T14:06:25.574886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:25.574978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:25.575116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:25.575129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:25.575140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:25.575151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:25.575195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:25.575213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:25.575357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594211310832248:2442], now have 1 active actors on pipe
2025-10-10T14:06:25.575383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594211310832416:8479], now have 1 active actors on pipe
2025-10-10T14:06:25.575404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.575427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:25.575468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:25.575506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594211310832402:7619], now have 1 active actors on pipe
2025-10-10T14:06:25.582225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:25.582274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:25.582381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0846803-dae80158-23140eb1-74b35ff7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:25.582416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:25.582435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:25.582447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:25.582487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:25.582534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:25.582593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:25.589270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:25.589322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:25.589418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:25.591477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 588 partition: 0 MaxSeqNo: 36 sessionId: src_id|b0846803-dae80158-23140eb1-74b35ff7_0
2025-10-10T14:06:25.593664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94500603-15b17463-4ae81434-ef0f207c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b0846803-dae80158-23140eb1-74b35ff7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:25.605245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:25.605280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:25.605293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:25.617087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0846803-dae80158-23140eb1-74b35ff7_0] Write session: try to update token
2025-10-10T14:06:25.623896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0846803-dae80158-23140eb1-74b35ff7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:25.686852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:25.686888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:25.686905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:25.686918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:25.686932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:25.686970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.687000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.687027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.687051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.687259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:25.687296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:25.687309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:25.688352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:25.689247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:25.689272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:25.689308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:25.689341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:25.761107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId: src_id|b0846803-dae80158-23140eb1-74b35ff7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:25.792156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:25.851281Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:25.863843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:25.863899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:25.863967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:25.864044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:25.864087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594209732911549:7599]
2025-10-10T14:06:25.864527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:25.864726Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:25.865742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594211310832402:7619]
2025-10-10T14:06:25.865830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:25.865935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:25.929420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0846803-dae80158-23140eb1-74b35ff7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:25.929487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0846803-dae80158-23140eb1-74b35ff7_0] Write session will restart in 0.008732s
2025-10-10T14:06:25.929648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0846803-dae80158-23140eb1-74b35ff7_0] Write session: Do CDS request
2025-10-10T14:06:25.929694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0846803-dae80158-23140eb1-74b35ff7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:25.925917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 588 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b0846803-dae80158-23140eb1-74b35ff7_0
2025-10-10T14:06:25.926244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 588 sessionId: src_id|b0846803-dae80158-23140eb1-74b35ff7_0 is DEAD
2025-10-10T14:06:25.947827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0846803-dae80158-23140eb1-74b35ff7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:25.947245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:25.947278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 589
2025-10-10T14:06:25.949171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:25.949301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:25.949317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:25.949328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:25.950778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 589 sessionId:  describe result for acl check
2025-10-10T14:06:25.950902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:25.950911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:25.950922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:25.950938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594211310832505:8491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:25.956084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594211310832505:8491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:25.966069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594211310832555:7619]
2025-10-10T14:06:25.973332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594211310832505:8491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:25.983025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594211310832505:8491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:25.983065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594211310832505:8491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:25.983082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594211310832505:8491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:25.983111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:25.998068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:26.005470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:26.006433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:26.006451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:26.006499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:26.006746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:26.006941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594214027879030:7602]
2025-10-10T14:06:26.008988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:26.017798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:26.018051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:26.019366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:26.019664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:26.019671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:26.019676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:26.019682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:26.019688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:26.019694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:26.019701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:26.019709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:26.019715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.019721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.019729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.019735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.019779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:26.019875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:26.019918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:26.019957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:26.019998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:26.020038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:26.020078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:26.020119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:26.020160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.020202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.020243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.020283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.020318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:26.020372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:26.020441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:26.020495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:26.020536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:26.020585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:26.020625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:26.020671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:26.020713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:26.020760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:26.020800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:26.020850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:26.020890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:26.020937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:26.020975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:26.021024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:26.021068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.021117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.021177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.021225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.021267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.021311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.021352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.021399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.021795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:26.076149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:26.091944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:26.091990Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:26.092004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:26.092023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:26.092044Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 588 [2:7559594214027879030:7602]
2025-10-10T14:06:26.092092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:26.092144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:26.092156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:26.092167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:26.092177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:26.092223Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:26.092246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:26.092267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:26.095176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.095202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.095216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.095226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.095235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:26.095508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:26.095524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.095651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.095810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.096013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.096117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:26.096188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594209732911729:7602]
2025-10-10T14:06:26.096204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594209732911729:7602]
2025-10-10T14:06:26.096217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594209732911729:7602]
2025-10-10T14:06:26.096228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594209732911729:7602]
2025-10-10T14:06:26.096273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:26.096351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:26.096533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:26.096550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:26.096679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594209732911729:7602]
2025-10-10T14:06:26.096698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:26.096958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:26.096970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:26.096980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:26.096990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:26.097013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:26.099023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 588
2025-10-10T14:06:26.099102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 588, pipe: [1:7559594211310832555:7619]
2025-10-10T14:06:26.099168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 588
2025-10-10T14:06:26.108981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594211310832452:2442], now have 1 active actors on pipe
2025-10-10T14:06:26.109025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594211310832555:7619], now have 1 active actors on pipe
2025-10-10T14:06:26.109046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594211310832607:8491], now have 1 active actors on pipe
2025-10-10T14:06:26.109119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:26.109157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:26.109236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2bc88e6-365bd5c7-651a232b-99879221_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:26.109270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:26.109287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:26.109297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:26.109337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:26.109383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:26.109428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:26.112221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:26.112256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:26.112323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:26.115184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 589 partition: 0 MaxSeqNo: 36 sessionId: src_id|d2bc88e6-365bd5c7-651a232b-99879221_0
2025-10-10T14:06:26.120471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0846803-dae80158-23140eb1-74b35ff7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d2bc88e6-365bd5c7-651a232b-99879221_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:26.188597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc88e6-365bd5c7-651a232b-99879221_0] Write session: try to update token
2025-10-10T14:06:26.188651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc88e6-365bd5c7-651a232b-99879221_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:26.235891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:26.236107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:26.236125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:26.236188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:26.236203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:26.236216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:26.236228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:26.236240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:26.236279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594209732911729:7602]
2025-10-10T14:06:26.236307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594209732911729:7602]
2025-10-10T14:06:26.236334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594209732911729:7602]
2025-10-10T14:06:26.236355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594209732911729:7602]
2025-10-10T14:06:26.236520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:26.236547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.236559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:26.237664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:26.241661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:26.241702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:26.241732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:26.241763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:26.417870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId: src_id|d2bc88e6-365bd5c7-651a232b-99879221_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:26.461210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:26.472489Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:26.479207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:26.479252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:26.481877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:26.482283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594211310832555:7619]
2025-10-10T14:06:26.482493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:26.482531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:26.499829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 589 reason: error at write: Disconnected sessionId: src_id|d2bc88e6-365bd5c7-651a232b-99879221_0
2025-10-10T14:06:26.500181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 589 sessionId: src_id|d2bc88e6-365bd5c7-651a232b-99879221_0 is DEAD
2025-10-10T14:06:26.501270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc88e6-365bd5c7-651a232b-99879221_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:26.501309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc88e6-365bd5c7-651a232b-99879221_0] Write session will restart in 0.008001s
2025-10-10T14:06:26.501422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc88e6-365bd5c7-651a232b-99879221_0] Write session: Do CDS request
2025-10-10T14:06:26.501461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc88e6-365bd5c7-651a232b-99879221_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:26.516060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:26.530741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc88e6-365bd5c7-651a232b-99879221_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:26.543327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:26.543374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 590
2025-10-10T14:06:26.544172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:26.544303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:26.544318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:26.544330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:26.545904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 590 sessionId:  describe result for acl check
2025-10-10T14:06:26.546106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:26.546129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:26.546152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:26.546182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594215605799964:8502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:26.566340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594215605799964:8502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:26.583136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594215605799964:8502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:26.588744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594215605799987:7619]
2025-10-10T14:06:26.606598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594215605799964:8502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:26.606644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594215605799964:8502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:26.606667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594215605799964:8502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:26.606705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:26.666317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:26.673651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:26.674563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:26.674582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:26.674627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:26.674891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:26.675102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594214027879232:7611]
2025-10-10T14:06:26.677174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:26.678446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:26.678672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:26.679887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:26.680206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:26.680214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:26.680221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:26.680226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:26.680233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:26.680240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:26.680248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:26.680255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:26.680261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.680267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.680273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.680280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.680322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:26.680439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:26.680487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:26.680534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:26.680580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:26.680625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:26.680669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:26.680712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:26.680754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.680797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.680841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.680883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.680922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:26.680982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:26.681037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:26.681095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:26.681160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:26.681212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:26.681254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:26.681303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:26.681347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:26.681399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:26.681443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:26.681493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:26.681536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:26.681589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:26.681631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:26.681682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:26.681732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.681796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.681839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.681890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.681933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.681983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.682025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.682085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.682509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:26.727652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:26.770729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:26.770774Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:26.770790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:26.770809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:26.770833Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 589 [2:7559594214027879232:7611]
2025-10-10T14:06:26.770885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:26.770944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:26.770959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:26.770969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:26.770980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:26.771028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:26.771049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:26.771070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:26.772455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.772479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.772493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.772507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.772517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:26.772791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:26.772815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:26.772944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:26.773115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:26.773352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:26.773464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:26.773551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594215605799951:2442], now have 1 active actors on pipe
2025-10-10T14:06:26.773572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594215605800004:8502], now have 1 active actors on pipe
2025-10-10T14:06:26.773592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594215605799987:7619], now have 1 active actors on pipe
2025-10-10T14:06:26.773618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:26.773634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:26.773646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:26.773657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:26.773698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:26.773766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:26.773776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:26.773784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:26.773799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:26.773812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:26.773940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:26.773955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:26.774082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:26.774113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:26.774152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:26.776688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 589
2025-10-10T14:06:26.776803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 589
2025-10-10T14:06:26.776878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 589, pipe: [1:7559594215605799987:7619]
2025-10-10T14:06:26.777807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:26.777848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:26.777952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:26.777986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:26.778005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:26.778014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:26.778051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:26.778109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:26.778169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:26.779553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:26.779583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:26.779663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:26.780250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 590 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0
2025-10-10T14:06:26.782701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2bc88e6-365bd5c7-651a232b-99879221_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:26.811541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0] Write session: try to update token
2025-10-10T14:06:26.811599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:26.832537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:26.832573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:26.832615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:26.832759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:26.832770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:26.853419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:26.855434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:26.875590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:26.905792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:26.929715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:26.930293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:26.930313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:26.930324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:26.930380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:27.003835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId: src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:27.036999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:27.037023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:27.037033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:27.037040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:27.037046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:27.037080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:27.037103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:27.037143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:27.037165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594214027879227:7611]
2025-10-10T14:06:27.037287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:27.037316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:27.037320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:27.037327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:27.037340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:27.037348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:27.037376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:27.037430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:27.037455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:27.037488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:27.037514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.037524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:27.033958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:27.038312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:27.211316Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:27.216924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:27.221355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:27.222079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:27.222405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594215605799987:7619]
2025-10-10T14:06:27.322870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594219900767501:7619]
2025-10-10T14:06:27.327265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 590 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0
2025-10-10T14:06:27.328824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 546 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 15769614 MessagesInflight: 10 }
2025-10-10T14:06:27.328925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:27.328950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0] Write session will restart in 0.007242s
2025-10-10T14:06:27.329046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0] Write session: Do CDS request
2025-10-10T14:06:27.329076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:27.332975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 590 sessionId: src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0 is DEAD
2025-10-10T14:06:27.344788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:27.344834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 591
2025-10-10T14:06:27.345962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:27.346539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:27.346675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:27.346698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:27.346708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:27.347991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 591 sessionId:  describe result for acl check
2025-10-10T14:06:27.348107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:27.348117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:27.348125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:27.348142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594219900767562:8513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:27.350755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594219900767562:8513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:27.360824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594219900767562:8513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:27.368621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:27.368747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594219900767562:8513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:27.368796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594219900767562:8513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:27.368811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594219900767562:8513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:27.368842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:27.380268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:27.381314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:27.381343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:27.381378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:27.381596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:27.381729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594218322846696:7621]
2025-10-10T14:06:27.383301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:27.384866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:27.385141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:27.386541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:27.386917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:27.386926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:27.386934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:27.386941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:27.386948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:27.386957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:27.386964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:27.386972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:27.386979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.386986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.386993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.387001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.387053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:27.387178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:27.387234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:27.387286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:27.387350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:27.387404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:27.387454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:27.387503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:27.387557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.387609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.387661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.387708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.387755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:27.387829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:27.387895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:27.387956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:27.388011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:27.388072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:27.388125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:27.388183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:27.388235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:27.388292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:27.388343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:27.388424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:27.388479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:27.388534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:27.388584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:27.388643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:27.388701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.388757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.388805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.388855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.388893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.388935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.388971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.389011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.389510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:27.420487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:27.432996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:27.433048Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:27.433069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:27.433092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:27.433116Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 590 [2:7559594218322846696:7621]
2025-10-10T14:06:27.433194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:27.433255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:27.433270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:27.433283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:27.433296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:27.433346Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:27.433371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:27.433395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:27.434991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.435024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.435040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.435056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.435069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:27.435380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:27.435407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.435563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.435819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.436098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.436237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:27.436321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594219900767431:2442], now have 1 active actors on pipe
2025-10-10T14:06:27.436350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594219900767596:8513], now have 1 active actors on pipe
2025-10-10T14:06:27.436388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594219900767501:7619], now have 1 active actors on pipe
2025-10-10T14:06:27.436455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:27.436478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:27.436515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.436532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.436546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.436561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.436603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:27.436631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:27.436641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:27.436649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:27.436657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:27.436685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:27.435618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 590
2025-10-10T14:06:27.435752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 590
2025-10-10T14:06:27.435821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 590, pipe: [1:7559594219900767501:7619]
2025-10-10T14:06:27.437337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:27.437364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:27.437435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:27.437465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:27.437483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:27.437494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:27.437529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:27.437569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:27.437701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.437737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:27.437787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:27.437853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:27.438748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:27.438779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:27.438845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:27.439374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 591 partition: 0 MaxSeqNo: 36 sessionId: src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0
2025-10-10T14:06:27.442610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed91bc8-bb3e4f21-be0c31f1-2e6d1cfe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:27.481819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0] Write session: try to update token
2025-10-10T14:06:27.481873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:27.536665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:27.536705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:27.536745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.536888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:27.536904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:27.536916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:27.537006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:27.537455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:27.541485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:27.545927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:27.548161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:27.559563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:27.599283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:27.599789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:27.653226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId: src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:27.653736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:27.653767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:27.653780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:27.653833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:27.653847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:27.653860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:27.653871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:27.653883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:27.653921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.653950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.653973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.653996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594218322846689:7621]
2025-10-10T14:06:27.654127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:27.654160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.654171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:27.654207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:27.654250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:27.654283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:27.654335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:27.655216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:27.693499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:27.807426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:27.810426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:27.810470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:27.812925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:27.813167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:27.813185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:27.811798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:27.832772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594219900767501:7619]
2025-10-10T14:06:27.832884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 591 reason: error at write: Disconnected sessionId: src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0
2025-10-10T14:06:27.833316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 591 sessionId: src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0 is DEAD
2025-10-10T14:06:27.834775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:27.834822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0] Write session will restart in 0.008657s
2025-10-10T14:06:27.834944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0] Write session: Do CDS request
2025-10-10T14:06:27.834971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:27.854649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:27.867642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:27.876604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 592
2025-10-10T14:06:27.877059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:27.877216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:27.877242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:27.877253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:27.878792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 592 sessionId:  describe result for acl check
2025-10-10T14:06:27.878922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:27.878942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:27.878953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:27.878972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594219900767655:8525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:27.883138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594219900767655:8525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:27.900144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594219900767655:8525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:27.918994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594219900767655:8525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:27.919042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594219900767655:8525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:27.919063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594219900767655:8525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:27.919097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:27.931579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594219900767732:7619]
2025-10-10T14:06:27.984254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:27.985230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:27.985960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:27.985978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:27.986019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:27.986251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:27.986426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594218322846890:7631]
2025-10-10T14:06:27.989482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:27.991050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:27.991303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:27.992604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:27.992942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:27.992952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:27.992959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:27.992965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:27.992973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:27.992980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:27.992987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:27.992995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:27.993003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.993009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.993016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.993024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.993071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:27.993202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:27.993251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:27.993298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:27.993346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:27.993396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:27.993442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:27.993490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:27.993536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.993584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.993629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.993696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.993744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:27.993818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:27.993878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:27.993935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:27.993989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:27.994047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:27.994096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:27.994155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:27.994210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:27.994265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:27.994311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:27.994364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:27.994412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:27.995415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:27.995485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:27.995635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:27.995688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.995742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:27.995788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.995844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:27.995890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.995941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:27.995987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.996039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:27.996523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:28.035807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:28.050944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:28.050989Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:28.051005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:28.051024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:28.051047Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 591 [2:7559594218322846890:7631]
2025-10-10T14:06:28.051100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:28.051159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:28.051174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:28.051186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:28.051197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:28.051244Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:28.051268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:28.051290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:28.054392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:28.054421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:28.054435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:28.054449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:28.054460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:28.054724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:28.054741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:28.054876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:28.055056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:28.055299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:28.055412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:28.055478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.055493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.055506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.055518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.055557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:28.055633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:28.055808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:28.055826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:28.058144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 591, pipe: [1:7559594219900767732:7619]
2025-10-10T14:06:28.058250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 591
2025-10-10T14:06:28.058316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 591
2025-10-10T14:06:28.056925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:28.056946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:28.056957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:28.056969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:28.058770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.058809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:28.058925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594219900767732:7619], now have 1 active actors on pipe
2025-10-10T14:06:28.058952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594219900767703:8525], now have 1 active actors on pipe
2025-10-10T14:06:28.058975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594219900767640:2442], now have 1 active actors on pipe
2025-10-10T14:06:28.059030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:28.059051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:28.059204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:28.059234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:28.059253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:28.059264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:28.059296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:28.059335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:28.059404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:28.059788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:28.064611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:28.064639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:28.064720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:28.065076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 592 partition: 0 MaxSeqNo: 36 sessionId: src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0
2025-10-10T14:06:28.069375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76b07f5c-18e8a74b-98308418-28f7bc38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:28.126081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0] Write session: try to update token
2025-10-10T14:06:28.126140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:28.243428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:28.243458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:28.243470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:28.243524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:28.243539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:28.243551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:28.243562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:28.243573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:28.243608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.243635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.243661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.243683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.243895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:28.243922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:28.243933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:28.249271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:28.249334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:28.253263Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 5 CurrentSessionLifetimeMs: 422851 BytesRead: 29286416 MessagesRead: 13 BytesReadCompressed: 29286416 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-10-10T14:06:28.249375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:28.249425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:28.258356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:28.308845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId: src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:28.338163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:28.416809Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:28.459515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:28.459563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:28.459634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:28.459646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:28.459684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594218322846884:7631]
2025-10-10T14:06:28.461688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:28.462114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594219900767732:7619]
2025-10-10T14:06:28.462224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:28.462238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:28.465289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:28.465838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:28.481888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:28.481970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0] Write session will restart in 0.008263s
2025-10-10T14:06:28.482098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0] Write session: Do CDS request
2025-10-10T14:06:28.482142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:28.480766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 592 reason: error at write: Disconnected sessionId: src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0
2025-10-10T14:06:28.481066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 592 sessionId: src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0 is DEAD
2025-10-10T14:06:28.506348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:28.506952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:28.506989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 593
2025-10-10T14:06:28.507423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:28.507559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:28.507574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:28.507585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:28.509239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 593 sessionId:  describe result for acl check
2025-10-10T14:06:28.509405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:28.509428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:28.509448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:28.509479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594224195735145:8533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:28.512821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594224195735145:8533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:28.560054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594224195735145:8533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:28.564957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594224195735197:7619]
2025-10-10T14:06:28.581309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594224195735145:8533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:28.581365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594224195735145:8533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:28.581384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594224195735145:8533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:28.581414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:28.647818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:28.658615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:28.659384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:28.659412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:28.659451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:28.659664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:28.659793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594222617814391:7640]
2025-10-10T14:06:28.661484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:28.663189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:28.663418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:28.664707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:28.665058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:28.665067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:28.665074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:28.665082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:28.665089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:28.665096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:28.665104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:28.665111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:28.665118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:28.665143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:28.665152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:28.665160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:28.665209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:28.665323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:28.665378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:28.665424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:28.665471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:28.665523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:28.666130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:28.666193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:28.666241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:28.666290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:28.666334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:28.666381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:28.666428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:28.666494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:28.666554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:28.666607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:28.666876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:28.666937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:28.666984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:28.667039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:28.667086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:28.667139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:28.667186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:28.667241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:28.667285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:28.667335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:28.667380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:28.667432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:28.667486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:28.667552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:28.667599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:28.667651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:28.667696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:28.667748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:28.667791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:28.667840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:28.668269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:28.694707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:28.706942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:28.706996Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:28.707016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:28.707037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:28.707062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 592 [2:7559594222617814391:7640]
2025-10-10T14:06:28.707129Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:28.707197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:28.707214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:28.707228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:28.707241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:28.707292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:28.707316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:28.707339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:28.708777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:28.708799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:28.708815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:28.708830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:28.708843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:28.709843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 592
2025-10-10T14:06:28.709952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 592
2025-10-10T14:06:28.710029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 592, pipe: [1:7559594224195735197:7619]
2025-10-10T14:06:28.709200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:28.709228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:28.709384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:28.709585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:28.709828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:28.709955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:28.710044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594224195735233:8533], now have 1 active actors on pipe
2025-10-10T14:06:28.710070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594224195735133:2442], now have 1 active actors on pipe
2025-10-10T14:06:28.710095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594224195735197:7619], now have 1 active actors on pipe
2025-10-10T14:06:28.710122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.710137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.710152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.710164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.710202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:28.710287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:28.710306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:28.710319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:28.710331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:28.710342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:28.710478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:28.710495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:28.710652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:28.710675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:28.710725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.710756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:28.710874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:28.710903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:28.710921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:28.710932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:28.710970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:28.711011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:28.711113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:28.711222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:28.712411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:28.712438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:28.712506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:28.712929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 593 partition: 0 MaxSeqNo: 36 sessionId: src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0
2025-10-10T14:06:28.713872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f25d94-57fcf7ef-129f2dc3-83b36790_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:28.744902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0] Write session: try to update token
2025-10-10T14:06:28.744969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:28.832055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:28.832085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:28.832097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:28.832148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:28.832162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:28.832199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.832354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:28.833255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:28.834216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:28.835484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:28.846108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:28.862023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:28.863679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:28.864034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:28.955835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId: src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:28.999521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:28.999559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:28.999571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:28.999631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:28.999646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:28.999662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:28.999673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:28.999686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:28.999728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.999757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.999781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.999806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594222617814384:7640]
2025-10-10T14:06:28.999991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:29.000023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.000037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:29.002219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:29.002275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:29.002305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:29.002335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:29.006187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:29.009454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:29.149392Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:29.151585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:29.151709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:29.152654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:29.152664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:29.152687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:29.152863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594224195735197:7619]
2025-10-10T14:06:29.155204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:29.187867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 593 reason: error at write: Disconnected sessionId: src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0
2025-10-10T14:06:29.188148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 593 sessionId: src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0 is DEAD
2025-10-10T14:06:29.192855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:29.192944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0] Write session will restart in 0.007648s
2025-10-10T14:06:29.193148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0] Write session: Do CDS request
2025-10-10T14:06:29.193200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:29.206685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:29.207341Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:29.207374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 594
2025-10-10T14:06:29.207699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:29.207827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:29.207844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:29.207854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:29.209796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 594 sessionId:  describe result for acl check
2025-10-10T14:06:29.209924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:29.209937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:29.209947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:29.209964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594228490702649:8539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:29.212869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594228490702649:8539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:29.225868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594228490702649:8539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:29.244592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594228490702649:8539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:29.244637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594228490702649:8539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:29.244655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594228490702649:8539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:29.244689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:29.251952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594228490702785:7619]
2025-10-10T14:06:29.258116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:29.262678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:29.263582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:29.263603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:29.263652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:29.263917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:29.264106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594226912781858:7644]
2025-10-10T14:06:29.266288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:29.268740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:29.268976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:29.270275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:29.270612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:29.270621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:29.270629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:29.270638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:29.270645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:29.270651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:29.270660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:29.270668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:29.270673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.270680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.270687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.270694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.270740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:29.270845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:29.270892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:29.270941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:29.270988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:29.271035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:29.271081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:29.271125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:29.271172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.271217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.271260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.271304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.271345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:29.271408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:29.271463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:29.271517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:29.271565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:29.271619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:29.271664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:29.271713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:29.271755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:29.271806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:29.271849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:29.271902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:29.271946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:29.271995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:29.272042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:29.272093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:29.272140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.272190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.272234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.272288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.272350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.272428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.272485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.272535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.272964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:29.324533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:29.365052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:29.365097Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:29.365114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:29.365150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:29.365174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 593 [2:7559594226912781858:7644]
2025-10-10T14:06:29.365227Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:29.365290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:29.365307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:29.365319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:29.365330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:29.365379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:29.365401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:29.365423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:29.368233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.368260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.368274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.368288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.368298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:29.368598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:29.368615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.368751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.368921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.370851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 593
2025-10-10T14:06:29.370953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 593, pipe: [1:7559594228490702785:7619]
2025-10-10T14:06:29.371030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 593
2025-10-10T14:06:29.372459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.372618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:29.372719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594228490702625:2442], now have 1 active actors on pipe
2025-10-10T14:06:29.372742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594228490702785:7619], now have 1 active actors on pipe
2025-10-10T14:06:29.372765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594228490702782:8539], now have 1 active actors on pipe
2025-10-10T14:06:29.372831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:29.372854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:29.372897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.372912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.372925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.372937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.372981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:29.373073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:29.373273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:29.373292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:29.373368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|620029eb-89be87a8-47398ad4-97de52e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:29.373403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:29.373424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:29.373435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:29.373473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:29.373517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:29.373659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.373679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:29.373723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:29.374559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:29.374577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:29.374588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:29.374598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:29.374624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:29.376579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:29.376614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:29.376687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:29.381908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 594 partition: 0 MaxSeqNo: 36 sessionId: src_id|620029eb-89be87a8-47398ad4-97de52e0_0
2025-10-10T14:06:29.385445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9f68780-f19e2393-aa7bda70-b24d5a7e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|620029eb-89be87a8-47398ad4-97de52e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:29.445276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|620029eb-89be87a8-47398ad4-97de52e0_0] Write session: try to update token
2025-10-10T14:06:29.445337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|620029eb-89be87a8-47398ad4-97de52e0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:29.547723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:29.547759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:29.547772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:29.547828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:29.547842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:29.547856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:29.547869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:29.547881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:29.547920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.547948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.547973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.547996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.548091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:29.548122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:29.548154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:29.548183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:29.557341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:29.557389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.557400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:29.558453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:29.658114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId: src_id|620029eb-89be87a8-47398ad4-97de52e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:29.680898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:29.734965Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:29.752003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:29.752051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:29.752111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:29.752122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:29.752159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594226912781853:7644]
2025-10-10T14:06:29.752827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:29.754367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:29.754396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:29.762668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:29.807098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|620029eb-89be87a8-47398ad4-97de52e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:29.807157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|620029eb-89be87a8-47398ad4-97de52e0_0] Write session will restart in 0.008431s
2025-10-10T14:06:29.807294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|620029eb-89be87a8-47398ad4-97de52e0_0] Write session: Do CDS request
2025-10-10T14:06:29.807338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|620029eb-89be87a8-47398ad4-97de52e0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:29.806295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 594 reason: error at write: Disconnected sessionId: src_id|620029eb-89be87a8-47398ad4-97de52e0_0
2025-10-10T14:06:29.806633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 594 sessionId: src_id|620029eb-89be87a8-47398ad4-97de52e0_0 is DEAD
2025-10-10T14:06:29.826350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|620029eb-89be87a8-47398ad4-97de52e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:29.830508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:29.830643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594228490702785:7619]
2025-10-10T14:06:29.830670Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:29.830683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 595
2025-10-10T14:06:29.836023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:29.836162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:29.836175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:29.836185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:29.837783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 595 sessionId:  describe result for acl check
2025-10-10T14:06:29.837910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:29.837919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:29.837927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:29.837944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594228490702852:8552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:29.840442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594228490702852:8552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:29.863313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594228490702852:8552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:29.876639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594228490702852:8552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:29.876683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594228490702852:8552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:29.876701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594228490702852:8552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:29.876735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:29.882373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:29.893299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:29.894222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:29.894253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:29.894299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:29.894567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:29.894765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594226912782052:7653]
2025-10-10T14:06:29.896870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:29.898590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:29.898789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:29.900076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:29.900381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:29.900388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:29.900395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:29.900402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:29.900408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:29.900416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:29.900423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:29.900428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:29.900434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.900441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.900448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.900455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.900497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:29.900596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:29.900642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:29.900690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:29.900733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:29.900775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:29.900816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:29.900857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:29.900898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.900943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.900984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.901025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.901059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:29.901118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:29.901193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:29.901243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:29.901288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:29.901338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:29.901378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:29.901426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:29.901475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:29.901527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:29.901583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:29.901638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:29.901684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:29.901736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:29.901778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:29.901828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:29.901872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.901922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.901963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.902010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.902053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.902100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.902139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.902188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.902588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:29.933291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594228490702997:7619]
2025-10-10T14:06:29.946339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:29.982292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:29.982328Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:29.982341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:29.982356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:29.982372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 594 [2:7559594226912782052:7653]
2025-10-10T14:06:29.982417Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:29.982466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:29.982478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:29.982487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:29.982496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:29.982531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:29.982547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:29.982562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:29.984346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.984373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.984389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.984405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.984417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:29.984691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:29.984709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:29.984871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:29.985091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:29.985415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:29.985558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:29.985646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594228490702997:7619], now have 1 active actors on pipe
2025-10-10T14:06:29.985677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594228490702988:8552], now have 1 active actors on pipe
2025-10-10T14:06:29.985701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594228490702838:2442], now have 1 active actors on pipe
2025-10-10T14:06:29.985727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:29.985747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:29.985761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:29.985777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:29.985817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:29.985907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:29.986086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:29.986108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:29.986238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:29.986263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:29.986367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:29.986385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:29.986396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:29.986408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:29.986432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:29.989593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 594
2025-10-10T14:06:29.989596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 594, pipe: [1:7559594228490702997:7619]
2025-10-10T14:06:29.989725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 594
2025-10-10T14:06:29.992202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:29.992266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:29.992400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:29.992438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:29.992459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:29.992471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:29.992512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:29.992559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:29.992617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:30.005328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:30.005376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:30.005463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:30.005952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 595 partition: 0 MaxSeqNo: 36 sessionId: src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0
2025-10-10T14:06:30.006815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|620029eb-89be87a8-47398ad4-97de52e0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:30.058533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0] Write session: try to update token
2025-10-10T14:06:30.058592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:30.101113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:30.101156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:30.101169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:30.101227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:30.101241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:30.101280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:30.101400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:30.101483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:30.103415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:30.251054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:30.252098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:30.255583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId: src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:30.263558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:30.270623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:30.271074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:30.271088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:30.271111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:30.271188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:30.291637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:30.325273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:30.325323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:30.325371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:30.325384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:30.325396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:30.325406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:30.325417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:30.325459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:30.325485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:30.325505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:30.325526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594226912782044:7653]
2025-10-10T14:06:30.325708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:30.325737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:30.325748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:30.326825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:30.328662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:30.328705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:30.328734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:30.328762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:30.491496Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:30.529148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:06:30.530838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:30.535703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594228490702997:7619]
2025-10-10T14:06:30.535822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:30.555885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:30.555923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:30.556100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 595 reason: error at write: Disconnected sessionId: src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0
2025-10-10T14:06:30.556385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 595 sessionId: src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0 is DEAD
2025-10-10T14:06:30.557324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:30.557393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0] Write session will restart in 0.007107s
2025-10-10T14:06:30.557631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0] Write session: Do CDS request
2025-10-10T14:06:30.557697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:30.569469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:30.569503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 596
2025-10-10T14:06:30.577070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:30.577727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:30.577902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:30.577926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:30.577936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:30.579316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 596 sessionId:  describe result for acl check
2025-10-10T14:06:30.579448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:30.579465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:30.579475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:30.579492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594232785670346:8560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:30.582013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594232785670346:8560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:30.590753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594232785670346:8560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:30.602376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594232785670346:8560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:30.602425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594232785670346:8560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:30.602443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594232785670346:8560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:30.602475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:30.632482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594232785670482:7619]
2025-10-10T14:06:30.684375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:30.691795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:30.692710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:30.692738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:30.692783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:30.693028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:30.693242Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594231207749548:7663]
2025-10-10T14:06:30.695314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:30.697055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:30.697282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:30.698569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:30.698884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:30.698892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:30.698898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:30.698905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:30.698914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:30.698920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:30.698926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:30.698933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:30.698939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:30.698946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:30.698953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:30.698960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:30.699005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:30.699110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:30.699156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:30.699202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:30.699250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:30.699299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:30.699340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:30.699381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:30.699424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:30.699468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:30.699512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:30.699556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:30.699593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:30.699656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:30.699715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:30.699765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:30.699969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:30.700024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:30.700066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:30.700119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:30.700167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:30.700228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:30.700272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:30.700343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:30.700389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:30.700439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:30.700483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:30.700535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:30.700591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:30.700649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:30.700695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:30.700746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:30.700791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:30.700842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:30.700885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:30.700949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:30.701485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:30.737554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:30.752045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:30.752088Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:30.752102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:30.752120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:30.752142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 595 [2:7559594231207749548:7663]
2025-10-10T14:06:30.752194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:30.752248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:30.752262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:30.752274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:30.752296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:30.752343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:30.752365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:30.752387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:30.754208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:30.754234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:30.754246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:30.754257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:30.754267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:30.754534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:30.754559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:30.754695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:30.755399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 595, pipe: [1:7559594232785670482:7619]
2025-10-10T14:06:30.755497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 595
2025-10-10T14:06:30.755562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 595
2025-10-10T14:06:30.754891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:30.755116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:30.755224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:30.755304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594232785670482:7619], now have 1 active actors on pipe
2025-10-10T14:06:30.755324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594232785670437:8560], now have 1 active actors on pipe
2025-10-10T14:06:30.755344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594232785670325:2442], now have 1 active actors on pipe
2025-10-10T14:06:30.755366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:30.755381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:30.755393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:30.755403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:30.755441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:30.755514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:30.755675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:30.755691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:30.755803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:30.755821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:30.756548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:30.756560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:30.756570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:30.756581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:30.756605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:30.757335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:30.757360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:30.757444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:30.757477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:30.757493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:30.757502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:30.757536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:30.757578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:30.757619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:30.759911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:30.759940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:30.760004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:30.761092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 596 partition: 0 MaxSeqNo: 36 sessionId: src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0
2025-10-10T14:06:30.761936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a782e20-af4afc4f-22830c0c-949ebc5a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:30.800523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0] Write session: try to update token
2025-10-10T14:06:30.800584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:30.940520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId: src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:30.953652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:30.953683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:30.953694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:30.953752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:30.953764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:30.953775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:30.953787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:30.953797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:30.953831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:30.953859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:30.953883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:30.953903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:30.954025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:30.954070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:30.954107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:30.954108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:30.954133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:30.954136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:30.954145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:30.955186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:30.995476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:31.138645Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:31.152446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:31.152495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:31.152563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:31.152576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:31.152618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594231207749542:7663]
2025-10-10T14:06:31.152870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:31.153366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:31.154932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:31.155166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594232785670482:7619]
2025-10-10T14:06:31.155276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:31.201597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 596 reason: status is not ok: tablet will be restarted right now sessionId: src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0
2025-10-10T14:06:31.201942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 596 sessionId: src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0 is DEAD
2025-10-10T14:06:31.206673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:31.206738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0] Write session will restart in 0.007177s
2025-10-10T14:06:31.206912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0] Write session: Do CDS request
2025-10-10T14:06:31.206964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:31.222086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:31.222121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 597
2025-10-10T14:06:31.229819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:31.231953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:31.232107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:31.232129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:31.232138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:31.233389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 597 sessionId:  describe result for acl check
2025-10-10T14:06:31.233521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:31.233532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:31.233540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:31.233558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594237080637890:8575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:31.236120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594237080637890:8575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:31.245882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594237080637890:8575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:31.257609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594237080637890:8575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:31.257658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594237080637890:8575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:31.257675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594237080637890:8575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:31.257709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:31.258306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594237080637996:7619]
2025-10-10T14:06:31.276173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:31.283621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:31.284590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:31.284610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:31.284657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:31.284920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:31.285092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594235502717044:7673]
2025-10-10T14:06:31.287365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:31.290489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:31.290741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:31.292385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:31.292717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:31.292734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:31.292740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:31.292748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:31.292754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:31.292761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:31.292767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:31.292773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:31.292779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.292786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.292794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.292800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.292845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:31.292946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:31.292993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:31.293036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:31.293094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:31.293155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:31.293201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:31.293246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:31.293288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.293334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.293377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.293419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.293461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:31.293521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:31.293576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:31.293627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:31.293674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:31.293725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:31.293769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:31.293819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:31.293867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:31.293918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:31.293963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:31.294014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:31.294058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:31.294108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:31.294152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:31.294206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:31.294253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.294304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.294344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.294393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.294436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.294486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.294530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.294580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.294942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:31.330927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:31.346310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:31.346368Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:31.346381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:31.346399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:31.346420Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 596 [2:7559594235502717044:7673]
2025-10-10T14:06:31.346467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:31.346524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:31.346537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:31.346548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:31.346559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:31.346605Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:31.346625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:31.346646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:31.348997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.349024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.349038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.349052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.349062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:31.349855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:31.349891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.350015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.350206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.350426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.350540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:31.350599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594237080637996:7619], now have 1 active actors on pipe
2025-10-10T14:06:31.350627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594237080637837:2442], now have 1 active actors on pipe
2025-10-10T14:06:31.350646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594237080637995:8575], now have 1 active actors on pipe
2025-10-10T14:06:31.350717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.350736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.350748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.350760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.350795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:31.350868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:31.351029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:31.351052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:31.351172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.351198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:31.351523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:31.351547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:31.351557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:31.351567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:31.351592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:31.351751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 596, pipe: [1:7559594237080637996:7619]
2025-10-10T14:06:31.351879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 596
2025-10-10T14:06:31.351964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 596
2025-10-10T14:06:31.352553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:31.352585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:31.352678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|625264de-2409b3de-d3469b75-a0816842_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:31.352713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:31.352730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:31.352748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:31.352788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:31.352848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:31.352908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:31.355767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:31.355795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:31.355869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:31.356160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 597 partition: 0 MaxSeqNo: 36 sessionId: src_id|625264de-2409b3de-d3469b75-a0816842_0
2025-10-10T14:06:31.357034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|632858ce-aa0b9362-e573bd76-92d5aa9b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|625264de-2409b3de-d3469b75-a0816842_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:31.387275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|625264de-2409b3de-d3469b75-a0816842_0] Write session: try to update token
2025-10-10T14:06:31.387329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|625264de-2409b3de-d3469b75-a0816842_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:31.458850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:31.458884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:31.458897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:31.458907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:31.458918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:31.458951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.458980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.459003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.459023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.459154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:31.459194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:31.459221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:31.459233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:31.459245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:31.459245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:31.459255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:31.459295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:31.459318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.459329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:31.460346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:31.596360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId: src_id|625264de-2409b3de-d3469b75-a0816842_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:31.645924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:31.714510Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:31.754823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:31.754870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:31.754940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:31.754953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:31.754993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594235502717039:7673]
2025-10-10T14:06:31.755227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:31.755537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:31.760794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594237080637996:7619]
2025-10-10T14:06:31.761000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:31.761226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:31.798531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 597 reason: status is not ok: tablet will be restarted right now sessionId: src_id|625264de-2409b3de-d3469b75-a0816842_0
2025-10-10T14:06:31.798918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 597 sessionId: src_id|625264de-2409b3de-d3469b75-a0816842_0 is DEAD
2025-10-10T14:06:31.801700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|625264de-2409b3de-d3469b75-a0816842_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:31.801737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|625264de-2409b3de-d3469b75-a0816842_0] Write session will restart in 0.007425s
2025-10-10T14:06:31.801836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|625264de-2409b3de-d3469b75-a0816842_0] Write session: Do CDS request
2025-10-10T14:06:31.801867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|625264de-2409b3de-d3469b75-a0816842_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:31.821376Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:31.821411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 598
2025-10-10T14:06:31.829976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|625264de-2409b3de-d3469b75-a0816842_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
E1010 14:06:31.831390117  252552 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:06:31.835731Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:06:31.836205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:31.836357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:31.836372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:31.836383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:31.839616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 598 sessionId:  describe result for acl check
2025-10-10T14:06:31.839740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:31.839750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:31.839760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:31.839779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594237080638089:8586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:31.842532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594237080638089:8586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:31.853978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594237080638089:8586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:31.856715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594237080638149:7619]
2025-10-10T14:06:31.882419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594237080638089:8586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:31.882468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594237080638089:8586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:31.882490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594237080638089:8586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:31.883519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:31.910720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:31.917907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:31.918793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:31.918811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:31.918856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:31.919124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:31.919315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594235502717257:7682]
2025-10-10T14:06:31.921637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:31.922762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:31.922986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:31.924154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:31.924478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:31.924487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:31.924494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:31.924500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:31.924507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:31.924514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:31.924520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:31.924526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:31.924534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.924540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.924547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.924554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.924600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:31.924704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:31.924754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:31.924797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:31.924842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:31.924886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:31.924932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:31.924974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:31.925014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.925059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.925102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.925170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.925214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:31.925280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:31.925347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:31.925401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:31.925449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:31.925501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:31.925546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:31.925599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:31.925646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:31.925700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:31.925744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:31.925796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:31.925837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:31.925891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:31.925934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:31.925986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:31.926034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.926086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:31.926127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.926179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:31.926225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.926277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:31.926320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.926370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:31.927981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:32.019401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:32.036926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:32.036982Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:32.037001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:32.037023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:32.037052Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 597 [2:7559594235502717257:7682]
2025-10-10T14:06:32.037112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:32.037796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:32.037816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:32.037829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:32.037840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:32.037895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:32.037918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:32.037942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:32.039681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.039708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:32.039720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:32.039732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:32.039743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:32.040037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:32.040055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.040202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:32.040407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:32.040630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:32.040741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:32.040822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.040839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.040853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.040866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.040918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:32.041005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:32.041067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:32.041081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:32.041092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:32.041104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:32.041704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:32.041733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:32.041914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594237080638149:7619], now have 1 active actors on pipe
2025-10-10T14:06:32.041946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594237080638039:2442], now have 1 active actors on pipe
2025-10-10T14:06:32.041967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594237080638193:8586], now have 1 active actors on pipe
2025-10-10T14:06:32.041987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.042020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:32.042469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 597, pipe: [1:7559594237080638149:7619]
2025-10-10T14:06:32.042577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 597
2025-10-10T14:06:32.042651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 597
2025-10-10T14:06:32.042716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:32.047042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:32.047084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:32.047189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d80b2e75-a354201e-277f6549-e0368c39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:32.047230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:32.047252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:32.047263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:32.047322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:32.047372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:32.047430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:32.051075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 598 partition: 0 MaxSeqNo: 36 sessionId: src_id|d80b2e75-a354201e-277f6549-e0368c39_0
2025-10-10T14:06:32.050608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:32.050646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:32.050739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:32.051933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|625264de-2409b3de-d3469b75-a0816842_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d80b2e75-a354201e-277f6549-e0368c39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:32.098061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d80b2e75-a354201e-277f6549-e0368c39_0] Write session: try to update token
2025-10-10T14:06:32.098127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d80b2e75-a354201e-277f6549-e0368c39_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:32.250937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:32.250966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:32.250978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:32.251032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:32.251045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:32.251057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:32.251069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:32.251080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:32.251119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.251144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.251165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.251184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.251406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:32.251433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.251443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:32.252414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:32.252449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:32.252474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:32.252499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:32.254443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:32.261194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId: src_id|d80b2e75-a354201e-277f6549-e0368c39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:32.296680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:32.442534Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:32.451558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:32.451608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:32.451680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:32.451692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:32.451738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594235502717252:7682]
2025-10-10T14:06:32.454510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594237080638149:7619]
2025-10-10T14:06:32.454617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:32.454725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:32.452004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:32.452363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:32.469507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 598 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d80b2e75-a354201e-277f6549-e0368c39_0
2025-10-10T14:06:32.469882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 598 sessionId: src_id|d80b2e75-a354201e-277f6549-e0368c39_0 is DEAD
2025-10-10T14:06:32.472357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80b2e75-a354201e-277f6549-e0368c39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:32.472390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80b2e75-a354201e-277f6549-e0368c39_0] Write session will restart in 0.005920s
2025-10-10T14:06:32.472487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80b2e75-a354201e-277f6549-e0368c39_0] Write session: Do CDS request
2025-10-10T14:06:32.472518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80b2e75-a354201e-277f6549-e0368c39_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:32.490155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:32.490188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 599
2025-10-10T14:06:32.494872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d80b2e75-a354201e-277f6549-e0368c39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:32.504191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:32.504364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:32.504380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:32.504393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:32.506311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 599 sessionId:  describe result for acl check
2025-10-10T14:06:32.506423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:32.506434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:32.506443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:32.506459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594241375605548:8592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:32.508886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594241375605548:8592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:32.554599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594241375605548:8592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:32.556019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594241375605606:7619]
2025-10-10T14:06:32.571243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594241375605548:8592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:32.571292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594241375605548:8592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:32.571312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594241375605548:8592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:32.571343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:32.621004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:32.624964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:32.625860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:32.625890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:32.625935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:32.626185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:32.626362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594239797684736:7686]
2025-10-10T14:06:32.628424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:32.638086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:32.638363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:32.639616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:32.639958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:32.639980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:32.639987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:32.639994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:32.640000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:32.640007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:32.640014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:32.640019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:32.640026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.640031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:32.640038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:32.640045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:32.640088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:32.640193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:32.640255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:32.640301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:32.640343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:32.640388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:32.640430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:32.640477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:32.640520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.640564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:32.640606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:32.640648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:32.640689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:32.640749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:32.640803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:32.640853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:32.640898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:32.640948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:32.640990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:32.641059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:32.641106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:32.641946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:32.642002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:32.642056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:32.642103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:32.642151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:32.642192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:32.642245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:32.642291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.642340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.642381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:32.642428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:32.642470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:32.642519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:32.642561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:32.642606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:32.643015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:32.677013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:32.694840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:32.694884Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:32.694903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:32.694923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:32.694948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 598 [2:7559594239797684736:7686]
2025-10-10T14:06:32.695002Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:32.695064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:32.695078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:32.695091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:32.695102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:32.695150Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:32.695172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:32.695194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:32.719446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.719474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:32.719486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:32.719498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:32.719509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:32.719782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:32.719799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.719937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:32.720102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:32.720328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:32.720439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:32.720522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.720536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.720550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.720563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.720594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:32.720678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:32.720847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:32.720866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:32.721000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.721019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:32.721625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:32.721637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:32.721649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:32.721660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:32.721686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:32.723632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594241375605606:7619], now have 1 active actors on pipe
2025-10-10T14:06:32.723667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594241375605534:2442], now have 1 active actors on pipe
2025-10-10T14:06:32.723686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594241375605630:8592], now have 1 active actors on pipe
2025-10-10T14:06:32.723841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 598, pipe: [1:7559594241375605606:7619]
2025-10-10T14:06:32.723936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 598
2025-10-10T14:06:32.724008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 598
2025-10-10T14:06:32.724501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:32.724531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:32.724607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:32.724643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:32.724663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:32.724672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:32.724708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:32.724756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:32.724802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:32.725536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:32.725562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:32.725621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:32.729561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80b2e75-a354201e-277f6549-e0368c39_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:32.726731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 599 partition: 0 MaxSeqNo: 36 sessionId: src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0
2025-10-10T14:06:32.763286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0] Write session: try to update token
2025-10-10T14:06:32.763352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:32.812287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:32.812315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:32.812352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.812465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:32.812478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:32.812491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:32.813863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:32.823180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:32.854605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:32.865834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:32.893781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:32.909764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:32.920249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:32.923737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:32.923754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:32.923764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:32.923817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:32.964345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId: src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:32.975708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:32.975746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:32.975760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:32.975771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:32.975781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:32.975823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.975849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.975871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.975893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594239797684725:7686]
2025-10-10T14:06:32.976038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:32.976064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:32.976075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:32.977246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:32.977277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:32.977304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:32.977333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:32.977413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:32.991929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:33.145407Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:33.147260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:33.147299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:33.150118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:33.150448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:33.150481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:33.153457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594241375605606:7619]
2025-10-10T14:06:33.153572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:33.169783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:33.169853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0] Write session will restart in 0.009215s
2025-10-10T14:06:33.169971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0] Write session: Do CDS request
2025-10-10T14:06:33.170002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:33.165280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 599 reason: error at write: Disconnected sessionId: src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0
2025-10-10T14:06:33.165624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 599 sessionId: src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0 is DEAD
2025-10-10T14:06:33.184888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:33.187035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:33.187080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 600
2025-10-10T14:06:33.189351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:33.189522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:33.189538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:33.189549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:33.191137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 600 sessionId:  describe result for acl check
2025-10-10T14:06:33.191250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:33.191262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:33.191272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:33.191290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594245670573074:8607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:33.194318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594245670573074:8607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:33.203589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594245670573074:8607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:33.218352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594245670573074:8607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:33.218404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594245670573074:8607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:33.218424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594245670573074:8607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:33.218457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:33.253672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594245670573220:7619]
2025-10-10T14:06:33.279024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:33.292381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:33.293350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:33.293372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:33.293418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:33.293719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:33.293922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594244092652250:7703]
2025-10-10T14:06:33.296640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:33.301527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:33.301816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:33.303397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:33.303828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:33.303848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:33.303867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:33.303881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:33.303902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:33.303917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:33.303937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:33.303954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:33.303969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:33.303988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:33.303997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:33.304006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:33.304059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:33.304241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:33.304296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:33.304348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:33.304401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:33.304453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:33.304505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:33.304555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:33.304605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:33.304656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:33.304708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:33.304756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:33.304820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:33.304959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:33.305072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:33.322580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:33.322712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:33.322799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:33.322905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:33.322971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:33.323032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:33.323097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:33.323153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:33.323446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:33.323507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:33.323572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:33.323624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:33.323686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:33.323758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:33.323821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:33.323873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:33.323934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:33.323992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:33.324050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:33.324103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:33.324164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:33.324953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:33.372935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:33.450840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:33.450892Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:33.450909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:33.450928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:33.450951Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 599 [2:7559594244092652250:7703]
2025-10-10T14:06:33.451008Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:33.451071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:33.451087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:33.451101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:33.451112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:33.451158Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:33.451180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:33.451201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:33.452764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:33.452792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:33.452807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:33.452821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:33.452833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:33.453096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:33.453114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:33.455047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:33.455234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:33.455434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:33.455547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:33.454603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 599
2025-10-10T14:06:33.455645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594245670573062:2442], now have 1 active actors on pipe
2025-10-10T14:06:33.455679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594245670573220:7619], now have 1 active actors on pipe
2025-10-10T14:06:33.454702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 599, pipe: [1:7559594245670573220:7619]
2025-10-10T14:06:33.455706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594245670573121:8607], now have 1 active actors on pipe
2025-10-10T14:06:33.454790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 599
2025-10-10T14:06:33.455783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:33.455810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:33.455851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.455871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.455886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.455900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.455944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:33.455979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:33.455995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:33.456007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:33.456020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:33.456040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:33.456259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:33.456286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:33.456359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:33.456396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:33.456419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:33.456431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:33.456467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:33.456513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:33.456651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.456684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:33.456732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:33.456739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:33.458160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:33.458193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:33.458267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:33.458548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 600 partition: 0 MaxSeqNo: 36 sessionId: src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0
2025-10-10T14:06:33.459262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9842086-1ec7a8ad-3ee00cc6-97c802e1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:33.490838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0] Write session: try to update token
2025-10-10T14:06:33.490896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:33.534131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:33.534160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:33.534198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.534322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:33.536117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:33.536540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:33.565202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:33.593501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:33.610298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:33.611848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:33.612193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:33.612219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:33.612230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:33.612287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:33.691214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId: src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:33.726325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:33.726358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:33.726371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:33.726434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:33.726449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:33.726463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:33.726473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:33.726484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:33.726539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.726575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.726598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.726621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594244092652244:7703]
2025-10-10T14:06:33.726758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:33.726785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:33.726797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:33.727893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:33.728370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:33.728412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:33.728446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:33.728480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:33.738834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:33.886054Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:33.888054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:33.888087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:33.890086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594245670573220:7619]
2025-10-10T14:06:33.890192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:33.890207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:33.893271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:33.889247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:33.906141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:33.906222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0] Write session will restart in 0.008841s
2025-10-10T14:06:33.906429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0] Write session: Do CDS request
2025-10-10T14:06:33.906485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:33.905293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 600 reason: error at write: Disconnected sessionId: src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0
2025-10-10T14:06:33.905623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 600 sessionId: src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0 is DEAD
2025-10-10T14:06:33.929756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:33.928233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:33.928269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 601
2025-10-10T14:06:33.930246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:33.930370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:33.930387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:33.930396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:33.934036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 601 sessionId:  describe result for acl check
2025-10-10T14:06:33.934165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:33.934177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:33.934186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:33.934203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594245670573269:8614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:33.939562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594245670573269:8614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:33.951817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594245670573269:8614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:33.989437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594245670573269:8614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:33.989484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594245670573269:8614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:33.989503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594245670573269:8614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:33.989534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:33.998349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594245670573370:7619]
2025-10-10T14:06:34.034982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:34.044310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:34.045357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:34.045390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:34.045442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:34.045739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:34.045930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594248387619736:7705]
2025-10-10T14:06:34.048307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:34.050313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:34.050551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:34.051888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:34.052235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:34.052253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:34.052262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:34.052269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:34.052277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:34.052285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:34.052294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:34.052301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:34.052309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.052317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.052324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.052331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.052383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:34.052504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:34.052558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:34.052611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:34.052661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:34.052712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:34.052764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:34.052815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:34.052866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.052919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.052971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.053024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.053067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:34.053163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:34.053229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:34.053289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:34.053344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:34.053401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:34.053451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:34.053520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:34.053581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:34.053645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:34.053775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:34.053838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:34.053890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:34.053948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:34.054001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:34.054062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:34.054116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.054171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.054222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.054278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.054322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.054378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.054427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.054482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.055245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:34.101684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:34.115179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:34.115224Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:34.115241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:34.115262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:34.115286Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 600 [2:7559594248387619736:7705]
2025-10-10T14:06:34.115342Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:34.115402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:34.115416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:34.115429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:34.115441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:34.115490Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:34.115511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:34.115533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:34.118145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.118171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.118186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.118200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.118223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:34.118497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:34.118515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.118680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.118876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.119118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.119243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:34.119311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.119325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.119338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.119352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.119392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:34.119468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:34.119648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:34.119664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:34.119780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.119800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:34.120460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:34.120479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:34.120492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:34.120503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:34.120526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:34.122927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594245670573370:7619], now have 1 active actors on pipe
2025-10-10T14:06:34.122961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594245670573350:8614], now have 1 active actors on pipe
2025-10-10T14:06:34.122985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594245670573260:2442], now have 1 active actors on pipe
2025-10-10T14:06:34.128680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 600, pipe: [1:7559594245670573370:7619]
2025-10-10T14:06:34.128801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 600
2025-10-10T14:06:34.128875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 600
2025-10-10T14:06:34.133367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:34.133407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:34.133491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86364394-dd97258a-3343340e-9fa074f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:34.133527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:34.133546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:34.133557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:34.133594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:34.133637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:34.133681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:34.134704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:34.134732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:34.134799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:34.135226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 601 partition: 0 MaxSeqNo: 36 sessionId: src_id|86364394-dd97258a-3343340e-9fa074f2_0
2025-10-10T14:06:34.137707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|474d8fc1-1038ac39-1af847ef-f0c36b33_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86364394-dd97258a-3343340e-9fa074f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:34.201872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86364394-dd97258a-3343340e-9fa074f2_0] Write session: try to update token
2025-10-10T14:06:34.201928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86364394-dd97258a-3343340e-9fa074f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:34.213258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:34.213289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:34.213301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:34.361063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:34.361099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:34.361111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:34.361122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:34.361150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:34.361183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.361209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.361231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.361253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.361488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:34.361512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:34.361524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:34.361567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:34.361593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.361611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:34.362211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:34.362255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:34.362295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:34.362326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:34.362686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:34.398438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId: src_id|86364394-dd97258a-3343340e-9fa074f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:34.421630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:34.546520Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:34.566609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:34.566656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:34.566717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:34.566727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:34.566753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594248387619730:7705]
2025-10-10T14:06:34.567026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:34.567283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:34.568436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:34.568723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594245670573370:7619]
2025-10-10T14:06:34.568801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:34.589731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|86364394-dd97258a-3343340e-9fa074f2_0
2025-10-10T14:06:34.589993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 601 sessionId: src_id|86364394-dd97258a-3343340e-9fa074f2_0 is DEAD
2025-10-10T14:06:34.614473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86364394-dd97258a-3343340e-9fa074f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:34.614517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86364394-dd97258a-3343340e-9fa074f2_0] Write session will restart in 0.005841s
2025-10-10T14:06:34.614630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86364394-dd97258a-3343340e-9fa074f2_0] Write session: Do CDS request
2025-10-10T14:06:34.614663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86364394-dd97258a-3343340e-9fa074f2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:34.630336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86364394-dd97258a-3343340e-9fa074f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:34.662833Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:06:34.663180Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 6 consumer shared/user session shared/user_1_6_7174296375807937715_v1 is DEAD
2025-10-10T14:06:34.663433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:34.663447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 602
2025-10-10T14:06:34.665617Z :ERROR: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:06:34.666081Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:06:34.666108Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:06:34.666142Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Reconnecting session to cluster  in 0.007276s
2025-10-10T14:06:34.666678Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559593945022846573:7613] disconnected; active server actors: 1
2025-10-10T14:06:34.666721Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559593945022846573:7613] client user disconnected session shared/user_1_6_7174296375807937715_v1
2025-10-10T14:06:34.666906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:34.667050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:34.667075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:34.667085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:34.670198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 602 sessionId:  describe result for acl check
2025-10-10T14:06:34.670307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:34.670318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:34.670328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:34.670344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594249965540790:8625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:34.673026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594249965540790:8625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:34.693277Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Successfully connected. Initializing session
2025-10-10T14:06:34.695136Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:06:34.695163Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 7
2025-10-10T14:06:34.698504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594249965540790:8625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:34.698767Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 7 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:06:34.698991Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 read init: from# ipv6:[::1]:40068, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:06:34.699392Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 auth for : user
2025-10-10T14:06:34.700996Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 Handle describe topics response
2025-10-10T14:06:34.701120Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 auth is DEAD
2025-10-10T14:06:34.701200Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:06:34.702262Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:06:34.705547Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559594249965540894:8632] connected; active server actors: 1
2025-10-10T14:06:34.706162Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559594249965540894:8632] session shared/user_1_7_7318788858938900782_v1
2025-10-10T14:06:34.706209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:06:34.706256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:06:34.706289Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_7_7318788858938900782_v1" (Sender=[1:7559594249965540886:8632], Pipe=[1:7559594249965540894:8632], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:06:34.706314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:06:34.706363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:06:34.706410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_7_7318788858938900782_v1" (Sender=[1:7559594249965540886:8632], Pipe=[1:7559594249965540894:8632], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:06:34.706462Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_7_7318788858938900782_v1" sender [1:7559594249965540886:8632] lock partition 0 for ReadingSession "shared/user_1_7_7318788858938900782_v1" (Sender=[1:7559594249965540886:8632], Pipe=[1:7559594249965540894:8632], Partitions=[], ActiveFamilyCount=1) generation 1 step 7
2025-10-10T14:06:34.706502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:06:34.706525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000144s
2025-10-10T14:06:34.707397Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_7_7318788858938900782_v1" ClientId: "user" PipeClient { RawX1: 7559594249965540894 RawX2: 4503603922346424 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:06:34.707466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:06:34.709248Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got InitResponse. ReadSessionId: shared/user_1_7_7318788858938900782_v1
2025-10-10T14:06:34.720898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594249965540790:8625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:34.720940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594249965540790:8625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:34.720957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594249965540790:8625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:34.720985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:34.732159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:34.735152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:34.736070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:34.736088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:34.736136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:34.736423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:34.736620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594248387619933:7715]
2025-10-10T14:06:34.739535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:34.741392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:34.741635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:34.743008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:34.743406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:34.743424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:34.743432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:34.743438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:34.743446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:34.743454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:34.743461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:34.743469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:34.743477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.743484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.743491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.743499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.743548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:34.743659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:34.743712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:34.743762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:34.743811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:34.743861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:34.743907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:34.743954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:34.744001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.744050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.744099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.744143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.744208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:34.744278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:34.744360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:34.744416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:34.744471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:34.744529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:34.744577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:34.744631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:34.744684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:34.744742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:34.744790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:34.744850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:34.744901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:34.744955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:34.745005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:34.745059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:34.745112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.745188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.745239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.745295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.745344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.745400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.745445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.745502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.745972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:34.778377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:34.793058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:34.795265Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:34.795296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:34.795319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:34.795344Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 601 [2:7559594248387619933:7715]
2025-10-10T14:06:34.795407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:34.795469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:34.795485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:34.795498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:34.795514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:34.795567Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:34.795592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:34.795616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:34.835780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.835810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.835823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.835836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.835847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:34.836129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:34.836157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.836326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:34.836534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:34.836773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:34.836906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:34.837001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594249965540940:8625], now have 1 active actors on pipe
2025-10-10T14:06:34.837031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594249965540906:8635], now have 1 active actors on pipe
2025-10-10T14:06:34.837061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594249965540757:2442], now have 1 active actors on pipe
2025-10-10T14:06:34.837222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 601
2025-10-10T14:06:34.837339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 601, pipe: [1:7559594249965540906:8635]
2025-10-10T14:06:34.837411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 601
2025-10-10T14:06:34.837090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:34.837114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:34.837143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:34.837157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:34.837200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:34.837292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:34.837485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:34.837503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:34.837633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:34.837655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:34.838182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:34.838206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:34.838217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:34.838230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:34.838254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:34.839049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:34.839075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:34.839134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:34.839149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:34.839179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_7_7318788858938900782_v1 on pipe: [1:7559594249965540906:8635]
2025-10-10T14:06:34.839281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:34.839325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:34.839342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:34.839354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:34.839393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:34.839435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:34.839483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:34.839504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:34.839514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:34.839571Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_7_7318788858938900782_v1
2025-10-10T14:06:34.839584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:34.839718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:34.839771Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:06:34.840260Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_7_7318788858938900782_v1:1 with generation 601
2025-10-10T14:06:34.841620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:34.841653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:34.841723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:34.843288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 602 partition: 0 MaxSeqNo: 36 sessionId: src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0
2025-10-10T14:06:34.846059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86364394-dd97258a-3343340e-9fa074f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:34.847739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:06:34.847829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:06:34.847855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:34.847868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:34.847879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:34.847913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:06:34.847951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:06:34.850819Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1760104766000 SizeLag: 18742722 WriteTimestampEstimateMS: 1760105194839 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:06:34.850875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-10T14:06:34.850964Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 sending to client partition status
2025-10-10T14:06:34.925071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0] Write session: try to update token
2025-10-10T14:06:34.925171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:34.934106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:34.934138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:34.934150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:34.934210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:34.934227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:34.934244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:34.934258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:34.934271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:34.934308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:34.934339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:34.934366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:34.934392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:34.934621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:34.934651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:34.934662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:34.934859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:34.934901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:34.934939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:34.934972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:34.936788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:35.140658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId: src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:35.164744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:35.292116Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:35.310069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:35.310123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:35.310230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:35.310244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:35.310295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594248387619927:7715]
2025-10-10T14:06:35.314565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:35.314674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_7_7318788858938900782_v1
2025-10-10T14:06:35.314704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:35.316041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:35.316271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:35.319981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594249965540906:8635]
2025-10-10T14:06:35.333895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 602 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0
2025-10-10T14:06:35.337751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 602 sessionId: src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0 is DEAD
2025-10-10T14:06:35.345000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:35.345036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0] Write session will restart in 0.005740s
2025-10-10T14:06:35.345151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0] Write session: Do CDS request
2025-10-10T14:06:35.345178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:35.370792Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_7_7318788858938900782_v1
2025-10-10T14:06:35.377686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:35.377732Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:35.377766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 603
2025-10-10T14:06:35.378448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:35.378598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:35.378629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:35.378642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:35.380722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 603 sessionId:  describe result for acl check
2025-10-10T14:06:35.380867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:35.380889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:35.380912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:35.380941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594254260508294:8639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:35.384209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594254260508294:8639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:35.408754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594254260508294:8639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:35.420146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594254260508367:8635]
2025-10-10T14:06:35.421797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594254260508294:8639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:35.421826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594254260508294:8639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:35.421843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594254260508294:8639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:35.421876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:35.478558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:35.493784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:35.494756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:35.494778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:35.494829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:35.495121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:35.495329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594252682587442:7726]
2025-10-10T14:06:35.501371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:35.510484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:35.510797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:35.512281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:35.512664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:35.512673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:35.512680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:35.512688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:35.512695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:35.512705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:35.512711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:35.512720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:35.512726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:35.512734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:35.512750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:35.512760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:35.512817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:35.512943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:35.512998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:35.513053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:35.513109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:35.513196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:35.513250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:35.513316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:35.513370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:35.513422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:35.513474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:35.513527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:35.513575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:35.513655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:35.513724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:35.513785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:35.513839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:35.513900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:35.513952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:35.514012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:35.514070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:35.514133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:35.514184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:35.514245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:35.514300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:35.514360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:35.514408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:35.514469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:35.514522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:35.514585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:35.514638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:35.514699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:35.514772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:35.514841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:35.514895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:35.514954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:35.515478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:35.551595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:35.569660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:35.569706Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:35.569727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:35.569750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:35.569775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 602 [2:7559594252682587442:7726]
2025-10-10T14:06:35.569837Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:35.569904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:35.569921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:35.569935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:35.569947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:35.569999Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:35.570022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:35.570045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:35.571730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:35.571751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:35.571767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:35.571784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:35.571797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:35.572096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:35.572118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:35.572305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:35.572524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:35.572793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:35.572933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:35.573005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.573021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.573035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.573049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.573218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:35.573234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:35.573247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:35.573259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:35.573592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:35.573688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:35.573904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:35.573921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:35.573973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594254260508379:8639], now have 1 active actors on pipe
2025-10-10T14:06:35.574000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594254260508278:2442], now have 1 active actors on pipe
2025-10-10T14:06:35.574024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594254260508367:8635], now have 1 active actors on pipe
2025-10-10T14:06:35.574148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.574183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:35.574497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:35.575378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:35.575419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:35.575508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:35.575546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:35.575564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:35.575576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:35.575610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:35.575650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:35.575705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:35.576581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:35.576610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:35.576691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:35.574611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 602
2025-10-10T14:06:35.574719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 602
2025-10-10T14:06:35.574787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 602, pipe: [1:7559594254260508367:8635]
2025-10-10T14:06:35.577159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 603 partition: 0 MaxSeqNo: 36 sessionId: src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0
2025-10-10T14:06:35.578312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f9aa7d9-308b1fd-13c8d2c3-c82e80d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:35.617281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0] Write session: try to update token
2025-10-10T14:06:35.617343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:35.768311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:35.768342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:35.768352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:35.768463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:35.768477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:35.768489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:35.768499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:35.768508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:35.768541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.768565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.768587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.768607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.772420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId: src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:35.769546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:35.769578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:35.769605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:35.769630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:35.815533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:35.823364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:35.823410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:35.823420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:35.824439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:35.985159Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:35.989142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:35.989165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:35.989207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594252682587437:7726]
2025-10-10T14:06:35.989279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:35.989334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:35.989355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:35.991018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:35.991043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:35.994687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:36.059908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 603 reason: error at write: Disconnected sessionId: src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0
2025-10-10T14:06:36.060254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 603 sessionId: src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0 is DEAD
2025-10-10T14:06:36.061676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:36.061707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0] Write session will restart in 0.005979s
2025-10-10T14:06:36.061800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0] Write session: Do CDS request
2025-10-10T14:06:36.061828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:36.072558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:36.091385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:36.091514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594254260508367:8635]
2025-10-10T14:06:36.091748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:36.091760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 604
2025-10-10T14:06:36.092284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:36.092388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:36.092402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:36.092412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:36.093664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 604 sessionId:  describe result for acl check
2025-10-10T14:06:36.093775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:36.093784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:36.093791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:36.093807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594258555475843:8651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:36.096218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594258555475843:8651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:36.138029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594258555475843:8651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:36.170543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594258555475843:8651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:36.170591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594258555475843:8651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:36.170609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594258555475843:8651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:36.170642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:36.175681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:36.185482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:36.186353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:36.186372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:36.186419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:36.186669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:36.186849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594256977554943:7736]
2025-10-10T14:06:36.188930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:36.190316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:36.190508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:36.193228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594258555475966:8635]
2025-10-10T14:06:36.195915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:36.196339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:36.196348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:36.196354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:36.196361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:36.196367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:36.196373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:36.196379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:36.196386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:36.196392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.196398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.196404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.196410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.196453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:36.196553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:36.196595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:36.196636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:36.196677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:36.196719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:36.196759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:36.196798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:36.196838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.196879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.196920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.196959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.196995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:36.197052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:36.197100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:36.197167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:36.197213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:36.197260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:36.197301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:36.197348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:36.197391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:36.197437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:36.197476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:36.197522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:36.197562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:36.197607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:36.197648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:36.197694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:36.197738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.197786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.197826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.197874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.197915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.197962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.198002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.198048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.198432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:36.241548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:36.268428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:36.277331Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:36.277361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:36.277380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:36.277402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 603 [2:7559594256977554943:7736]
2025-10-10T14:06:36.277452Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:36.277504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:36.277520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:36.277532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:36.277541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:36.277587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:36.277610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:36.277629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:36.279457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.279481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.279493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.279504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.279514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:36.279787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:36.279802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.279933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.280097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.280313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.280419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:36.280491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594256977554938:7736]
2025-10-10T14:06:36.280512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594256977554938:7736]
2025-10-10T14:06:36.280525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594256977554938:7736]
2025-10-10T14:06:36.280538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594256977554938:7736]
2025-10-10T14:06:36.280575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:36.280661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:36.280836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:36.280854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:36.280983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594256977554938:7736]
2025-10-10T14:06:36.281002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:36.285249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 603, pipe: [1:7559594258555475966:8635]
2025-10-10T14:06:36.285356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 603
2025-10-10T14:06:36.285417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 603
2025-10-10T14:06:36.281241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:36.281259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:36.281270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:36.281280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:36.281302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:36.286638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594258555475966:8635], now have 1 active actors on pipe
2025-10-10T14:06:36.286671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594258555475961:8651], now have 1 active actors on pipe
2025-10-10T14:06:36.286689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594258555475829:2442], now have 1 active actors on pipe
2025-10-10T14:06:36.289516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:36.289561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:36.289666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:36.289700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:36.289718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:36.289727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:36.289763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:36.289811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:36.289858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:36.290557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:36.290581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:36.290635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:36.290998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 604 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0
2025-10-10T14:06:36.291965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e08792-3b4ea6ea-80e4d808-63400a83_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:36.347648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0] Write session: try to update token
2025-10-10T14:06:36.347693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:36.378032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:36.378057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:36.378067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:36.434656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:36.434688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:36.434697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:36.434706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:36.434714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:36.434742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594256977554938:7736]
2025-10-10T14:06:36.434770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594256977554938:7736]
2025-10-10T14:06:36.434793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594256977554938:7736]
2025-10-10T14:06:36.434820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594256977554938:7736]
2025-10-10T14:06:36.434931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:36.434951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.434957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:36.435862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:36.437473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:36.437501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:36.437523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:36.437541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:36.640379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId: src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:36.645146Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:36.650635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594258555475966:8635]
2025-10-10T14:06:36.650709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:36.688934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:36.688964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:36.699191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 604 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0
2025-10-10T14:06:36.699523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 604 sessionId: src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0 is DEAD
2025-10-10T14:06:36.700678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:06:36.700755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0] Write session will restart in 0.006262s
2025-10-10T14:06:36.700956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0] Write session: Do CDS request
2025-10-10T14:06:36.701015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:36.722174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:36.722787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:36.722819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 605
2025-10-10T14:06:36.723159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:36.723264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:36.723280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:36.723289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:36.734278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 605 sessionId:  describe result for acl check
2025-10-10T14:06:36.734410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:36.734420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:36.734429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:36.734446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594258555476031:8661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:36.737092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594258555476031:8661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:36.748941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594258555476043:8635]
2025-10-10T14:06:36.801840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594258555476031:8661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:36.830350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:36.832279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594258555476031:8661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:36.832324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594258555476031:8661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:36.832340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594258555476031:8661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:36.832370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:36.845009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:36.845992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:36.846013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:36.846060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:36.846327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:36.846799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594256977555150:7745]
2025-10-10T14:06:36.848998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:36.857693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:36.857954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:36.859252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:36.859591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:36.859600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:36.859607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:36.859614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:36.859620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:36.859627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:36.859634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:36.859640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:36.859646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.859653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.859660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.859667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.859714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:36.859822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:36.859870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:36.859918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:36.859967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:36.860013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:36.860058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:36.860102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:36.860164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.860211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.860256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.860301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.860344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:36.860408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:36.860463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:36.860515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:36.860564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:36.860620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:36.860666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:36.860717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:36.860763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:36.860817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:36.860861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:36.860913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:36.860959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:36.861010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:36.861054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:36.861105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:36.862185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.862259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.862308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.862362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.862410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.862461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.862504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.862557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.863014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:36.899596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:36.934957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:36.935000Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:36.935017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:36.935037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:36.935063Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 604 [2:7559594256977555150:7745]
2025-10-10T14:06:36.935119Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:36.935194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:36.935211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:36.935223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:36.935235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:36.935286Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:36.935309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:36.935330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:36.936678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.936693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.936707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.936721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.936733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:36.937003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:36.937019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:36.940916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 604
2025-10-10T14:06:36.941013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 604
2025-10-10T14:06:36.941078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 604, pipe: [1:7559594258555476043:8635]
2025-10-10T14:06:36.944419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:36.944649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:36.944891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:36.945022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:36.945154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594258555476179:8661], now have 1 active actors on pipe
2025-10-10T14:06:36.945183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594258555476006:2442], now have 1 active actors on pipe
2025-10-10T14:06:36.945209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594258555476043:8635], now have 1 active actors on pipe
2025-10-10T14:06:36.945263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:36.945286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:36.945346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:36.945361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:36.945374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:36.945386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:36.945431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:36.945515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:36.945694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:36.945710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:36.945775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:36.945807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:36.945825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:36.945836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:36.945873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:36.945917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:36.946053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:36.946073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:36.946116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:36.946852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:36.946871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:36.946881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:36.946892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:36.946916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:36.952635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:36.952675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:36.952754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:37.019583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 605 partition: 0 MaxSeqNo: 36 sessionId: src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0
2025-10-10T14:06:37.021622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5cb2c18-63fac22c-7550026d-ec48abdb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:37.070246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0] Write session: try to update token
2025-10-10T14:06:37.070314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:37.074603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:37.074633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:37.074645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:37.074768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:37.074783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:37.074796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:37.074808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:37.074818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:37.074857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:37.074887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:37.074912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:37.074934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:37.075059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:37.075095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:37.075128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:37.075174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:37.085392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:37.085442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:37.085455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:37.086913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:37.187237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId: src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:37.208639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:37.283206Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:37.284913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:37.284930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:37.284977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594256977555144:7745]
2025-10-10T14:06:37.285251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:37.285352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:37.285384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:37.287071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:37.287097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:37.289348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:37.289489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594258555476043:8635]
2025-10-10T14:06:37.286551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:37.319834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 605 reason: error at write: Disconnected sessionId: src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0
2025-10-10T14:06:37.320640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:37.320693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0] Write session will restart in 0.008757s
2025-10-10T14:06:37.320801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0] Write session: Do CDS request
2025-10-10T14:06:37.320833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:37.320235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 605 sessionId: src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0 is DEAD
2025-10-10T14:06:37.344532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:37.341811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:37.341871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 606
2025-10-10T14:06:37.348053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:37.348251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:37.348270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:37.348282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:37.350192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 606 sessionId:  describe result for acl check
2025-10-10T14:06:37.350319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:37.350331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:37.350341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:37.350359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594262850443526:8667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:37.353644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594262850443526:8667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:37.382186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594262850443526:8667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:37.390046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594262850443606:8635]
2025-10-10T14:06:37.395720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594262850443526:8667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:37.395764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594262850443526:8667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:37.395781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594262850443526:8667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:37.395811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:37.429069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:37.431572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:37.432594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:37.432632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:37.432683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:37.432992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:37.433224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594261272522641:7749]
2025-10-10T14:06:37.435685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:37.437071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:37.437361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:37.438777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:37.439159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:37.439181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:37.439189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:37.439199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:37.439207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:37.439216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:37.439224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:37.439232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:37.439240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:37.439247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:37.439256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:37.439264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:37.439328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:37.439459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:37.439524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:37.439581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:37.439639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:37.439699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:37.439758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:37.439819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:37.439877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:37.439935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:37.439992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:37.440049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:37.440114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:37.440193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:37.440259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:37.440326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:37.440391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:37.440458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:37.440516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:37.440584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:37.440645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:37.440714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:37.440772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:37.440839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:37.440899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:37.440965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:37.441023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:37.441087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:37.441302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:37.441377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:37.441438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:37.441507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:37.441570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:37.441641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:37.441703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:37.441763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:37.442278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:37.492211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:37.520962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:37.521016Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:37.521038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:37.521061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:37.521087Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 605 [2:7559594261272522641:7749]
2025-10-10T14:06:37.521228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:37.521293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:37.521310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:37.521322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:37.521335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:37.521388Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:37.521410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:37.521432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:37.522829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:37.522860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:37.522876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:37.522891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:37.522904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:37.523233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:37.523254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:37.523416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:37.523733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:37.523995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:37.524152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:37.524244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594262850443606:8635], now have 1 active actors on pipe
2025-10-10T14:06:37.524271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594262850443633:8667], now have 1 active actors on pipe
2025-10-10T14:06:37.524296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594262850443509:2442], now have 1 active actors on pipe
2025-10-10T14:06:37.524322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.524339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.524353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.524367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.524414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:37.524503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:37.524500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:37.524517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:37.524529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:37.524539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:37.524708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:37.524726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:37.524861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.524894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:37.525212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:37.525984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 605, pipe: [1:7559594262850443606:8635]
2025-10-10T14:06:37.526101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 605
2025-10-10T14:06:37.526585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:37.526619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:37.526713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:37.526744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:37.526764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:37.526776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:37.526226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 605
2025-10-10T14:06:37.526815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:37.526853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:37.527949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 606 partition: 0 MaxSeqNo: 36 sessionId: src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0
2025-10-10T14:06:37.526900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:37.527490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:37.527509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:37.527573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:37.528895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f79deb-56147e4e-dc52f2fa-32c5c953_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:37.583481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0] Write session: try to update token
2025-10-10T14:06:37.583543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:37.687153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:37.687188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:37.687200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:37.687311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:37.687328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:37.687342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:37.687354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:37.687366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:37.687400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.687427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.687452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.687478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.687634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:37.687690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:37.687742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:37.687784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:37.732735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:37.741407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:37.741437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:37.742463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:37.750412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId: src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:37.789076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:37.899142Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:37.902639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:37.902666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:37.902706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594261272522636:7749]
2025-10-10T14:06:37.902842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:37.902865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:37.903757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:37.904455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:37.910099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594262850443606:8635]
2025-10-10T14:06:37.910206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:37.934286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:37.934598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 606 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0
2025-10-10T14:06:37.934995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 606 sessionId: src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0 is DEAD
2025-10-10T14:06:37.935967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:37.936012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0] Write session will restart in 0.006820s
2025-10-10T14:06:37.936114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0] Write session: Do CDS request
2025-10-10T14:06:37.936143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:37.950846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:37.955455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:37.955492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 607
2025-10-10T14:06:37.961723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:37.961877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:37.961893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:37.961904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:37.963078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 607 sessionId:  describe result for acl check
2025-10-10T14:06:37.963182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:37.963192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:37.963201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:37.963217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594262850443750:8680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:37.968969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594262850443750:8680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:37.975605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594262850443750:8680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:38.006406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594262850443750:8680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:38.006454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594262850443750:8680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:38.006472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594262850443750:8680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:38.006507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:38.012351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594267145411084:8635]
2025-10-10T14:06:38.068671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:38.069860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:38.070534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:38.070547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:38.070581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:38.070779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:38.070893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594265567490147:7757]
2025-10-10T14:06:38.072736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:38.073546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:38.073706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:38.074623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:38.074852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:38.074857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:38.074861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:38.074867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:38.074871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:38.074876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:38.074881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:38.074886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:38.074892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.074896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.074900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.074906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.074943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:38.075027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:38.075063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:38.075099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:38.075133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:38.075168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:38.075213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:38.075249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:38.075283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.075319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.075353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.075389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.075414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:38.075462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:38.075504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:38.075554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:38.075593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:38.075636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:38.075669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:38.075719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:38.075756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:38.075796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:38.075829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:38.075869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:38.075903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:38.075941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:38.077236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:38.077315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:38.077369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.077426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.077475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.077534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.077589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.077655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.077727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.077786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.078285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:38.119695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:38.160687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:38.160741Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:38.160761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:38.160783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:38.160807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 606 [2:7559594265567490147:7757]
2025-10-10T14:06:38.160866Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:38.160927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:38.160942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:38.160955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:38.160967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:38.161014Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:38.161036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:38.161060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:38.162758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.162789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.162804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.162819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.162832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:38.163119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:38.163145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.163313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.163595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 606, pipe: [1:7559594267145411084:8635]
2025-10-10T14:06:38.163715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 606
2025-10-10T14:06:38.163831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 606
2025-10-10T14:06:38.163548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.163804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.168337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:38.168475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594267145411084:8635], now have 1 active actors on pipe
2025-10-10T14:06:38.168506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594262850443739:2442], now have 1 active actors on pipe
2025-10-10T14:06:38.168533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594267145411073:8680], now have 1 active actors on pipe
2025-10-10T14:06:38.168593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:38.168636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:38.168701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.168719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.168735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.168750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.168795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:38.168886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:38.169093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:38.169111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:38.169184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:38.169198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|647fddb9-879a1b67-cea04494-c6d001a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:38.169206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:38.169217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:38.169229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:38.169232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:38.169252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:38.169263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:38.169304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:38.169349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:38.169500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.169536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:38.169587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:38.169852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:38.172598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:38.172639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:38.172725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:38.173091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 607 partition: 0 MaxSeqNo: 36 sessionId: src_id|647fddb9-879a1b67-cea04494-c6d001a3_0
2025-10-10T14:06:38.177434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d7e153-8f432bd1-3cda2a8f-71102558_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|647fddb9-879a1b67-cea04494-c6d001a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:38.220797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|647fddb9-879a1b67-cea04494-c6d001a3_0] Write session: try to update token
2025-10-10T14:06:38.220852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|647fddb9-879a1b67-cea04494-c6d001a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:38.282770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:38.282802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:38.282814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:38.282826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:38.282837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:38.282869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.282895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.282919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.282944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.283126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:38.283136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:38.283144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:38.283155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:38.283171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:38.283207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:38.283237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:38.296755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:38.296812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.296825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:38.298045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:38.363875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId: src_id|647fddb9-879a1b67-cea04494-c6d001a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:38.387468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:38.456825Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:38.459256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:38.459284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:38.459330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594265567490142:7757]
2025-10-10T14:06:38.459464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:38.459493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:38.459518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:38.460428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594267145411084:8635]
2025-10-10T14:06:38.460537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:38.460694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:38.460707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:38.460260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:38.468143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 607 reason: error at write: Disconnected sessionId: src_id|647fddb9-879a1b67-cea04494-c6d001a3_0
2025-10-10T14:06:38.468497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 607 sessionId: src_id|647fddb9-879a1b67-cea04494-c6d001a3_0 is DEAD
2025-10-10T14:06:38.476498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647fddb9-879a1b67-cea04494-c6d001a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:38.476563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647fddb9-879a1b67-cea04494-c6d001a3_0] Write session will restart in 0.007752s
2025-10-10T14:06:38.476727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647fddb9-879a1b67-cea04494-c6d001a3_0] Write session: Do CDS request
2025-10-10T14:06:38.476778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647fddb9-879a1b67-cea04494-c6d001a3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:38.490767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:38.490802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 608
2025-10-10T14:06:38.491179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|647fddb9-879a1b67-cea04494-c6d001a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:38.491823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:38.491953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:38.491969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:38.491979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:38.501103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 608 sessionId:  describe result for acl check
2025-10-10T14:06:38.501384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:38.501407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:38.501420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:38.501438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594267145411251:8688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:38.512492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594267145411251:8688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:38.546857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594267145411251:8688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:38.554974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594267145411251:8688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:38.555014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594267145411251:8688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:38.555033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594267145411251:8688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:38.555062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:38.560744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594267145411360:8635]
2025-10-10T14:06:38.605332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:38.611614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:38.612376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:38.612397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:38.612445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:38.612756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:38.612964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594265567490353:7768]
2025-10-10T14:06:38.616582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:38.617620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:38.617798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:38.618764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:38.619020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:38.619025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:38.619030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:38.619035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:38.619040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:38.619046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:38.619050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:38.619056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:38.619061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.619065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.619071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.619074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.619112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:38.619205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:38.619246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:38.619285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:38.619322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:38.619360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:38.619396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:38.619432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:38.619468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.619513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.619550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.619587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.619631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:38.619685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:38.619731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:38.619774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:38.619807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:38.619847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:38.619881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:38.619923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:38.619962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:38.620012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:38.620049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:38.620104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:38.620142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:38.620184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:38.620219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:38.620258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:38.620297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.620336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.620369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.620410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.620448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.620488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.620532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.620571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.621223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:38.648230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:38.662729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:38.662779Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:38.662801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:38.662824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:38.662851Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 607 [2:7559594265567490353:7768]
2025-10-10T14:06:38.662913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:38.662970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:38.662985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:38.662998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:38.663010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:38.663062Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:38.663085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:38.663109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:38.730012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.730039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.730051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.730063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.730073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:38.730349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:38.730365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.730507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:38.730685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:38.730900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:38.731016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:38.731080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:38.731095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:38.731109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:38.731122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:38.731166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:38.731246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:38.731430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:38.731435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:38.731439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:38.731448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:38.731450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:38.731455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:38.731567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:38.731588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:38.731625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:38.731700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594267145411360:8635], now have 1 active actors on pipe
2025-10-10T14:06:38.731764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594267145411339:8688], now have 1 active actors on pipe
2025-10-10T14:06:38.731788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594267145411236:2442], now have 1 active actors on pipe
2025-10-10T14:06:38.732590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 607, pipe: [1:7559594267145411360:8635]
2025-10-10T14:06:38.732711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 607
2025-10-10T14:06:38.732785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 607
2025-10-10T14:06:38.733285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:38.733324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:38.733436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:38.733468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:38.733487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:38.733503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:38.733552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:38.733592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:38.733642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:38.739663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:38.739716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:38.739800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:38.745390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 608 partition: 0 MaxSeqNo: 36 sessionId: src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0
2025-10-10T14:06:38.748383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|647fddb9-879a1b67-cea04494-c6d001a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:38.765989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:38.766024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:38.766037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:38.803758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0] Write session: try to update token
2025-10-10T14:06:38.803818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:38.835816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:38.835850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:38.835866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:38.835880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:38.835890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:38.835929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:38.835958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:38.835985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:38.836011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:38.836597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:38.836633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:38.836665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:38.836695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:38.916172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:38.916223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:38.916235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:38.918498Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:39.004678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId: src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:39.060466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:39.147652Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:39.149633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:39.149659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:39.149712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594265567490348:7768]
2025-10-10T14:06:39.149873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:39.149898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:39.150215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:39.151551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:39.155238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594267145411360:8635]
2025-10-10T14:06:39.155436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:39.163882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 608 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0
2025-10-10T14:06:39.164260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 608 sessionId: src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0 is DEAD
2025-10-10T14:06:39.168932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:39.168965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0] Write session will restart in 0.007003s
2025-10-10T14:06:39.169076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0] Write session: Do CDS request
2025-10-10T14:06:39.169105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:39.181372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:39.180279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:39.180468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:39.180483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 609
2025-10-10T14:06:39.182938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:39.183091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:39.183109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:39.183118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:39.185051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 609 sessionId:  describe result for acl check
2025-10-10T14:06:39.185188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:39.185199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:39.185209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:39.185226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594271440378766:8698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:39.190595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594271440378766:8698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:39.224744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594271440378766:8698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:39.238254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594271440378766:8698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:39.238298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594271440378766:8698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:39.238315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594271440378766:8698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:39.238345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:39.257435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594271440378932:8635]
2025-10-10T14:06:39.266360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:39.272128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:39.273046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:39.273084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:39.273153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:39.273468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:39.273655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594269862457847:7772]
2025-10-10T14:06:39.275756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:39.279718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:39.280013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:39.281499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:39.281862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:39.281870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:39.281877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:39.281885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:39.281894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:39.281902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:39.281909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:39.281917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:39.281925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.281934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.281943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.281950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.282002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:39.282120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:39.282170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:39.282223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:39.282268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:39.282321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:39.282366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:39.282414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:39.282459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.282505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.282551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.282599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.282638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:39.282711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:39.282769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:39.282827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:39.282881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:39.282942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:39.282988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:39.283042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:39.283095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:39.283153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:39.283200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:39.283257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:39.283309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:39.283368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:39.283414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:39.283469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:39.283523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.283580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.283627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.283685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.283735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.283794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.283845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.283903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.284395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:39.346267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:39.361333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:39.361373Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:39.361390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:39.361409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:39.361430Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 608 [2:7559594269862457847:7772]
2025-10-10T14:06:39.361482Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:39.361534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:39.361549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:39.361561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:39.361572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:39.361614Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:39.361638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:39.361657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:39.365015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.365033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.365049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.365061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.365072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:39.367196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:39.367230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.367375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.367561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.367792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.367914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:39.367978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594271440378858:8698], now have 1 active actors on pipe
2025-10-10T14:06:39.368004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594271440378932:8635], now have 1 active actors on pipe
2025-10-10T14:06:39.368026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594271440378755:2442], now have 1 active actors on pipe
2025-10-10T14:06:39.368109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594269862457842:7772]
2025-10-10T14:06:39.368123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594269862457842:7772]
2025-10-10T14:06:39.368139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594269862457842:7772]
2025-10-10T14:06:39.368153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594269862457842:7772]
2025-10-10T14:06:39.368199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:39.368267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:39.368276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:39.368284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:39.368296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:39.368308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:39.368466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:39.368483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:39.368609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594269862457842:7772]
2025-10-10T14:06:39.368639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:39.369472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:39.369941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 608, pipe: [1:7559594271440378932:8635]
2025-10-10T14:06:39.370016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 608
2025-10-10T14:06:39.370084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 608
2025-10-10T14:06:39.370440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:39.370461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:39.370519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46e8d2f5-32a433c9-d0515703-37582043_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:39.370539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:39.370551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:39.370558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:39.370580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:39.370611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:39.370639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:39.380712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:39.380752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:39.380858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:39.383434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 609 partition: 0 MaxSeqNo: 36 sessionId: src_id|46e8d2f5-32a433c9-d0515703-37582043_0
2025-10-10T14:06:39.388287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e03088-e3f30d27-ba267bdc-46806d1b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|46e8d2f5-32a433c9-d0515703-37582043_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:39.418023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46e8d2f5-32a433c9-d0515703-37582043_0] Write session: try to update token
2025-10-10T14:06:39.418073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46e8d2f5-32a433c9-d0515703-37582043_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:39.472843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:39.472882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:39.472896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:39.472908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:39.472921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:39.472957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594269862457842:7772]
2025-10-10T14:06:39.472987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594269862457842:7772]
2025-10-10T14:06:39.473015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594269862457842:7772]
2025-10-10T14:06:39.473036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594269862457842:7772]
2025-10-10T14:06:39.473243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:39.473257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:39.473271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:39.473316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:39.473343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.473356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:39.473444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:39.473463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:39.473483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:39.473501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:39.486286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:39.624682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId: src_id|46e8d2f5-32a433c9-d0515703-37582043_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:39.653765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:39.660677Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:39.664191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:39.664231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:39.666274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:39.666304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:39.685712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 609 reason: error at write: Disconnected sessionId: src_id|46e8d2f5-32a433c9-d0515703-37582043_0
2025-10-10T14:06:39.686070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 609 sessionId: src_id|46e8d2f5-32a433c9-d0515703-37582043_0 is DEAD
2025-10-10T14:06:39.689880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e8d2f5-32a433c9-d0515703-37582043_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:39.689948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e8d2f5-32a433c9-d0515703-37582043_0] Write session will restart in 0.005704s
2025-10-10T14:06:39.690124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e8d2f5-32a433c9-d0515703-37582043_0] Write session: Do CDS request
2025-10-10T14:06:39.690176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e8d2f5-32a433c9-d0515703-37582043_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:39.700725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46e8d2f5-32a433c9-d0515703-37582043_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:39.714096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:39.729391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594271440378932:8635]
2025-10-10T14:06:39.729515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:39.729600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:39.729614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 610
2025-10-10T14:06:39.733523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:39.733703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:39.733721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:39.733732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:39.735435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 610 sessionId:  describe result for acl check
2025-10-10T14:06:39.735583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:39.735596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:39.735607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:39.735625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594271440378969:8705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:39.738797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594271440378969:8705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:39.753893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594271440378969:8705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:39.763540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594271440378969:8705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:39.763583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594271440378969:8705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:39.763600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594271440378969:8705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:39.763629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:39.777831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:39.786289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:39.787181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:39.787219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:39.787267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:39.787532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:39.787723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594269862458051:7780]
2025-10-10T14:06:39.790070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:39.791076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:39.791313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:39.792553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:39.792845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:39.792860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:39.792867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:39.792873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:39.792880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:39.792888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:39.792895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:39.792904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:39.792911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.792918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.792924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.792931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.792980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:39.793089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:39.793155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:39.793204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:39.793261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:39.793318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:39.793365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:39.793419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:39.793469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.793526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.793570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.793635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.793685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:39.793765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:39.793840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:39.794020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:39.794087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:39.794154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:39.794210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:39.794278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:39.794336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:39.794400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:39.794471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:39.794529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:39.794576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:39.794635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:39.794687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:39.794746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:39.794800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.794862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.794927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.794992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.795057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.795120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.795171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.795227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.795641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:39.818359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:39.832698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:39.833167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594271440379142:8635]
2025-10-10T14:06:39.835747Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:39.835778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:39.835798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:39.835822Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 609 [2:7559594269862458051:7780]
2025-10-10T14:06:39.835884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:39.835941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:39.835961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:39.835975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:39.835991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:39.836056Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:39.836082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:39.836104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:39.874445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.874477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.874492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.874505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.874517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:39.874825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:39.874850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:39.875009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:39.875210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:39.875449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:39.875589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:39.875648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 609, pipe: [1:7559594271440379142:8635]
2025-10-10T14:06:39.875678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594271440379142:8635], now have 1 active actors on pipe
2025-10-10T14:06:39.875753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 609
2025-10-10T14:06:39.875705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594271440378960:2442], now have 1 active actors on pipe
2025-10-10T14:06:39.875823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 609
2025-10-10T14:06:39.875730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594271440379110:8705], now have 1 active actors on pipe
2025-10-10T14:06:39.875756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594269862458046:7780]
2025-10-10T14:06:39.875772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594269862458046:7780]
2025-10-10T14:06:39.875786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594269862458046:7780]
2025-10-10T14:06:39.875799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594269862458046:7780]
2025-10-10T14:06:39.875843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:39.875904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:39.875925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:39.875937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:39.875945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:39.875948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:39.876158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:39.876175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:39.876297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594269862458046:7780]
2025-10-10T14:06:39.876341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:39.877587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:39.879834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:39.879872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:39.879968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92c9838c-cc1216b0-15f7729c-2758d181_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:39.880013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:39.880030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:39.880059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:39.880100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:39.880155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:39.880199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:39.880980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:39.880999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:39.881073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:39.883580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 610 partition: 0 MaxSeqNo: 36 sessionId: src_id|92c9838c-cc1216b0-15f7729c-2758d181_0
2025-10-10T14:06:39.884503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46e8d2f5-32a433c9-d0515703-37582043_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|92c9838c-cc1216b0-15f7729c-2758d181_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:39.932367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92c9838c-cc1216b0-15f7729c-2758d181_0] Write session: try to update token
2025-10-10T14:06:39.932425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92c9838c-cc1216b0-15f7729c-2758d181_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:39.937186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:39.937220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:39.937232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:40.004264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:40.004297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:40.004310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:40.004319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:40.004328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:40.004363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594269862458046:7780]
2025-10-10T14:06:40.004386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594269862458046:7780]
2025-10-10T14:06:40.004406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594269862458046:7780]
2025-10-10T14:06:40.004425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594269862458046:7780]
2025-10-10T14:06:40.004568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:40.004594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.004606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:40.005094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:40.005140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:40.005166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:40.005190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:40.006343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:40.089291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId: src_id|92c9838c-cc1216b0-15f7729c-2758d181_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:40.131858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:40.173183Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:40.175070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:40.175101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:40.177864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:40.180490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594271440379142:8635]
2025-10-10T14:06:40.180568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:40.180685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:40.240566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 610 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92c9838c-cc1216b0-15f7729c-2758d181_0
2025-10-10T14:06:40.240909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 610 sessionId: src_id|92c9838c-cc1216b0-15f7729c-2758d181_0 is DEAD
2025-10-10T14:06:40.249894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92c9838c-cc1216b0-15f7729c-2758d181_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:40.249941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92c9838c-cc1216b0-15f7729c-2758d181_0] Write session will restart in 0.007058s
2025-10-10T14:06:40.250062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92c9838c-cc1216b0-15f7729c-2758d181_0] Write session: Do CDS request
2025-10-10T14:06:40.250094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92c9838c-cc1216b0-15f7729c-2758d181_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:40.262980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92c9838c-cc1216b0-15f7729c-2758d181_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:40.263483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:40.263522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 611
2025-10-10T14:06:40.267920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:40.268091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:40.268106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:40.268117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:40.269406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 611 sessionId:  describe result for acl check
2025-10-10T14:06:40.269516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:40.269526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:40.269536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:40.269552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594275735346503:8714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:40.272976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594275735346503:8714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:40.280481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594275735346517:8635]
2025-10-10T14:06:40.288437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594275735346503:8714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:40.298518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594275735346503:8714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:40.298564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594275735346503:8714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:40.298580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594275735346503:8714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:40.298611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:40.370266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:40.378457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:40.379323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:40.379340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:40.379384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:40.379621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:40.379798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594274157425567:7791]
2025-10-10T14:06:40.382060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:40.383707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:40.383986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:40.385415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:40.385790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:40.385799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:40.385808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:40.385815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:40.385824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:40.385831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:40.385839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:40.385847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:40.385855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.385863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.385872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.385880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.385932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:40.386054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:40.386109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:40.386164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:40.386213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:40.386264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:40.386316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:40.386368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:40.386424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.386481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.392483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.392577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.392643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:40.392726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:40.392797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:40.392861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:40.392919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:40.392979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:40.393030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:40.393091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:40.393175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:40.393237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:40.393290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:40.393350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:40.393404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:40.393467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:40.393521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:40.393580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:40.393640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.393707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.393761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.393824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.393876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.393938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.393993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.394053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.394594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:40.424049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:40.471149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:40.471197Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:40.471213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:40.471233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:40.471257Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 610 [2:7559594274157425567:7791]
2025-10-10T14:06:40.471314Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:40.471379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:40.471395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:40.471407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:40.471418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:40.471468Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:40.471489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:40.471510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:40.473098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.473115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.480394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.480444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.480456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:40.480819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:40.480838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.480986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.481176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.481390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.481501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:40.481582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.481598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.481610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.481622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.481668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:40.481777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594275735346468:2442], now have 1 active actors on pipe
2025-10-10T14:06:40.481816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594275735346517:8635], now have 1 active actors on pipe
2025-10-10T14:06:40.481843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:40.482015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:40.482030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:40.482064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594275735346558:8714], now have 1 active actors on pipe
2025-10-10T14:06:40.482184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.482204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:40.482819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:40.482844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:40.482858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:40.482872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:40.482898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:40.482567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 610
2025-10-10T14:06:40.482669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 610, pipe: [1:7559594275735346517:8635]
2025-10-10T14:06:40.482742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 610
2025-10-10T14:06:40.499623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:40.499688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:40.499793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:40.499832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:40.499851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:40.499862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:40.499914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:40.499963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:40.500010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:40.501096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:40.501150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:40.501234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:40.501609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 611 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0
2025-10-10T14:06:40.502527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92c9838c-cc1216b0-15f7729c-2758d181_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:40.557727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0] Write session: try to update token
2025-10-10T14:06:40.557791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:40.571963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:40.571996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:40.572009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:40.661696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId: src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:40.692663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:40.692709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:40.692723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:40.692732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:40.692741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:40.692767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.692794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.692822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.692846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.692977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:40.693023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:40.693063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:40.693067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:40.693080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:40.693092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:40.693100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:40.693156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:40.693182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.693193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:40.694342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:40.713861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:40.843933Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:40.859714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:40.859762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:40.859833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:40.859847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:40.859891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594274157425561:7791]
2025-10-10T14:06:40.860177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:40.860622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:40.861850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:40.885061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 611 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0
2025-10-10T14:06:40.885390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 611 sessionId: src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0 is DEAD
2025-10-10T14:06:40.887612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:40.887647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0] Write session will restart in 0.009623s
2025-10-10T14:06:40.887841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0] Write session: Do CDS request
2025-10-10T14:06:40.887894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:40.905612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:40.906930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:40.907082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594275735346517:8635]
2025-10-10T14:06:40.907252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:40.907272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 612
2025-10-10T14:06:40.910316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:40.910472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:40.910495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:40.910506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:40.911931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 612 sessionId:  describe result for acl check
2025-10-10T14:06:40.912057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:40.912076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:40.912087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:40.912104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594275735346708:8726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:40.914808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594275735346708:8726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:40.929650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594275735346708:8726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:40.946631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594275735346708:8726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:40.946674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594275735346708:8726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:40.946692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594275735346708:8726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:40.946720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:40.959996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:40.966885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:40.967757Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:40.967776Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:40.967820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:40.968104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:40.968291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594274157425766:7793]
2025-10-10T14:06:40.970292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:40.973409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:40.973669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:40.975017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:40.975359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:40.975366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:40.975373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:40.975382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:40.975390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:40.975396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:40.975403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:40.975410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:40.975416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.975424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.975431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.975439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.975486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:40.975597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:40.975645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:40.975695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:40.975742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:40.975793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:40.975839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:40.975884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:40.975930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.975974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.976037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.976082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.976125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:40.976191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:40.976254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:40.976308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:40.976355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:40.976408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:40.976451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:40.976507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:40.976560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:40.976620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:40.976670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:40.976729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:40.976782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:40.976858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:40.976905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:40.976964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:40.977028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.977091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:40.977245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.977312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:40.977368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.977434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:40.977487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.977548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:40.977896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:41.003217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594280030314177:8635]
2025-10-10T14:06:41.003083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:41.018434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:41.018479Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:41.018494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:41.018511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:41.018535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 611 [2:7559594274157425766:7793]
2025-10-10T14:06:41.018585Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:41.018641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:41.018656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:41.018667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:41.018678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:41.018724Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:41.018744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:41.018765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:41.022020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:41.022046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:41.022059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:41.022073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:41.022083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:41.022361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:41.022376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:41.022500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:41.022671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:41.022880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:41.022993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:41.023075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.023094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.023108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.023123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.023179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:41.023273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:41.023357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:41.023373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:41.023385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:41.023398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:41.023482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:41.023503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:41.023655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.023684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:41.023691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:41.023739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594280030314177:8635], now have 1 active actors on pipe
2025-10-10T14:06:41.023830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594275735346695:2442], now have 1 active actors on pipe
2025-10-10T14:06:41.024396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 611, pipe: [1:7559594280030314177:8635]
2025-10-10T14:06:41.023856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594275735346861:8726], now have 1 active actors on pipe
2025-10-10T14:06:41.024493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 611
2025-10-10T14:06:41.024578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 611
2025-10-10T14:06:41.025016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:41.025049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:41.025144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|177f1088-540824b7-e85144f2-897a0263_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:41.025182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:41.025203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:41.025216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:41.025259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:41.025316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:41.025394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:41.026376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:41.026407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:41.026474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:41.026950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 612 partition: 0 MaxSeqNo: 36 sessionId: src_id|177f1088-540824b7-e85144f2-897a0263_0
2025-10-10T14:06:41.027761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9ddaa08-43f24e4b-75fcdebf-195fc509_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|177f1088-540824b7-e85144f2-897a0263_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:41.064873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177f1088-540824b7-e85144f2-897a0263_0] Write session: try to update token
2025-10-10T14:06:41.064926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177f1088-540824b7-e85144f2-897a0263_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:41.300380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:41.300413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:41.300424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:41.300528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:41.300540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:41.300552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:41.300561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:41.300570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:41.300601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.300622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.300641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.300660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.300742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:41.300779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:41.300798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:41.300815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:41.333521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:41.333569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:41.333580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:41.334668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:41.378020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId: src_id|177f1088-540824b7-e85144f2-897a0263_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:41.430777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:41.596769Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:41.600524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:41.600555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:41.600596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594274157425761:7793]
2025-10-10T14:06:41.600730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:41.600752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:41.601230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:41.602254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:41.602581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:41.602711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:41.602722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:41.619001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594280030314177:8635]
2025-10-10T14:06:41.619093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 612 reason: error at write: Disconnected sessionId: src_id|177f1088-540824b7-e85144f2-897a0263_0
2025-10-10T14:06:41.619422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 612 sessionId: src_id|177f1088-540824b7-e85144f2-897a0263_0 is DEAD
2025-10-10T14:06:41.623821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f1088-540824b7-e85144f2-897a0263_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:41.623867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f1088-540824b7-e85144f2-897a0263_0] Write session will restart in 0.006994s
2025-10-10T14:06:41.623968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f1088-540824b7-e85144f2-897a0263_0] Write session: Do CDS request
2025-10-10T14:06:41.624012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f1088-540824b7-e85144f2-897a0263_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:41.643875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177f1088-540824b7-e85144f2-897a0263_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:41.652463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:41.652536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 613
2025-10-10T14:06:41.657707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:41.657876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:41.657894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:41.657904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:41.660056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 613 sessionId:  describe result for acl check
2025-10-10T14:06:41.660175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:41.660186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:41.660195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:41.660212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594280030314222:8734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:41.662686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594280030314222:8734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:41.679110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594280030314222:8734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:41.692198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594280030314222:8734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:41.692246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594280030314222:8734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:41.692265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594280030314222:8734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:41.692298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:41.719509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594280030314304:8635]
2025-10-10T14:06:41.767335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:41.777616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:41.778601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:41.778621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:41.778670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:41.778953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:41.779140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594278452393290:7808]
2025-10-10T14:06:41.782679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:41.783952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:41.784214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:41.785575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:41.785905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:41.785914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:41.785921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:41.785928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:41.785937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:41.785943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:41.785950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:41.785957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:41.785964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:41.785970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:41.785976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:41.785983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:41.786030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:41.786137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:41.786185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:41.786233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:41.786275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:41.786322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:41.786365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:41.786407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:41.786449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:41.786492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:41.786534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:41.786577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:41.786617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:41.786702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:41.787553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:41.787622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:41.787671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:41.787724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:41.787768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:41.787822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:41.787868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:41.787919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:41.787962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:41.788030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:41.788073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:41.788125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:41.788170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:41.788221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:41.788270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:41.788319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:41.788364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:41.788434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:41.788490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:41.788541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:41.788583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:41.788634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:41.789067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:41.815917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:41.829495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:41.829536Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:41.829553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:41.829572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:41.829596Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 612 [2:7559594278452393290:7808]
2025-10-10T14:06:41.829652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:41.829718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:41.829734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:41.829746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:41.829758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:41.829804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:41.829825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:41.829848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:41.831111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:41.831125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:41.831139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:41.831151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:41.831161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:41.831429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:41.831445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:41.831574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:41.831746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:41.831954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:41.832671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 612
2025-10-10T14:06:41.832768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 612
2025-10-10T14:06:41.833055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 612, pipe: [1:7559594280030314304:8635]
2025-10-10T14:06:41.832077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:41.832150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:41.832165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:41.832176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:41.832186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:41.832230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:41.832309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:41.832505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:41.832518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:41.832537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:41.832548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:41.833271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:41.833290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:41.835359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 613 partition: 0 MaxSeqNo: 36 sessionId: src_id|c68b7061-f39701db-7ef65a3d-94e267db_0
2025-10-10T14:06:41.833437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594280030314200:2442], now have 1 active actors on pipe
2025-10-10T14:06:41.833470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594280030314259:8734], now have 1 active actors on pipe
2025-10-10T14:06:41.833490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594280030314304:8635], now have 1 active actors on pipe
2025-10-10T14:06:41.833548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:41.833568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:41.833601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:41.833630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:41.833751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c68b7061-f39701db-7ef65a3d-94e267db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:41.833781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:41.833798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:41.833808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:41.833842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:41.833883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:41.833960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:41.834061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:41.834975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:41.834995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:41.835062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:41.840622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177f1088-540824b7-e85144f2-897a0263_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c68b7061-f39701db-7ef65a3d-94e267db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:41.883077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68b7061-f39701db-7ef65a3d-94e267db_0] Write session: try to update token
2025-10-10T14:06:41.883145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68b7061-f39701db-7ef65a3d-94e267db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:41.933791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:41.933853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:41.933880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:42.033246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId: src_id|c68b7061-f39701db-7ef65a3d-94e267db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:42.104812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:42.126206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:42.126238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:42.126248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:42.126301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:42.126313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:42.126324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:42.126334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:42.126343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:42.126375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:42.126399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:42.126418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:42.126439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:42.126612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:42.126637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:42.126724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:42.126748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.126758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:42.127710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:42.128563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:42.128600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:42.128628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:42.128665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:42.275919Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:42.286008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:42.286037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:42.286083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594278452393285:7808]
2025-10-10T14:06:42.286300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:42.288707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594280030314304:8635]
2025-10-10T14:06:42.288834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:42.289027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:42.287211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:42.336307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 613 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c68b7061-f39701db-7ef65a3d-94e267db_0
2025-10-10T14:06:42.336676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 613 sessionId: src_id|c68b7061-f39701db-7ef65a3d-94e267db_0 is DEAD
2025-10-10T14:06:42.341819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68b7061-f39701db-7ef65a3d-94e267db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:42.341861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68b7061-f39701db-7ef65a3d-94e267db_0] Write session will restart in 0.006232s
2025-10-10T14:06:42.341960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68b7061-f39701db-7ef65a3d-94e267db_0] Write session: Do CDS request
2025-10-10T14:06:42.341992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68b7061-f39701db-7ef65a3d-94e267db_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:42.354269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68b7061-f39701db-7ef65a3d-94e267db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:42.354937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:42.354970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 614
2025-10-10T14:06:42.355379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:42.355513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:42.355531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:42.355540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:42.361979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 614 sessionId:  describe result for acl check
2025-10-10T14:06:42.362133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:42.362150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:42.362160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:42.362191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594284325281812:8743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:42.364478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594284325281812:8743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:42.376430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594284325281812:8743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:42.383007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:42.388668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594284325281812:8743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:42.388714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594284325281812:8743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:42.388731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594284325281812:8743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:42.388763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:42.389318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594284325281903:8635]
2025-10-10T14:06:42.388498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:42.392288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:42.392312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:42.392375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:42.392769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:42.392985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594282747360777:7813]
2025-10-10T14:06:42.395351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:42.396637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:42.396910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:42.398460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:42.398791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:42.398808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:42.398816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:42.398824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:42.398832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:42.398839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:42.398847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:42.398855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:42.398864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.398872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.398880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.398888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.398940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:42.399068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:42.399121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:42.399184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:42.399241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:42.399298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:42.399356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:42.399411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:42.399467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.399525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.399579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.399649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.399707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:42.399790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:42.399862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:42.399925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:42.400007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:42.400070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:42.400133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:42.400244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:42.400309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:42.400376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:42.400439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:42.400502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:42.400561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:42.400623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:42.400679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:42.400743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:42.400803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.400871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.400929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.400993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.401048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.401112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.401185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.401250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.401754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:42.442287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:42.470048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:42.470096Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:42.470116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:42.470138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:42.470163Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 613 [2:7559594282747360777:7813]
2025-10-10T14:06:42.470224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:42.470288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:42.470303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:42.470315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:42.470328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:42.470377Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:42.470398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:42.470422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:42.472299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.472329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.472345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.472360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.472372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:42.472654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:42.472680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.472843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.473068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.473496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.473644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:42.473741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594284325281721:2442], now have 1 active actors on pipe
2025-10-10T14:06:42.473775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594284325281903:8635], now have 1 active actors on pipe
2025-10-10T14:06:42.473798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594284325281902:8743], now have 1 active actors on pipe
2025-10-10T14:06:42.473832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594282747360770:7813]
2025-10-10T14:06:42.473860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594282747360770:7813]
2025-10-10T14:06:42.473879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594282747360770:7813]
2025-10-10T14:06:42.473895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594282747360770:7813]
2025-10-10T14:06:42.473930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:42.473963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:42.473990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:42.474001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:42.474014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:42.474016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:42.474215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:42.474241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:42.474324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:42.474350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:42.473258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 613
2025-10-10T14:06:42.474481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594282747360770:7813]
2025-10-10T14:06:42.474524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:42.473369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 613, pipe: [1:7559594284325281903:8635]
2025-10-10T14:06:42.473441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 613
2025-10-10T14:06:42.474597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:42.474629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:42.474649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:42.474660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:42.474694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:42.474732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:42.474866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:42.474977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:42.475997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:42.476028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:42.476096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:42.481397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 614 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0
2025-10-10T14:06:42.485601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68b7061-f39701db-7ef65a3d-94e267db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:42.547443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0] Write session: try to update token
2025-10-10T14:06:42.547502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:42.596407Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:42.596438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:42.596450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:42.596459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:42.596466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:42.596497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594282747360770:7813]
2025-10-10T14:06:42.596517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594282747360770:7813]
2025-10-10T14:06:42.598419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594282747360770:7813]
2025-10-10T14:06:42.598457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594282747360770:7813]
2025-10-10T14:06:42.598641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:42.598653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:42.598664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:42.598709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:42.598734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.598744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:42.598808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:42.598851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:42.598884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:42.598917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:42.600005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:42.700630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId: src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:42.722817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:42.757214Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:42.760762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:42.760795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:42.762358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:42.762541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594284325281903:8635]
2025-10-10T14:06:42.762673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:42.762688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:42.765362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:42.823029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:42.823101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0] Write session will restart in 0.008475s
2025-10-10T14:06:42.823225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0] Write session: Do CDS request
2025-10-10T14:06:42.823254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:42.821517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 614 reason: error at write: Disconnected sessionId: src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0
2025-10-10T14:06:42.821845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 614 sessionId: src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0 is DEAD
2025-10-10T14:06:42.845884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:42.866440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594284325282035:8635]
2025-10-10T14:06:42.866486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:42.866499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 615
2025-10-10T14:06:42.870470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:42.870606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:42.870622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:42.870633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:42.873968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 615 sessionId:  describe result for acl check
2025-10-10T14:06:42.874089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:42.874098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:42.874106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:42.874122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594284325282056:8754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:42.876562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594284325282056:8754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:42.903935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594284325282056:8754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:42.915450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594284325282056:8754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:42.915494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594284325282056:8754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:42.915513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594284325282056:8754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:42.915542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:42.926597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:42.929295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:42.930197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:42.930234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:42.930284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:42.930566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:42.930780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594282747360992:7822]
2025-10-10T14:06:42.933110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:42.934537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:42.934758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:42.935842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:42.936179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:42.936198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:42.936205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:42.936212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:42.936219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:42.936227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:42.936234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:42.936242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:42.936249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.936256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.936263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.936270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.936333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:42.936431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:42.936468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:42.936508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:42.936547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:42.936587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:42.936627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:42.936666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:42.936703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.936744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.936789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.936836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.936878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:42.936932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:42.936977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:42.937018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:42.937057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:42.937139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:42.937203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:42.937265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:42.937319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:42.937379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:42.937428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:42.937485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:42.937532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:42.937588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:42.937632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:42.937715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:42.937766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.937821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:42.937882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.937944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:42.937991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.938032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:42.938078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.938128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:42.938517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:42.972973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:42.990248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:42.990291Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:42.990307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:42.990325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:42.990346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 614 [2:7559594282747360992:7822]
2025-10-10T14:06:42.990399Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:42.990452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:42.990465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:42.990476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:42.990487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:42.990531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:42.990561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:42.990582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:43.011262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.011292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:43.011305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:43.011315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:43.011326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:43.011614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:43.011637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.011769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:43.011937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:43.012163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:43.012277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:43.012351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594284325281933:2442], now have 1 active actors on pipe
2025-10-10T14:06:43.012383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594284325282116:8754], now have 1 active actors on pipe
2025-10-10T14:06:43.012405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594284325282035:8635], now have 1 active actors on pipe
2025-10-10T14:06:43.012429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594282747360987:7822]
2025-10-10T14:06:43.012445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594282747360987:7822]
2025-10-10T14:06:43.012458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594282747360987:7822]
2025-10-10T14:06:43.012471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594282747360987:7822]
2025-10-10T14:06:43.012501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:43.012544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:43.012558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:43.012569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:43.012578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:43.012579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:43.012914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 614
2025-10-10T14:06:43.013672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 614
2025-10-10T14:06:43.013744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 614, pipe: [1:7559594284325282035:8635]
2025-10-10T14:06:43.012757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:43.012779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:43.012891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594282747360987:7822]
2025-10-10T14:06:43.012923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:43.013049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:43.014659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:43.014691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:43.014786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c26ab98f-76780081-6512b3d3-43927c6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:43.014841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:43.014859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:43.014868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:43.014942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:43.014991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:43.015036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:43.020288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:43.020325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:43.020398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:43.025482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 615 partition: 0 MaxSeqNo: 36 sessionId: src_id|c26ab98f-76780081-6512b3d3-43927c6e_0
2025-10-10T14:06:43.029370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5055e36-ce94f0ac-736d828c-ad55320f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c26ab98f-76780081-6512b3d3-43927c6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:43.075191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ab98f-76780081-6512b3d3-43927c6e_0] Write session: try to update token
2025-10-10T14:06:43.075250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ab98f-76780081-6512b3d3-43927c6e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:43.148594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:43.148625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:43.148634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:43.148686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:43.148697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:43.148709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:43.148718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:43.148729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:43.148761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594282747360987:7822]
2025-10-10T14:06:43.148783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594282747360987:7822]
2025-10-10T14:06:43.148805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594282747360987:7822]
2025-10-10T14:06:43.148825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594282747360987:7822]
2025-10-10T14:06:43.148955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:43.148979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.148989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:43.149306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:43.149336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:43.149364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:43.149391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:43.151880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:43.263382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId: src_id|c26ab98f-76780081-6512b3d3-43927c6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:43.285537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:43.318007Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:43.321612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:43.321656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:43.324729Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:43.323072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:43.323344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:43.323370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:43.323594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594284325282035:8635]
2025-10-10T14:06:43.387164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 615 reason: error at write: Disconnected sessionId: src_id|c26ab98f-76780081-6512b3d3-43927c6e_0
2025-10-10T14:06:43.387520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 615 sessionId: src_id|c26ab98f-76780081-6512b3d3-43927c6e_0 is DEAD
2025-10-10T14:06:43.391004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ab98f-76780081-6512b3d3-43927c6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:43.391075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ab98f-76780081-6512b3d3-43927c6e_0] Write session will restart in 0.006821s
2025-10-10T14:06:43.391238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ab98f-76780081-6512b3d3-43927c6e_0] Write session: Do CDS request
2025-10-10T14:06:43.391292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ab98f-76780081-6512b3d3-43927c6e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:43.403843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:43.403877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 616
2025-10-10T14:06:43.404789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ab98f-76780081-6512b3d3-43927c6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:43.405338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:43.405464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:43.405479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:43.405490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:43.407612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 616 sessionId:  describe result for acl check
2025-10-10T14:06:43.407734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:43.407744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:43.407753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:43.407770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594288620249493:8764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:43.410370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594288620249493:8764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:43.418476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594288620249493:8764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:43.425196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594288620249517:8635]
2025-10-10T14:06:43.433511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594288620249493:8764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:43.433554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594288620249493:8764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:43.433575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594288620249493:8764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:43.433608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:43.496692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:43.502527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:43.503448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:43.503470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:43.503520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:43.503806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:43.504014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594287042328505:7832]
2025-10-10T14:06:43.506740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:43.509489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:43.509745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:43.511023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:43.511358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:43.511366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:43.511373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:43.511380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:43.511386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:43.511392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:43.511398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:43.511405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:43.511411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.511416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:43.511422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:43.511429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:43.511476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:43.511584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:43.511631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:43.511678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:43.511721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:43.511767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:43.511810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:43.511855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:43.511901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.511968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:43.512012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:43.512054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:43.512097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:43.512161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:43.512221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:43.512274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:43.512317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:43.512352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:43.512385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:43.512421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:43.512453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:43.512489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:43.512520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:43.512555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:43.512588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:43.512622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:43.514367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:43.514446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:43.514500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.514551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.514600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:43.514659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:43.514708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:43.514766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:43.514816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:43.514876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:43.515312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:43.551844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:43.606395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:43.606436Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:43.606453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:43.606471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:43.606493Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 615 [2:7559594287042328505:7832]
2025-10-10T14:06:43.606545Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:43.606595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:43.606609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:43.606622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:43.606632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:43.606675Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:43.606695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:43.606716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:43.608621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.608637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:43.608650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:43.608664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:43.608676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:43.608947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:43.608964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.609108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:43.610187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:43.610433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:43.610562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:43.610643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594288620249522:8764], now have 1 active actors on pipe
2025-10-10T14:06:43.610668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594288620249517:8635], now have 1 active actors on pipe
2025-10-10T14:06:43.610689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594288620249456:2442], now have 1 active actors on pipe
2025-10-10T14:06:43.610714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.610729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.610746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.610760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.610796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:43.610874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:43.611057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:43.611075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:43.611193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.611212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:43.611967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:43.611987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:43.611999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:43.612414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 615
2025-10-10T14:06:43.612506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 615, pipe: [1:7559594288620249517:8635]
2025-10-10T14:06:43.612582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 615
2025-10-10T14:06:43.612010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:43.612033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:43.613209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:43.613251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:43.613359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:43.613390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:43.613408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:43.613419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:43.613454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:43.613491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:43.613542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:43.615067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:43.615097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:43.615163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:43.621416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 616 partition: 0 MaxSeqNo: 36 sessionId: src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0
2025-10-10T14:06:43.626169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26ab98f-76780081-6512b3d3-43927c6e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:43.674538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0] Write session: try to update token
2025-10-10T14:06:43.674599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:43.703384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:43.703417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:43.703458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.703588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:43.703975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:43.713659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:43.714971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:43.717391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:43.718624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:43.720302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:43.720708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:43.720728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:43.720739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:43.720796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:43.850749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId: src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:43.899277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:43.899310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:43.899323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:43.899333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:43.899342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:43.899383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.899410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.899432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.899456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594287042328500:7832]
2025-10-10T14:06:43.899581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:43.899614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:43.899615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:43.899625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:43.899634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:43.899636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:43.899650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:43.899681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:43.899705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:43.899717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:43.900728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:43.907012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:44.075538Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:44.080098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:44.080139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:44.081918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:44.081945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:44.082643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594288620249517:8635]
2025-10-10T14:06:44.082843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:44.084414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:44.099398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 616 reason: error at write: Disconnected sessionId: src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0
2025-10-10T14:06:44.100360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:44.100446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0] Write session will restart in 0.007893s
2025-10-10T14:06:44.100660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0] Write session: Do CDS request
2025-10-10T14:06:44.100727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:44.099757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 616 sessionId: src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0 is DEAD
2025-10-10T14:06:44.118704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:44.118740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 617
2025-10-10T14:06:44.120512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:44.121266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:44.121396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:44.121411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:44.121420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:44.123074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 617 sessionId:  describe result for acl check
2025-10-10T14:06:44.123192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:44.123202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:44.123211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:44.123228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594292915216992:8770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:44.129972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594292915216992:8770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:44.142959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594292915216992:8770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:44.154507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594292915216992:8770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:44.154550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594292915216992:8770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:44.154566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594292915216992:8770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:44.154597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:44.185780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594292915217122:8635]
2025-10-10T14:06:44.217642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:44.242020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:44.242877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:44.242897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:44.242949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:44.243230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:44.243424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594291337296013:7836]
2025-10-10T14:06:44.245942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:44.254212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:44.254503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:44.255807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:44.256177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:44.256194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:44.256200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:44.256206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:44.256212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:44.256219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:44.256225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:44.256231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:44.256238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.256243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.256249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.256255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.256297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:44.256401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:44.256449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:44.256494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:44.256539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:44.256582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:44.256625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:44.256670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:44.256713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.256756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.256796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.256839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.256876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:44.256937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:44.256992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:44.257059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:44.257110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:44.257264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:44.257312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:44.257361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:44.257407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:44.257458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:44.257504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:44.257568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:44.257617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:44.257669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:44.257724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:44.257771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:44.257815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.257868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.257911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.257963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.258005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.258053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.258092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.258137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.258536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:44.302663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:44.326899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:44.326944Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:44.326960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:44.326980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:44.327003Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 616 [2:7559594291337296013:7836]
2025-10-10T14:06:44.327054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:44.327109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:44.327125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:44.327137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:44.327150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:44.327197Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:44.327220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:44.327241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:44.351813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.351851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.351865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.351876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.351885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:44.352191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:44.352206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.352334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.352494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.352703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.352804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:44.352879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.352892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.352905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.352916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.352962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:44.353041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:44.353427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:44.353441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:44.353452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:44.353463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:44.353907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 616, pipe: [1:7559594292915217122:8635]
2025-10-10T14:06:44.354061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 616
2025-10-10T14:06:44.354145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 616
2025-10-10T14:06:44.353866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:44.353898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:44.354075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594292915217122:8635], now have 1 active actors on pipe
2025-10-10T14:06:44.354095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594292915217031:8770], now have 1 active actors on pipe
2025-10-10T14:06:44.354114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594292915216978:2442], now have 1 active actors on pipe
2025-10-10T14:06:44.354133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.354163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:44.354640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:44.355560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:44.355589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:44.355674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:44.355706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:44.355723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:44.355733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:44.355769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:44.355811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:44.355857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:44.359138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:44.359173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:44.359231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:44.359548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 617 partition: 0 MaxSeqNo: 36 sessionId: src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0
2025-10-10T14:06:44.361331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|628af069-6b5c5f98-c36b7644-fc31d4a1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:44.433247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:44.433277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:44.433288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:44.439913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0] Write session: try to update token
2025-10-10T14:06:44.439998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:44.538425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:44.538456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:44.538469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:44.538478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:44.538488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:44.538521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.538543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.538565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.538597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.538744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:44.538755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:44.538767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:44.541259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:44.541295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:44.541322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:44.541345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:44.595407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:44.595457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.595469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:44.601497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:44.620772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId: src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:44.652235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:44.793929Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:44.798674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:44.798709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:44.798755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594291337296003:7836]
2025-10-10T14:06:44.798904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:44.798931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:44.799575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:44.801062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594292915217122:8635]
2025-10-10T14:06:44.801173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:44.801186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:44.805791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:44.823507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:44.844465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 617 reason: error at write: Disconnected sessionId: src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0
2025-10-10T14:06:44.845253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:44.845318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0] Write session will restart in 0.009502s
2025-10-10T14:06:44.845468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0] Write session: Do CDS request
2025-10-10T14:06:44.845513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:44.844768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 617 sessionId: src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0 is DEAD
2025-10-10T14:06:44.862715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:44.862748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 618
2025-10-10T14:06:44.865780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:44.867600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:44.867751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:44.867768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:44.867777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:44.869346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 618 sessionId:  describe result for acl check
2025-10-10T14:06:44.869445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:44.869456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:44.869466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:44.869481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594292915217228:8784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:44.871960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594292915217228:8784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:44.880773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594292915217228:8784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:44.895303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594292915217228:8784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:44.895348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594292915217228:8784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:44.895366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594292915217228:8784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:44.895397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:44.901082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594292915217387:8635]
2025-10-10T14:06:44.907751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:44.916961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:44.917887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:44.917905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:44.917951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:44.918224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:44.918403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594291337296253:7850]
2025-10-10T14:06:44.920811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:44.921936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:44.922185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:44.923579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:44.923939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:44.923950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:44.923958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:44.923967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:44.923976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:44.923984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:44.923992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:44.924000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:44.924007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.924015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.924024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.924032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.924090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:44.924213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:44.924268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:44.924321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:44.924372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:44.924425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:44.924475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:44.924526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:44.924576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.924627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.924680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.924731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.924776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:44.924850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:44.924918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:44.924980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:44.925034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:44.925093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:44.925945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:44.926024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:44.926081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:44.926141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:44.926211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:44.926275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:44.926329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:44.926392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:44.926443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:44.926506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:44.926563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.926623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:44.926675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.926732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:44.926782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.926843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:44.926889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.926948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:44.927465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:44.968865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:45.003995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:45.004047Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:45.004066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:45.004087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:45.004111Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 617 [2:7559594291337296253:7850]
2025-10-10T14:06:45.004172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:45.004236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:45.004252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:45.004264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:45.004277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:45.004327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:45.004350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:45.004373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:45.007544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.007572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:45.007587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:45.007603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:45.007617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:45.007894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:45.007928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.008087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:45.008292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:45.008539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:45.008659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:45.008732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.008747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.008761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.008774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.008818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:45.008896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:45.009095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:45.009112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:45.009294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:45.009309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:45.009322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:45.009334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:45.010467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 617, pipe: [1:7559594292915217387:8635]
2025-10-10T14:06:45.010575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 617
2025-10-10T14:06:45.010652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 617
2025-10-10T14:06:45.010772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.010813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:45.010872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594292915217387:8635], now have 1 active actors on pipe
2025-10-10T14:06:45.010896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594292915217197:2442], now have 1 active actors on pipe
2025-10-10T14:06:45.010897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:45.010918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594292915217385:8784], now have 1 active actors on pipe
2025-10-10T14:06:45.011402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:45.011432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:45.011499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:45.011530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:45.011547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:45.011558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:45.011593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:45.011633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:45.011676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:45.013143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:45.013173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:45.013241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:45.018308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 618 partition: 0 MaxSeqNo: 36 sessionId: src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0
2025-10-10T14:06:45.022869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bbae5d2-bdb32824-274d98c0-7175abdc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:45.065001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0] Write session: try to update token
2025-10-10T14:06:45.065068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:45.126458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:45.126492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:45.126503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:45.126625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:45.126640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:45.126655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:45.126667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:45.126678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:45.126714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.126741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.126765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.126786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.129271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:45.129322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:45.129355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:45.129386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:45.144948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:45.145001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.145013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:45.146085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:45.208141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId: src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:45.231090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:45.304777Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:45.325917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:45.325954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:45.326005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594291337296247:7850]
2025-10-10T14:06:45.326161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:45.326187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:45.326994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594292915217387:8635]
2025-10-10T14:06:45.327087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:45.327228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:45.327239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:45.326727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:45.332067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:45.341524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 618 reason: error at write: Disconnected sessionId: src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0
2025-10-10T14:06:45.341881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 618 sessionId: src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0 is DEAD
2025-10-10T14:06:45.344840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:45.344943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0] Write session will restart in 0.005468s
2025-10-10T14:06:45.345041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0] Write session: Do CDS request
2025-10-10T14:06:45.345092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:45.373856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:45.375956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:45.375985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 619
2025-10-10T14:06:45.376379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:45.376513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:45.376529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:45.376540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:45.378113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 619 sessionId:  describe result for acl check
2025-10-10T14:06:45.378233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:45.378243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:45.378251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:45.378269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594297210184741:8790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:45.380780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594297210184741:8790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:45.387121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594297210184741:8790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:45.406908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594297210184741:8790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:45.406951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594297210184741:8790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:45.406981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594297210184741:8790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:45.407012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:45.427235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594297210184896:8635]
2025-10-10T14:06:45.451845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:45.459251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:45.460150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:45.460184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:45.460232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:45.460512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:45.460709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594295632263743:7855]
2025-10-10T14:06:45.470095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:45.473389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:45.473669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:45.474955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:45.475272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:45.475280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:45.475287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:45.475294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:45.475301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:45.475310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:45.475317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:45.475323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:45.475331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.475337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:45.475344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:45.475350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:45.475397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:45.475504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:45.475553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:45.475596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:45.475643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:45.475712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:45.475758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:45.475809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:45.475850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.475893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:45.475954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:45.475995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:45.476037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:45.476101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:45.476192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:45.476257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:45.476306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:45.476371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:45.476419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:45.476469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:45.476515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:45.476564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:45.476618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:45.476673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:45.476716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:45.476766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:45.476809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:45.476874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:45.476925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.476977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.477039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:45.477095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:45.480205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:45.480313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:45.480372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:45.480448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:45.480985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:45.503937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:45.558055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:45.558104Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:45.558122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:45.558144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:45.558170Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 618 [2:7559594295632263743:7855]
2025-10-10T14:06:45.558228Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:45.558291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:45.558307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:45.558321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:45.558332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:45.558385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:45.558408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:45.558432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:45.559817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.559832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:45.561028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 618, pipe: [1:7559594297210184896:8635]
2025-10-10T14:06:45.561176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 618
2025-10-10T14:06:45.561261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 618
2025-10-10T14:06:45.559846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:45.559860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:45.559871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:45.560163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:45.560180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.560320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:45.560495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:45.560727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:45.560836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:45.560919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594297210184896:8635], now have 1 active actors on pipe
2025-10-10T14:06:45.560941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594297210184717:2442], now have 1 active actors on pipe
2025-10-10T14:06:45.560962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594297210184817:8790], now have 1 active actors on pipe
2025-10-10T14:06:45.560987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.561002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.561014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.561027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.561096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:45.561107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:45.561117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:45.561146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:45.562086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:45.562190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:45.562379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:45.562398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:45.562474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:45.562496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:45.562624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.562655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:45.562729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:45.562760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:45.562778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:45.562788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:45.562824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:45.562868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:45.562991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:45.563424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:45.564327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:45.564354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:45.564420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:45.566297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 619 partition: 0 MaxSeqNo: 36 sessionId: src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0
2025-10-10T14:06:45.573376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7d5eae9-5cb3a554-39523ec1-8be05646_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:45.610911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0] Write session: try to update token
2025-10-10T14:06:45.610970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:45.691335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:45.691367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:45.691379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:45.691493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:45.691509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:45.691524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:45.691537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:45.691549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:45.691585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.691609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.691634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.691657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.693908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:45.693975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:45.694022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:45.694073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:45.704480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:45.704531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:45.704544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:45.705637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:45.764098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId: src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:45.788135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:45.862616Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:45.867860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:45.867911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:45.867955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594295632263738:7855]
2025-10-10T14:06:45.868094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:45.868108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:45.868131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:45.868871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:45.869316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594297210184896:8635]
2025-10-10T14:06:45.869402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:45.869533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:45.869544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:45.883865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 619 reason: error at write: Disconnected sessionId: src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0
2025-10-10T14:06:45.884206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 619 sessionId: src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0 is DEAD
2025-10-10T14:06:45.885356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:45.885408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0] Write session will restart in 0.009439s
2025-10-10T14:06:45.885534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0] Write session: Do CDS request
2025-10-10T14:06:45.885578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:45.919059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:45.920001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:45.920033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 620
2025-10-10T14:06:45.920342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:45.920469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:45.920491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:45.920501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:45.922070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 620 sessionId:  describe result for acl check
2025-10-10T14:06:45.922178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:45.922189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:45.922198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:45.922215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594297210184950:8799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:45.925646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594297210184950:8799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:45.945436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594297210184950:8799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:45.969359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594297210185047:8635]
2025-10-10T14:06:45.980792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594297210184950:8799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:45.980822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594297210184950:8799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:45.980834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594297210184950:8799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:45.980856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:46.021176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:46.027043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:46.027811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:46.027841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:46.027897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:46.028104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:46.028262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594299927231259:7864]
2025-10-10T14:06:46.030433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:46.031520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:46.031741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:46.033103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:46.033509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:46.033528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:46.033536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:46.033546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:46.033554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:46.033561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:46.033568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:46.033576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:46.033584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.033592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.033601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.033609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.033666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:46.033794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:46.033851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:46.033900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:46.033950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:46.034002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:46.034053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:46.034106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:46.034152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.034202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.034252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.034302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.034357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:46.034428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:46.034490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:46.034548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:46.034602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:46.034659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:46.034716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:46.034774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:46.034828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:46.034889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:46.034946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:46.035012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:46.035066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:46.035123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:46.035178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:46.035238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:46.035298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.035357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.035412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.035475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.035524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.035584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.035634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.035693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.036209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:46.065036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:46.081372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:46.081415Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:46.081432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:46.081451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:46.081475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 619 [2:7559594299927231259:7864]
2025-10-10T14:06:46.081528Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:46.081582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:46.081596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:46.081609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:46.081621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:46.081667Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:46.081690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:46.081710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:46.100994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.101024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.101038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.101203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.101219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:46.101531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:46.101551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.101957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.102159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.102443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 619, pipe: [1:7559594297210185047:8635]
2025-10-10T14:06:46.102581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 619
2025-10-10T14:06:46.103146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 619
2025-10-10T14:06:46.102385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.102517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:46.102602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594297210185070:8799], now have 1 active actors on pipe
2025-10-10T14:06:46.102628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594297210185047:8635], now have 1 active actors on pipe
2025-10-10T14:06:46.102650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594297210184925:2442], now have 1 active actors on pipe
2025-10-10T14:06:46.102674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.102690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.102704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.102718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.102760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:46.102840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:46.103023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:46.103040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:46.103186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.103208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:46.103422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:46.103440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:46.103452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:46.103465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:46.103495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:46.104230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:46.104266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:46.104340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:46.104370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:46.104388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:46.104398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:46.104433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:46.104477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:46.104531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:46.108692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:46.108736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:46.108821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:46.109551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 620 partition: 0 MaxSeqNo: 36 sessionId: src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0
2025-10-10T14:06:46.111484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f482c4-2821d75-42bc3b38-cc7b2dec_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:46.136885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0] Write session: try to update token
2025-10-10T14:06:46.136942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:46.263593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:46.263630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:46.263643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:46.263754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:46.263770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:46.263785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:46.263797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:46.263810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:46.263846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.263874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.263916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.263941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.265246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:46.265295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:46.265330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:46.265363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:46.305329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId: src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:46.336232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:46.336314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.336339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:46.338657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:46.347279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:46.487795Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:46.490666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:46.490695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:46.490741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594299927231254:7864]
2025-10-10T14:06:46.490887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:46.490913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:46.491226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:46.492350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:46.492812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:46.492845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:46.503284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594297210185047:8635]
2025-10-10T14:06:46.503419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:46.514188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 620 reason: error at write: Disconnected sessionId: src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0
2025-10-10T14:06:46.514494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 620 sessionId: src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0 is DEAD
2025-10-10T14:06:46.518270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:46.518334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0] Write session will restart in 0.008215s
2025-10-10T14:06:46.518503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0] Write session: Do CDS request
2025-10-10T14:06:46.518553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:46.541767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:46.541610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:46.541643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 621
2025-10-10T14:06:46.542228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:46.542354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:46.542371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:46.542380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:46.543853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 621 sessionId:  describe result for acl check
2025-10-10T14:06:46.543992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:46.544004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:46.544014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:46.544030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594301505152486:8813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:46.547899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594301505152486:8813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:46.565614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594301505152486:8813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:46.585503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594301505152486:8813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:46.585551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594301505152486:8813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:46.585569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594301505152486:8813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:46.585598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:46.608485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594301505152632:8635]
2025-10-10T14:06:46.622385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:46.628507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:46.629425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:46.629455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:46.629500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:46.629781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:46.629970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594299927231483:7872]
2025-10-10T14:06:46.632288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:46.634133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:46.634322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:46.635346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:46.635602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:46.635611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:46.635619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:46.635627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:46.635636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:46.635644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:46.635650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:46.635657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:46.635664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.635672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.635680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.635687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.635737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:46.635855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:46.635920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:46.635972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:46.636034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:46.636085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:46.636133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:46.636182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:46.636231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.636280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.636324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.636371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.636416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:46.636487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:46.636549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:46.636619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:46.636671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:46.636729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:46.636779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:46.636836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:46.636889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:46.636950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:46.637001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:46.637057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:46.637109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:46.637191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:46.637243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:46.637304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:46.637358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.637419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.637469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.637526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.637578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.637638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.637689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.637748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.638239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:46.662594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:46.675510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:46.675560Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:46.675579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:46.675601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:46.675625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 620 [2:7559594299927231483:7872]
2025-10-10T14:06:46.675687Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:46.675750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:46.675766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:46.675780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:46.675793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:46.675841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:46.675863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:46.675901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:46.743841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.743889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.743900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.743911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.743921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:46.744230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:46.744248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.744394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:46.744578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:46.744863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:46.744998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:46.745079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594299927231477:7872]
2025-10-10T14:06:46.745095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594299927231477:7872]
2025-10-10T14:06:46.745109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594299927231477:7872]
2025-10-10T14:06:46.745142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594299927231477:7872]
2025-10-10T14:06:46.745191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:46.745282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:46.745405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:46.745422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:46.745434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:46.745447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:46.745505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:46.745526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:46.745674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594299927231477:7872]
2025-10-10T14:06:46.745703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:46.745720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:46.745889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594301505152461:2442], now have 1 active actors on pipe
2025-10-10T14:06:46.745916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594301505152632:8635], now have 1 active actors on pipe
2025-10-10T14:06:46.745939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594301505152567:8813], now have 1 active actors on pipe
2025-10-10T14:06:46.747256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:46.747284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:46.747368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:46.747406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:46.747426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:46.747438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:46.747477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:46.747524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:46.747570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:46.746005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 620
2025-10-10T14:06:46.746109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 620, pipe: [1:7559594301505152632:8635]
2025-10-10T14:06:46.746191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 620
2025-10-10T14:06:46.751169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 621 partition: 0 MaxSeqNo: 36 sessionId: src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0
2025-10-10T14:06:46.753521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd55d37-90f11b94-f7daa9d5-1712a2b7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:46.750602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:46.750661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:46.750770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:46.774740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0] Write session: try to update token
2025-10-10T14:06:46.774806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:46.776421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:46.776455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:46.776468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:06:46.835925914  106874 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:06:46.936592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:46.936626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:46.936640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:46.936698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:46.936712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:46.936725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:46.936737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:46.936748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:46.936787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594299927231477:7872]
2025-10-10T14:06:46.936815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594299927231477:7872]
2025-10-10T14:06:46.936838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594299927231477:7872]
2025-10-10T14:06:46.936861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594299927231477:7872]
2025-10-10T14:06:46.937021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:46.937047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:46.937060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:46.937272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:46.937305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:46.937338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:46.937365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:46.939270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:46.976851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId: src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:46.998735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:47.106845Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:47.109253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:47.109297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:47.111755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:47.111918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594301505152632:8635]
2025-10-10T14:06:47.111996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:47.112007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:47.124030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:47.124070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0] Write session will restart in 0.008990s
2025-10-10T14:06:47.124168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0] Write session: Do CDS request
2025-10-10T14:06:47.124195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:47.124786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:47.119519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 621 reason: error at write: Disconnected sessionId: src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0
2025-10-10T14:06:47.119828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 621 sessionId: src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0 is DEAD
2025-10-10T14:06:47.138283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:47.138443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:47.138476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 622
2025-10-10T14:06:47.138902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:47.139066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:47.139083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:47.139094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:47.140646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 622 sessionId:  describe result for acl check
2025-10-10T14:06:47.140777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:47.140790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:47.140802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:47.140819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594305800120001:8819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:47.143618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594305800120001:8819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:47.157659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594305800120001:8819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:47.192542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594305800120001:8819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:47.192589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594305800120001:8819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:47.192609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594305800120001:8819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:47.192640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:47.215964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:47.217411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594305800120177:8635]
2025-10-10T14:06:47.223149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:47.224000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:47.224017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:47.224061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:47.224313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:47.224714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594304222198990:7878]
2025-10-10T14:06:47.226968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:47.227886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:47.228066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:47.229078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:47.229437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:47.229457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:47.229463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:47.229470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:47.229477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:47.229484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:47.229491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:47.229498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:47.229507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.229513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.229519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.229526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.229575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:47.229684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:47.229748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:47.229804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:47.229858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:47.229906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:47.229948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:47.229985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:47.230019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.230056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.230099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.230136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.230165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:47.230209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:47.230257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:47.230300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:47.230343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:47.230388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:47.230425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:47.230462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:47.230502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:47.230543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:47.230579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:47.230628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:47.230666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:47.230708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:47.230742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:47.230783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:47.230820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.230871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.230907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.230961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.230998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.231569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.231630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.231689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.232114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:47.254105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:47.268029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:47.268074Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:47.268092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:47.268111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:47.268136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 621 [2:7559594304222198990:7878]
2025-10-10T14:06:47.268189Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:47.268249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:47.268264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:47.268276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:47.268288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:47.268333Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:47.268354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:47.268376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:47.289909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.289937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.289950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.289963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.289974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:47.290257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:47.290272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.290408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.290577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.290787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.290896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:47.290966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.290981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.290994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.291006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.291047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:47.291128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:47.291297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:47.291313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:47.291435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.291452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:47.292982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:47.293001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:47.293013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:47.293024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:47.293046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:47.293764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594305800120177:8635], now have 1 active actors on pipe
2025-10-10T14:06:47.293794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594305800120123:8819], now have 1 active actors on pipe
2025-10-10T14:06:47.293815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594305800119981:2442], now have 1 active actors on pipe
2025-10-10T14:06:47.293842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 621, pipe: [1:7559594305800120177:8635]
2025-10-10T14:06:47.293961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 621
2025-10-10T14:06:47.294030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 621
2025-10-10T14:06:47.294758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:47.294798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:47.294885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:47.294920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:47.294939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:47.294950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:47.294991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:47.295035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:47.295086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:47.298274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:47.298306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:47.298379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:47.298787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 622 partition: 0 MaxSeqNo: 36 sessionId: src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0
2025-10-10T14:06:47.299804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ce7f0d-a522c358-d7b8e20b-b764f36a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:47.366747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0] Write session: try to update token
2025-10-10T14:06:47.366805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:47.391312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:47.391343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:47.391354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:47.391408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:47.391422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:47.391459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.391580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:47.391615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:47.398714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:47.400150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:47.401406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:47.403141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:47.404629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:47.405148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:47.489919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:47.489949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:47.489972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:47.554211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:47.554243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:47.554255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:47.554266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:47.554276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:47.554317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.554340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.554372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.554396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594304222198984:7878]
2025-10-10T14:06:47.554550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:47.554555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:47.554576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.554588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:47.554596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:47.554630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:47.554661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:47.571773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:47.581335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId: src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:47.608352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:47.734600Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:47.742079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:47.742125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:47.742804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:47.742703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594305800120177:8635]
2025-10-10T14:06:47.742813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:47.742822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:47.801438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:47.801485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0] Write session will restart in 0.008165s
2025-10-10T14:06:47.801586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0] Write session: Do CDS request
2025-10-10T14:06:47.801617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:47.797832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 622 reason: error at write: Disconnected sessionId: src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0
2025-10-10T14:06:47.798130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 622 sessionId: src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0 is DEAD
2025-10-10T14:06:47.822638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:47.822796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:47.822810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 623
2025-10-10T14:06:47.826061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:47.826834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:47.826991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:47.827012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:47.827023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:47.830004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 623 sessionId:  describe result for acl check
2025-10-10T14:06:47.830116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:47.830128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:47.830141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:47.830158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594305800120283:8830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:47.832757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594305800120283:8830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:47.845440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594305800120311:8635]
2025-10-10T14:06:47.865200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594305800120283:8830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:47.882170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594305800120283:8830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:47.882217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594305800120283:8830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:47.882235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594305800120283:8830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:47.882268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:47.892075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:47.902963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:47.903922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:47.903936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:47.903970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:47.904200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:47.904411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594304222199231:7886]
2025-10-10T14:06:47.906307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:47.907307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:47.907481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:47.908438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:47.908665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:47.908670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:47.908675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:47.908682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:47.908688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:47.908694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:47.908699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:47.908704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:47.908709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.908715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.908720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.908726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.908762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:47.908866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:47.908907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:47.908949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:47.908988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:47.909027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:47.909062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:47.909098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:47.909170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.909231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.909292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.909345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.909391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:47.909468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:47.909532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:47.909596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:47.909655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:47.909719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:47.910161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:47.910254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:47.910318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:47.910379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:47.910421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:47.910466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:47.910503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:47.910568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:47.910605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:47.910653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:47.910691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.910735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.910772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.910816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.910863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.910919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.910957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.911002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.911441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:47.971166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:47.985906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:47.985938Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:47.985951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:47.985965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:47.985983Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 622 [2:7559594304222199231:7886]
2025-10-10T14:06:47.986024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:47.986069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:47.986082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:47.986094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:47.986107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:47.986154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:47.986177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:47.986199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:47.988054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.988065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.988073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.988082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.988089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:47.988278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:47.988290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:47.988389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:47.988521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:47.988678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:47.988758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:47.988800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:47.988810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:47.988818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:47.988827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:47.988853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:47.988907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:47.989049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:47.989060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:47.989211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:47.989234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:47.989812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:47.989827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:47.989839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:47.989852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:47.989877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:47.991233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594305800120270:2442], now have 1 active actors on pipe
2025-10-10T14:06:47.991277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594305800120311:8635], now have 1 active actors on pipe
2025-10-10T14:06:47.991301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594305800120394:8830], now have 1 active actors on pipe
2025-10-10T14:06:47.991938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:47.991972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:47.992063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:47.992097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:47.992115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:47.992125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:47.992162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:47.992207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:47.992258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:47.991468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 622
2025-10-10T14:06:47.991567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 622
2025-10-10T14:06:47.991633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 622, pipe: [1:7559594305800120311:8635]
2025-10-10T14:06:47.993860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:47.993891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:47.993957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:47.997184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9da63ad-b21d503-57d0499a-5d6b7387_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:47.994324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 623 partition: 0 MaxSeqNo: 36 sessionId: src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0
2025-10-10T14:06:48.057841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0] Write session: try to update token
2025-10-10T14:06:48.057908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:48.087068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:48.087110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:48.087120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:48.253992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:48.254030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:48.254045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:48.254056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:48.254068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:48.254107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:48.254135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:48.254158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:48.254181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:48.254353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:48.254365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:48.254377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:48.254480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:48.254506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:48.254518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:48.255505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:48.257287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:48.257333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:48.257365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:48.257392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:48.287465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId: src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:48.342137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:48.467448Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:48.477545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:48.477600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:48.477676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:48.477689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:48.477732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594304222199225:7886]
2025-10-10T14:06:48.477872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:48.478336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:48.482007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:48.482152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594305800120311:8635]
2025-10-10T14:06:48.482234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:48.492721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 623 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0
2025-10-10T14:06:48.493071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 623 sessionId: src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0 is DEAD
2025-10-10T14:06:48.497058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:48.497101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0] Write session will restart in 0.006702s
2025-10-10T14:06:48.497232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0] Write session: Do CDS request
2025-10-10T14:06:48.497262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:48.509202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:48.509773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:48.509808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 624
2025-10-10T14:06:48.510218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:48.510340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:48.510356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:48.510366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:48.520936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 624 sessionId:  describe result for acl check
2025-10-10T14:06:48.521069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:48.521080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:48.521092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:48.521110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594310095087752:8840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:48.523982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594310095087752:8840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:48.548425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594310095087752:8840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:48.575221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594310095087752:8840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:48.575273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594310095087752:8840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:48.575291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594310095087752:8840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:48.575323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:48.582658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594310095087862:8635]
2025-10-10T14:06:48.625113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:48.628435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:48.629358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:48.629376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:48.629424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:48.629693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:48.629903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594308517166735:7897]
2025-10-10T14:06:48.632033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:48.633429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:48.633666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:48.635203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:48.635528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:48.635537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:48.635543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:48.635549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:48.635556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:48.635563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:48.635570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:48.635577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:48.635583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:48.635591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:48.635597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:48.635604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:48.635652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:48.635756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:48.635803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:48.635867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:48.635911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:48.635958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:48.636001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:48.636048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:48.636088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:48.636134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:48.636177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:48.636224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:48.636266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:48.636330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:48.636434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:48.636489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:48.636538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:48.636591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:48.636634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:48.636685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:48.636733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:48.636783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:48.636826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:48.636880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:48.636929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:48.636979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:48.637021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:48.637070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:48.637113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:48.642617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:48.642708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:48.642780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:48.642839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:48.642894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:48.642946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:48.643004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:48.643466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:48.676002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:48.735496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:48.735546Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:48.735564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:48.735585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:48.735611Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 623 [2:7559594308517166735:7897]
2025-10-10T14:06:48.735665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:48.735727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:48.735742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:48.735754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:48.735767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:48.735828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:48.735864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:48.735892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:48.737045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:48.737062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:48.737077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:48.737090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:48.737103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:48.737408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:48.737424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:48.737566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:48.738521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 623
2025-10-10T14:06:48.738523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 623
2025-10-10T14:06:48.738636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 623, pipe: [1:7559594310095087862:8635]
2025-10-10T14:06:48.738462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:48.738701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:48.739149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:48.739244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594310095087743:2442], now have 1 active actors on pipe
2025-10-10T14:06:48.739268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594310095087862:8635], now have 1 active actors on pipe
2025-10-10T14:06:48.739292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594310095087838:8840], now have 1 active actors on pipe
2025-10-10T14:06:48.739333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:48.739354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:48.739406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594308517166730:7897]
2025-10-10T14:06:48.739420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594308517166730:7897]
2025-10-10T14:06:48.739444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594308517166730:7897]
2025-10-10T14:06:48.739456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594308517166730:7897]
2025-10-10T14:06:48.739490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:48.739570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:48.739737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:48.739753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:48.739829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|889eb616-17671ce0-bca0b407-9878c9f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:48.739860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:48.739877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:48.739888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:48.739921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:48.739964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:48.740093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594308517166730:7897]
2025-10-10T14:06:48.740114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:48.740155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:48.741168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:48.741189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:48.741202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:48.741215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:48.741246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:48.741736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:48.741764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:48.741826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:48.742415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 624 partition: 0 MaxSeqNo: 36 sessionId: src_id|889eb616-17671ce0-bca0b407-9878c9f4_0
2025-10-10T14:06:48.745194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2968fcbc-609fd353-7e8ff911-27f5681a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|889eb616-17671ce0-bca0b407-9878c9f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:48.780950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|889eb616-17671ce0-bca0b407-9878c9f4_0] Write session: try to update token
2025-10-10T14:06:48.781012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|889eb616-17671ce0-bca0b407-9878c9f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:48.832228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:48.832264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:48.832275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:48.832285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:48.832293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:48.832326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594308517166730:7897]
2025-10-10T14:06:48.832345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594308517166730:7897]
2025-10-10T14:06:48.832363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594308517166730:7897]
2025-10-10T14:06:48.832378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594308517166730:7897]
2025-10-10T14:06:48.832518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:48.832541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:48.832548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:48.832829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:48.832868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:48.832899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:48.832927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:48.834656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:48.921462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId: src_id|889eb616-17671ce0-bca0b407-9878c9f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:48.952557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:49.004666Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:49.021228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:49.021274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:49.029265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:49.029423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594310095087862:8635]
2025-10-10T14:06:49.029501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:49.029516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:49.053439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889eb616-17671ce0-bca0b407-9878c9f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:49.053515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889eb616-17671ce0-bca0b407-9878c9f4_0] Write session will restart in 0.005643s
2025-10-10T14:06:49.053691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889eb616-17671ce0-bca0b407-9878c9f4_0] Write session: Do CDS request
2025-10-10T14:06:49.053750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889eb616-17671ce0-bca0b407-9878c9f4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:49.051537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 624 reason: error at write: Disconnected sessionId: src_id|889eb616-17671ce0-bca0b407-9878c9f4_0
2025-10-10T14:06:49.051874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 624 sessionId: src_id|889eb616-17671ce0-bca0b407-9878c9f4_0 is DEAD
2025-10-10T14:06:49.091327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:49.121443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:49.121476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 625
2025-10-10T14:06:49.122213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|889eb616-17671ce0-bca0b407-9878c9f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:49.125387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:49.125539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:49.125555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:49.125566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:49.130546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 625 sessionId:  describe result for acl check
2025-10-10T14:06:49.130680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:49.130691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:49.130702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:49.130720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594314390055271:8845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:49.133786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594314390055273:8635]
2025-10-10T14:06:49.133844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594314390055271:8845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:49.158824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594314390055271:8845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:49.197892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594314390055271:8845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:49.197940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594314390055271:8845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:49.197957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594314390055271:8845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:49.197988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:49.234056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:49.242039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:49.242936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:49.242956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:49.243000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:49.243300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:49.243514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594312812134259:7906]
2025-10-10T14:06:49.245962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:49.247179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:49.247405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:49.248656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:49.248979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:49.248988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:49.248995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:49.249003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:49.249010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:49.249018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:49.249025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:49.249033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:49.249041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.249048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.249056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.249064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.249114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:49.249246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:49.249300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:49.249348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:49.249397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:49.249448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:49.249496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:49.249561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:49.249613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.249662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.249709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.249758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.249800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:49.249869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:49.249935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:49.249993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:49.250045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:49.250105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:49.250155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:49.250211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:49.250262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:49.250318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:49.250365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:49.250420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:49.250472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:49.250530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:49.250582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:49.250639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:49.250691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.250746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.250794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.250852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.250900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.250955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.251001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.251054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.251564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:49.287544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:49.312145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:49.312194Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:49.312211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:49.312233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:49.312259Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 624 [2:7559594312812134259:7906]
2025-10-10T14:06:49.312316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:49.312375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:49.312391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:49.312404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:49.312416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:49.312461Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:49.312485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:49.312508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:49.315516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.315547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.315562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.315578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.315590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:49.315881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:49.315898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.316048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.316242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.316484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.316610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:49.316681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.316696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.316710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.316723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.316766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:49.316847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:49.317029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:49.317047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:49.317696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:49.317716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:49.317727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:49.317741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:49.318242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.318275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:49.318331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594314390055273:8635], now have 1 active actors on pipe
2025-10-10T14:06:49.318374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594314390055385:8845], now have 1 active actors on pipe
2025-10-10T14:06:49.318403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594314390055257:2442], now have 1 active actors on pipe
2025-10-10T14:06:49.318686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:49.322995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 624, pipe: [1:7559594314390055273:8635]
2025-10-10T14:06:49.323103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 624
2025-10-10T14:06:49.323168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 624
2025-10-10T14:06:49.327097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:49.327143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:49.327257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:49.327291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:49.327311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:49.327323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:49.327373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:49.327441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:49.327538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:49.329878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:49.329926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:49.330010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:49.330565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 625 partition: 0 MaxSeqNo: 36 sessionId: src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0
2025-10-10T14:06:49.331464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|889eb616-17671ce0-bca0b407-9878c9f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:49.414278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:49.414315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:49.414328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:49.467304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0] Write session: try to update token
2025-10-10T14:06:49.467385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:49.536300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:49.536338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:49.536351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:49.536362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:49.536374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:49.536409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.536437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.536465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.536488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.536655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:49.536667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:49.536680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:49.536778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:49.536803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.536815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:49.536971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:49.537004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:49.537035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:49.537065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:49.542286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:49.668021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId: src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:49.698335Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:49.707949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:49.738062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:49.738094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:49.738138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594312812134254:7906]
2025-10-10T14:06:49.739024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:49.740497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594314390055273:8635]
2025-10-10T14:06:49.740587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:49.740598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:49.759565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 625 reason: error at write: Disconnected sessionId: src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0
2025-10-10T14:06:49.759974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 625 sessionId: src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0 is DEAD
2025-10-10T14:06:49.761593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:49.761628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0] Write session will restart in 0.008744s
2025-10-10T14:06:49.761726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0] Write session: Do CDS request
2025-10-10T14:06:49.761754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:49.786083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:49.801300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:49.801437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:49.801452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 626
2025-10-10T14:06:49.805629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:49.805786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:49.805802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:49.805813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:49.807245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 626 sessionId:  describe result for acl check
2025-10-10T14:06:49.807357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:49.807366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:49.807375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:49.807391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594314390055509:8857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:49.810189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594314390055509:8857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:49.823383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594314390055509:8857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:49.841698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594314390055626:8635]
2025-10-10T14:06:49.858821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594314390055509:8857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:49.858863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594314390055509:8857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:49.858881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594314390055509:8857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:49.858915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:49.881777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:49.891010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:49.894912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:49.894947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:49.894993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:49.895283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:49.895451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594312812134485:7914]
2025-10-10T14:06:49.897091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:49.903294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:49.903616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:49.905085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:49.905486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:49.905496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:49.905504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:49.905511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:49.905519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:49.905526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:49.905534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:49.905542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:49.905550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.905557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.905564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.905572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.905625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:49.905748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:49.905803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:49.905860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:49.905911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:49.905963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:49.906022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:49.906075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:49.906126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.906178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.906229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.906282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.906329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:49.906403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:49.906467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:49.906530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:49.906585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:49.906647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:49.906697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:49.906759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:49.906815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:49.906876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:49.906927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:49.906985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:49.907039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:49.907098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:49.907150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:49.907211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:49.907265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.907326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.907377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.907435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.907489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.907548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.907598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.907655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.908172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:49.943872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:49.991447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:49.991494Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:49.991513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:49.991534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:49.991559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 625 [2:7559594312812134485:7914]
2025-10-10T14:06:49.991620Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:49.991692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:49.991709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:49.991721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:49.991733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:49.991794Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:49.991817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:49.991839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:49.993456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.993481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.993497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.993511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.993521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:49.993802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:49.993821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:49.993971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:49.994162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:49.994416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:49.994547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:49.994631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594314390055681:8857], now have 1 active actors on pipe
2025-10-10T14:06:49.994658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594314390055626:8635], now have 1 active actors on pipe
2025-10-10T14:06:49.994683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594314390055505:2442], now have 1 active actors on pipe
2025-10-10T14:06:49.994709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:49.994725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:49.994741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:49.994756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:49.994796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:49.994837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:49.994855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:49.994867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:49.994877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:49.994879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:49.995072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:49.995088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:49.995209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:49.995250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:49.995319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:49.995397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:49.995419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:49.995472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16bbf040-178d7029-154d103f-366c3bf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:49.995496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:49.995510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:49.995519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:49.995543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:49.995571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:49.995600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:49.994971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 625, pipe: [1:7559594314390055626:8635]
2025-10-10T14:06:49.995107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 625
2025-10-10T14:06:49.995199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 625
2025-10-10T14:06:49.996720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:49.996752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:49.996833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:49.997811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 626 partition: 0 MaxSeqNo: 36 sessionId: src_id|16bbf040-178d7029-154d103f-366c3bf6_0
2025-10-10T14:06:50.000201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e32bf8c-9342ae87-6e59b466-6153a9a2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16bbf040-178d7029-154d103f-366c3bf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:50.043111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16bbf040-178d7029-154d103f-366c3bf6_0] Write session: try to update token
2025-10-10T14:06:50.043173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16bbf040-178d7029-154d103f-366c3bf6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:50.204480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId: src_id|16bbf040-178d7029-154d103f-366c3bf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:50.215488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:50.215542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:50.215554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:50.215608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:50.215621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:50.215632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:50.215642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:50.215652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:50.215685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:50.215711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:50.215735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:50.215756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:50.215977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:50.216010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:50.216021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:50.216677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:50.216710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:50.216731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:50.216749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:50.223479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:50.248098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:50.391315Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:50.418861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:50.418915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:50.418996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:50.419012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:50.419059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594312812134480:7914]
2025-10-10T14:06:50.419473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:50.419704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:50.420700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:50.423344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594314390055626:8635]
2025-10-10T14:06:50.423488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:50.466876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 626 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16bbf040-178d7029-154d103f-366c3bf6_0
2025-10-10T14:06:50.467211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 626 sessionId: src_id|16bbf040-178d7029-154d103f-366c3bf6_0 is DEAD
2025-10-10T14:06:50.469704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bbf040-178d7029-154d103f-366c3bf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:50.469742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bbf040-178d7029-154d103f-366c3bf6_0] Write session will restart in 0.005042s
2025-10-10T14:06:50.469845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bbf040-178d7029-154d103f-366c3bf6_0] Write session: Do CDS request
2025-10-10T14:06:50.469876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bbf040-178d7029-154d103f-366c3bf6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:50.480912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16bbf040-178d7029-154d103f-366c3bf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:50.481001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:50.481034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 627
2025-10-10T14:06:50.481511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:50.481652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:50.481667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:50.481677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:50.483269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 627 sessionId:  describe result for acl check
2025-10-10T14:06:50.483383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:50.483394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:50.483405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:50.483421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594318685023058:8867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:50.486427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594318685023058:8867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:50.523084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594318685023112:8635]
2025-10-10T14:06:50.526241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594318685023058:8867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:50.551214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594318685023058:8867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:50.551266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594318685023058:8867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:50.551285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594318685023058:8867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:50.551321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:50.608389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:50.620072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:50.621017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:50.621054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:50.621098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:50.621401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:50.621624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594317107101998:7920]
2025-10-10T14:06:50.623981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:50.624976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:50.625236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:50.626499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:50.626826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:50.626842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:50.626849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:50.626858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:50.626864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:50.626873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:50.626881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:50.626889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:50.626897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:50.626905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:50.626911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:50.626920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:50.626973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:50.627089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:50.627141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:50.627199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:50.627253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:50.627307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:50.627359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:50.627413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:50.627468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:50.627523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:50.627582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:50.627630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:50.627674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:50.627743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:50.627823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:50.627881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:50.627935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:50.627998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:50.628053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:50.628112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:50.628167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:50.628226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:50.628274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:50.628333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:50.628385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:50.628441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:50.628501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:50.628566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:50.628627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:50.628686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:50.628734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:50.628791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:50.628843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:50.628900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:50.628949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:50.629008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:50.629527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:50.664307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:50.678169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:50.678203Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:50.678217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:50.678232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:50.678251Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 626 [2:7559594317107101998:7920]
2025-10-10T14:06:50.678304Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:50.678351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:50.678362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:50.678371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:50.678379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:50.678412Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:50.678427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:50.678442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:50.716833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:50.716864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:50.716877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:50.716888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:50.716899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:50.717878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 626, pipe: [1:7559594318685023112:8635]
2025-10-10T14:06:50.717992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 626
2025-10-10T14:06:50.718085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 626
2025-10-10T14:06:50.717364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:50.717387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:50.717518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:50.717682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:50.717889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:50.717998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:50.718072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594318685023112:8635], now have 1 active actors on pipe
2025-10-10T14:06:50.718095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594318685023035:2442], now have 1 active actors on pipe
2025-10-10T14:06:50.718116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594318685023158:8867], now have 1 active actors on pipe
2025-10-10T14:06:50.718140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:50.718155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:50.718168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:50.718181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:50.718211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:50.718229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:50.718242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:50.718252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:50.718263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:50.718284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:50.718457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:50.718474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:50.718540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:50.718561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:50.718676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:50.718707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:50.718776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:50.718804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:50.718822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:50.718832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:50.718863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:50.718901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:50.719024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:50.719025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:50.720329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:50.720360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:50.720428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:50.721294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 627 partition: 0 MaxSeqNo: 36 sessionId: src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0
2025-10-10T14:06:50.725378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bbf040-178d7029-154d103f-366c3bf6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:50.764973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0] Write session: try to update token
2025-10-10T14:06:50.765015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:50.820083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:50.820112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:50.820125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:50.820231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:50.820246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:50.820260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:50.820271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:50.820283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:50.820324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:50.820359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:50.820386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:50.820409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:50.820733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:50.820767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:50.820796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:50.820824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:50.861361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:50.861429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:50.861445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:50.862740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:50.913279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId: src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:50.946084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:51.013362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:51.032192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:51.032226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:51.032267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594317107101992:7920]
2025-10-10T14:06:51.032396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:51.032410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:51.032433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:51.033905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594318685023112:8635]
2025-10-10T14:06:51.033976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:51.034082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:51.034099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:51.040482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:51.082509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 627 reason: error at write: Disconnected sessionId: src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0
2025-10-10T14:06:51.082819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 627 sessionId: src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0 is DEAD
2025-10-10T14:06:51.090401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:51.090450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0] Write session will restart in 0.007107s
2025-10-10T14:06:51.090558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0] Write session: Do CDS request
2025-10-10T14:06:51.090586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:51.108026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:51.108060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 628
2025-10-10T14:06:51.109644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:51.114180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:51.114343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:51.114361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:51.114382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:51.116084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 628 sessionId:  describe result for acl check
2025-10-10T14:06:51.116209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:51.116219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:51.116229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:51.116246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594322979990614:8878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:51.118948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594322979990614:8878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:51.128985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594322979990614:8878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:51.133689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594322979990669:8635]
2025-10-10T14:06:51.147367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594322979990614:8878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:51.147407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594322979990614:8878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:51.147424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594322979990614:8878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:51.147453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:51.181596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:51.191091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:51.191946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:51.191976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:51.192018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:51.192275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:51.192439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594321402069542:7928]
2025-10-10T14:06:51.194719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:51.196120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:51.196333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:51.197677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:51.198009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:51.198016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:51.198024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:51.198032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:51.198040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:51.198046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:51.198053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:51.198061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:51.198068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.198076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.198082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.198089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.198140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:51.198250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:51.198303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:51.198356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:51.198403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:51.198450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:51.198497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:51.198542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:51.198598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.198652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.198700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.198748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.198789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:51.198859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:51.198920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:51.198978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:51.199033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:51.199733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:51.199817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:51.199882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:51.199940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:51.199999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:51.200051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:51.200111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:51.200163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:51.200223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:51.200269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:51.200327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:51.200382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.200438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.200487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.200554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.200606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.200663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.200711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.200766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.201285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:51.245659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:51.260530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:51.260565Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:51.260577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:51.260591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:51.260607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 627 [2:7559594321402069542:7928]
2025-10-10T14:06:51.260646Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:51.260688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:51.260699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:51.260708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:51.260717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:51.260752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:51.260767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:51.260782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:51.282624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.282653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.282668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.282682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.282695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:51.283014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:51.283031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.283171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.283363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.283586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.283701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:51.283794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.283810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.283823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.283836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.283879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:51.283959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:51.284153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:51.284170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:51.284292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.284313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:51.285577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:51.285600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:51.285613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:51.285626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:51.285653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:51.286236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594322979990723:8878], now have 1 active actors on pipe
2025-10-10T14:06:51.286269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594322979990564:2442], now have 1 active actors on pipe
2025-10-10T14:06:51.286290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594322979990669:8635], now have 1 active actors on pipe
2025-10-10T14:06:51.286987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 627
2025-10-10T14:06:51.287048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 627
2025-10-10T14:06:51.287092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 627, pipe: [1:7559594322979990669:8635]
2025-10-10T14:06:51.289603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:51.289636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:51.289712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:51.289741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:51.289758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:51.289769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:51.289803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:51.289846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:51.289892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:51.290844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:51.290871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:51.290936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:51.291411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 628 partition: 0 MaxSeqNo: 36 sessionId: src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0
2025-10-10T14:06:51.294446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772eb470-14f5b99d-9b89cdb3-8475848b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:51.326833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0] Write session: try to update token
2025-10-10T14:06:51.326890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:51.432985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:51.433012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:51.433021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:51.433060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:51.433070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:51.433080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:51.433088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:51.433097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:51.433144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.433167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.433184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.433198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.433302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:51.433334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:51.433340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:51.433352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:51.433358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.433366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:51.433370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:51.434389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:51.505307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId: src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:51.528887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:51.585209Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:51.649914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:51.649964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:51.650044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:51.650058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:51.650098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594321402069525:7928]
2025-10-10T14:06:51.653503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:51.654693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:51.660531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:51.660560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:51.661831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:51.662082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594322979990669:8635]
2025-10-10T14:06:51.665994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 628 reason: error at write: Disconnected sessionId: src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0
2025-10-10T14:06:51.667204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:51.667239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0] Write session will restart in 0.007897s
2025-10-10T14:06:51.667311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0] Write session: Do CDS request
2025-10-10T14:06:51.667337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:51.666333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 628 sessionId: src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0 is DEAD
2025-10-10T14:06:51.686366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:51.690060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:51.690126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 629
2025-10-10T14:06:51.690658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:51.690878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:51.690913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:51.690933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:51.692512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 629 sessionId:  describe result for acl check
2025-10-10T14:06:51.692616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:51.692627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:51.692637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:51.692654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594322979990818:8889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:51.695475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594322979990818:8889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:51.712408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594322979990818:8889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:51.726994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594322979990818:8889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:51.727045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594322979990818:8889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:51.727063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594322979990818:8889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:51.727097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:51.763286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594322979990932:8635]
2025-10-10T14:06:51.803897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:51.816644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:51.817571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:51.817591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:51.817637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:51.817917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:51.818110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594321402069753:7939]
2025-10-10T14:06:51.820533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:51.822004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:51.822238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:51.823583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:51.823944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:51.823954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:51.823962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:51.823970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:51.823979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:51.823987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:51.823995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:51.824003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:51.824011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.824019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.824027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.824036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.824089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:51.824209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:51.824267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:51.824320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:51.824372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:51.824425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:51.824476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:51.824526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:51.824580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.824637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.824688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.824738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.824787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:51.824863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:51.824931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:51.824998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:51.825055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:51.825116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:51.825991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:51.826074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:51.826135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:51.826192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:51.826239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:51.826297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:51.826351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:51.826410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:51.826465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:51.826525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:51.826579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.826637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.826689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.826749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.826798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.826856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.826905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.826965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.827464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:51.864346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:51.926739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:51.926787Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:51.926803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:51.926822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:51.926845Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 628 [2:7559594321402069753:7939]
2025-10-10T14:06:51.926898Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:51.926959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:51.926975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:51.926987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:51.926998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:51.927045Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:51.927065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:51.927087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:51.928906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.928926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.928939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.928950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.928960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:51.929248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:51.929265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:51.929411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:51.929588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:51.929800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:51.929910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:51.929984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:51.929999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:51.930011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:51.930023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:51.930063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:51.930139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:51.930309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:51.930325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:51.930450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:51.930468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:51.931195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:51.931213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:51.931223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:51.931234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:51.931258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:51.933198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594322979990932:8635], now have 1 active actors on pipe
2025-10-10T14:06:51.933235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594322979990858:8889], now have 1 active actors on pipe
2025-10-10T14:06:51.933265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594322979990807:2442], now have 1 active actors on pipe
2025-10-10T14:06:51.932717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 628
2025-10-10T14:06:51.932732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 628, pipe: [1:7559594322979990932:8635]
2025-10-10T14:06:51.932823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 628
2025-10-10T14:06:51.933660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:51.933688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:51.933776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:51.933811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:51.933828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:51.933839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:51.933876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:51.933922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:51.933969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:51.934492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:51.934516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:51.934575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:51.938518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8febe20-98bb36ab-4dc7d0f-e9dc051d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:51.934977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 629 partition: 0 MaxSeqNo: 36 sessionId: src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0
2025-10-10T14:06:52.010378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0] Write session: try to update token
2025-10-10T14:06:52.010441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:52.032537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:52.032574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:52.032587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:52.208489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:52.208520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:52.208530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:52.208580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:52.208593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:52.208604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:52.208615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:52.208625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:52.208657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:52.208680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:52.208703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:52.208724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:52.208902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:52.208909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:52.208927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:52.208935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:52.208936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:52.208959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:52.208994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:52.214229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:52.266934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId: src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:52.309104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:52.633204Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:52.694176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:52.694221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:52.694289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:52.694301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:52.694343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594321402069748:7939]
2025-10-10T14:06:52.694713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:52.698536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594322979990932:8635]
2025-10-10T14:06:52.698642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:52.698655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:52.705728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:52.716541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 629 reason: error at write: Disconnected sessionId: src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0
2025-10-10T14:06:52.716887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 629 sessionId: src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0 is DEAD
2025-10-10T14:06:52.721700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:52.721742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0] Write session will restart in 0.009399s
2025-10-10T14:06:52.721834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0] Write session: Do CDS request
2025-10-10T14:06:52.721861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:52.737743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:52.745536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:52.745754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:52.745770Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 630
2025-10-10T14:06:52.746631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:52.746750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:52.746765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:52.746774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:52.748455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 630 sessionId:  describe result for acl check
2025-10-10T14:06:52.748580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:52.748590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:52.748599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:52.748616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594327274958363:8902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:52.751153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594327274958363:8902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:52.766851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594327274958363:8902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:52.791442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594327274958363:8902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:52.791488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594327274958363:8902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:52.791505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594327274958363:8902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:52.791535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:52.803413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594327274958421:8635]
2025-10-10T14:06:52.887381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:52.905289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:52.906132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:52.906151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:52.906196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:52.906457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:52.906643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594325697037281:7949]
2025-10-10T14:06:52.908676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:52.913660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:52.913931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:52.916912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:52.917291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:52.917299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:52.917306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:52.917312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:52.917318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:52.917324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:52.917330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:52.917336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:52.917347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:52.917358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:52.917365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:52.917372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:52.917415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:52.917514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:52.917557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:52.917602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:52.917644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:52.917686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:52.917726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:52.917769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:52.917808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:52.917851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:52.917889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:52.917939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:52.917979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:52.918038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:52.918090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:52.918139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:52.918184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:52.918233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:52.918274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:52.918322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:52.918366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:52.918415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:52.918457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:52.918506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:52.918547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:52.918594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:52.918635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:52.918686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:52.918731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:52.918783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:52.918821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:52.918870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:52.918910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:52.918959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:52.919000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:52.919044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:52.919444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:52.975686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:53.003809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:53.003855Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:53.003871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:53.003888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:53.003910Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 629 [2:7559594325697037281:7949]
2025-10-10T14:06:53.003959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:53.004017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:53.004031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:53.004041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:53.004052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:53.004098Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:53.004119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:53.004139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:53.006291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:53.006316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:53.006329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:53.006341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:53.006352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:53.006634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:53.006650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:53.006780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:53.006943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:53.007148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:53.007256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:53.007330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594325697037276:7949]
2025-10-10T14:06:53.007343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594325697037276:7949]
2025-10-10T14:06:53.007355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594325697037276:7949]
2025-10-10T14:06:53.007367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594325697037276:7949]
2025-10-10T14:06:53.007418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:53.007498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:53.007575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:53.007589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:53.007600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:53.007611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:53.007657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:53.007672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:53.007818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594325697037276:7949]
2025-10-10T14:06:53.007839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:53.007892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:53.007925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594327274958421:8635], now have 1 active actors on pipe
2025-10-10T14:06:53.007945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594327274958359:2442], now have 1 active actors on pipe
2025-10-10T14:06:53.008015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594327274958411:8902], now have 1 active actors on pipe
2025-10-10T14:06:53.009753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 629, pipe: [1:7559594327274958421:8635]
2025-10-10T14:06:53.009854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 629
2025-10-10T14:06:53.009923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 629
2025-10-10T14:06:53.019927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:53.019975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:53.020081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:53.020119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:53.020138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:53.020149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:53.020190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:53.020240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:53.020291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:53.022423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:53.022462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:53.022535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:53.022964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 630 partition: 0 MaxSeqNo: 36 sessionId: src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0
2025-10-10T14:06:53.025744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7fc842e-76e6148d-312bf0e5-54dbb314_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:53.073899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0] Write session: try to update token
2025-10-10T14:06:53.073958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:53.106951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:53.106985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:53.106998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:53.191474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:53.191501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:53.191513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:53.191522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:53.191533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:53.191564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594325697037276:7949]
2025-10-10T14:06:53.191588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594325697037276:7949]
2025-10-10T14:06:53.191610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594325697037276:7949]
2025-10-10T14:06:53.191630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594325697037276:7949]
2025-10-10T14:06:53.191782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:53.191809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:53.191819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:53.192856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:53.196398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:53.196439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:53.196466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:53.196492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:53.308873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId: src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:53.335034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:53.448901Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:53.457945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:53.457995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:53.460966Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:53.460807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:53.460921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:53.460930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:53.462748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594327274958421:8635]
2025-10-10T14:06:53.531811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 630 reason: error at write: Disconnected sessionId: src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0
2025-10-10T14:06:53.532177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 630 sessionId: src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0 is DEAD
2025-10-10T14:06:53.538030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:53.538073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0] Write session will restart in 0.005786s
2025-10-10T14:06:53.538182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0] Write session: Do CDS request
2025-10-10T14:06:53.538211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:53.558930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:53.559762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:53.559816Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 631
2025-10-10T14:06:53.560322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:53.560444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:53.560458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:53.560470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:53.562396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 631 sessionId:  describe result for acl check
2025-10-10T14:06:53.562530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:53.562539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:53.562550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:53.562568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594331569925964:8911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:53.568861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594331569925975:8635]
2025-10-10T14:06:53.569720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594331569925964:8911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:53.585240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594331569925964:8911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:53.602664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594331569925964:8911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:53.602714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594331569925964:8911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:53.602733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594331569925964:8911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:53.602767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:53.631627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:53.638654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:53.639370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:53.639382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:53.639413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:53.639595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:53.639766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594329992004822:7960]
2025-10-10T14:06:53.643351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:06:53.643413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-10T14:06:53.648629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:53.650291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:53.650567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:53.652048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:53.652324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:53.652330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:53.652335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:53.652340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:53.652345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:53.652350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:53.652355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:53.652360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:53.652366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:53.652372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:53.652376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:53.652381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:53.652417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:53.652509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:53.652549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:53.652588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:53.652627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:53.652664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:53.652701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:53.652736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:53.652774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:53.652809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:53.652846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:53.652882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:53.652907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:53.652958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:53.653001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:53.653043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:53.653080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:53.653120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:53.653189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:53.653249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:53.653300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:53.653358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:53.653405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:53.653461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:53.653511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:53.653567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:53.653615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:53.653676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:53.653724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:53.653779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:53.653827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:53.653888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:53.653939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:53.653995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:53.654045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:53.654103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:53.654589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:53.692670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:53.801053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 630
2025-10-10T14:06:53.797943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:53.801179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 630, pipe: [1:7559594331569925975:8635]
2025-10-10T14:06:53.797987Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:53.798004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:53.798024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:53.798047Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 630 [2:7559594329992004822:7960]
2025-10-10T14:06:53.798100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:53.798157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:53.798171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:53.798183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:53.798194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:53.798241Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:53.798263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:53.798285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:53.799742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:53.799759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:53.799774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:53.799787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:53.801275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 630
2025-10-10T14:06:53.799798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:53.800081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:53.800100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:53.800256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:53.800460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:53.800708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:53.800859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:53.800952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594331569925884:2442], now have 1 active actors on pipe
2025-10-10T14:06:53.800976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594331569925975:8635], now have 1 active actors on pipe
2025-10-10T14:06:53.800998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594331569926069:8911], now have 1 active actors on pipe
2025-10-10T14:06:53.801024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:53.801041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:53.801055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:53.801069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:53.801111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:53.801207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:53.801283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:53.801301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:53.801312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:53.801324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:53.801400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:53.801417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:53.801613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:53.801641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:53.801685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:53.801704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:53.801724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:53.801920Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:06:53.802079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:53.802108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:53.802127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:53.802137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:53.802168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:53.802205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:53.802288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:53.802955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 15 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:06:53.803058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:53.803084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:06:53.803087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:53.803150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:53.803989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 631 partition: 0 MaxSeqNo: 36 sessionId: src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0
2025-10-10T14:06:53.807828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37ee174-639f62bd-3cb3b40d-a4bfcf46_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:53.872678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0] Write session: try to update token
2025-10-10T14:06:53.872742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:53.901263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:53.901301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:53.901314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:54.036527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:54.036555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:54.036566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:54.036616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:54.036631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:54.036643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:54.036653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:54.036663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:54.036697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:54.036725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:54.036749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:54.036773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:54.037353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:54.037392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:54.037423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:54.037450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:54.072668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:54.072722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:54.072736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:54.074093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:54.089856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId: src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:54.113407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:54.244052Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:54.247635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:54.247673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:54.247735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594329992004817:7960]
2025-10-10T14:06:54.247896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:54.247922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:54.248078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:54.248909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:54.248780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:54.248990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594331569925975:8635]
2025-10-10T14:06:54.249063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:54.249073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:54.261351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 631 reason: error at write: Disconnected sessionId: src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0
2025-10-10T14:06:54.261767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 631 sessionId: src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0 is DEAD
2025-10-10T14:06:54.262731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:54.262772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0] Write session will restart in 0.008215s
2025-10-10T14:06:54.262878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0] Write session: Do CDS request
2025-10-10T14:06:54.262912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:54.282769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:54.291538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:54.291577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 632
2025-10-10T14:06:54.292497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:54.292616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:54.292640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:54.292648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:54.293872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 632 sessionId:  describe result for acl check
2025-10-10T14:06:54.293982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:54.293994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:54.294004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:54.294022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594335864893448:8921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:54.307768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594335864893448:8921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:54.328574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594335864893448:8921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:54.338967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594335864893448:8921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:54.339014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594335864893448:8921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:54.339033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594335864893448:8921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:54.339065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:54.349324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594335864893481:8635]
2025-10-10T14:06:54.439595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:54.445524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:54.446385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:54.446403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:54.446450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:54.446708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:54.446892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594334286972353:7970]
2025-10-10T14:06:54.449014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:54.450966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:54.451192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:54.452401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:54.452696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:54.452704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:54.452710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:54.452717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:54.452724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:54.452730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:54.452737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:54.452744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:54.452750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:54.452756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:54.452763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:54.452774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:54.452822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:54.452922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:54.452967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:54.453010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:54.453053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:54.453096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:54.453154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:54.453195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:54.453236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:54.453280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:54.453319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:54.453359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:54.453396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:54.453456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:54.453509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:54.453557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:54.453599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:54.453648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:54.453687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:54.453733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:54.453777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:54.453824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:54.453868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:54.453917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:54.453957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:54.454002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:54.454077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:54.454138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:54.454185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:54.454235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:54.454277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:54.454328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:54.454369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:54.454416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:54.454457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:54.454502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:54.456451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:54.498399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:54.555619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:54.555666Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:54.555699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:54.555719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:54.555745Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 631 [2:7559594334286972353:7970]
2025-10-10T14:06:54.555819Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:54.555882Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:54.555897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:54.555907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:54.555918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:54.555965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:54.555988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:54.556011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:54.557316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:54.557332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:54.557345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:54.557357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:54.557367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:54.558972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 631, pipe: [1:7559594335864893481:8635]
2025-10-10T14:06:54.559084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 631
2025-10-10T14:06:54.559156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 631
2025-10-10T14:06:54.569515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:54.569555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:54.569691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:54.569863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:54.570084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:54.570193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:54.570307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594335864893481:8635], now have 1 active actors on pipe
2025-10-10T14:06:54.570332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594335864893427:2442], now have 1 active actors on pipe
2025-10-10T14:06:54.570352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594335864893478:8921], now have 1 active actors on pipe
2025-10-10T14:06:54.570430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:54.570452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:54.570494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.570510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.570523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.570536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.570580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:54.570664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:54.570845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:54.570862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:54.570932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:54.570963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:54.570982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:54.570993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:54.571029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:54.571075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:54.571207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.571228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:54.571269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:54.571799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:54.571813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:54.571826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:54.571837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:54.571863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:54.597468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:54.597500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:54.597559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:54.601570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 632 partition: 0 MaxSeqNo: 36 sessionId: src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0
2025-10-10T14:06:54.602608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02b86af-7c9e8a01-3bc311c9-a570d629_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:54.657878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:54.657912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:54.657925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:54.687752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0] Write session: try to update token
2025-10-10T14:06:54.687813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:54.719545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:54.719580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:54.719620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.719770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:54.721403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:54.725953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:54.727233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:54.728411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:54.745630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:54.754548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:54.754970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:54.757328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:54.757349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:54.757361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:54.930626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:54.930660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:54.930671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:54.930731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:54.930746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:54.930760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:54.930770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:54.930782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:54.930826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.930854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.930877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.930898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594334286972348:7970]
2025-10-10T14:06:54.931048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:54.931076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:54.931086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:54.931237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:54.931264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:54.931291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:54.931320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:54.950541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:54.963788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId: src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:54.989393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:55.209044Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:55.263677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:55.263736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:55.264515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:55.266377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594335864893481:8635]
2025-10-10T14:06:55.266529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:55.266704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:55.266716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:55.287392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 632 reason: error at write: Disconnected sessionId: src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0
2025-10-10T14:06:55.287761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 632 sessionId: src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0 is DEAD
2025-10-10T14:06:55.290675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:55.290723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0] Write session will restart in 0.005247s
2025-10-10T14:06:55.290820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0] Write session: Do CDS request
2025-10-10T14:06:55.290848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:55.304645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:55.304696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 633
2025-10-10T14:06:55.309046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:55.309888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:55.310049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:55.310067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:55.310081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:55.312275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 633 sessionId:  describe result for acl check
2025-10-10T14:06:55.312397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:55.312408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:55.312417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:55.312435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594340159861005:8933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:55.315033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594340159861005:8933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:55.336526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594340159861005:8933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:55.359544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594340159861005:8933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:55.359594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594340159861005:8933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:55.359612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594340159861005:8933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:55.359645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:55.368597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594340159861045:8635]
2025-10-10T14:06:55.494836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:55.505093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:55.506049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:55.506069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:55.506119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:55.506394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:55.506585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594338581939899:7980]
2025-10-10T14:06:55.508975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:55.511301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:55.511575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:55.512875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:55.513235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:55.513243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:55.513250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:55.513256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:55.513264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:55.513271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:55.513279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:55.513284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:55.513290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:55.513298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:55.513303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:55.513309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:55.513355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:55.513460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:55.513508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:55.513554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:55.513601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:55.513647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:55.513692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:55.513736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:55.513795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:55.513839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:55.513883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:55.513930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:55.513973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:55.514038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:55.514097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:55.514153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:55.514203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:55.514254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:55.514297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:55.514345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:55.514392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:55.514444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:55.514487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:55.514539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:55.514581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:55.514633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:55.514676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:55.514724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:55.514769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:55.514818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:55.514858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:55.514904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:55.514945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:55.514992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:55.515031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:55.515078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:55.515481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:55.565560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:55.592751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:55.592800Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:55.592817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:55.592835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:55.592859Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 632 [2:7559594338581939899:7980]
2025-10-10T14:06:55.592912Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:55.592978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:55.592992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:55.593004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:55.593015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:55.593067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:55.593097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:55.593119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:55.600057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:55.600089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:55.600101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:55.600113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:55.600123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:55.600412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:55.600427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:55.600567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:55.600741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:55.600949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:55.601055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:55.601476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 632, pipe: [1:7559594340159861045:8635]
2025-10-10T14:06:55.601585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 632
2025-10-10T14:06:55.601655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 632
2025-10-10T14:06:55.601458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594340159861045:8635], now have 1 active actors on pipe
2025-10-10T14:06:55.601489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594340159861043:8933], now have 1 active actors on pipe
2025-10-10T14:06:55.601511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594340159860993:2442], now have 1 active actors on pipe
2025-10-10T14:06:55.601537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:55.601554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:55.601567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:55.601580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:55.601622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:55.601707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:55.601884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:55.601901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:55.601914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:55.601928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:55.601939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:55.601950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:55.602023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:55.602043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:55.602079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:55.602141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:55.602163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:55.602274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b3916b8-756a3874-4413af60-92a96518_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:55.602310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:55.602330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:55.602341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:55.602379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:55.602421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:55.602485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:55.616561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:55.616615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:55.616708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:55.621635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 633 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b3916b8-756a3874-4413af60-92a96518_0
2025-10-10T14:06:55.625820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|563ef5bc-be09a5ff-2a9189b1-ac7e8c8a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b3916b8-756a3874-4413af60-92a96518_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:55.669012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3916b8-756a3874-4413af60-92a96518_0] Write session: try to update token
2025-10-10T14:06:55.669073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3916b8-756a3874-4413af60-92a96518_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:55.779890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:55.779923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:55.779933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:55.779991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:55.780004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:55.780015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:55.780024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:55.780033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:55.780066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:55.780090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:55.780108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:55.780124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:55.780356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:55.780385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:55.780402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:55.780471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:55.780519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:55.780547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:55.780577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:55.785526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:55.869143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId: src_id|6b3916b8-756a3874-4413af60-92a96518_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:55.920590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:56.012968Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:56.030127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:56.030188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:56.030258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:56.030274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:56.030318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594338581939894:7980]
2025-10-10T14:06:56.030609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:56.031123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:56.037368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:56.041335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:56.041582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594340159861045:8635]
2025-10-10T14:06:56.110751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 633 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b3916b8-756a3874-4413af60-92a96518_0
2025-10-10T14:06:56.114409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 633 sessionId: src_id|6b3916b8-756a3874-4413af60-92a96518_0 is DEAD
2025-10-10T14:06:56.118670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3916b8-756a3874-4413af60-92a96518_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:56.118704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3916b8-756a3874-4413af60-92a96518_0] Write session will restart in 0.008287s
2025-10-10T14:06:56.118796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3916b8-756a3874-4413af60-92a96518_0] Write session: Do CDS request
2025-10-10T14:06:56.118825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3916b8-756a3874-4413af60-92a96518_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:56.140578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3916b8-756a3874-4413af60-92a96518_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:56.145355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594344454828678:8635]
2025-10-10T14:06:56.145409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:56.145421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 634
2025-10-10T14:06:56.153797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:56.153970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:56.153988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:56.153997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:56.159811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 634 sessionId:  describe result for acl check
2025-10-10T14:06:56.159939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:56.159950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:56.159958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:56.159974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594344454828701:8942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
E1010 14:06:56.165811256  112399 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:06:56.167442Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:06:56.168739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594344454828701:8942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:56.175153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:56.186626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594344454828701:8942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:56.197701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:56.198619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:56.198637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:56.198678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:56.198925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:56.199093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594342876907416:7990]
2025-10-10T14:06:56.201896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:56.204578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:56.204822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:56.206126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:56.206475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:56.206483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:56.206490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:56.206497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:56.206504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:56.206510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:56.206516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:56.206521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:56.206528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:56.206535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:56.206542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:56.206549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:56.206596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:56.206696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:56.206743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:56.206788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:56.206832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:56.206874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:56.206914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:56.206959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:56.207000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:56.207044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:56.207083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:56.207123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:56.207163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:56.207223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:56.207278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:56.207330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:56.207376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:56.207426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:56.207467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:56.207513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:56.207558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:56.207606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:56.207664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:56.207712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:56.207759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:56.207810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:56.207853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:56.207902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:56.207947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:56.207994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:56.208035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:56.208085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:56.208127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:56.208177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:56.208218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:56.208266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:56.212901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:56.218935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594344454828701:8942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:56.218976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594344454828701:8942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:56.218994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594344454828701:8942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:56.219067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:56.264892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:56.317852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:56.317900Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:56.317917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:56.317939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:56.317966Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 633 [2:7559594342876907416:7990]
2025-10-10T14:06:56.318023Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:56.318089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:56.318105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:56.318118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:56.318130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:56.318180Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:56.318202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:56.318225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:56.320428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:56.320445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:56.320459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:56.320472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:56.320483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:56.320765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:56.320779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:56.320911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:56.321076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:56.321576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:56.321685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:56.321786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594344454828530:2442], now have 1 active actors on pipe
2025-10-10T14:06:56.321810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594344454828745:8942], now have 1 active actors on pipe
2025-10-10T14:06:56.321831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594344454828678:8635], now have 1 active actors on pipe
2025-10-10T14:06:56.321856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.321873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.321885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.321898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.321938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:56.321989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:56.322004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:56.322015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:56.322018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:56.322026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:56.322190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:56.322207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:56.322334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.322362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:56.322414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:56.325348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 633
2025-10-10T14:06:56.325469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 633
2025-10-10T14:06:56.325537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 633, pipe: [1:7559594344454828678:8635]
2025-10-10T14:06:56.327600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 634 partition: 0 MaxSeqNo: 36 sessionId: src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0
2025-10-10T14:06:56.326185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:56.326223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:56.326306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:56.326341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:56.326361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:56.326371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:56.326409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:56.326456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:56.326507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:56.327143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:56.327163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:56.327222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:56.329768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b3916b8-756a3874-4413af60-92a96518_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:56.434084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0] Write session: try to update token
2025-10-10T14:06:56.434147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:56.497441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:56.497476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:56.497517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.497648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:56.497661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:56.497671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:56.497667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:56.497730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:06:56.524726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:06:56.529072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:56.568367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:56.569790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:06:56.577219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:06:56.577794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:06:56.627293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:56.627329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:56.627341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:56.627400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:56.627415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:56.627430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:56.627440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:56.627451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:56.627492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.627523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.627549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.627574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594342876907410:7990]
2025-10-10T14:06:56.627734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:56.627762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:56.627773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:56.628862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:56.629381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:56.629428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:56.629463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:56.629497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:56.649232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId: src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:56.693557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:56.998617Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:57.000327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:57.000361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:57.002852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:57.003013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:57.003026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:57.009201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594344454828678:8635]
2025-10-10T14:06:57.006986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:57.101343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:57.101393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0] Write session will restart in 0.008016s
2025-10-10T14:06:57.095003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 634 reason: error at write: Disconnected sessionId: src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0
2025-10-10T14:06:57.101507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0] Write session: Do CDS request
2025-10-10T14:06:57.095354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 634 sessionId: src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0 is DEAD
2025-10-10T14:06:57.101537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:57.109863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594348749796128:8635]
2025-10-10T14:06:57.120545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:57.121618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:57.121651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 635
2025-10-10T14:06:57.122472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:57.122598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:57.122614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:57.122625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:57.124886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 635 sessionId:  describe result for acl check
2025-10-10T14:06:57.125013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:57.125023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:57.125031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:57.125048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594348749796157:8958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:57.127652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594348749796157:8958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:57.157310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594348749796157:8958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:57.191915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594348749796157:8958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:57.191962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594348749796157:8958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:57.191979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594348749796157:8958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:57.192009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:57.219855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:57.229955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:57.230754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:57.230771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:57.230810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:57.231054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:57.231226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594347171874962:8001]
2025-10-10T14:06:57.233112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:57.234992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:57.235210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:57.236347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:57.236644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:57.236650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:57.236657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:57.236663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:57.236669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:57.236676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:57.236681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:57.236687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:57.236694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:57.236701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:57.236706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:57.236712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:57.236753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:57.236848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:57.236889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:57.236925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:57.236962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:57.236997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:57.237031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:57.237067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:57.237105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:57.239768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:57.239836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:57.239877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:57.239922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:57.239985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:57.240041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:57.240091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:57.240135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:57.240186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:57.240228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:57.240272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:57.240317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:57.240362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:57.240396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:57.240439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:57.240477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:57.240516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:57.240552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:57.240593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:57.240631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:57.240671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:57.240706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:57.240752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:57.240794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:57.240839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:57.240875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:57.240916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:57.241292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:57.296722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:57.309917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:57.309965Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:57.309982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:57.310001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:57.310025Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 634 [2:7559594347171874962:8001]
2025-10-10T14:06:57.310083Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:57.310139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:57.310154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:57.310169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:57.310181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:57.310231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:57.310251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:57.310275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:57.311982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:57.312000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:57.312013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:57.312027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:57.312038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:57.312332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:57.312349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:57.312484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:57.312667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:57.312897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:57.313008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:57.313094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594348749796283:8958], now have 1 active actors on pipe
2025-10-10T14:06:57.313119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594348749796128:8635], now have 1 active actors on pipe
2025-10-10T14:06:57.313753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594348749796093:2442], now have 1 active actors on pipe
2025-10-10T14:06:57.313797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.313811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.313823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.313837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.313875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:57.313960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:57.314135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:57.314152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:57.314283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.314303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:57.314705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:57.314725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:57.314736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:57.314748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:57.314772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:57.315920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 634
2025-10-10T14:06:57.316002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 634, pipe: [1:7559594348749796128:8635]
2025-10-10T14:06:57.316068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 634
2025-10-10T14:06:57.318092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:57.318132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:57.318226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b51c873-7d3eb51f-4d813751-b724c361_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:57.318263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:57.318281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:57.318290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:57.318328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:57.318376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:57.318428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:57.324824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:57.324871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:57.324949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:57.333384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 635 partition: 0 MaxSeqNo: 36 sessionId: src_id|4b51c873-7d3eb51f-4d813751-b724c361_0
2025-10-10T14:06:57.338531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a5e3e0-359fa943-32b156ee-a16706b0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4b51c873-7d3eb51f-4d813751-b724c361_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:57.399642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b51c873-7d3eb51f-4d813751-b724c361_0] Write session: try to update token
2025-10-10T14:06:57.399703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b51c873-7d3eb51f-4d813751-b724c361_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:57.413250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:57.413284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:57.413295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:57.596288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:57.596321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:57.596333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:57.596341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:57.596349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:57.596380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.596403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.596421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.596440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.596594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:57.596604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:57.596613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:57.596706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:57.596726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:57.596735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:57.599716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:57.599775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:57.599803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:57.599829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:57.613782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:57.623469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId: src_id|4b51c873-7d3eb51f-4d813751-b724c361_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:57.672868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:57.803214Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:57.825240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:06:57.825268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:06:57.823535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:57.823579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:57.823655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:57.823668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:57.823709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594347171874956:8001]
2025-10-10T14:06:57.823907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:57.824262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:57.838494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594348749796128:8635]
2025-10-10T14:06:57.838572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:57.838686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 635 reason: error at write: Disconnected sessionId: src_id|4b51c873-7d3eb51f-4d813751-b724c361_0
2025-10-10T14:06:57.845474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 635 sessionId: src_id|4b51c873-7d3eb51f-4d813751-b724c361_0 is DEAD
2025-10-10T14:06:57.849969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b51c873-7d3eb51f-4d813751-b724c361_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:06:57.850047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b51c873-7d3eb51f-4d813751-b724c361_0] Write session will restart in 0.007486s
2025-10-10T14:06:57.850254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b51c873-7d3eb51f-4d813751-b724c361_0] Write session: Do CDS request
2025-10-10T14:06:57.850321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b51c873-7d3eb51f-4d813751-b724c361_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:57.864014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:57.864045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 636
2025-10-10T14:06:57.866300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b51c873-7d3eb51f-4d813751-b724c361_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:57.866958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:57.867126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:57.867143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:57.867155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:57.870822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 636 sessionId:  describe result for acl check
2025-10-10T14:06:57.870961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:57.870973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:57.870981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:57.870997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594348749796342:8964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:57.873972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594348749796342:8964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:57.894920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594348749796342:8964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:57.934998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594348749796342:8964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:57.935052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594348749796342:8964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:57.935068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594348749796342:8964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:57.935100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:57.945264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594348749796412:8635]
2025-10-10T14:06:58.021666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:58.026983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:58.027975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:58.028006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:58.028057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:58.028391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:58.028621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594351466842514:8016]
2025-10-10T14:06:58.030786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:58.032032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:58.032309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:58.033708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:58.034057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:58.034066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:58.034073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:58.034079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:58.034086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:58.034092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:58.034098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:58.034105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:58.034112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.034118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.034124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.034130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.034174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:58.034279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:58.034326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:58.034374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:58.034418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:58.034461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:58.034509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:58.034553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:58.034599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.034644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.034688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.034730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.034773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:58.034837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:58.034894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:58.034946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:58.034994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:58.035048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:58.035094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:58.035145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:58.035192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:58.035243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:58.035287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:58.035339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:58.035382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:58.035430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:58.036394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:58.036472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:58.036530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.036581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.036626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.036680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.036725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.036779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.036825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.036878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.037343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:58.091362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:58.105052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:58.106333Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:58.106373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:58.106394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:58.106418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 635 [2:7559594351466842514:8016]
2025-10-10T14:06:58.106473Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:58.106543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:58.106557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:58.106568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:58.106580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:58.106626Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:58.106648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:58.106669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:58.107859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.107875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.107888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.107901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.107912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:58.108185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:58.108200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.108336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.108512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.108733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.108843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:58.108912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.108927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.108939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.108955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.109000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:58.114828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 635
2025-10-10T14:06:58.109073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:58.109264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:58.114931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 635, pipe: [1:7559594348749796412:8635]
2025-10-10T14:06:58.109282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:58.115001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 635
2025-10-10T14:06:58.109954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.109980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:58.113568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:58.113582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:58.113593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:58.113606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:58.113635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:58.113903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594348749796335:2442], now have 1 active actors on pipe
2025-10-10T14:06:58.115377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594348749796412:8635], now have 1 active actors on pipe
2025-10-10T14:06:58.115422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594348749796387:8964], now have 1 active actors on pipe
2025-10-10T14:06:58.115501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:58.115522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:58.115631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:58.115671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:58.115708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:58.115726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:58.115772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:58.115834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:58.115890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:58.122919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 636 partition: 0 MaxSeqNo: 36 sessionId: src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0
2025-10-10T14:06:58.122423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:58.122467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:58.122548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:58.125510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b51c873-7d3eb51f-4d813751-b724c361_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:58.166031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0] Write session: try to update token
2025-10-10T14:06:58.166092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:58.295375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:58.295403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:58.295413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:58.295465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:58.295476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:58.295488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:58.295496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:58.295503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:58.295534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.295556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.295575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.295605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.295781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:58.295803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.295812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:58.296767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:58.297583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:58.297612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:58.297634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:58.297655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:58.322807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId: src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:58.376570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:58.578650Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:58.625674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:58.625723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:58.625788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:58.625803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:58.625843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594351466842509:8016]
2025-10-10T14:06:58.629434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:58.630409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:58.634843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594348749796412:8635]
2025-10-10T14:06:58.634996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:58.645416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:58.645549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 636 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0
2025-10-10T14:06:58.645889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 636 sessionId: src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0 is DEAD
2025-10-10T14:06:58.653343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:58.653389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0] Write session will restart in 0.008662s
2025-10-10T14:06:58.653484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0] Write session: Do CDS request
2025-10-10T14:06:58.653513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:58.672023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:58.677069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:58.677113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 637
2025-10-10T14:06:58.677895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:58.678070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:58.678088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:58.678100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:58.679646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 637 sessionId:  describe result for acl check
2025-10-10T14:06:58.679767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:58.679779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:58.679789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:58.679807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594353044763885:8976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:58.682757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594353044763885:8976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:58.690446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594353044763885:8976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:58.707754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594353044763885:8976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:58.707802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594353044763885:8976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:58.707820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594353044763885:8976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:58.707853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:58.734994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594353044763951:8635]
2025-10-10T14:06:58.807406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:58.817939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:58.818895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:58.818912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:58.818958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:58.819214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:58.819394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594351466842742:8020]
2025-10-10T14:06:58.821713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:58.829668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:58.829933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:58.831218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:58.831522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:58.831533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:58.831540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:58.831546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:58.831553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:58.831558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:58.831579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:58.831586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:58.831592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.831598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.831605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.831612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.831655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:58.831755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:58.831801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:58.831847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:58.831889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:58.831932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:58.831973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:58.832012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:58.832054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.832097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.832139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.832178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.832217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:58.832274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:58.832325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:58.832376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:58.832421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:58.832472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:58.832514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:58.832561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:58.832603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:58.832649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:58.832688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:58.832734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:58.832778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:58.832828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:58.832869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:58.832918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:58.832960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.833009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.833052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.833097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.835820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.835912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.835970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.836024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.836500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:58.906206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:58.922076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:58.922111Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:58.922121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:58.922135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:58.922154Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 636 [2:7559594351466842742:8020]
2025-10-10T14:06:58.922205Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:58.922252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:58.922264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:58.922273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:58.922284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:58.922319Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:58.922337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:58.922353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:58.924129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.924140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.924147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.924156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.924163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:58.924370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:58.924380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:58.924468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:58.924576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:58.924714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:58.924791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:58.924839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:58.924849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:58.924857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:58.924865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:58.924899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:58.924971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:58.925010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:58.925022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:58.925033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:58.925044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:58.925143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:58.925158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:58.925288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:58.925307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:58.925341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:58.925395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594353044763923:8976], now have 1 active actors on pipe
2025-10-10T14:06:58.925418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594353044763874:2442], now have 1 active actors on pipe
2025-10-10T14:06:58.925436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594353044763951:8635], now have 1 active actors on pipe
2025-10-10T14:06:58.926811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 636
2025-10-10T14:06:58.926894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 636
2025-10-10T14:06:58.926953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 636, pipe: [1:7559594353044763951:8635]
2025-10-10T14:06:58.927207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:58.927235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:58.927320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:58.927349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:58.927361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:58.927368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:58.927396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:58.927439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:58.927481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:58.928775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:58.928797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:58.928873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:58.933934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 637 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0
2025-10-10T14:06:58.934860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9e99367-b6c0a8a7-37ad5648-d6a103c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:58.989388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0] Write session: try to update token
2025-10-10T14:06:58.989447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:59.135893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:59.135928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:59.135941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:59.135994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:59.136009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:59.136023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:59.136035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:59.136046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:59.136082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:59.136109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:59.136135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:59.136157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:59.136373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:59.136400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:59.136411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:59.137277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:59.137317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:59.137346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:59.137376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:59.145791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:59.163936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId: src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:06:59.193633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:06:59.341007Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:06:59.356416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:59.360718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:06:59.358699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:59.358818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:06:59.358834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:59.358878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594351466842737:8020]
2025-10-10T14:06:59.359173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:06:59.359529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:06:59.361274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:06:59.361500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594353044763951:8635]
2025-10-10T14:06:59.414964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:06:59.415052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0] Write session will restart in 0.009895s
2025-10-10T14:06:59.415276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0] Write session: Do CDS request
2025-10-10T14:06:59.415346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:06:59.411380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0
2025-10-10T14:06:59.411747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 637 sessionId: src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0 is DEAD
2025-10-10T14:06:59.429898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:59.435513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:06:59.435549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 638
2025-10-10T14:06:59.437009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:06:59.437196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:06:59.437216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:06:59.437228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:06:59.438875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 638 sessionId:  describe result for acl check
2025-10-10T14:06:59.439004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:06:59.439017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:06:59.439028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:06:59.439044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594357339731436:8986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:06:59.442503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594357339731436:8986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:06:59.468296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594357339731465:8635]
2025-10-10T14:06:59.471652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594357339731436:8986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:06:59.493922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594357339731436:8986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:06:59.493977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594357339731436:8986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:06:59.493998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594357339731436:8986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:06:59.494033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:06:59.612500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:06:59.616019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:06:59.616873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:06:59.616890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:06:59.616933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:06:59.617188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:06:59.617373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594355761810303:8030]
2025-10-10T14:06:59.619344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:06:59.621079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:06:59.621333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:06:59.622491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:06:59.622769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:59.622776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:59.622783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:59.622789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:59.622794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:59.622800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:59.622806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:59.622810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:59.622815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:59.622820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:59.622825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:59.622831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:59.622871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:59.622964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:59.623002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:59.623038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:59.623070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:59.623102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:59.623135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:59.623165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:59.623196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:59.623228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:59.623258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:59.623288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:59.623321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:59.623372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:06:59.623414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:59.623452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:06:59.623484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:59.623522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:06:59.623572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:59.623611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:06:59.623646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:59.623687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:06:59.623720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:59.623758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:06:59.623792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:59.623830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:06:59.623860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:59.623897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:06:59.623930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:59.623971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:59.624002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:59.624040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:59.624072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:59.624112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:59.624145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:59.624185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:59.625257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:06:59.651690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:06:59.666786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:06:59.666821Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:06:59.666833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:06:59.666847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:06:59.666865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 637 [2:7559594355761810303:8030]
2025-10-10T14:06:59.666905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:06:59.666953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:06:59.666966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:59.666974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:59.666983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:59.667017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:06:59.667034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:06:59.667052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:06:59.668039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:59.668049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:59.668058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:59.668068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:59.668076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:06:59.668281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:06:59.668292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:59.668386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:06:59.668509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:06:59.668656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:06:59.668732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:06:59.668787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594355761810298:8030]
2025-10-10T14:06:59.668797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594355761810298:8030]
2025-10-10T14:06:59.668806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594355761810298:8030]
2025-10-10T14:06:59.668814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594355761810298:8030]
2025-10-10T14:06:59.669089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:06:59.669097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:06:59.669104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:06:59.669111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:06:59.669409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:06:59.669501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:06:59.669675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:06:59.669696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:06:59.669756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594357339731511:8986], now have 1 active actors on pipe
2025-10-10T14:06:59.669780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594357339731421:2442], now have 1 active actors on pipe
2025-10-10T14:06:59.669800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594357339731465:8635], now have 1 active actors on pipe
2025-10-10T14:06:59.669939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594355761810298:8030]
2025-10-10T14:06:59.669967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:06:59.671019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 637
2025-10-10T14:06:59.671141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 637
2025-10-10T14:06:59.671222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 637, pipe: [1:7559594357339731465:8635]
2025-10-10T14:06:59.670137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:06:59.678220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:59.678266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:59.678376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:06:59.678415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:59.678433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:59.678443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:06:59.678484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:59.678537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:06:59.678594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:59.683021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:06:59.683059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:06:59.683152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:06:59.683625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 638 partition: 0 MaxSeqNo: 36 sessionId: src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0
2025-10-10T14:06:59.685352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe120fb0-28d5f1d1-eaf5aaf5-c5b080f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:06:59.723345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0] Write session: try to update token
2025-10-10T14:06:59.723410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:06:59.838624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:06:59.838659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:06:59.838670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:06:59.838733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:06:59.838750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:06:59.838765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:06:59.838780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:06:59.838792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:06:59.838832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594355761810298:8030]
2025-10-10T14:06:59.838859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594355761810298:8030]
2025-10-10T14:06:59.838886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594355761810298:8030]
2025-10-10T14:06:59.838909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594355761810298:8030]
2025-10-10T14:06:59.839051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:06:59.839079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:06:59.839091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:06:59.839129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:06:59.839189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:06:59.839219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:06:59.839264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:06:59.856709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:06:59.985308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId: src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:00.029412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:00.141571Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:00.154238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:00.154280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:00.158642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:00.158672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:00.169951Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:00.299720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:00.299805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0] Write session will restart in 0.006416s
2025-10-10T14:07:00.300022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0] Write session: Do CDS request
2025-10-10T14:07:00.300091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:00.296245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:00.296403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594357339731465:8635]
2025-10-10T14:07:00.296490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 638 reason: error at write: Disconnected sessionId: src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0
2025-10-10T14:07:00.296833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 638 sessionId: src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0 is DEAD
2025-10-10T14:07:00.320123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:00.321415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:00.321455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 639
2025-10-10T14:07:00.325655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:00.325836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:00.325865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:00.325878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:00.327427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 639 sessionId:  describe result for acl check
2025-10-10T14:07:00.327585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:00.327598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:00.327609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:00.327626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594361634699111:8998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:00.330523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594361634699111:8998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:00.356558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594361634699111:8998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:00.391861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594361634699111:8998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:00.391911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594361634699111:8998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:00.391930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594361634699111:8998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:00.391963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:00.394750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:00.400470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594361634699180:8635]
2025-10-10T14:07:00.397268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:00.398162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:00.398181Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:00.398229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:00.398508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:00.398709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594360056777812:8039]
2025-10-10T14:07:00.401842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:00.403106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:00.403362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:00.404733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:00.405080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:00.405089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:00.405096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:00.405104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:00.405111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:00.405119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:00.405146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:00.405154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:00.405162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:00.405169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:00.405177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:00.405185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:00.405235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:00.405356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:00.405409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:00.405461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:00.405512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:00.405567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:00.405623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:00.405677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:00.405727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:00.405778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:00.405842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:00.405892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:00.405936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:00.406012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:00.406077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:00.406885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:00.406964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:00.407032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:00.407085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:00.407146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:00.407204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:00.407283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:00.407334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:00.407391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:00.407443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:00.407500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:00.407567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:00.407626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:00.407683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:00.407741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:00.407793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:00.407852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:00.407908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:00.407976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:00.408025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:00.408085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:00.408587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:00.443547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:00.535893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:00.535946Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:00.535964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:00.535984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:00.536008Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 638 [2:7559594360056777812:8039]
2025-10-10T14:07:00.536064Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:00.536128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:00.536143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:00.536155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:00.536168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:00.536214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:00.536244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:00.536266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:00.538526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 638, pipe: [1:7559594361634699180:8635]
2025-10-10T14:07:00.538696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 638
2025-10-10T14:07:00.538795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 638
2025-10-10T14:07:00.537572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:00.537599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:00.537612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:00.537626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:00.537638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:00.537920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:00.537937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:00.538077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:00.538252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:00.538465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:00.538598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:00.538680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594361634699180:8635], now have 1 active actors on pipe
2025-10-10T14:07:00.538705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594361634699177:8998], now have 1 active actors on pipe
2025-10-10T14:07:00.538726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594361634699061:2442], now have 1 active actors on pipe
2025-10-10T14:07:00.538752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.538767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.538780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.538792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.538823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:00.538861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:00.538876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:00.538889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:00.538899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:00.538902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:00.539069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:00.539087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:00.539147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:00.539167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:00.539311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.539342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:00.539358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:00.539414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4206643-2b332796-920798b1-c397274d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:00.539449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:00.539468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:00.539478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:00.539515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:00.539571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:00.539710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:00.541687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:00.541714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:00.541782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:00.547595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 639 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4206643-2b332796-920798b1-c397274d_0
2025-10-10T14:07:00.553388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b20c0e-2cdd819d-1cd0fac9-befb0749_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4206643-2b332796-920798b1-c397274d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:00.614889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4206643-2b332796-920798b1-c397274d_0] Write session: try to update token
2025-10-10T14:07:00.614951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4206643-2b332796-920798b1-c397274d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:00.711187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:00.711230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:00.711244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:00.711256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:00.711266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:00.711301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.711329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.711354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.711379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.711571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:00.711585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:00.711597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:00.711699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:00.711727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:00.711738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:00.712801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:00.713232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:00.713262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:00.713294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:00.713324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:00.749240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId: src_id|b4206643-2b332796-920798b1-c397274d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:00.782849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:00.900320Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:00.945544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:00.945599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:00.945681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:00.945696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:00.945738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594360056777807:8039]
2025-10-10T14:07:00.951631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594361634699180:8635]
2025-10-10T14:07:00.949463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:00.951778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:00.951794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:00.952309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:00.953441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:01.014581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4206643-2b332796-920798b1-c397274d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:01.014667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4206643-2b332796-920798b1-c397274d_0] Write session will restart in 0.006260s
2025-10-10T14:07:01.014863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4206643-2b332796-920798b1-c397274d_0] Write session: Do CDS request
2025-10-10T14:07:01.014914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4206643-2b332796-920798b1-c397274d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:01.013754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 639 reason: error at write: Disconnected sessionId: src_id|b4206643-2b332796-920798b1-c397274d_0
2025-10-10T14:07:01.014075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 639 sessionId: src_id|b4206643-2b332796-920798b1-c397274d_0 is DEAD
2025-10-10T14:07:01.026913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4206643-2b332796-920798b1-c397274d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:01.031579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:01.031617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 640
2025-10-10T14:07:01.033272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:01.033417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:01.033440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:01.033451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:01.034982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 640 sessionId:  describe result for acl check
2025-10-10T14:07:01.035099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:01.035110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:01.035119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:01.035137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594365929666546:9007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:01.037703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594365929666546:9007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:01.049413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594365929666546:9007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:01.062181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594365929666585:8635]
2025-10-10T14:07:01.083919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594365929666546:9007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:01.083956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594365929666546:9007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:01.083969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594365929666546:9007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:01.083994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:01.154680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:01.162322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:01.163234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:01.163254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:01.163299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:01.163581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:01.163844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594364351745377:8051]
2025-10-10T14:07:01.166285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:01.167394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:01.167625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:01.168992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:01.169341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:01.169350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:01.169359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:01.169368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:01.169376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:01.169384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:01.169392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:01.169400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:01.169408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.169416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.169423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.169430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.169483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:01.169608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:01.169662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:01.169715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:01.169764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:01.169817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:01.169886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:01.169936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:01.169986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.170038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.170093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.170150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.170194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:01.170265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:01.170338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:01.170398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:01.170450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:01.170508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:01.170558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:01.170615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:01.170669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:01.170727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:01.170774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:01.170831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:01.170882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:01.170940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:01.170993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:01.171050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:01.171100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.171154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.171201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.171261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.171309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.171366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.171414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.171483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.171985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:01.225714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:01.268033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:01.268082Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:01.268103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:01.268124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:01.268151Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 639 [2:7559594364351745377:8051]
2025-10-10T14:07:01.268216Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:01.268281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:01.268297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:01.268310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:01.268322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:01.268371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:01.268395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:01.268418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:01.278206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.278240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.278257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.278272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.278284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:01.278591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:01.278610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.278772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.278982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.279233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.279366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:01.279449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594365929666585:8635], now have 1 active actors on pipe
2025-10-10T14:07:01.279478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594365929666636:9007], now have 1 active actors on pipe
2025-10-10T14:07:01.279502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594361634699230:2442], now have 1 active actors on pipe
2025-10-10T14:07:01.279543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594364351745372:8051]
2025-10-10T14:07:01.279559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594364351745372:8051]
2025-10-10T14:07:01.279573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594364351745372:8051]
2025-10-10T14:07:01.279586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594364351745372:8051]
2025-10-10T14:07:01.279632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:01.279672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:01.279688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:01.279702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:01.279714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:01.279718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:01.279918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:01.279936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:01.280056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594364351745372:8051]
2025-10-10T14:07:01.280082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:01.280536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:01.280618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 639, pipe: [1:7559594365929666585:8635]
2025-10-10T14:07:01.280735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 639
2025-10-10T14:07:01.280812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 639
2025-10-10T14:07:01.285237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:01.285282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:01.285383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:01.285416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:01.285434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:01.285445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:01.285481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:01.285525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:01.285577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:01.289252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:01.289290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:01.289367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:01.293377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 640 partition: 0 MaxSeqNo: 36 sessionId: src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0
2025-10-10T14:07:01.297421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4206643-2b332796-920798b1-c397274d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:01.346313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0] Write session: try to update token
2025-10-10T14:07:01.346375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:01.369399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:01.369434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:01.369447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:01.448588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:01.448623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:01.448637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:01.448651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:01.448665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:01.448706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594364351745372:8051]
2025-10-10T14:07:01.448737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594364351745372:8051]
2025-10-10T14:07:01.448767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594364351745372:8051]
2025-10-10T14:07:01.448795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594364351745372:8051]
2025-10-10T14:07:01.448943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:01.448954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:01.448983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:01.448986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.448999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:01.449030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:01.449070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:01.450233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:01.591949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId: src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:01.655004Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:01.661144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:01.704744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594365929666585:8635]
2025-10-10T14:07:01.704930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:01.704950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:01.718630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 640 reason: error at write: Disconnected sessionId: src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0
2025-10-10T14:07:01.718925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 640 sessionId: src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0 is DEAD
2025-10-10T14:07:01.721063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:01.721156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0] Write session will restart in 0.009201s
2025-10-10T14:07:01.721351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0] Write session: Do CDS request
2025-10-10T14:07:01.721411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:01.738865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:01.751914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:01.752072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:01.752087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 641
2025-10-10T14:07:01.754552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:01.754732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:01.754758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:01.754771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:01.758339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 641 sessionId:  describe result for acl check
2025-10-10T14:07:01.758487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:01.758506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:01.758516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:01.758534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594365929666784:9021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:01.761489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594365929666784:9021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:01.777206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594365929666784:9021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:01.799804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594365929666784:9021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:01.799853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594365929666784:9021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:01.799871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594365929666784:9021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:01.799903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:01.806900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594365929666838:8635]
2025-10-10T14:07:01.904941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:01.919772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:01.920792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:01.920813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:01.920871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:01.921224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:01.921435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594364351745608:8060]
2025-10-10T14:07:01.924090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:01.927692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:01.927964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:01.929425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:01.929820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:01.929830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:01.929840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:01.929848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:01.929857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:01.929867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:01.929876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:01.929886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:01.929896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.929904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.929911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.929918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.929977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:01.930099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:01.930153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:01.930206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:01.930260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:01.930309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:01.930361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:01.930415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:01.930465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.930519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.930570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.930622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.930680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:01.930755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:01.930825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:01.930886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:01.930940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:01.931002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:01.931052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:01.931111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:01.931164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:01.931223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:01.931270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:01.931330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:01.931382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:01.931448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:01.931522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:01.931583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:01.931639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.931705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:01.931760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.931823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:01.931879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.931939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:01.931989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.932045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:01.934084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:02.079634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:02.100323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:02.100383Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:02.100403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:02.100426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:02.100450Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 640 [2:7559594364351745608:8060]
2025-10-10T14:07:02.100510Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:02.100580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:02.100603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:02.100616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:02.100629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:02.100681Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:02.100705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:02.100727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:02.103313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:02.103334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:02.103353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:02.103370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:02.103383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:02.103695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:02.103714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:02.103881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:02.104096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:02.104354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:02.104485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:02.104563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.104592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.104606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.104623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.104671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:02.104758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:02.104853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:02.104869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:02.104881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:02.104894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:02.104961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:02.104979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:02.105109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.105151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:02.105158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:02.105252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594365929666838:8635], now have 1 active actors on pipe
2025-10-10T14:07:02.105278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594365929666779:2442], now have 1 active actors on pipe
2025-10-10T14:07:02.105302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594365929666827:9021], now have 1 active actors on pipe
2025-10-10T14:07:02.105772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 640, pipe: [1:7559594365929666838:8635]
2025-10-10T14:07:02.105873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 640
2025-10-10T14:07:02.105959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 640
2025-10-10T14:07:02.106586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:02.106623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:02.106708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40626660-6f6867e0-a6997082-7db65476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:02.106742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:02.106760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:02.106772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:02.106808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:02.106857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:02.106917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:02.108500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:02.108533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:02.108602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:02.108991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 641 partition: 0 MaxSeqNo: 36 sessionId: src_id|40626660-6f6867e0-a6997082-7db65476_0
2025-10-10T14:07:02.110238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97965bf-95f8b31-3c4c8e01-4b4fabbe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|40626660-6f6867e0-a6997082-7db65476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:02.190792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40626660-6f6867e0-a6997082-7db65476_0] Write session: try to update token
2025-10-10T14:07:02.190852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40626660-6f6867e0-a6997082-7db65476_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:02.196880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:02.196913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:02.196925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:02.404391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:02.404435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:02.404450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:02.404461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:02.404472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:02.404514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.404541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.404565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.404589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.404761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:02.404786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:02.404798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:02.404913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:02.404946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:02.404957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:02.406060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:02.409262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:02.409297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:02.409329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:02.409359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:02.482990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId: src_id|40626660-6f6867e0-a6997082-7db65476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:02.506832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:02.598043Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:02.665889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:02.665943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:02.666011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:02.666026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:02.666068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594364351745603:8060]
2025-10-10T14:07:02.666966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:02.671922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594365929666838:8635]
2025-10-10T14:07:02.672100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:02.672343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:02.672369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:02.669555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:02.690937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40626660-6f6867e0-a6997082-7db65476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:02.691015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40626660-6f6867e0-a6997082-7db65476_0] Write session will restart in 0.009773s
2025-10-10T14:07:02.691181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40626660-6f6867e0-a6997082-7db65476_0] Write session: Do CDS request
2025-10-10T14:07:02.691227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40626660-6f6867e0-a6997082-7db65476_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:02.689502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 641 reason: error at write: Disconnected sessionId: src_id|40626660-6f6867e0-a6997082-7db65476_0
2025-10-10T14:07:02.689894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 641 sessionId: src_id|40626660-6f6867e0-a6997082-7db65476_0 is DEAD
2025-10-10T14:07:02.712164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40626660-6f6867e0-a6997082-7db65476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:02.713910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:02.713950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 642
2025-10-10T14:07:02.715312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:02.715561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:02.715593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:02.715611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:02.718346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 642 sessionId:  describe result for acl check
2025-10-10T14:07:02.718572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:02.718590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:02.718611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:02.718646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594370224634334:9031] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:02.724845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594370224634334:9031] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:02.747444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594370224634334:9031] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:02.885364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594370224634431:8635]
2025-10-10T14:07:02.891887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594370224634334:9031] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:02.891943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594370224634334:9031] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:02.891960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594370224634334:9031] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:02.891994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:02.992169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:02.994591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:02.995529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:02.995547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:02.995597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:02.995880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:02.996082Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594368646713175:8072]
2025-10-10T14:07:02.998507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:02.999896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:03.000150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:03.001544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:03.001894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:03.001904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:03.001913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:03.001920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:03.001928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:03.001936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:03.001943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:03.001950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:03.001958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.001967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.001976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.001983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.002038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:03.002160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:03.002212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:03.002263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:03.002314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:03.002365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:03.002415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:03.002466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:03.002518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.002585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.002636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.002688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.002731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:03.002807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:03.002877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:03.002939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:03.002992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:03.003050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:03.003100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:03.003162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:03.003216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:03.003276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:03.003327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:03.003385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:03.003440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:03.004733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:03.004811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:03.004876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:03.004935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.004993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.005045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.005106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.005178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.005251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.005306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.005366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.005902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:03.111077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:03.127862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:03.127911Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:03.127933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:03.127955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:03.127979Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 641 [2:7559594368646713175:8072]
2025-10-10T14:07:03.128042Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:03.128105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:03.128122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:03.128135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:03.128147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:03.128195Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:03.128219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:03.128242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:03.130304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.130333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.130350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.130366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.130379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:03.130693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:03.130714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.130880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.131093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.131356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.133385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 641
2025-10-10T14:07:03.133489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 641
2025-10-10T14:07:03.133560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 641, pipe: [1:7559594370224634431:8635]
2025-10-10T14:07:03.134034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:03.134144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.134162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.134180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.134193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.134229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:03.134332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594370224634446:9031], now have 1 active actors on pipe
2025-10-10T14:07:03.134360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594370224634330:2442], now have 1 active actors on pipe
2025-10-10T14:07:03.134387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594370224634431:8635], now have 1 active actors on pipe
2025-10-10T14:07:03.134435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:03.134458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:03.134527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:03.134740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:03.134758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:03.134921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:03.134952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:03.134972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:03.134984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:03.135020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:03.135059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:03.135102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.135126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:03.135232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:03.135384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:03.135399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:03.135413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:03.135426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:03.135450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:03.143130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 642 partition: 0 MaxSeqNo: 36 sessionId: src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0
2025-10-10T14:07:03.145836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40626660-6f6867e0-a6997082-7db65476_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:03.141946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:03.141998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:03.142095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:03.207731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0] Write session: try to update token
2025-10-10T14:07:03.207793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:03.232161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:03.232195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:03.232209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:03.365782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:03.365825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:03.365850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:03.365954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:03.365986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:03.366018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:03.366045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:03.366078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:03.366157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.366211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.366263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.366321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.366639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:03.366672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.366685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:03.366823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:03.366855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:03.366906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:03.366940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:03.373053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:03.570285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId: src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:03.600368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:03.669671Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:03.702989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:03.703046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:03.703118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:03.703132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:03.703175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594368646713170:8072]
2025-10-10T14:07:03.703714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:03.704339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:03.704370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:03.706238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:03.714818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:03.714972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 642 reason: error at write: Disconnected sessionId: src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0
2025-10-10T14:07:03.715351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 642 sessionId: src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0 is DEAD
2025-10-10T14:07:03.721448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:03.721516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0] Write session will restart in 0.007846s
2025-10-10T14:07:03.721674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0] Write session: Do CDS request
2025-10-10T14:07:03.721722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:03.726554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594370224634431:8635]
2025-10-10T14:07:03.736370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:03.737455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:03.737493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 643
2025-10-10T14:07:03.737866Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:03.737986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:03.738002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:03.738014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:03.739420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 643 sessionId:  describe result for acl check
2025-10-10T14:07:03.739570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:03.739590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:03.739600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:03.739616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594374519601898:9044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:03.741938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594374519601898:9044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:03.765026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594374519601898:9044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:03.802370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594374519601898:9044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:03.802428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594374519601898:9044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:03.802448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594374519601898:9044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:03.802482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:03.823252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594374519601943:8635]
2025-10-10T14:07:03.939857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:03.947680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:03.948668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:03.948686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:03.948731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:03.948991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:03.949217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594372941680716:8080]
2025-10-10T14:07:03.951810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:03.952979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:03.954923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:03.956445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:03.956784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:03.956793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:03.956800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:03.956809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:03.956816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:03.956824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:03.956831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:03.956838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:03.956846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.956855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.956864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.956871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.956923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:03.957043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:03.957097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:03.957165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:03.957218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:03.957272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:03.957324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:03.957378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:03.957428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.957479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.957530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.957582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.957623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:03.957693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:03.957758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:03.957816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:03.957871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:03.957926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:03.957976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:03.958038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:03.958090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:03.958148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:03.958197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:03.958259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:03.958311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:03.958372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:03.958420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:03.958480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:03.958532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.958591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:03.958639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.958696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:03.958747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.958802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:03.958850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.958908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:03.959388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:04.019553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:04.035595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:04.035643Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:04.035660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:04.035679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:04.035701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 642 [2:7559594372941680716:8080]
2025-10-10T14:07:04.035758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:04.035813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:04.035827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:04.035839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:04.035851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:04.035895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:04.035916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:04.035938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:04.038685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:04.038714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:04.038728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:04.038744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:04.038757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:04.039029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:04.039048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:04.039196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:04.039403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:04.039668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:04.041268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 642
2025-10-10T14:07:04.041362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 642, pipe: [1:7559594374519601943:8635]
2025-10-10T14:07:04.041437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 642
2025-10-10T14:07:04.041710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:04.041805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594374519601892:2442], now have 1 active actors on pipe
2025-10-10T14:07:04.041830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594374519601943:8635], now have 1 active actors on pipe
2025-10-10T14:07:04.041853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594374519601932:9044], now have 1 active actors on pipe
2025-10-10T14:07:04.041914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:04.041937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:04.041976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594372941680711:8080]
2025-10-10T14:07:04.041992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594372941680711:8080]
2025-10-10T14:07:04.042006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594372941680711:8080]
2025-10-10T14:07:04.042021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594372941680711:8080]
2025-10-10T14:07:04.042059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:04.042144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:04.042336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:04.042353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:04.042416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:04.042446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:04.042464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:04.042475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:04.042508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:04.042565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:04.042692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594372941680711:8080]
2025-10-10T14:07:04.042713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:04.042759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:04.051180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 643 partition: 0 MaxSeqNo: 36 sessionId: src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0
2025-10-10T14:07:04.043436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:04.043471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:04.043484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:04.043496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:04.043518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:04.050171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:04.050207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:04.050294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:04.054344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89d588f-77c686f-6d2d8225-4bbb90d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:04.115433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0] Write session: try to update token
2025-10-10T14:07:04.115509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:04.137412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:04.137461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:04.137474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:04.270676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:04.270715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:04.270730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:04.270741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:04.270752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:04.270790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594372941680711:8080]
2025-10-10T14:07:04.270816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594372941680711:8080]
2025-10-10T14:07:04.270841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594372941680711:8080]
2025-10-10T14:07:04.270866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594372941680711:8080]
2025-10-10T14:07:04.271036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:04.271092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:04.271126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:04.271164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:04.275888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:04.275926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:04.275939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:04.276004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:04.276032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:04.276043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:04.309768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:04.379504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId: src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:04.474543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:04.717628Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:04.719893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:04.719924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:04.727300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:04.727490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594374519601943:8635]
2025-10-10T14:07:04.727579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:04.727591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:04.741918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 643 reason: error at write: Disconnected sessionId: src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0
2025-10-10T14:07:04.742279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 643 sessionId: src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0 is DEAD
2025-10-10T14:07:04.745237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:04.745284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0] Write session will restart in 0.007148s
2025-10-10T14:07:04.745382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0] Write session: Do CDS request
2025-10-10T14:07:04.745411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:04.771356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:04.774359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:04.774397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 644
2025-10-10T14:07:04.775025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:04.775145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:04.775160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:04.775170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:04.776628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 644 sessionId:  describe result for acl check
2025-10-10T14:07:04.776749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:04.776762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:04.776771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:04.776788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594378814569456:9054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:04.784133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594378814569456:9054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:04.805338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594378814569456:9054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:04.818196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:04.823994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594378814569485:8635]
2025-10-10T14:07:04.835987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594378814569456:9054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:04.836032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594378814569456:9054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:04.836049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594378814569456:9054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:04.836080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:05.018119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:05.020477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:05.021372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:05.021391Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:05.021437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:05.021690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:05.021880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594381531615566:8092]
2025-10-10T14:07:05.024009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:05.025391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:05.025613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:05.026796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:05.027093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:05.027100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:05.027107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:05.027113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:05.027121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:05.027127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:05.027133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:05.027140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:05.027146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.027153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.027158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.027166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.027209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:05.027314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:05.027362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:05.027407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:05.027470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:05.027515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:05.027555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:05.027598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:05.027639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.027685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.027728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.027768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.027807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:05.027869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:05.027926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:05.027978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:05.028026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:05.028076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:05.028121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:05.028172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:05.028216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:05.028263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:05.028304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:05.028354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:05.028396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:05.028443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:05.028485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:05.028537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:05.028580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.028632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.028673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.028724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.028770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.028818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.028859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.028906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.030551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:05.114854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:05.137919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:05.137978Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:05.137996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:05.138016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:05.138040Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 643 [2:7559594381531615566:8092]
2025-10-10T14:07:05.138102Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:05.138169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:05.138184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:05.138195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:05.138206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:05.138256Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:05.138279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:05.138303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:05.140472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.140490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.140504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.140516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.140526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:05.140821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:05.140839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.140976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.141170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.144051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 643
2025-10-10T14:07:05.144150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 643
2025-10-10T14:07:05.144224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 643, pipe: [1:7559594378814569485:8635]
2025-10-10T14:07:05.141379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.141503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:05.141590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594378814569490:9054], now have 1 active actors on pipe
2025-10-10T14:07:05.141611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594378814569447:2442], now have 1 active actors on pipe
2025-10-10T14:07:05.141632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594378814569485:8635], now have 1 active actors on pipe
2025-10-10T14:07:05.141658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.141673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.141685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.141698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.141736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:05.141817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:05.142000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:05.142019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:05.142156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.142177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:05.142702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:05.142716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:05.142727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:05.142739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:05.142765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:05.153761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:05.153810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:05.153914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:05.153953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:05.153989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:05.154001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:05.154041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:05.154093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:05.154148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:05.160862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:05.160913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:05.161005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:05.161554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 644 partition: 0 MaxSeqNo: 36 sessionId: src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0
2025-10-10T14:07:05.162912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4aa7a07-b53125fc-6a1866f8-e9733960_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:05.213378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0] Write session: try to update token
2025-10-10T14:07:05.213442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:05.362787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:05.362822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:05.362834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:05.362889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:05.362905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:05.362919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:05.362930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:05.362941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:05.362978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.363004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.363030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.363054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.363267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:05.363294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.363306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:05.364492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:05.365234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:05.365266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:05.365297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:05.365325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:05.400436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId: src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:05.435366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:05.516130Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:05.528379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:05.528434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:05.528514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:05.528530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:05.528576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594381531615561:8092]
2025-10-10T14:07:05.528990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:05.529435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:05.530300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594378814569485:8635]
2025-10-10T14:07:05.530411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:05.530425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:05.543725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:05.557854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 644 reason: error at write: Disconnected sessionId: src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0
2025-10-10T14:07:05.558176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 644 sessionId: src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0 is DEAD
2025-10-10T14:07:05.563368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:05.563450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0] Write session will restart in 0.008632s
2025-10-10T14:07:05.563571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0] Write session: Do CDS request
2025-10-10T14:07:05.563619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:05.623164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:05.633968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594383109537044:8635]
2025-10-10T14:07:05.634020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:05.634034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 645
2025-10-10T14:07:05.638612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:05.638765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:05.638780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:05.638791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:05.641273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 645 sessionId:  describe result for acl check
2025-10-10T14:07:05.641395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:05.641405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:05.641414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:05.641432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594383109537057:9067] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:05.643963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594383109537057:9067] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:05.674500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594383109537057:9067] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:05.691903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594383109537057:9067] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:05.691951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594383109537057:9067] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:05.691971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594383109537057:9067] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:05.692002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:05.716133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:05.724443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:05.725405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:05.725436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:05.725485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:05.725777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:05.725977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594381531615786:8100]
2025-10-10T14:07:05.728484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:05.730607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:05.730876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:05.732406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:05.732809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:05.732819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:05.732826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:05.732834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:05.732842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:05.732849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:05.732857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:05.732864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:05.732871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.732879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.732886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.732894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.732946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:05.733091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:05.733167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:05.733219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:05.733271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:05.733322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:05.733374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:05.733425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:05.733478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.733534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.733587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.733637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.733682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:05.733755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:05.733819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:05.733883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:05.733937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:05.734000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:05.734051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:05.734109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:05.734162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:05.734224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:05.734271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:05.734327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:05.734373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:05.734431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:05.734480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:05.734586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:05.734647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.734706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.734755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.734815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.734868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.734930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.734978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.735037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.735544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:05.785656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:05.820845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:05.820917Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:05.820937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:05.820966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:05.820991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 644 [2:7559594381531615786:8100]
2025-10-10T14:07:05.821044Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:05.821101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:05.821115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:05.821144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:05.821157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:05.821230Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:05.824934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:05.824982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:05.827234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.827278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.827294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.827308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.827321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:05.827644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:05.827664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:05.827812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:05.827992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:05.828208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:05.828329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:05.828406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:05.828421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:05.828436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:05.828448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:05.828493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:05.828570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:05.828750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:05.828767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:05.828897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:05.828918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:05.829516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:05.829529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:05.829540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:05.829552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:05.829575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:05.833295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 644, pipe: [1:7559594383109537044:8635]
2025-10-10T14:07:05.833436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 644
2025-10-10T14:07:05.833526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 644
2025-10-10T14:07:05.832299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594383109537044:8635], now have 1 active actors on pipe
2025-10-10T14:07:05.832343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594383109537011:2442], now have 1 active actors on pipe
2025-10-10T14:07:05.832364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594383109537180:9067], now have 1 active actors on pipe
2025-10-10T14:07:05.834636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:05.834664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:05.834756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:05.834797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:05.834817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:05.834828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:05.834875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:05.834948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:05.835013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:05.838241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:05.838282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:05.838367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:05.839747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 645 partition: 0 MaxSeqNo: 36 sessionId: src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0
2025-10-10T14:07:05.845780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a4cec7f-2018e228-bd5398ac-5e503ed7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:05.898181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0] Write session: try to update token
2025-10-10T14:07:05.898245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:05.932154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:05.932190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:05.932202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:06.020132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:06.037207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:06.037242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:06.037255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:06.037267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:06.037308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:06.037336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:06.037364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:06.037391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:06.037662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:06.037674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:06.037686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:06.037727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:06.037754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:06.037765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:06.038892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:06.041640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:06.041688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:06.041725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:06.041757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:06.088537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId: src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:06.112431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:06.274262Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:06.311455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:06.311507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:06.311579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:06.311593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:06.311633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594381531615780:8100]
2025-10-10T14:07:06.313435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:06.315515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:06.315641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594383109537044:8635]
2025-10-10T14:07:06.315740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:06.315862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:06.315875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:06.343005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 645 reason: error at write: Disconnected sessionId: src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0
2025-10-10T14:07:06.343414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 645 sessionId: src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0 is DEAD
2025-10-10T14:07:06.347080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:06.347143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0] Write session will restart in 0.008294s
2025-10-10T14:07:06.347347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0] Write session: Do CDS request
2025-10-10T14:07:06.347425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:06.371713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:06.372017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:06.372073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 646
2025-10-10T14:07:06.376397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:06.376573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:06.376591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:06.376602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:06.378152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 646 sessionId:  describe result for acl check
2025-10-10T14:07:06.378281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:06.378292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:06.378302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:06.378319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594387404504574:9076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:06.394103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594387404504574:9076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:06.411611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594387404504574:9076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:06.418601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594387404504598:8635]
2025-10-10T14:07:06.429544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594387404504574:9076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:06.429595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594387404504574:9076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:06.429612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594387404504574:9076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:06.429646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:06.568915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:06.578654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:06.579907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:06.579938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:06.579986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:06.580309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:06.580514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594385826583355:8112]
2025-10-10T14:07:06.583007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:06.601630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:06.601942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:06.603506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:06.603923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:06.603933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:06.603941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:06.603950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:06.603958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:06.603966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:06.603975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:06.603982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:06.603990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:06.603998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:06.604006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:06.604014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:06.604067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:06.604199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:06.604257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:06.604314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:06.604366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:06.604418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:06.604470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:06.604532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:06.604583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:06.604639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:06.605387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:06.605455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:06.605512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:06.618453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:06.618573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:06.618664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:06.618729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:06.618799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:06.618855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:06.618919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:06.618984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:06.619050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:06.619106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:06.619169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:06.619230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:06.619296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:06.619355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:06.619438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:06.619495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:06.619570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:06.619625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:06.619691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:06.619748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:06.619811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:06.619862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:06.619920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:06.620559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:06.744894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:06.758735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:06.758787Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:06.758807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:06.758831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:06.758856Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 645 [2:7559594385826583355:8112]
2025-10-10T14:07:06.758917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:06.758983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:06.759000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:06.759013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:06.759025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:06.759076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:06.759099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:06.759123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:06.760556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:06.760574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:06.760588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:06.760605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:06.760617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:06.760906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:06.760926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:06.761082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:06.761771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 645, pipe: [1:7559594387404504598:8635]
2025-10-10T14:07:06.761884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 645
2025-10-10T14:07:06.761980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 645
2025-10-10T14:07:06.762123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:06.762399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:06.762528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:06.762617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594387404504605:9076], now have 1 active actors on pipe
2025-10-10T14:07:06.762644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594387404504598:8635], now have 1 active actors on pipe
2025-10-10T14:07:06.762667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594387404504561:2442], now have 1 active actors on pipe
2025-10-10T14:07:06.762737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:06.762760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:06.762800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:06.762815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:06.762831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:06.762845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:06.762887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:06.762979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:06.763174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:06.763192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:06.763260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:06.763291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:06.763310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:06.763320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:06.763354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:06.763415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:06.763555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:06.763577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:06.763624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:06.767648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:06.767675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:06.767688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:06.767703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:06.767738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:06.770701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 646 partition: 0 MaxSeqNo: 36 sessionId: src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0
2025-10-10T14:07:06.770239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:06.770283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:06.770371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:06.773968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34b53fa6-5dd05fa9-9d84dac-1afc09e4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:06.844367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0] Write session: try to update token
2025-10-10T14:07:06.844431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:06.991227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:06.991253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:06.991261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:06.991301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:06.991311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:06.991319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:06.991326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:06.991332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:06.991357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:06.991390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:06.991410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:06.998274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:06.998583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:06.998613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:06.998626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:07.000032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:07.000112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:07.000148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:07.000180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:07.000213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:07.046012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId: src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:07.087179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:07.173936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:07.210748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:07.210797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:07.210864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:07.210876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:07.210914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594385826583349:8112]
2025-10-10T14:07:07.212714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:07.212745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:07.211356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:07.219506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:07.239621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 646 reason: error at write: Disconnected sessionId: src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0
2025-10-10T14:07:07.239915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 646 sessionId: src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0 is DEAD
2025-10-10T14:07:07.241562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:07.241595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0] Write session will restart in 0.005567s
2025-10-10T14:07:07.241693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0] Write session: Do CDS request
2025-10-10T14:07:07.241724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:07.252535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:07.272886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594387404504598:8635]
2025-10-10T14:07:07.272991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:07.273967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:07.273993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 647
2025-10-10T14:07:07.274516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:07.274632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:07.274648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:07.274657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:07.276111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 647 sessionId:  describe result for acl check
2025-10-10T14:07:07.276229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:07.276240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:07.276249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:07.276264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594391699472138:9090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:07.278871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594391699472138:9090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:07.310412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594391699472138:9090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:07.320048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594391699472138:9090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:07.320094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594391699472138:9090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:07.320112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594391699472138:9090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:07.320143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:07.373411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594391699472340:8635]
2025-10-10T14:07:07.385719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:07.393052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:07.394036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:07.394070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:07.394120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:07.394422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:07.394611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594390121550887:8121]
2025-10-10T14:07:07.396966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:07.399737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:07.400031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:07.401440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:07.401811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:07.401823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:07.401831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:07.401839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:07.401846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:07.401854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:07.401861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:07.401868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:07.401875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:07.401882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:07.401889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:07.401897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:07.401948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:07.402066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:07.402116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:07.402167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:07.402217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:07.402267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:07.402316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:07.402364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:07.402415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:07.402466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:07.402551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:07.402598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:07.402645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:07.402716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:07.402791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:07.402851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:07.402901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:07.402959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:07.403007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:07.403064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:07.403156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:07.403215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:07.403264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:07.403321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:07.403408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:07.403469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:07.403520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:07.403576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:07.403651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:07.403708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:07.403755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:07.403809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:07.403858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:07.403916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:07.403963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:07.404017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:07.404496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:07.434139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:07.480219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:07.480268Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:07.480287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:07.480307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:07.480331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 646 [2:7559594390121550887:8121]
2025-10-10T14:07:07.480389Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:07.480451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:07.480466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:07.480480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:07.480492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:07.480544Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:07.480567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:07.480588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:07.482017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:07.482048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:07.482067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:07.482082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:07.482094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:07.482396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:07.482415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:07.482574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:07.482783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:07.483046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:07.483175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:07.483262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594391699472133:2442], now have 1 active actors on pipe
2025-10-10T14:07:07.483289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594391699472340:8635], now have 1 active actors on pipe
2025-10-10T14:07:07.483313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594391699472241:9090], now have 1 active actors on pipe
2025-10-10T14:07:07.483339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.483356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.483385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.483398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.483442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:07.483532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:07.483738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:07.483757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:07.483892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.483916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:07.484099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:07.484115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:07.484128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:07.484142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:07.484167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:07.485647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 646
2025-10-10T14:07:07.485759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 646, pipe: [1:7559594391699472340:8635]
2025-10-10T14:07:07.485816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 646
2025-10-10T14:07:07.486716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:07.486760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:07.486839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:07.486862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:07.486875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:07.486883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:07.486910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:07.486948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:07.486999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:07.497348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:07.497404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:07.497497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:07.501356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 647 partition: 0 MaxSeqNo: 36 sessionId: src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0
2025-10-10T14:07:07.502044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe4c3c3d-6f7507bc-d792e5d7-b97dc732_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:07.540262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:07.540305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:07.540348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.540486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:07.540484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:07.542431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:07.544135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:07.553603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:07.554847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:07.556467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:07.556875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:07.562481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0] Write session: try to update token
2025-10-10T14:07:07.562539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:07.585791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:07.585831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:07.585846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:07.670156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:07.670197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:07.670212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:07.670227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:07.670241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:07.670283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.670312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.670344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.670373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594390121550882:8121]
2025-10-10T14:07:07.670509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:07.670528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:07.670555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:07.670557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:07.670567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:07.670598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:07.670628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:07.682707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:07.728209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId: src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:07.774639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:07.856728Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:07.859726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:07.859768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:07.860738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:07.863273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594391699472340:8635]
2025-10-10T14:07:07.863488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:07.869305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:07.874395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 647 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0
2025-10-10T14:07:07.875811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:07:07.875855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0] Write session will restart in 0.008543s
2025-10-10T14:07:07.875963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0] Write session: Do CDS request
2025-10-10T14:07:07.875998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:07.887505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 647 sessionId: src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0 is DEAD
2025-10-10T14:07:07.897788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:07.897226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:07.897262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 648
2025-10-10T14:07:07.898432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:07.898532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:07.898543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:07.898551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:07.899784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 648 sessionId:  describe result for acl check
2025-10-10T14:07:07.899929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:07.899942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:07.899952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:07.899970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594391699472387:9099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:07.903499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594391699472387:9099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:07.945659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594391699472387:9099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:07.963268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594391699472415:8635]
2025-10-10T14:07:07.967235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594391699472387:9099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:07.967295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594391699472387:9099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:07.967314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594391699472387:9099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:07.967345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:08.117226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:08.124570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:08.125355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:08.125377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:08.125412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:08.125617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:08.125791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594394416518459:8131]
2025-10-10T14:07:08.127607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:08.128514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:08.128672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:08.129788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:08.130087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:08.130098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:08.130107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:08.130116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:08.130124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:08.130132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:08.130141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:08.130148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:08.130153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.130159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.130164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.130170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.130209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:08.130316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:08.130359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:08.130397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:08.130435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:08.130473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:08.130509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:08.130549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:08.130587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.130627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.130663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.130704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.130735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:08.130792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:08.130846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:08.130902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:08.130939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:08.130986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:08.131025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:08.131065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:08.131103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:08.131147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:08.131190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:08.131249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:08.131288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:08.131343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:08.131394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:08.131437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:08.131474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.131517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.131549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.131592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.131627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.131670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.131707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.131746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.132103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:08.159386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:08.303631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:08.303679Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:08.303699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:08.303719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:08.303736Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 647 [2:7559594394416518459:8131]
2025-10-10T14:07:08.303790Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:08.303842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:08.303854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:08.303864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:08.303874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:08.303910Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:08.303927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:08.303944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:08.307387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 647
2025-10-10T14:07:08.307497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 647, pipe: [1:7559594391699472415:8635]
2025-10-10T14:07:08.307574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 647
2025-10-10T14:07:08.306081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.306112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.306128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.306145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.306158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:08.306475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:08.306494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.306665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.306871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.307130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.307258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:08.307362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594391699472374:2442], now have 1 active actors on pipe
2025-10-10T14:07:08.307389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594391699472415:8635], now have 1 active actors on pipe
2025-10-10T14:07:08.307414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594391699472419:9099], now have 1 active actors on pipe
2025-10-10T14:07:08.307441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594394416518453:8131]
2025-10-10T14:07:08.307457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594394416518453:8131]
2025-10-10T14:07:08.307470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594394416518453:8131]
2025-10-10T14:07:08.307483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594394416518453:8131]
2025-10-10T14:07:08.307527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:08.307617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:08.307809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:08.307826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:08.307960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594394416518453:8131]
2025-10-10T14:07:08.307983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:08.308160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:08.308174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:08.308186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:08.308199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:08.308224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:08.308534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:08.308562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:08.308641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:08.308670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:08.308688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:08.308699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:08.308734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:08.308774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:08.308833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:08.309382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:08.309413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:08.309480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:08.309823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 648 partition: 0 MaxSeqNo: 36 sessionId: src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0
2025-10-10T14:07:08.310553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0ec4e37-3ea288c1-d74be54c-16435b09_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:08.336443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0] Write session: try to update token
2025-10-10T14:07:08.336506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:08.387444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:08.387485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:08.387501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:08.387514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:08.387526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:08.387565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594394416518453:8131]
2025-10-10T14:07:08.387594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594394416518453:8131]
2025-10-10T14:07:08.387622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594394416518453:8131]
2025-10-10T14:07:08.387646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594394416518453:8131]
2025-10-10T14:07:08.387809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:08.387840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.387853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:08.388267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:08.388304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:08.388341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:08.388374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:08.398086Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:08.482447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId: src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:08.513273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:08.580950Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:08.583426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:08.583467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:08.589607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594391699472415:8635]
2025-10-10T14:07:08.589724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:08.589738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:08.591316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:08.626686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:08.626823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 648 reason: error at write: Disconnected sessionId: src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0
2025-10-10T14:07:08.627108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 648 sessionId: src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0 is DEAD
2025-10-10T14:07:08.633463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:08.633508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0] Write session will restart in 0.009272s
2025-10-10T14:07:08.633611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0] Write session: Do CDS request
2025-10-10T14:07:08.633644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:08.651840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:08.690346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:08.690383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 649
2025-10-10T14:07:08.692295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:08.692468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:08.692485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:08.692496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:08.692586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594395994439979:8635]
2025-10-10T14:07:08.694611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 649 sessionId:  describe result for acl check
2025-10-10T14:07:08.694734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:08.694745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:08.694754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:08.694770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594395994439981:9112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:08.699259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594395994439981:9112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:08.713534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594395994439981:9112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:08.742758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594395994439981:9112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:08.742817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594395994439981:9112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:08.742836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594395994439981:9112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:08.742872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:08.790555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:08.794300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:08.795201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:08.795232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:08.795275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:08.795574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:08.795759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594394416518683:8140]
2025-10-10T14:07:08.798654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:08.809490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:08.809788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:08.811179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:08.811551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:08.811560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:08.811566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:08.811575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:08.811583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:08.811592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:08.811599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:08.811607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:08.811613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.811621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.811629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.811636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.811685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:08.811797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:08.811847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:08.811896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:08.811942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:08.811989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:08.812036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:08.812084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:08.812133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.812183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.812230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.812276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.812318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:08.812384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:08.812445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:08.812505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:08.812560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:08.812664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:08.812722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:08.812776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:08.812829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:08.812888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:08.812937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:08.812990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:08.813053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:08.813148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:08.813201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:08.813258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:08.813312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.813367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.813414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.813471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.813520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.813575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.813623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.813676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.814147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:08.930663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:08.951096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:08.951145Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:08.951162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:08.951181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:08.951205Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 648 [2:7559594394416518683:8140]
2025-10-10T14:07:08.951264Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:08.951320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:08.951350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:08.951363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:08.951374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:08.951421Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:08.951442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:08.951463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:08.960045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.960077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.960092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.960107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.960119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:08.960394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:08.960410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:08.960552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:08.960740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:08.960979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:08.961100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:08.962425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 648, pipe: [1:7559594395994439979:8635]
2025-10-10T14:07:08.962506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 648
2025-10-10T14:07:08.962561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 648
2025-10-10T14:07:08.962188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594394416518678:8140]
2025-10-10T14:07:08.962215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594394416518678:8140]
2025-10-10T14:07:08.962229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594394416518678:8140]
2025-10-10T14:07:08.962243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594394416518678:8140]
2025-10-10T14:07:08.962284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:08.962384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594395994439979:8635], now have 1 active actors on pipe
2025-10-10T14:07:08.962410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594395994439961:2442], now have 1 active actors on pipe
2025-10-10T14:07:08.962434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594395994440119:9112], now have 1 active actors on pipe
2025-10-10T14:07:08.962474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:08.962675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:08.962694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:08.962729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:08.962738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:08.962747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:08.962754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:08.962825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594394416518678:8140]
2025-10-10T14:07:08.962845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:08.962847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:08.962975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:08.963007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:08.963144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecabec1f-2d3944b1-7742f401-37195796_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:08.963174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:08.963192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:08.963201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:08.963236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:08.963281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:08.963372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:08.967074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:08.967108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:08.967178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:08.969284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 649 partition: 0 MaxSeqNo: 36 sessionId: src_id|ecabec1f-2d3944b1-7742f401-37195796_0
2025-10-10T14:07:08.970275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e49a4a86-a493b67f-57dc6d6a-7907ce82_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ecabec1f-2d3944b1-7742f401-37195796_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:09.009532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecabec1f-2d3944b1-7742f401-37195796_0] Write session: try to update token
2025-10-10T14:07:09.009587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecabec1f-2d3944b1-7742f401-37195796_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:09.155865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:09.155896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:09.155909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:09.155961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:09.155978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:09.155993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:09.156006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:09.156019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:09.156055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594394416518678:8140]
2025-10-10T14:07:09.156083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594394416518678:8140]
2025-10-10T14:07:09.156109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594394416518678:8140]
2025-10-10T14:07:09.156134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594394416518678:8140]
2025-10-10T14:07:09.156272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:09.156298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:09.156311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:09.163284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:09.163336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:09.163371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:09.163404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:09.163436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:09.206255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId: src_id|ecabec1f-2d3944b1-7742f401-37195796_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:09.263348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:09.458140Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:09.468862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:09.474085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:09.479089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594395994439979:8635]
2025-10-10T14:07:09.479171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:09.479296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:09.479307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:09.485386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecabec1f-2d3944b1-7742f401-37195796_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:09.485429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecabec1f-2d3944b1-7742f401-37195796_0] Write session will restart in 0.008222s
2025-10-10T14:07:09.485532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecabec1f-2d3944b1-7742f401-37195796_0] Write session: Do CDS request
2025-10-10T14:07:09.485562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecabec1f-2d3944b1-7742f401-37195796_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:09.483193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 649 reason: error at write: Disconnected sessionId: src_id|ecabec1f-2d3944b1-7742f401-37195796_0
2025-10-10T14:07:09.485372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 649 sessionId: src_id|ecabec1f-2d3944b1-7742f401-37195796_0 is DEAD
2025-10-10T14:07:09.523031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecabec1f-2d3944b1-7742f401-37195796_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:09.523785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:09.523823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 650
2025-10-10T14:07:09.524277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:09.524418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:09.524435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:09.524447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:09.526416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 650 sessionId:  describe result for acl check
2025-10-10T14:07:09.526545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:09.526556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:09.526565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:09.526582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594400289407529:9122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:09.533950Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:09.536430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594400289407529:9122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:09.581356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594400289407566:8635]
2025-10-10T14:07:09.612622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594400289407529:9122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:09.641861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594400289407529:9122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:09.641910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594400289407529:9122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:09.641927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594400289407529:9122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:09.641958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:09.718235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:09.725674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:09.726580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:09.726600Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:09.726644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:09.726908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:09.727092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594398711486238:8152]
2025-10-10T14:07:09.729828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:09.730890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:09.731134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:09.732571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:09.732915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:09.732924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:09.732932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:09.732939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:09.732946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:09.732954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:09.732960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:09.732969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:09.732976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:09.732983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:09.732991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:09.733000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:09.733054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:09.733203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:09.733258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:09.733311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:09.733365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:09.733418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:09.733470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:09.733534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:09.733592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:09.733646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:09.733693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:09.733745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:09.733794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:09.733867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:09.733930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:09.733989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:09.734041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:09.734101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:09.734153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:09.734216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:09.734273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:09.734333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:09.734384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:09.734443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:09.734496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:09.734558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:09.734610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:09.734670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:09.734724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:09.734783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:09.734834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:09.734893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:09.734946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:09.735007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:09.735059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:09.735118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:09.735672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:09.773082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:09.829984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:09.830036Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:09.830056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:09.830076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:09.830103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 649 [2:7559594398711486238:8152]
2025-10-10T14:07:09.830166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:09.830231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:09.830247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:09.830261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:09.830275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:09.830331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:09.830355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:09.830381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:09.833172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:09.833204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:09.833219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:09.833236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:09.833251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:09.833581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:09.833606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:09.833788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:09.834013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:09.834351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:09.834485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:09.834563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:09.834581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:09.834596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:09.834612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:09.834659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:09.834748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:09.834961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:09.834980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:09.835121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:09.835144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:09.836162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:09.836191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:09.836205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:09.836220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:09.836247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:09.841048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594400289407566:8635], now have 1 active actors on pipe
2025-10-10T14:07:09.841099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594400289407638:9122], now have 1 active actors on pipe
2025-10-10T14:07:09.841141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594400289407518:2442], now have 1 active actors on pipe
2025-10-10T14:07:09.841193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:09.841224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:09.840192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 649, pipe: [1:7559594400289407566:8635]
2025-10-10T14:07:09.840328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 649
2025-10-10T14:07:09.840414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 649
2025-10-10T14:07:09.841342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:09.841402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:09.841425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:09.841436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:09.841484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:09.841537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:09.841607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:09.845648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:09.845679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:09.845772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:09.847546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 650 partition: 0 MaxSeqNo: 36 sessionId: src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0
2025-10-10T14:07:09.848614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecabec1f-2d3944b1-7742f401-37195796_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:09.907156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0] Write session: try to update token
2025-10-10T14:07:09.907201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:10.030245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:10.030279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:10.030291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:10.030410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:10.030424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:10.030438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:10.030450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:10.030460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:10.030496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:10.030520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:10.030541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:10.030562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:10.033908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:10.033953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:10.033983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:10.034012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:10.094446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:10.094854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:10.098505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId: src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:10.113467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:10.118495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:10.136808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:10.319175Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:10.321593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:10.321644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:10.321700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594398711486233:8152]
2025-10-10T14:07:10.321869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:10.321905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:10.321936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:10.325686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:10.323796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:10.323946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594400289407566:8635]
2025-10-10T14:07:10.324027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:10.324038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:10.390930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 650 reason: error at write: Disconnected sessionId: src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0
2025-10-10T14:07:10.392532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:10.392578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0] Write session will restart in 0.005257s
2025-10-10T14:07:10.391666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 650 sessionId: src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0 is DEAD
2025-10-10T14:07:10.392684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0] Write session: Do CDS request
2025-10-10T14:07:10.392718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:10.402374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:10.402412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 651
2025-10-10T14:07:10.406396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:10.406983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:10.407151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:10.407175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:10.407186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:10.408995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 651 sessionId:  describe result for acl check
2025-10-10T14:07:10.409150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:10.409161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:10.409172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:10.409190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594404584375099:9127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:10.412109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594404584375099:9127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:10.425934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594404584375106:8635]
2025-10-10T14:07:10.451819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594404584375099:9127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:10.498256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594404584375099:9127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:10.498310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594404584375099:9127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:10.498327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594404584375099:9127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:10.498353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:10.568548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:10.586906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:10.587894Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:10.587914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:10.587958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:10.588235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:10.588421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594403006453795:8161]
2025-10-10T14:07:10.590410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:10.592970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:10.593259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:10.594576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:10.594903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:10.594910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:10.594918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:10.594924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:10.594932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:10.594939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:10.594947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:10.594954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:10.594961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:10.594967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:10.594974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:10.594982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:10.595031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:10.595138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:10.595188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:10.595236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:10.595280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:10.595340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:10.595385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:10.595432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:10.595475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:10.595522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:10.595571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:10.595615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:10.595656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:10.595721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:10.595785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:10.595841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:10.595888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:10.595939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:10.595982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:10.596031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:10.596079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:10.596131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:10.596174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:10.596227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:10.596273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:10.596326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:10.596369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:10.596421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:10.596469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:10.596519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:10.596558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:10.596608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:10.596652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:10.596707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:10.596752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:10.596801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:10.614925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:10.673336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:10.700886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:10.700942Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:10.700961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:10.700980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:10.701004Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 650 [2:7559594403006453795:8161]
2025-10-10T14:07:10.701058Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:10.701122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:10.715409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:10.715423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:10.715435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:10.715503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:10.715530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:10.715555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:10.718237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:10.718266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:10.718283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:10.718298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:10.718310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:10.720006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:10.720027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:10.720171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:10.720349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:10.720562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:10.720672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:10.720714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594404584375251:9127], now have 1 active actors on pipe
2025-10-10T14:07:10.720737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594404584375106:8635], now have 1 active actors on pipe
2025-10-10T14:07:10.720757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594404584375075:2442], now have 1 active actors on pipe
2025-10-10T14:07:10.720825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:10.720840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:10.720851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:10.720864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:10.720938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:10.720951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:10.720961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:10.720971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:10.721092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:10.721200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:10.721373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:10.721389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:10.721393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 650
2025-10-10T14:07:10.721483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 650, pipe: [1:7559594404584375106:8635]
2025-10-10T14:07:10.721553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 650
2025-10-10T14:07:10.735016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:10.735065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:10.735141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:10.735180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:10.735339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:10.735373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:10.735391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:10.735402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:10.735442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:10.735488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:10.735573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:10.737621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:10.746865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:10.746909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:10.746993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:10.747525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 651 partition: 0 MaxSeqNo: 36 sessionId: src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0
2025-10-10T14:07:10.751009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86a32cf0-9c8307c3-f6766135-5379a1fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:10.806930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0] Write session: try to update token
2025-10-10T14:07:10.806988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:10.817361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:10.817392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:10.817410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:10.955302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:10.955335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:10.955347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:10.955398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:10.955413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:10.955428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:10.955441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:10.955454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:10.955489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:10.955516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:10.955544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:10.955569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:10.955767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:10.955806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:10.955819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:10.956929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:10.957285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:10.957318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:10.957351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:10.957381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:10.998217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId: src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:11.036853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:11.134465Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:11.166214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:11.166261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:11.166326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:11.166339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:11.166375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594403006453790:8161]
2025-10-10T14:07:11.166688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:11.167552Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:11.168104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594404584375106:8635]
2025-10-10T14:07:11.168182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:11.168286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:11.168311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:11.188911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 651 reason: error at write: Disconnected sessionId: src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0
2025-10-10T14:07:11.190374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:11.190438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0] Write session will restart in 0.009211s
2025-10-10T14:07:11.190631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0] Write session: Do CDS request
2025-10-10T14:07:11.190692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:11.189688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 651 sessionId: src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0 is DEAD
E1010 14:07:11.201385992  107741 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:07:11.204403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:11.209235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:11.209273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 652
2025-10-10T14:07:11.209688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:11.209801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:11.209816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:11.209825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:11.211194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 652 sessionId:  describe result for acl check
2025-10-10T14:07:11.211330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:11.211346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:11.211357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:11.211373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594408879342682:9143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:11.214046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594408879342682:9143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:11.222359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594408879342682:9143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:11.243200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594408879342682:9143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:11.243236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594408879342682:9143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:11.243248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594408879342682:9143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:11.243283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:11.266022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594408879342850:8635]
2025-10-10T14:07:11.292311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:11.302558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:11.303584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:11.303617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:11.303665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:11.303957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:11.304173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594407301421352:8165]
2025-10-10T14:07:11.306710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:11.314350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:11.314688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:11.316221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:11.316545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:11.316553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:11.316560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:11.316566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:11.316573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:11.316579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:11.316586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:11.316593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:11.316599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:11.316606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:11.316612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:11.316619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:11.316668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:11.316776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:11.316827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:11.316878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:11.316926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:11.316976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:11.317024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:11.317070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:11.317117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:11.338065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:11.338134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:11.338187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:11.338251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:11.338334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:11.338401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:11.338459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:11.338510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:11.338565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:11.338621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:11.338671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:11.338721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:11.338774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:11.338819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:11.338875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:11.338925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:11.338981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:11.339027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:11.339079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:11.339128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:11.339183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:11.339231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:11.339302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:11.339351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:11.339420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:11.339468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:11.339524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:11.339982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:11.376196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:11.398684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:11.398737Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:11.398756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:11.398776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:11.398799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 651 [2:7559594407301421352:8165]
2025-10-10T14:07:11.398855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:11.398915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:11.398929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:11.398941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:11.398951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:11.398998Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:11.399024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:11.399052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:11.401567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:11.401598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:11.401611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:11.401625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:11.401635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:11.401930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:11.401948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:11.402100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:11.402272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:11.402480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:11.402578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:11.402655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594408879342790:9143], now have 1 active actors on pipe
2025-10-10T14:07:11.402674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594408879342850:8635], now have 1 active actors on pipe
2025-10-10T14:07:11.402692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594408879342654:2442], now have 1 active actors on pipe
2025-10-10T14:07:11.402737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:11.402755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:11.402802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.402814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.402826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.402838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.402880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:11.402916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:11.402930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:11.402942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:11.402953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:11.402952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:11.403113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:11.403128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:11.403189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:11.403218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:11.403234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:11.403244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:11.403288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:11.403327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:11.403449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.403479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:11.403496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:11.403519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:11.402269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 651, pipe: [1:7559594408879342850:8635]
2025-10-10T14:07:11.402281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 651
2025-10-10T14:07:11.402401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 651
2025-10-10T14:07:11.404549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:11.404583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:11.404644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:11.404972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 652 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0
2025-10-10T14:07:11.405665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53686cfe-35d7eb2c-24a2bf5c-8a50a5d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:11.450440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:11.450472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:11.450508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.450626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:11.450647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:11.454026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0] Write session: try to update token
2025-10-10T14:07:11.454094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:11.458234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:11.460192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:11.461736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:11.463188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:11.472750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:11.473511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:11.705375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId: src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:11.784404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:11.788087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:11.788118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:11.788129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:11.788184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:11.788196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:11.788208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:11.788218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:11.788226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:11.788263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.788285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.788305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.788324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594407301421347:8165]
2025-10-10T14:07:11.788439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:11.788463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:11.788489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:11.788513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:11.789389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:11.789422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:11.789457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:11.789491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:11.789501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:11.790547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:11.964036Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:11.968514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:11.968601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:11.969091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:11.969377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594408879342850:8635]
2025-10-10T14:07:11.967195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:12.005082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:12.005160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0] Write session will restart in 0.006970s
2025-10-10T14:07:12.005394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0] Write session: Do CDS request
2025-10-10T14:07:12.005449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:12.002607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 652 reason: error at write: Disconnected sessionId: src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0
2025-10-10T14:07:12.002973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 652 sessionId: src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0 is DEAD
2025-10-10T14:07:12.021579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:12.021616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 653
2025-10-10T14:07:12.021888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:12.025604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:12.025777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:12.025795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:12.025807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:12.029162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 653 sessionId:  describe result for acl check
2025-10-10T14:07:12.029295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:12.029303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:12.029309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:12.029330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594413174310237:9151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:12.031590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594413174310237:9151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:12.052525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594413174310237:9151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:12.064998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594413174310237:9151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:12.065030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594413174310237:9151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:12.065042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594413174310237:9151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:12.065066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:12.069537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594413174310326:8635]
2025-10-10T14:07:12.116856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:12.119004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:12.119939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:12.119975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:12.120023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:12.120317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:12.120668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594411596388894:8180]
2025-10-10T14:07:12.123348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:12.124275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:12.124530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:12.126005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:12.126373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:12.126396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:12.126406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:12.126416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:12.126425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:12.126434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:12.126444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:12.126452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:12.126461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.126470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.126478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.126486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.126550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:12.126677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:12.126747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:12.126812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:12.126879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:12.126939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:12.126994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:12.127046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:12.127100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.127156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.127207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.127273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.127322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:12.127400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:12.127470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:12.127536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:12.127597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:12.127662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:12.127717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:12.127778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:12.127836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:12.127899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:12.127953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:12.128018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:12.128078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:12.128143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:12.128196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:12.128260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:12.128318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.128382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.128437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.128503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.128559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.128620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.128671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.128735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.130099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:12.173343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:12.207283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:12.207335Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:12.207357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:12.207379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:12.207405Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 652 [2:7559594411596388894:8180]
2025-10-10T14:07:12.207468Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:12.207531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:12.207549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:12.207564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:12.207578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:12.207628Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:12.207652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:12.207677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:12.252322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.252358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.252371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.252383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.252395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:12.252689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:12.253056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.253227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.253430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.253437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 652
2025-10-10T14:07:12.253521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 652, pipe: [1:7559594413174310326:8635]
2025-10-10T14:07:12.253598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 652
2025-10-10T14:07:12.253683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.253823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:12.253909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594413174310315:9151], now have 1 active actors on pipe
2025-10-10T14:07:12.253934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594413174310326:8635], now have 1 active actors on pipe
2025-10-10T14:07:12.253958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594408879342919:2442], now have 1 active actors on pipe
2025-10-10T14:07:12.254013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:12.254037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:12.254090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594411596388889:8180]
2025-10-10T14:07:12.254107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594411596388889:8180]
2025-10-10T14:07:12.254120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594411596388889:8180]
2025-10-10T14:07:12.254136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594411596388889:8180]
2025-10-10T14:07:12.254193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:12.254216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:12.254233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:12.254245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:12.254258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:12.254300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:12.254917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:12.254944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:12.255016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:12.255048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:12.255068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:12.255079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:12.255115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:12.255159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:12.255316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594411596388889:8180]
2025-10-10T14:07:12.255351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:12.255402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:12.255415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:12.262703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:12.262758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:12.262850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:12.267598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 653 partition: 0 MaxSeqNo: 36 sessionId: src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0
2025-10-10T14:07:12.269453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2e7a422-f361a456-51b86e57-dcc2c6be_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:12.307220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:12.307263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:12.307283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:12.341175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0] Write session: try to update token
2025-10-10T14:07:12.341241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:12.460804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:12.460843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:12.460859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:12.460871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:12.460884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:12.460925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594411596388889:8180]
2025-10-10T14:07:12.460954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594411596388889:8180]
2025-10-10T14:07:12.460982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594411596388889:8180]
2025-10-10T14:07:12.461007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594411596388889:8180]
2025-10-10T14:07:12.461198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:12.461212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:12.461225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:12.461280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:12.461307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.461321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:12.461788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:12.461835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:12.461863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:12.461891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:12.464404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:12.515784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId: src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:12.559880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:12.604169Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:12.615887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:12.615930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:12.617366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594413174310326:8635]
2025-10-10T14:07:12.617515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:12.617724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:12.617749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:12.624738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:12.624813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0] Write session will restart in 0.007393s
2025-10-10T14:07:12.625007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0] Write session: Do CDS request
2025-10-10T14:07:12.625048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:12.623750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 653 reason: error at write: Disconnected sessionId: src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0
2025-10-10T14:07:12.624131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 653 sessionId: src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0 is DEAD
2025-10-10T14:07:12.642357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:12.651692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:12.651727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 654
2025-10-10T14:07:12.652342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:12.652465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:12.652480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:12.652490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:12.658364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 654 sessionId:  describe result for acl check
2025-10-10T14:07:12.658503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:12.658512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:12.658521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:12.658538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594413174310478:9163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:12.668237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:12.673677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594413174310478:9163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:12.689858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594413174310478:9163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:12.709794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594413174310478:9163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:12.709843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594413174310478:9163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:12.709859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594413174310478:9163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:12.709890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:12.717451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594413174310514:8635]
2025-10-10T14:07:12.817329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:12.832167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:12.833212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:12.833242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:12.833289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:12.833593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:12.833785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594411596389144:8184]
2025-10-10T14:07:12.836149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:12.839097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:12.839385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:12.841988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:12.842454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:12.842473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:12.842483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:12.842491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:12.842499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:12.842507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:12.842515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:12.842522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:12.842529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.842538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.842547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.842554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.842610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:12.842735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:12.842791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:12.842845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:12.842905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:12.842964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:12.843020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:12.843078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:12.843138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.843197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.843272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.843322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.843374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:12.843469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:12.843540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:12.843606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:12.843667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:12.843729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:12.843784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:12.843850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:12.843910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:12.843971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:12.844029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:12.845666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:12.845759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:12.845830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:12.845893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:12.847075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:12.847148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.847217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.847291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.847362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.847424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.847505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.847559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.847618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.848154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:12.880472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:12.923709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:12.923757Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:12.923774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:12.923795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:12.923821Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 653 [2:7559594411596389144:8184]
2025-10-10T14:07:12.923877Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:12.923938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:12.923954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:12.923967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:12.923978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:12.924023Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:12.924045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:12.924065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:12.925845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.925868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.925880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.925891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.925902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:12.926186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:12.926204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:12.926344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:12.926615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 653, pipe: [1:7559594413174310514:8635]
2025-10-10T14:07:12.926739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 653
2025-10-10T14:07:12.926821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 653
2025-10-10T14:07:12.926537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:12.926785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:12.926899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:12.926992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594413174310514:8635], now have 1 active actors on pipe
2025-10-10T14:07:12.927015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594413174310469:2442], now have 1 active actors on pipe
2025-10-10T14:07:12.927035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594413174310512:9163], now have 1 active actors on pipe
2025-10-10T14:07:12.927062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:12.927078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:12.927091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:12.927103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:12.927147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:12.927225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:12.927420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:12.927438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:12.927568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:12.927586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:12.927830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:12.927842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:12.927852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:12.927863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:12.927887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:12.928330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:12.928353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:12.928431Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:12.928462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:12.928480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:12.928489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:12.928527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:12.928570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:12.928611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:12.930708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:12.930752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:12.930842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:12.931263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 654 partition: 0 MaxSeqNo: 36 sessionId: src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0
2025-10-10T14:07:12.932190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae7687d-99b558fb-a6ac9171-713aacbb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:12.978922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0] Write session: try to update token
2025-10-10T14:07:12.978984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:13.014616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:13.014650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:13.014689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:13.014784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:13.015559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:13.035169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:13.057693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:13.076407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:13.080710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:13.087711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:13.103921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:13.103953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:13.103965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:13.104023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:13.158581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:13.158616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:13.158630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:13.158641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:13.158654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:13.158693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:13.158720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:13.158745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:13.158767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594411596389139:8184]
2025-10-10T14:07:13.158906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:13.158931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:13.158941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:13.161293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:13.161340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:13.161372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:13.161416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:13.163943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:13.183532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId: src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:13.209431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:13.354835Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:13.357784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:13.357820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:13.362047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594413174310514:8635]
2025-10-10T14:07:13.362145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:13.362158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:13.365381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:13.371015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:13.427166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 654 reason: error at write: Disconnected sessionId: src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0
2025-10-10T14:07:13.427490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 654 sessionId: src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0 is DEAD
2025-10-10T14:07:13.430813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:13.430880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0] Write session will restart in 0.006880s
2025-10-10T14:07:13.431053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0] Write session: Do CDS request
2025-10-10T14:07:13.431112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:13.444897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:13.444931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 655
2025-10-10T14:07:13.445404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:13.445984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:13.446118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:13.446134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:13.446143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:13.447748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 655 sessionId:  describe result for acl check
2025-10-10T14:07:13.447884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:13.447896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:13.447905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:13.447921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594417469278056:9172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:13.450698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594417469278056:9172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:13.462189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594417469278084:8635]
2025-10-10T14:07:13.466507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594417469278056:9172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:13.484954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594417469278056:9172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:13.485001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594417469278056:9172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:13.485020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594417469278056:9172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:13.485052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:13.600896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:13.607622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:13.611482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:13.611518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:13.611580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:13.611968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:13.612188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594415891356715:8195]
2025-10-10T14:07:13.614422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:13.622176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:13.622449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:13.623885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:13.624213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:13.624221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:13.624227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:13.624234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:13.624241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:13.624248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:13.624254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:13.624261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:13.624267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:13.624273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:13.624279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:13.624286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:13.624329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:13.624431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:13.624474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:13.624513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:13.624552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:13.624591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:13.624627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:13.624664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:13.624702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:13.624741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:13.624781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:13.624817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:13.624851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:13.624913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:13.624968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:13.625016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:13.625058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:13.625103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:13.625807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:13.625872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:13.625918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:13.625965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:13.626002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:13.626048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:13.626087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:13.626130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:13.626168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:13.626218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:13.626256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:13.626301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:13.626338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:13.626383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:13.626422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:13.626468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:13.626501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:13.626540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:13.626887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:13.686631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:13.700942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:13.700997Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:13.701017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:13.701038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:13.701064Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 654 [2:7559594415891356715:8195]
2025-10-10T14:07:13.701143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:13.701211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:13.701226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:13.701239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:13.701253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:13.701300Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:13.701322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:13.701344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:13.715734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:13.715764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:13.715777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:13.715789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:13.715800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:13.716077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:13.716095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:13.716240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:13.716433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:13.716669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:13.716794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:13.716867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594415891356710:8195]
2025-10-10T14:07:13.716881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594415891356710:8195]
2025-10-10T14:07:13.716895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594415891356710:8195]
2025-10-10T14:07:13.716909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594415891356710:8195]
2025-10-10T14:07:13.716953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:13.717035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:13.717348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:13.717362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:13.717374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:13.717384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:13.717901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:13.717928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:13.718081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594417469278035:2442], now have 1 active actors on pipe
2025-10-10T14:07:13.718107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594417469278084:8635], now have 1 active actors on pipe
2025-10-10T14:07:13.718129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594417469278113:9172], now have 1 active actors on pipe
2025-10-10T14:07:13.718150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594415891356710:8195]
2025-10-10T14:07:13.718177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:13.718539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 654
2025-10-10T14:07:13.718629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 654, pipe: [1:7559594417469278084:8635]
2025-10-10T14:07:13.718701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 654
2025-10-10T14:07:13.718493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:13.719235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:13.719271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:13.719345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:13.719376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:13.719395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:13.719406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:13.719442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:13.719480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:13.719524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:13.722946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:13.722997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:13.723085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:13.724235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 655 partition: 0 MaxSeqNo: 36 sessionId: src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0
2025-10-10T14:07:13.729352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5fd13e5-f6ae7b2c-ed937834-5ed7f2ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:13.784070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0] Write session: try to update token
2025-10-10T14:07:13.784129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:13.833828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:13.833862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:13.833873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:13.833940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:13.833955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:13.833968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:13.833981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:13.833992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:13.834028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594415891356710:8195]
2025-10-10T14:07:13.834055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594415891356710:8195]
2025-10-10T14:07:13.834080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594415891356710:8195]
2025-10-10T14:07:13.834105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594415891356710:8195]
2025-10-10T14:07:13.834251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:13.834277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:13.834290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:13.834312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:13.834343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:13.834378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:13.834410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:13.860215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:13.979061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId: src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:14.000986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:14.059726Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:14.062311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:14.062351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:14.071387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:14.073622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:14.073889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594417469278084:8635]
2025-10-10T14:07:14.074019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:14.074044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:14.126259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 655 reason: error at write: Disconnected sessionId: src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0
2025-10-10T14:07:14.126589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 655 sessionId: src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0 is DEAD
2025-10-10T14:07:14.129705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:14.129773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0] Write session will restart in 0.006824s
2025-10-10T14:07:14.129943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0] Write session: Do CDS request
2025-10-10T14:07:14.129997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:14.144325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:14.144361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 656
2025-10-10T14:07:14.147550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:14.148272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:14.148450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:14.148469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:14.148481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:14.151286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 656 sessionId:  describe result for acl check
2025-10-10T14:07:14.151527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:14.151544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:14.151554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:14.151571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594421764245618:9184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:14.154843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594421764245618:9184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:14.172659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594421764245642:8635]
2025-10-10T14:07:14.186315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594421764245618:9184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:14.206503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594421764245618:9184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:14.206549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594421764245618:9184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:14.206567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594421764245618:9184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:14.206599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:14.324354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:14.331425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:14.332239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:14.332252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:14.332288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:14.332484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:14.332610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594420186324243:8203]
2025-10-10T14:07:14.336211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:14.337719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:14.337988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:14.340575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:14.341009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:14.341018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:14.341026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:14.341035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:14.341043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:14.341050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:14.341058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:14.341066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:14.341074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:14.341083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:14.341092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:14.341099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:14.341173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:14.341299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:14.341354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:14.341410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:14.341465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:14.341521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:14.341573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:14.341627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:14.341679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:14.341730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:14.341783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:14.341835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:14.341884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:14.341974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:14.342042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:14.342109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:14.342165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:14.342227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:14.342284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:14.342344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:14.342397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:14.342455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:14.342510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:14.342569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:14.342621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:14.342681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:14.342732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:14.342790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:14.342842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:14.342897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:14.342948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:14.343004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:14.343055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:14.343115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:14.343165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:14.344658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:14.345200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:14.379992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:14.406712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:14.407237Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:14.407264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:14.407284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:14.407307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 655 [2:7559594420186324243:8203]
2025-10-10T14:07:14.407364Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:14.407419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:14.407435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:14.407447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:14.407458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:14.407505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:14.407526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:14.407547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:14.409948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:14.409965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:14.409980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:14.409993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:14.410005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:14.411782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 655
2025-10-10T14:07:14.411875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 655
2025-10-10T14:07:14.411949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 655, pipe: [1:7559594421764245642:8635]
2025-10-10T14:07:14.413665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:14.413699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:14.413840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:14.414032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:14.414246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:14.414365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:14.414411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594421764245642:8635], now have 1 active actors on pipe
2025-10-10T14:07:14.414436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594421764245695:9184], now have 1 active actors on pipe
2025-10-10T14:07:14.414458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594421764245601:2442], now have 1 active actors on pipe
2025-10-10T14:07:14.414510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:14.414532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:14.414632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.414647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.414660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.414675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.414715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:14.414814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:14.414848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:14.414864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:14.414874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:14.414909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:14.414951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:14.415007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:14.415183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:14.415215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:14.415356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:14.415413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.415440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:14.416947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:14.416972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:14.416984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:14.416995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:14.417022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:14.422412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 656 partition: 0 MaxSeqNo: 36 sessionId: src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0
2025-10-10T14:07:14.421871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:14.421913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:14.422003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:14.425665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf8ad3b-102c2fc0-b8e816be-69f1c0ee_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:14.502407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0] Write session: try to update token
2025-10-10T14:07:14.502466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:14.675506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:14.675541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:14.675553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:14.675675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:14.675692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:14.675704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:14.675717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:14.675729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:14.675766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.675793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.675819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.675844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.677680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:14.677724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:14.677758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:14.677791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:14.714346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:14.714392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:14.714405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:14.715615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:14.762242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId: src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:14.785658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:14.963709Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:14.966921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:14.966939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:14.966984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594420186324238:8203]
2025-10-10T14:07:14.967133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:14.967145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:14.967168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:14.968335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:14.972236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594421764245642:8635]
2025-10-10T14:07:14.972424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:14.972449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:14.973350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:15.013803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 656 reason: error at write: Disconnected sessionId: src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0
2025-10-10T14:07:15.014204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 656 sessionId: src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0 is DEAD
2025-10-10T14:07:15.018838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:15.018889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0] Write session will restart in 0.009062s
2025-10-10T14:07:15.019001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0] Write session: Do CDS request
2025-10-10T14:07:15.019034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:15.037329Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:15.037371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 657
2025-10-10T14:07:15.042548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:15.043496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:15.043675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:15.043693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:15.043704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:15.045512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 657 sessionId:  describe result for acl check
2025-10-10T14:07:15.045657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:15.045676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:15.045687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:15.045705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594426059213188:9194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:15.051006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594426059213188:9194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:15.055405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594426059213195:8635]
2025-10-10T14:07:15.077353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594426059213188:9194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:15.088907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594426059213188:9194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:15.088963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594426059213188:9194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:15.088983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594426059213188:9194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:15.089018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:15.267606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:15.283400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:15.284361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:15.284384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:15.284435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:15.284732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:15.284933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594424481291805:8215]
2025-10-10T14:07:15.287228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:15.298156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:15.298469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:15.299878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:15.300266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:15.300276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:15.300283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:15.300290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:15.300296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:15.300303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:15.300309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:15.300316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:15.300323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:15.300329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:15.300336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:15.300342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:15.300391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:15.300515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:15.300561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:15.300603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:15.300646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:15.300692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:15.300739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:15.300782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:15.300826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:15.300873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:15.300914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:15.300955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:15.301000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:15.301063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:15.301119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:15.302336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:15.302398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:15.302452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:15.302500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:15.302556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:15.302606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:15.302664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:15.302733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:15.302784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:15.302841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:15.302897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:15.302944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:15.302997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:15.303061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:15.303123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:15.303171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:15.303243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:15.303290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:15.303346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:15.303393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:15.303443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:15.303886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:15.458071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:15.497332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:15.497386Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:15.497405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:15.497425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:15.497453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 656 [2:7559594424481291805:8215]
2025-10-10T14:07:15.497512Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:15.497575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:15.497592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:15.497605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:15.497617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:15.497669Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:15.497692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:15.497715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:15.509384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:15.509419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:15.509433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:15.509445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:15.509456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:15.509755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:15.509773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:15.509912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:15.510095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:15.510337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:15.510451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:15.510529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594424481291799:8215]
2025-10-10T14:07:15.510545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594424481291799:8215]
2025-10-10T14:07:15.510559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594424481291799:8215]
2025-10-10T14:07:15.510572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594424481291799:8215]
2025-10-10T14:07:15.510635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:15.510719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:15.510893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:15.510912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:15.511047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594424481291799:8215]
2025-10-10T14:07:15.511067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:15.511360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:15.511371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:15.511383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:15.511393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:15.511416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:15.514892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594421764245880:2442], now have 1 active actors on pipe
2025-10-10T14:07:15.514928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594426059213216:9194], now have 1 active actors on pipe
2025-10-10T14:07:15.514961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594426059213195:8635], now have 1 active actors on pipe
2025-10-10T14:07:15.513965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 656
2025-10-10T14:07:15.514077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 656, pipe: [1:7559594426059213195:8635]
2025-10-10T14:07:15.514260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 656
2025-10-10T14:07:15.517311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:15.517352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:15.517467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:15.517509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:15.517540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:15.517551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:15.517594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:15.517646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:15.517701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:15.518516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:15.518548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:15.518618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:15.519930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9beca869-61ea2ed0-13d376ec-a7ce8a2a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:15.518981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 657 partition: 0 MaxSeqNo: 36 sessionId: src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0
2025-10-10T14:07:15.578792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0] Write session: try to update token
2025-10-10T14:07:15.578856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:15.601465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:15.601500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:15.601513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:15.705240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:15.705276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:15.705290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:15.705299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:15.705310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:15.705346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594424481291799:8215]
2025-10-10T14:07:15.705372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594424481291799:8215]
2025-10-10T14:07:15.705395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594424481291799:8215]
2025-10-10T14:07:15.705415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594424481291799:8215]
2025-10-10T14:07:15.705584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:15.705595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:15.705606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:15.705654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:15.705678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:15.705690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:15.706760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:15.706800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:15.706827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:15.706851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:15.723423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:15.843274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId: src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:15.900971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:16.079244Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:16.081272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:16.081303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:16.088030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:16.088169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:16.088182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:16.104606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594426059213195:8635]
2025-10-10T14:07:16.104691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 657 reason: error at write: Disconnected sessionId: src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0
2025-10-10T14:07:16.105545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 657 sessionId: src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0 is DEAD
2025-10-10T14:07:16.109374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:16.109421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0] Write session will restart in 0.007921s
2025-10-10T14:07:16.109546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0] Write session: Do CDS request
2025-10-10T14:07:16.109578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:16.121092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:16.129617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:16.177337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:16.177371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 658
2025-10-10T14:07:16.178875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:16.178996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:16.179008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:16.179016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:16.182926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 658 sessionId:  describe result for acl check
2025-10-10T14:07:16.183062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:16.183072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:16.183082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:16.183099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594430354180775:9207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:16.186013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594430354180775:9207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
E1010 14:07:16.199385890  112376 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:07:16.201878Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:07:16.205169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594430354180775:9207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:16.206088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594430354180832:8635]
2025-10-10T14:07:16.223247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594430354180775:9207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:16.223295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594430354180775:9207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:16.223311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594430354180775:9207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:16.223341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:16.265472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:16.272247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:16.273079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:16.273097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:16.273161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:16.273429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:16.273642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594428776259368:8224]
2025-10-10T14:07:16.275833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:16.277190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:16.277415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:16.278595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:16.278886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:16.278894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:16.278901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:16.278907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:16.278913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:16.278920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:16.278928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:16.278934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:16.278941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:16.278947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:16.278953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:16.278960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:16.279000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:16.279096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:16.279139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:16.279200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:16.279241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:16.279282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:16.279325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:16.279366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:16.279406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:16.279449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:16.279489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:16.279527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:16.279562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:16.279622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:16.279676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:16.279722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:16.279766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:16.279813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:16.279854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:16.279904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:16.279947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:16.279995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:16.280036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:16.280083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:16.280125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:16.280169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:16.280212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:16.280260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:16.280300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:16.280346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:16.280386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:16.280433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:16.280471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:16.280516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:16.280554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:16.280600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:16.280988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:16.308086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:16.375587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:16.375636Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:16.375652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:16.375672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:16.375694Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 657 [2:7559594428776259368:8224]
2025-10-10T14:07:16.375748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:16.375807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:16.375823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:16.375833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:16.375843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:16.375889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:16.375911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:16.375931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:16.378272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:16.378296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:16.378309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:16.378321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:16.378331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:16.378584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:16.378600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:16.378723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:16.378883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:16.379087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:16.379206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:16.379271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.379286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.379298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.379310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.379357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:16.379425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:16.379589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:16.379605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:16.379727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.379743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:16.380037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:16.380049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:16.380061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:16.380072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:16.380091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:16.383943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594430354180888:9207], now have 1 active actors on pipe
2025-10-10T14:07:16.383980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594430354180749:2442], now have 1 active actors on pipe
2025-10-10T14:07:16.383998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594430354180832:8635], now have 1 active actors on pipe
2025-10-10T14:07:16.384460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:16.384491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:16.384583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f27612b6-9fc30e3a-b2042403-661ee050_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:16.384619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:16.384636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:16.384646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:16.384684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:16.384731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:16.384791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:16.385530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:16.385556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:16.385611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:16.387728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d21f2-a7b36d48-d11ddc83-f1ffe509_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f27612b6-9fc30e3a-b2042403-661ee050_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:16.382051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 657
2025-10-10T14:07:16.382138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 657
2025-10-10T14:07:16.382198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 657, pipe: [1:7559594430354180832:8635]
2025-10-10T14:07:16.386001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 658 partition: 0 MaxSeqNo: 36 sessionId: src_id|f27612b6-9fc30e3a-b2042403-661ee050_0
2025-10-10T14:07:16.440300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27612b6-9fc30e3a-b2042403-661ee050_0] Write session: try to update token
2025-10-10T14:07:16.440361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27612b6-9fc30e3a-b2042403-661ee050_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:16.473661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:16.473693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:16.473703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:16.637823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId: src_id|f27612b6-9fc30e3a-b2042403-661ee050_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:16.639026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:16.639065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:16.639079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:16.639091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:16.639104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:16.639163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.639188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.639216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.639241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.639414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:16.639428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:16.639439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:16.644612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:16.644671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:16.644706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:16.644740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:16.683953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:16.684017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:16.684031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:16.695794Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:16.720978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:16.880059Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:16.922724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:16.922767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:16.922815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594428776259362:8224]
2025-10-10T14:07:16.922963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:16.922990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:16.923108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:16.924112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:16.924152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:16.926991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594430354180832:8635]
2025-10-10T14:07:16.927162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:16.933692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 658 reason: error at write: Disconnected sessionId: src_id|f27612b6-9fc30e3a-b2042403-661ee050_0
2025-10-10T14:07:16.934081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 658 sessionId: src_id|f27612b6-9fc30e3a-b2042403-661ee050_0 is DEAD
2025-10-10T14:07:16.941349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27612b6-9fc30e3a-b2042403-661ee050_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:16.941393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27612b6-9fc30e3a-b2042403-661ee050_0] Write session will restart in 0.006963s
2025-10-10T14:07:16.941490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27612b6-9fc30e3a-b2042403-661ee050_0] Write session: Do CDS request
2025-10-10T14:07:16.941521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27612b6-9fc30e3a-b2042403-661ee050_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:16.940232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:16.962942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f27612b6-9fc30e3a-b2042403-661ee050_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:16.965850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:16.965903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 659
2025-10-10T14:07:16.966772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:16.967005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:16.967035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:16.967055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:16.968996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 659 sessionId:  describe result for acl check
2025-10-10T14:07:16.969118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:16.969150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:16.969160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:16.969178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594430354181030:9218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:16.971897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594430354181030:9218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:17.015807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594430354181030:9218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:17.028608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594434649148360:8635]
2025-10-10T14:07:17.033084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594430354181030:9218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:17.033156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594430354181030:9218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:17.033177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594430354181030:9218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:17.033213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:17.241221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:17.242732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:17.243600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:17.243630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:17.243680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:17.243962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:17.244173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594433071226950:8236]
2025-10-10T14:07:17.246787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:17.247777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:17.248017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:17.249116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:17.249483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:17.249504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:17.249512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:17.249520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:17.249528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:17.249536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:17.249545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:17.249553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:17.249562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.249571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.249579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.249587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.249643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:17.249768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:17.249828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:17.249891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:17.249950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:17.250003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:17.250051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:17.250099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:17.250151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.250190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.250240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.250293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.250333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:17.251603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:17.251688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:17.251767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:17.251830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:17.251889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:17.251945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:17.252016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:17.252075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:17.252137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:17.252189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:17.252254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:17.252309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:17.252372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:17.252424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:17.252487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:17.252542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.252601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.252654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.252714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.252769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.252829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.252881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.252938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.253468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:17.288364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:17.302751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:17.302795Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:17.302816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:17.302837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:17.302861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 658 [2:7559594433071226950:8236]
2025-10-10T14:07:17.302923Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:17.302988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:17.303008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:17.303021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:17.303032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:17.303080Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:17.303111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:17.303132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:17.304495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.304522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.304537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.304552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.304565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:17.304824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:17.304852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.305002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.305823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 658
2025-10-10T14:07:17.305917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 658, pipe: [1:7559594434649148360:8635]
2025-10-10T14:07:17.305986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 658
2025-10-10T14:07:17.305373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.305624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.305749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:17.305834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594434649148365:9218], now have 1 active actors on pipe
2025-10-10T14:07:17.305859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594434649148360:8635], now have 1 active actors on pipe
2025-10-10T14:07:17.305884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594430354181016:2442], now have 1 active actors on pipe
2025-10-10T14:07:17.305912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.305924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.305937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.305951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.305992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:17.306070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:17.306263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:17.306282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:17.306306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:17.306326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:17.306337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:17.306349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:17.306409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.306432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:17.306480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:17.306581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:17.306604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:17.306688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a51009b3-738dddc0-922edb95-4edd798d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:17.306719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:17.306737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:17.306748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:17.306784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:17.306824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:17.306872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:17.309796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:17.309835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:17.309914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:17.310344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 659 partition: 0 MaxSeqNo: 36 sessionId: src_id|a51009b3-738dddc0-922edb95-4edd798d_0
2025-10-10T14:07:17.313340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f27612b6-9fc30e3a-b2042403-661ee050_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a51009b3-738dddc0-922edb95-4edd798d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:17.351217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a51009b3-738dddc0-922edb95-4edd798d_0] Write session: try to update token
2025-10-10T14:07:17.351270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a51009b3-738dddc0-922edb95-4edd798d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:17.404208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:17.404244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:17.404257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:17.540254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:17.540287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:17.540297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:17.540411Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:17.540425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:17.540438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:17.540448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:17.540456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:17.540488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.540511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.540534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.540553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.540877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:17.540904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:17.540931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:17.540957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:17.574734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:17.574785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.574797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:17.585260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId: src_id|a51009b3-738dddc0-922edb95-4edd798d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:17.586354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:17.642019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:17.737452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:17.740026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:17.740043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:17.740090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594433071226945:8236]
2025-10-10T14:07:17.740200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:17.740247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:17.740272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:17.741730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:17.741765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:17.741695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:17.751927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594434649148360:8635]
2025-10-10T14:07:17.752025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:17.752153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 659 reason: error at write: Disconnected sessionId: src_id|a51009b3-738dddc0-922edb95-4edd798d_0
2025-10-10T14:07:17.752495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 659 sessionId: src_id|a51009b3-738dddc0-922edb95-4edd798d_0 is DEAD
2025-10-10T14:07:17.752832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a51009b3-738dddc0-922edb95-4edd798d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:17.752888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a51009b3-738dddc0-922edb95-4edd798d_0] Write session will restart in 0.007650s
2025-10-10T14:07:17.753027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a51009b3-738dddc0-922edb95-4edd798d_0] Write session: Do CDS request
2025-10-10T14:07:17.753074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a51009b3-738dddc0-922edb95-4edd798d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:17.765867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a51009b3-738dddc0-922edb95-4edd798d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:17.814443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:17.814481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 660
2025-10-10T14:07:17.817465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:17.817634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:17.817662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:17.817674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:17.819757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 660 sessionId:  describe result for acl check
2025-10-10T14:07:17.819932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:17.819969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:17.819985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:17.820014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594434649148621:9231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:17.823851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594434649148621:9231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:17.841406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594434649148621:9231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:17.853368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594434649148762:8635]
2025-10-10T14:07:17.859382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594434649148621:9231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:17.859429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594434649148621:9231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:17.859445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594434649148621:9231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:17.859475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:17.892219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:17.894713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:17.895607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:17.895627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:17.895672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:17.895940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:17.896120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594433071227187:8244]
2025-10-10T14:07:17.898502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:17.902017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:17.902292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:17.903752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:17.904135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:17.904144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:17.904153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:17.904160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:17.904168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:17.904177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:17.904186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:17.904195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:17.904205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.904212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.904219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.904226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.904282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:17.904410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:17.904468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:17.904520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:17.904572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:17.904625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:17.904673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:17.904722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:17.904776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.904827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.904876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.904926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.904978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:17.905052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:17.905118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:17.906055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:17.906138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:17.906204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:17.906256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:17.906317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:17.906372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:17.906429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:17.906479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:17.906538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:17.906591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:17.906649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:17.906698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:17.906762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:17.906818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.906895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:17.906950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.907012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:17.907069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.907138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:17.907188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.907248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:17.907732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:17.980506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:17.999955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:18.000010Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:18.000028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:18.000048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:18.000074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 659 [2:7559594433071227187:8244]
2025-10-10T14:07:18.000130Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:18.000193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:18.000209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:18.000221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:18.000232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:18.000289Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:18.000312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:18.000333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:18.002922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:18.002941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:18.002955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:18.002969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:18.002980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:18.003296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:18.003314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:18.003459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:18.003637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:18.003858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:18.003970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:18.004049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.004064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.004077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.004089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.004136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:18.004218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:18.004391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:18.004408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:18.004541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.004562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:18.004863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:18.004875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:18.004885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:18.004894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:18.004916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:18.009351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 659
2025-10-10T14:07:18.009453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 659
2025-10-10T14:07:18.009512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 659, pipe: [1:7559594434649148762:8635]
2025-10-10T14:07:18.015493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594434649148590:2442], now have 1 active actors on pipe
2025-10-10T14:07:18.015545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594434649148795:9231], now have 1 active actors on pipe
2025-10-10T14:07:18.015568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594434649148762:8635], now have 1 active actors on pipe
2025-10-10T14:07:18.015657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:18.015679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:18.015773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66e919ed-86957780-5ca21b-7b63c71b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:18.015811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:18.015830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:18.015842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:18.015886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:18.015941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:18.015993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:18.023452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:18.023497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:18.023581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:18.025424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 660 partition: 0 MaxSeqNo: 36 sessionId: src_id|66e919ed-86957780-5ca21b-7b63c71b_0
2025-10-10T14:07:18.029706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a51009b3-738dddc0-922edb95-4edd798d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66e919ed-86957780-5ca21b-7b63c71b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:18.103132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:18.103162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:18.103174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:18.144070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66e919ed-86957780-5ca21b-7b63c71b_0] Write session: try to update token
2025-10-10T14:07:18.144139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66e919ed-86957780-5ca21b-7b63c71b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:18.279267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:18.279296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:18.279308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:18.279420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:18.279434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:18.279447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:18.279459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:18.279471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:18.279504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.279531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.279559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.279582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.279888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:18.279918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:18.279950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:18.279978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:18.325024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:18.325076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:18.325087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:18.326394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:18.425246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId: src_id|66e919ed-86957780-5ca21b-7b63c71b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:18.497631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:18.517541Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:18.541750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:18.541784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:18.541831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594433071227182:8244]
2025-10-10T14:07:18.541984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:18.542013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:18.542266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:18.544723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:18.545407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:18.545557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:18.545571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:18.550464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594434649148762:8635]
2025-10-10T14:07:18.614154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 660 reason: error at write: Disconnected sessionId: src_id|66e919ed-86957780-5ca21b-7b63c71b_0
2025-10-10T14:07:18.614658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 660 sessionId: src_id|66e919ed-86957780-5ca21b-7b63c71b_0 is DEAD
2025-10-10T14:07:18.615775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e919ed-86957780-5ca21b-7b63c71b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:18.615816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e919ed-86957780-5ca21b-7b63c71b_0] Write session will restart in 0.005804s
2025-10-10T14:07:18.615925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e919ed-86957780-5ca21b-7b63c71b_0] Write session: Do CDS request
2025-10-10T14:07:18.615958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e919ed-86957780-5ca21b-7b63c71b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:18.631527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66e919ed-86957780-5ca21b-7b63c71b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:18.634464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:18.634506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 661
2025-10-10T14:07:18.635005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:18.635184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:18.635202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:18.635213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:18.641481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 661 sessionId:  describe result for acl check
2025-10-10T14:07:18.641637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:18.641648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:18.641659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:18.641679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594438944116182:9241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:18.644676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594438944116182:9241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:18.662161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594438944116191:8635]
2025-10-10T14:07:18.686067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594438944116182:9241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:18.735976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594438944116182:9241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:18.736029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594438944116182:9241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:18.736048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594438944116182:9241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:18.736082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:18.843640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:18.854062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:18.855093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:18.855130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:18.855181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:18.855511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:18.855719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594437366194771:8256]
2025-10-10T14:07:18.858516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:18.859790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:18.860029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:18.861476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:18.861832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:18.861843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:18.861850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:18.861857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:18.861865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:18.861874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:18.861882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:18.861890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:18.861896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:18.861904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:18.861911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:18.861919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:18.861975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:18.862107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:18.862166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:18.862218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:18.862269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:18.862319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:18.862368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:18.862417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:18.862467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:18.862518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:18.862567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:18.862615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:18.862659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:18.862728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:18.862791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:18.862851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:18.862904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:18.862961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:18.863014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:18.863072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:18.863146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:18.863203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:18.863254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:18.863310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:18.863361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:18.863415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:18.863464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:18.863520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:18.863571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:18.863626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:18.863673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:18.863730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:18.863780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:18.863839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:18.863887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:18.863941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:18.864429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:18.900193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:18.942521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:18.942570Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:18.942590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:18.942613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:18.942639Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 660 [2:7559594437366194771:8256]
2025-10-10T14:07:18.942702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:18.942772Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:18.942788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:18.942800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:18.942812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:18.942863Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:18.942887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:18.942909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:18.944181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:18.944197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:18.944213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:18.944227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:18.944240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:18.946038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 660
2025-10-10T14:07:18.946156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 660
2025-10-10T14:07:18.946217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 660, pipe: [1:7559594438944116191:8635]
2025-10-10T14:07:18.946870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:18.946901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:18.947053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:18.947291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:18.947544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:18.947675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:18.947721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594438944116265:9241], now have 1 active actors on pipe
2025-10-10T14:07:18.947747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594438944116191:8635], now have 1 active actors on pipe
2025-10-10T14:07:18.947773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594438944116156:2442], now have 1 active actors on pipe
2025-10-10T14:07:18.947838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:18.947862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:18.947944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:18.947959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:18.947974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:18.947987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:18.948029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:18.948140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:18.948172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:18.948192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:18.948203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:18.948239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:18.948281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:18.948333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:18.948527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:18.948543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:18.948678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:18.948728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:18.948751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:18.949616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:18.949641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:18.949653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:18.949664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:18.949690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:18.974870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:18.974921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:18.975011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:18.975558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 661 partition: 0 MaxSeqNo: 36 sessionId: src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0
2025-10-10T14:07:18.976508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e919ed-86957780-5ca21b-7b63c71b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:19.045587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:19.045623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:19.045640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:19.047380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0] Write session: try to update token
2025-10-10T14:07:19.047433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:19.286762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:19.286804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:19.286820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:19.286835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:19.286848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:19.286890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:19.286921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:19.286970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:19.286995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:19.287289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:19.287306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:19.287318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:19.287370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:19.287400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:19.287414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:19.288719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:19.293824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:19.293871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:19.293907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:19.293939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:19.354516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId: src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:19.455950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:19.497639Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:19.533409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:19.533462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:19.533531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:19.533545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:19.533588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594437366194766:8256]
2025-10-10T14:07:19.535213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:19.535249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:19.534342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:19.535504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:19.544210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594438944116191:8635]
2025-10-10T14:07:19.544308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:19.564549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 661 reason: error at write: Disconnected sessionId: src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0
2025-10-10T14:07:19.564946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 661 sessionId: src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0 is DEAD
2025-10-10T14:07:19.567235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:19.567320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0] Write session will restart in 0.009673s
2025-10-10T14:07:19.567476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0] Write session: Do CDS request
2025-10-10T14:07:19.567510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:19.614246Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:19.614288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 662
2025-10-10T14:07:19.618075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:19.647853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:19.648065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:19.648090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:19.648108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:19.648238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594443239083749:8635]
2025-10-10T14:07:19.649956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 662 sessionId:  describe result for acl check
2025-10-10T14:07:19.650093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:19.650104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:19.650116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:19.650135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594443239083751:9249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:19.653550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594443239083751:9249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:19.701597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594443239083751:9249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:19.733266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594443239083751:9249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:19.733338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594443239083751:9249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:19.733370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594443239083751:9249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:19.733427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:19.828158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:19.839813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:19.840932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:19.840954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:19.841008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:19.841353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:19.841567Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594441661162319:8264]
2025-10-10T14:07:19.844219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:19.853512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:19.853848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:19.855403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:19.855815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:19.855842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:19.855850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:19.855860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:19.855867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:19.855876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:19.855884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:19.855893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:19.855902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:19.855911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:19.855920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:19.855929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:19.855986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:19.856123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:19.856193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:19.856259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:19.856319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:19.856384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:19.856445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:19.856504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:19.856562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:19.856627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:19.856688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:19.856751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:19.856813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:19.856902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:19.856979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:19.857050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:19.857116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:19.857387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:19.857469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:19.857541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:19.857611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:19.857692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:19.857753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:19.857825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:19.857893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:19.857965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:19.858026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:19.858098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:19.858165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:19.858235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:19.858299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:19.858369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:19.858435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:19.858503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:19.858567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:19.858638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:19.859234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:19.893270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:19.909413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:19.909465Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:19.909487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:19.909510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:19.909536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 661 [2:7559594441661162319:8264]
2025-10-10T14:07:19.909601Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:19.909664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:19.909694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:19.909708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:19.909722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:19.909774Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:19.909799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:19.909825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:20.039902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:20.039936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:20.039951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:20.039965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:20.039978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:20.040124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:20.040138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:20.040151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:20.040345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:20.040364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:20.040529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:20.040732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:20.040980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:20.041106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:20.041209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.041226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.041239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.041252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.041285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:20.041372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:20.041570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:20.041587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:20.041706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.041727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:20.042088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:20.042102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:20.042116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:20.042129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:20.042151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:20.044995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 661, pipe: [1:7559594443239083749:8635]
2025-10-10T14:07:20.045105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 661
2025-10-10T14:07:20.045195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 661
2025-10-10T14:07:20.064069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594443239083749:8635], now have 1 active actors on pipe
2025-10-10T14:07:20.064127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594443239083825:9249], now have 1 active actors on pipe
2025-10-10T14:07:20.064155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594443239083730:2442], now have 1 active actors on pipe
2025-10-10T14:07:20.064224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:20.064251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:20.064351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:20.064388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:20.064409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:20.064420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:20.064461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:20.064505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:20.064558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:20.065577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:20.065610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:20.065676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:20.066056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 662 partition: 0 MaxSeqNo: 36 sessionId: src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0
2025-10-10T14:07:20.070239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f31bbfbf-d0eaa35a-221d5397-13eb0a0f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:20.100284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0] Write session: try to update token
2025-10-10T14:07:20.100343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:20.148988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:20.149017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:20.149027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:20.330592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:20.330626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:20.330637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:20.330739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:20.330752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:20.330766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:20.330776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:20.330786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:20.330817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.330843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.330867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.330897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.333553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:20.333598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:20.333628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:20.333657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:20.370541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId: src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:20.374123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:20.374176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:20.374188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:20.375335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:20.455009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:20.546474Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:20.551414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:20.551449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:20.551492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594441661162314:8264]
2025-10-10T14:07:20.551634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:20.551658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:20.554417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:20.557510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:20.566185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:20.566553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594443239083749:8635]
2025-10-10T14:07:20.566722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:20.600975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 662 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0
2025-10-10T14:07:20.605296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:07:20.605341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0] Write session will restart in 0.005315s
2025-10-10T14:07:20.605447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0] Write session: Do CDS request
2025-10-10T14:07:20.605477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:20.604558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 662 sessionId: src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0 is DEAD
2025-10-10T14:07:20.635982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:20.659812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:20.659865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 663
2025-10-10T14:07:20.662960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:20.663136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:20.663152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:20.663165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:20.667557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594447534051339:8635]
2025-10-10T14:07:20.668778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 663 sessionId:  describe result for acl check
2025-10-10T14:07:20.668899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:20.668910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:20.668921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:20.668938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594447534051341:9264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:20.671803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594447534051341:9264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:20.701385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594447534051341:9264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:20.746676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594447534051341:9264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:20.746733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594447534051341:9264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:20.746751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594447534051341:9264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:20.746784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:20.893238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:20.909603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:20.910541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:20.910561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:20.910608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:20.910883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:20.911085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594445956129908:8275]
2025-10-10T14:07:20.925484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:20.930430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:20.930714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:20.932190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:20.932540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:20.932549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:20.932556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:20.932563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:20.932571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:20.932578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:20.932584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:20.932592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:20.932598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:20.932605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:20.932613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:20.932621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:20.932668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:20.932776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:20.932825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:20.932883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:20.932932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:20.932980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:20.933030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:20.933079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:20.933146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:20.933196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:20.933241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:20.933287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:20.933331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:20.933396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:20.933453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:20.933510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:20.933561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:20.933613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:20.933659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:20.933711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:20.933759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:20.933811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:20.933859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:20.933907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:20.933951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:20.934003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:20.934057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:20.934110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:20.934163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:20.934216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:20.934263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:20.934314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:20.934359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:20.934412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:20.934455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:20.934506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:20.945480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:21.054521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:21.094947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:21.094999Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:21.095017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:21.095038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:21.095085Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 662 [2:7559594445956129908:8275]
2025-10-10T14:07:21.095144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:21.095209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:21.095225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:21.095238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:21.095250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:21.095313Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:21.095337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:21.095360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:21.096635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:21.096650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:21.096664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:21.096677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:21.096689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:21.096969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:21.096987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:21.101535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 662, pipe: [1:7559594447534051339:8635]
2025-10-10T14:07:21.101644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 662
2025-10-10T14:07:21.101670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 662
2025-10-10T14:07:21.117294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:21.117570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:21.117792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:21.117914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:21.118062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594447534051339:8635], now have 1 active actors on pipe
2025-10-10T14:07:21.118090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594447534051403:9264], now have 1 active actors on pipe
2025-10-10T14:07:21.118110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594447534051310:2442], now have 1 active actors on pipe
2025-10-10T14:07:21.118191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:21.118215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:21.118255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.118271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.118283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.118295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.118336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:21.118424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:21.118603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:21.118618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:21.118689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:21.118723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:21.118741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:21.118752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:21.118790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:21.118834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:21.118969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.118991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:21.119034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:21.119147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:21.119162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:21.119175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:21.119186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:21.119212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:21.126248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 663 partition: 0 MaxSeqNo: 36 sessionId: src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0
2025-10-10T14:07:21.125669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:21.125712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:21.125801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:21.137497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b57917d-c72c291c-64aca9ca-e9b3211f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:21.197898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:21.197928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:21.197942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:21.211963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0] Write session: try to update token
2025-10-10T14:07:21.212027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:21.440446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId: src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:21.460262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:21.460299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:21.460310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:21.460318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:21.460327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:21.460359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.460381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.460403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.460423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.460589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:21.460602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:21.460612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:21.460704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:21.460729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:21.460739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:21.460972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:21.461002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:21.461032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:21.461061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:21.471075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:21.497882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:21.641203Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:21.671842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:21.671896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:21.671966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:21.671982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:21.672026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594445956129903:8275]
2025-10-10T14:07:21.672403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:21.674252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594447534051339:8635]
2025-10-10T14:07:21.674363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:21.674376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:21.677258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:21.677934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:21.744288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 663 reason: error at write: Disconnected sessionId: src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0
2025-10-10T14:07:21.744705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 663 sessionId: src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0 is DEAD
2025-10-10T14:07:21.749537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:21.749607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0] Write session will restart in 0.006435s
2025-10-10T14:07:21.749822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0] Write session: Do CDS request
2025-10-10T14:07:21.749889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:21.767352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:21.768068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:21.768110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 664
2025-10-10T14:07:21.775556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:21.775728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:21.775746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:21.775757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:21.777395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594451829018927:8635]
2025-10-10T14:07:21.780455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 664 sessionId:  describe result for acl check
2025-10-10T14:07:21.780580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:21.780592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:21.780603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:21.780625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594451829018929:9275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:21.783900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594451829018929:9275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:21.831184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594451829018929:9275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:21.869546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594451829018929:9275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:21.869602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594451829018929:9275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:21.869621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594451829018929:9275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:21.869650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:21.949394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:21.957050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:21.958045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:21.958066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:21.958119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:21.958433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:21.958634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594450251097472:8286]
2025-10-10T14:07:21.961102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:21.967628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:21.967896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:21.969377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:21.969758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:21.969767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:21.969775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:21.969783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:21.969791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:21.969798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:21.969805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:21.969813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:21.969821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:21.969829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:21.969835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:21.969843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:21.969893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:21.970017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:21.970074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:21.970123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:21.970174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:21.970250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:21.970303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:21.970355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:21.970410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:21.970465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:21.970518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:21.970571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:21.970615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:21.970690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:21.970756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:21.970816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:21.970871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:21.970930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:21.970984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:21.971060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:21.971112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:21.971170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:21.971222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:21.971282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:21.971334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:21.971390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:21.971442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:21.971501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:21.971556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:21.971616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:21.977282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:21.977395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:21.977461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:21.977526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:21.977579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:21.977641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:21.978154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:22.033090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:22.211907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:22.211956Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:22.211974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:22.211993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:22.212019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 663 [2:7559594450251097472:8286]
2025-10-10T14:07:22.212078Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:22.212132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:22.212148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:22.212161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:22.212173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:22.212222Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:22.212246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:22.212268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:22.257310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:22.257345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:22.257360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:22.257374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:22.257385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:22.257707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:22.257740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:22.257888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:22.258089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:22.258337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:22.258465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:22.258548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.258562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.258576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.258590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.258644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:22.258735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:22.258781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:22.258797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:22.258807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:22.258818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:22.258932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:22.258952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:22.259111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.259153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:22.259218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594451829019060:9275], now have 1 active actors on pipe
2025-10-10T14:07:22.259261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594451829018927:8635], now have 1 active actors on pipe
2025-10-10T14:07:22.259287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594451829018899:2442], now have 1 active actors on pipe
2025-10-10T14:07:22.259574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:22.261630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 663
2025-10-10T14:07:22.261766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 663, pipe: [1:7559594451829018927:8635]
2025-10-10T14:07:22.261864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 663
2025-10-10T14:07:22.267282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 664 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0
2025-10-10T14:07:22.265536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:22.265582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:22.265681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:22.265716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:22.265734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:22.265745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:22.265784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:22.265843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:22.265907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:22.266873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:22.266897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:22.266961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:22.269952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|773c6b2e-dcfbc848-bea3d281-6c9f7ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:22.309296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:22.309331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:22.309341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:22.392734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0] Write session: try to update token
2025-10-10T14:07:22.392796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:22.473770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:22.473805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:22.473854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.473983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:22.473996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:22.474007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:22.474073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:22.474369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:22.475820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:22.477018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:22.504254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:22.569703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:22.574710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:22.581842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:22.581997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:22.582010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:22.582021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:22.731629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:22.731664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:22.731675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:22.731724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:22.731737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:22.731749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:22.731761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:22.731771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:22.731810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.731840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.731864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.731890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594450251097467:8286]
2025-10-10T14:07:22.732016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:22.732042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:22.732053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:22.733152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:22.733198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:22.733229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:22.733258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:22.734397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:22.756158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId: src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:22.846424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:23.009095Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:23.010955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:23.010990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:23.012085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:23.012123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:23.012167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594451829018927:8635]
2025-10-10T14:07:23.012313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:23.013480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:23.021576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 664 reason: error at write: Disconnected sessionId: src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0
2025-10-10T14:07:23.022178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:23.022204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0] Write session will restart in 0.006705s
2025-10-10T14:07:23.022276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0] Write session: Do CDS request
2025-10-10T14:07:23.022299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:23.026051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 664 sessionId: src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0 is DEAD
2025-10-10T14:07:23.042698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:23.042733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 665
2025-10-10T14:07:23.043895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:23.044857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:23.045019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:23.045037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:23.045050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:23.046781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 665 sessionId:  describe result for acl check
2025-10-10T14:07:23.046910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:23.046924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:23.046933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:23.046950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594460418953807:9289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:23.049857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594460418953807:9289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:23.082206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594460418953807:9289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:23.120869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594460418953862:8635]
2025-10-10T14:07:23.122073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594460418953807:9289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:23.122104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594460418953807:9289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:23.122124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594460418953807:9289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:23.122161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:23.306592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:23.317760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:23.318770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:23.318799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:23.318852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:23.319169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:23.319369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594458841032357:8303]
2025-10-10T14:07:23.321725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:23.323152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:23.323384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:23.324726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:23.325096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:23.325105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:23.325113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:23.325120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:23.325148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:23.325155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:23.325164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:23.325172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:23.325179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:23.325185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:23.325192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:23.325200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:23.325252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:23.325366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:23.325415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:23.325462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:23.325506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:23.325552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:23.325595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:23.325640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:23.325685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:23.325733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:23.325792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:23.327924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:23.327996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:23.328075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:23.328140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:23.328198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:23.328249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:23.328302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:23.328348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:23.328405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:23.328453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:23.328507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:23.328553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:23.328605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:23.328652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:23.328706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:23.328757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:23.328810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:23.328862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:23.328914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:23.328959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:23.329010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:23.329058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:23.329109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:23.329184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:23.329232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:23.329670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:23.494200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:23.513749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:23.513796Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:23.513813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:23.513835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:23.513860Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 664 [2:7559594458841032357:8303]
2025-10-10T14:07:23.513917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:23.513986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:23.514003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:23.514017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:23.514029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:23.514081Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:23.514103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:23.514126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:23.515483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:23.515500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:23.515514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:23.515527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:23.515537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:23.515819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:23.515837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:23.515984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:23.516165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:23.516393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:23.519565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 664
2025-10-10T14:07:23.519653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 664, pipe: [1:7559594460418953862:8635]
2025-10-10T14:07:23.519721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 664
2025-10-10T14:07:23.520440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:23.520559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594460418953865:9289], now have 1 active actors on pipe
2025-10-10T14:07:23.520585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594460418953862:8635], now have 1 active actors on pipe
2025-10-10T14:07:23.520609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594460418953797:2442], now have 1 active actors on pipe
2025-10-10T14:07:23.520657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:23.520681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:23.520737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.520751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.520765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.520779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.520819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:23.520910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:23.521094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:23.521112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:23.521203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:23.521237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:23.521256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:23.521266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:23.521304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:23.521350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:23.521503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.521525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:23.521569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:23.521671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:23.521688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:23.521701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:23.521712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:23.521740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:23.529229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:23.529286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:23.529389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:23.531773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 665 partition: 0 MaxSeqNo: 36 sessionId: src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0
2025-10-10T14:07:23.532664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f39e630-9f2ec4fa-386606c6-b7c6d037_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:23.580523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0] Write session: try to update token
2025-10-10T14:07:23.580588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:23.648137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:07:23.648210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-10-10T14:07:23.764973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:23.765002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:23.765012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:23.765073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:23.765084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:23.765119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.768769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:23.770422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:23.771622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:23.772683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:23.773258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:23.774297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId: src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:23.782173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:23.783725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:23.784183Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:07:23.786358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 16 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:07:23.786507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:07:23.829645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:23.832912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:23.833068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:23.833083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:23.833097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:23.833107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:23.833116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:23.833485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.833518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.833544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.833569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594458841032352:8303]
2025-10-10T14:07:23.833746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:23.833773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:23.833812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:23.833839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:23.833850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:23.835314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:23.837247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:23.837290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:23.837318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:23.837343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:24.161088Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:24.174858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:24.174886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:24.183513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:24.236813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 665 reason: error at write: Disconnected sessionId: src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0
2025-10-10T14:07:24.251909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 665 sessionId: src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0 is DEAD
2025-10-10T14:07:24.257378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:24.257425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0] Write session will restart in 0.008602s
2025-10-10T14:07:24.257532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0] Write session: Do CDS request
2025-10-10T14:07:24.257563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:24.274420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:24.324067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594460418953862:8635]
2025-10-10T14:07:24.324141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:24.324659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:24.324683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 666
2025-10-10T14:07:24.342598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:24.342747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:24.342764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:24.342774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:24.344220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 666 sessionId:  describe result for acl check
2025-10-10T14:07:24.344331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:24.344341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:24.344350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:24.344368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594464713921535:9303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:24.347173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594464713921535:9303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:24.394861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594464713921535:9303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:24.423129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:24.423632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:24.424369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:24.424387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:24.424430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:24.424662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:24.424833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594463135999920:8314]
2025-10-10T14:07:24.427065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:24.429792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594464713921635:8635]
2025-10-10T14:07:24.430569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594464713921535:9303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:24.430611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594464713921535:9303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:24.430644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594464713921535:9303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:24.430713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:24.428747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:24.428953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:24.430404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:24.430782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:24.430796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:24.430809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:24.430825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:24.430838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:24.430850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:24.430863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:24.430873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:24.430880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:24.430887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:24.430893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:24.430900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:24.430944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:24.431074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:24.431120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:24.431164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:24.431206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:24.431247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:24.431288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:24.431331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:24.431375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:24.431417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:24.431456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:24.431495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:24.431532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:24.431587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:24.431662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:24.431758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:24.431836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:24.431920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:24.431964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:24.432016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:24.432067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:24.432119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:24.433651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:24.433727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:24.433774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:24.433824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:24.433867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:24.433918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:24.433963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:24.434012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:24.434053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:24.434117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:24.434161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:24.434210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:24.434252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:24.434303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:24.434720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:24.500433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:24.537684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:24.537727Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:24.537743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:24.537761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:24.537785Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 665 [2:7559594463135999920:8314]
2025-10-10T14:07:24.537836Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:24.537896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:24.537911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:24.537921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:24.537930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:24.537977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:24.537998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:24.538018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:24.540505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:24.540522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:24.540534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:24.540546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:24.540556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:24.541661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:24.541690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:24.541829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:24.541992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:24.542191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:24.542297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:24.542339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594464713921635:8635], now have 1 active actors on pipe
2025-10-10T14:07:24.542358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594464713921638:9303], now have 1 active actors on pipe
2025-10-10T14:07:24.542379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594464713921497:2442], now have 1 active actors on pipe
2025-10-10T14:07:24.542448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.542462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.542473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.542485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.542527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:24.542600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:24.542760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:24.542775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:24.542899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.542918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:24.543657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:24.543676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:24.543687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:24.543697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:24.543719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:24.546513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 665, pipe: [1:7559594464713921635:8635]
2025-10-10T14:07:24.546601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 665
2025-10-10T14:07:24.546668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 665
2025-10-10T14:07:24.549213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:24.549263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:24.549382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:24.549418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:24.549437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:24.549448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:24.549490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:24.549541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:24.549593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:24.550366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:24.550394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:24.550454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:24.550724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 666 partition: 0 MaxSeqNo: 36 sessionId: src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0
2025-10-10T14:07:24.551727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2eb56d3-b0bb0b5a-9f7dd292-13e1db89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:24.579804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0] Write session: try to update token
2025-10-10T14:07:24.579863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:24.667787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:24.667825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:24.667865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.667963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:24.668072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:24.668093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:24.668106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:24.668190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:24.680049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:24.681261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:24.708125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:24.720936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:24.749269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:24.749721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:24.787823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:24.787849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:24.787860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:24.787915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:24.787932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:24.787945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:24.787957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:24.787967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:24.788007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.788033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.788057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.788079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594463135999915:8314]
2025-10-10T14:07:24.788225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:24.788249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:24.788259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:24.788884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:24.788919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:24.788953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:24.788978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:24.794313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:24.805961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId: src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:24.828339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:24.955066Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:24.997514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:24.997563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:24.999371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594464713921635:8635]
2025-10-10T14:07:24.999469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:24.999479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:24.998853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:25.003830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:25.023513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 666 reason: error at write: Disconnected sessionId: src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0
2025-10-10T14:07:25.023869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 666 sessionId: src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0 is DEAD
2025-10-10T14:07:25.029375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:25.029422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0] Write session will restart in 0.009007s
2025-10-10T14:07:25.029524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0] Write session: Do CDS request
2025-10-10T14:07:25.029558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:25.049692Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:25.049730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 667
2025-10-10T14:07:25.050742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:25.051548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:25.051696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:25.051712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:25.051722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:25.053306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 667 sessionId:  describe result for acl check
2025-10-10T14:07:25.053439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:25.053450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:25.053460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:25.053477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594469008888985:9312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:25.056389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594469008888985:9312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:25.110561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594469008889012:8635]
2025-10-10T14:07:25.113248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594469008888985:9312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:25.151980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594469008888985:9312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:25.152027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594469008888985:9312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:25.152045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594469008888985:9312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:25.152080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:25.247178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:25.259294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:25.260213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:25.260254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:25.260299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:25.260593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:25.260787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594467430967487:8325]
2025-10-10T14:07:25.263144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:25.265640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:25.265914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:25.267285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:25.267629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:25.267638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:25.267646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:25.267654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:25.267661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:25.267669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:25.267677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:25.267685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:25.267693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:25.267701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:25.267708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:25.267716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:25.267769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:25.267891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:25.267946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:25.268000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:25.268050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:25.268102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:25.268157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:25.268210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:25.268262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:25.268317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:25.268369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:25.268423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:25.268466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:25.268541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:25.268609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:25.268669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:25.268725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:25.268785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:25.268835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:25.268897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:25.268952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:25.269009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:25.269058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:25.269116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:25.270325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:25.270409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:25.270463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:25.270526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:25.270582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:25.270640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:25.270691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:25.270757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:25.270811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:25.270871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:25.270920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:25.270995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:25.271501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:25.371434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:25.392769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:25.395714Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:25.395745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:25.395766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:25.395789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 666 [2:7559594467430967487:8325]
2025-10-10T14:07:25.395848Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:25.395916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:25.395931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:25.395945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:25.395957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:25.396005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:25.396027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:25.396049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:25.398743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:25.398777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:25.398794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:25.398810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:25.398824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:25.399129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:25.399148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:25.399307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:25.399510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:25.399786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:25.399912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:25.399986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.400003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.400016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.400031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.400072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:25.400158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:25.400390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:25.400409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:25.400537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.400559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:25.403053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:25.403079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:25.403092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:25.403105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:25.403130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:25.404212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 666
2025-10-10T14:07:25.404299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 666, pipe: [1:7559594469008889012:8635]
2025-10-10T14:07:25.404369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 666
2025-10-10T14:07:25.404585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594469008889095:9312], now have 1 active actors on pipe
2025-10-10T14:07:25.404626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594469008889012:8635], now have 1 active actors on pipe
2025-10-10T14:07:25.404648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594464713921675:2442], now have 1 active actors on pipe
2025-10-10T14:07:25.405450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:25.405503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:25.405611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:25.405645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:25.405666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:25.405679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:25.405718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:25.405763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:25.405817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:25.410066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:25.410103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:25.410186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:25.410580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 667 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0
2025-10-10T14:07:25.411487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca71768-9a759990-6729bef5-c2fd5ceb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:25.470984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0] Write session: try to update token
2025-10-10T14:07:25.471043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:25.502260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:25.502297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:25.502337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.502464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:25.502477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:25.502491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:25.502553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:25.505412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:25.529656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:25.530995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:25.532192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:25.545460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:25.547292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:25.547638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:25.605236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:25.605282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:25.605295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:25.788106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:25.788148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:25.788161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:25.788218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:25.788235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:25.788250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:25.788263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:25.788275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:25.788320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.788348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.788374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.788400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594467430967481:8325]
2025-10-10T14:07:25.788500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:25.788531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:25.788563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:25.788594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:25.790763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:25.790818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:25.790831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:25.792228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:25.824154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId: src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:25.919728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:26.020675Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:26.024049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:26.024098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:26.026252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:26.026404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:26.026417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:26.047351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:26.105714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594469008889012:8635]
2025-10-10T14:07:26.105825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 667 reason: error at write: Disconnected sessionId: src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0
2025-10-10T14:07:26.106194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 667 sessionId: src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0 is DEAD
2025-10-10T14:07:26.117340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:26.117386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0] Write session will restart in 0.005200s
2025-10-10T14:07:26.117490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0] Write session: Do CDS request
2025-10-10T14:07:26.117520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:26.131167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:26.194261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:26.194294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 668
2025-10-10T14:07:26.201285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:26.201449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:26.201466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:26.201476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:26.203151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 668 sessionId:  describe result for acl check
2025-10-10T14:07:26.203276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:26.203286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:26.203295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:26.203312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594473303856582:9325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:26.206559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594473303856582:9325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:26.217256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594473303856588:8635]
2025-10-10T14:07:26.251121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594473303856582:9325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:26.287635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594473303856582:9325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:26.287685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594473303856582:9325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:26.287704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594473303856582:9325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:26.287735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:26.388908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:26.396505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:26.397458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:26.397480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:26.397525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:26.397813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:26.398003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594471725935068:8335]
2025-10-10T14:07:26.400380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:26.408040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:26.408369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:26.409798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:26.410150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:26.410159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:26.410168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:26.410177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:26.410184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:26.410191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:26.410199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:26.410206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:26.410212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:26.410220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:26.410228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:26.410236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:26.410283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:26.410403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:26.410453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:26.410499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:26.410545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:26.410594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:26.410640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:26.410688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:26.410733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:26.410784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:26.410832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:26.410879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:26.410917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:26.410999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:26.411059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:26.411117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:26.411168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:26.411223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:26.411271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:26.411330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:26.411379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:26.411433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:26.411485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:26.411541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:26.411596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:26.411653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:26.411695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:26.411750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:26.411800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:26.411856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:26.411907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:26.411965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:26.412013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:26.412070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:26.412116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:26.412170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:26.412637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:26.463434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:26.627677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:26.627730Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:26.627749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:26.627770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:26.627797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 667 [2:7559594471725935068:8335]
2025-10-10T14:07:26.627859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:26.627921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:26.627938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:26.627951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:26.627964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:26.628018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:26.628041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:26.628064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:26.678252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:26.678282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:26.678297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:26.678311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:26.678322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:26.678583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:26.678601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:26.678744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:26.678949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:26.679193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:26.679316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:26.679407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594473303856556:2442], now have 1 active actors on pipe
2025-10-10T14:07:26.679435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594473303856684:9325], now have 1 active actors on pipe
2025-10-10T14:07:26.679458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594473303856588:8635], now have 1 active actors on pipe
2025-10-10T14:07:26.679483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:26.679499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:26.679513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:26.679526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:26.679572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:26.679655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:26.679842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:26.679860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:26.679988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:26.680011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:26.681809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 667
2025-10-10T14:07:26.681918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 667
2025-10-10T14:07:26.681980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 667, pipe: [1:7559594473303856588:8635]
2025-10-10T14:07:26.680775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:26.680799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:26.680814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:26.680826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:26.680852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:26.686697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:26.686737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:26.686821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:26.686857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:26.686877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:26.686890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:26.686941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:26.686987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:26.687039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:26.691229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:26.691277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:26.691351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:26.691933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 668 partition: 0 MaxSeqNo: 36 sessionId: src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0
2025-10-10T14:07:26.693675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6211209-63fa4e0e-c1d37e1a-4925ae99_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:26.729888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:26.729919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:26.729932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:26.800926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0] Write session: try to update token
2025-10-10T14:07:26.801029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:26.825731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:26.825763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:26.825777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:26.825789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:26.825800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:26.825832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:26.825860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:26.825886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:26.825908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:26.829301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:26.829367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:26.829402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:26.829439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:26.843289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:26.843347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:26.843360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:26.844497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:27.002151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId: src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:27.026656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:27.092945Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:27.095044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:27.095078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:27.095128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594471725935063:8335]
2025-10-10T14:07:27.095279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:27.095308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:27.100805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:27.105372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:27.105690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:27.105718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:27.108323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594473303856588:8635]
2025-10-10T14:07:27.103326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:27.171925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 668 reason: error at write: Disconnected sessionId: src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0
2025-10-10T14:07:27.172255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 668 sessionId: src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0 is DEAD
2025-10-10T14:07:27.177432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:27.177499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0] Write session will restart in 0.006966s
2025-10-10T14:07:27.177677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0] Write session: Do CDS request
2025-10-10T14:07:27.177731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:27.197364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:27.197399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 669
2025-10-10T14:07:27.197930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:27.201597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:27.201775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:27.201794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:27.201805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:27.210378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 669 sessionId:  describe result for acl check
2025-10-10T14:07:27.210506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:27.210518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:27.210528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:27.210546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594477598824190:9337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:27.210617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594477598824192:8635]
2025-10-10T14:07:27.213695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594477598824190:9337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:27.237250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594477598824190:9337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:27.255430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594477598824190:9337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:27.255496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594477598824190:9337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:27.255518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594477598824190:9337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:27.255557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:27.328910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:27.337983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:27.339010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:27.339029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:27.339080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:27.339341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:27.339527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594476020902635:8345]
2025-10-10T14:07:27.342189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:27.405522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:27.405860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:27.407310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:27.407665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:27.407674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:27.407682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:27.407689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:27.407696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:27.407703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:27.407710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:27.407718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:27.407726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:27.407734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:27.407741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:27.407749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:27.407802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:27.407928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:27.407982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:27.408032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:27.408085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:27.408139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:27.408191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:27.408244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:27.408296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:27.408348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:27.408400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:27.408452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:27.408498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:27.408572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:27.408640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:27.408701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:27.408757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:27.408817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:27.408868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:27.408927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:27.408980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:27.409040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:27.409089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:27.410510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:27.410582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:27.410646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:27.410701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:27.410762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:27.410823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:27.410898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:27.410963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:27.411026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:27.411080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:27.411139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:27.411192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:27.411250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:27.411764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:27.460759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:27.500687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:27.500736Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:27.500755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:27.500774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:27.500797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 668 [2:7559594476020902635:8345]
2025-10-10T14:07:27.500860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:27.500918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:27.500932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:27.500946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:27.500958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:27.501005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:27.501025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:27.501048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:27.536747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:27.536776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:27.536789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:27.536801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:27.536812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:27.537085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:27.537101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:27.538350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 668
2025-10-10T14:07:27.538440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 668, pipe: [1:7559594477598824192:8635]
2025-10-10T14:07:27.538510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 668
2025-10-10T14:07:27.537666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:27.537867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:27.538094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:27.538223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:27.538315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594477598824274:9337], now have 1 active actors on pipe
2025-10-10T14:07:27.538355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594477598824192:8635], now have 1 active actors on pipe
2025-10-10T14:07:27.538379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594477598824147:2442], now have 1 active actors on pipe
2025-10-10T14:07:27.538406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.538420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.538443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.538456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.538495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:27.538582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:27.538771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:27.538789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:27.538929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.538948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:27.539179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:27.539193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:27.539204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:27.539217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:27.539239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:27.539765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:27.539790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:27.539865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:27.539897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:27.539916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:27.539928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:27.539963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:27.540004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:27.540050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:27.541002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:27.541024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:27.541090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:27.541373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 669 partition: 0 MaxSeqNo: 36 sessionId: src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0
2025-10-10T14:07:27.542190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 848 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 15769614 MessagesInflight: 10 }
2025-10-10T14:07:27.542307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b0fa2c-b58fa379-b2f7116e-b42bc702_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:27.580099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0] Write session: try to update token
2025-10-10T14:07:27.580159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:27.672033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:27.672075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:27.672090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:27.672211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:27.672230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:27.672275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.672417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:27.674699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:27.676258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:27.677541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:27.714019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:27.715284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:27.716907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:27.733142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:27.777350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:27.777383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:27.777395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:27.802346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId: src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:27.884153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:27.884198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:27.884214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:27.884227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:27.884241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:27.884288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.884319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.884348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.884375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594476020902630:8345]
2025-10-10T14:07:27.884556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:27.884569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:27.884582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:27.884627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:27.884655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:27.884669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:27.885859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:27.889713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:27.889763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:27.889796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:27.889827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:27.890358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:28.096948Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:28.104739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:28.104794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:28.108754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:28.107560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:28.107587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:28.139566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 669 reason: error at write: Disconnected sessionId: src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0
2025-10-10T14:07:28.139878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 669 sessionId: src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0 is DEAD
2025-10-10T14:07:28.145317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:28.145357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0] Write session will restart in 0.008833s
2025-10-10T14:07:28.145457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0] Write session: Do CDS request
2025-10-10T14:07:28.145485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:28.150879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594477598824192:8635]
2025-10-10T14:07:28.151365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:28.160502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:28.161421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:28.161461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 670
2025-10-10T14:07:28.161843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:28.161960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:28.161977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:28.161986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:28.163350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 670 sessionId:  describe result for acl check
2025-10-10T14:07:28.163466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:28.163477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:28.163486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:28.163502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594481893791746:9355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:28.166327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594481893791746:9355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:28.178482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594481893791746:9355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:28.187922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594481893791746:9355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:28.187963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594481893791746:9355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:28.187979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594481893791746:9355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:28.188012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:28.254783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594481893791973:8635]
2025-10-10T14:07:28.275405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:28.282041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:28.283000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:28.283021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:28.283067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:28.283350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:28.283532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594480315870205:8356]
2025-10-10T14:07:28.286654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:28.288061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:28.288297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:28.289702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:28.290056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:28.290075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:28.290083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:28.290090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:28.290097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:28.290105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:28.290113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:28.290120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:28.290127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.290135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.290143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.290150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.290220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:28.290329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:28.290380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:28.290434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:28.290480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:28.290529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:28.290578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:28.290628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:28.290676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.290725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.290771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.290815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.290857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:28.290942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:28.291008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:28.291069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:28.291120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:28.291177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:28.291227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:28.291285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:28.291336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:28.291394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:28.291444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:28.291501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:28.291551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:28.291609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:28.291655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:28.291707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:28.291755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.291811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.291861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.291916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.291961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.292015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.292062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.292116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.292570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:28.330156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:28.374398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:28.374441Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:28.374456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:28.374476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:28.374502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 669 [2:7559594480315870205:8356]
2025-10-10T14:07:28.374558Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:28.374612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:28.374627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:28.374639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:28.374651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:28.374701Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:28.374722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:28.374743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:28.383141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 669
2025-10-10T14:07:28.383240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 669, pipe: [1:7559594481893791973:8635]
2025-10-10T14:07:28.383325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 669
2025-10-10T14:07:28.381884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.381914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.381927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.381940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.381952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:28.382233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:28.382250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.386980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.387167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.387399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.387517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:28.387612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594481893791780:9355], now have 1 active actors on pipe
2025-10-10T14:07:28.387639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594481893791973:8635], now have 1 active actors on pipe
2025-10-10T14:07:28.387681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594481893791742:2442], now have 1 active actors on pipe
2025-10-10T14:07:28.387735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:28.387759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:28.387816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594480315870200:8356]
2025-10-10T14:07:28.387832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594480315870200:8356]
2025-10-10T14:07:28.387847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594480315870200:8356]
2025-10-10T14:07:28.387860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594480315870200:8356]
2025-10-10T14:07:28.387902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:28.387988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:28.388170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:28.388187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:28.388247Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:28.388276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:28.388295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:28.388308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:28.388341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:28.388381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:28.388513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594480315870200:8356]
2025-10-10T14:07:28.388534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:28.388579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:28.389085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:28.389098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:28.389111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:28.389138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:28.389162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:28.397448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:28.397498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:28.397581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:28.401469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 670 partition: 0 MaxSeqNo: 36 sessionId: src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0
2025-10-10T14:07:28.405682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5670bbde-4f06f97f-197524c9-6551b0f2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:28.453924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0] Write session: try to update token
2025-10-10T14:07:28.453980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:28.477238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:28.477276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:28.477289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:28.500664Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 6 CurrentSessionLifetimeMs: 483099 BytesRead: 29286416 MessagesRead: 13 BytesReadCompressed: 29286416 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-10-10T14:07:28.538771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:28.538810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:28.538824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:28.538835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:28.538847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:28.538883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594480315870200:8356]
2025-10-10T14:07:28.538923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594480315870200:8356]
2025-10-10T14:07:28.538951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594480315870200:8356]
2025-10-10T14:07:28.538977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594480315870200:8356]
2025-10-10T14:07:28.539136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:28.539173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.539184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:28.540278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:28.541291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:28.541338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:28.541370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:28.541401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:28.622301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId: src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:28.649273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:28.703610Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:28.705795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:28.705839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:28.710040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:28.710075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:28.714179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594481893791973:8635]
2025-10-10T14:07:28.714334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:28.717075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 670 reason: error at write: Disconnected sessionId: src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0
2025-10-10T14:07:28.717373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 670 sessionId: src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0 is DEAD
2025-10-10T14:07:28.721741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:28.721780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0] Write session will restart in 0.007887s
2025-10-10T14:07:28.721874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0] Write session: Do CDS request
2025-10-10T14:07:28.721905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:28.737226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:28.737334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:28.737372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 671
2025-10-10T14:07:28.741354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:28.741692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:28.741738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:28.741766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:28.746659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 671 sessionId:  describe result for acl check
2025-10-10T14:07:28.746852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:28.746864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:28.746874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:28.746907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594481893792035:9365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:28.749752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594481893792035:9365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:28.750171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:28.773201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594481893792035:9365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:28.791666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594481893792035:9365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:28.791716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594481893792035:9365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:28.791736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594481893792035:9365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:28.791776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:28.813630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594481893792116:8635]
2025-10-10T14:07:28.932597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:28.938917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:28.939808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:28.939827Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:28.939868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:28.940138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:28.940327Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594480315870488:8366]
2025-10-10T14:07:28.943034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:28.944254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:28.944507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:28.945890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:28.946261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:28.946270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:28.946278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:28.946286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:28.946294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:28.946302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:28.946310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:28.946318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:28.946326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.946333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.946342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.946350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.946406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:28.946538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:28.946593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:28.946650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:28.946703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:28.946758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:28.946812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:28.946866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:28.946937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.946991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.947048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.947103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.947150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:28.947228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:28.947296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:28.947357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:28.947412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:28.947474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:28.947528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:28.947593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:28.947650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:28.947712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:28.947767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:28.947830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:28.947887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:28.947949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:28.947998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:28.948058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:28.948113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.948175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:28.948229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.948289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:28.948342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.948402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:28.948453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.948513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:28.949030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:28.981951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:29.056727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:29.056779Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:29.056800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:29.056823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:29.056850Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 670 [2:7559594480315870488:8366]
2025-10-10T14:07:29.056916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:29.056978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:29.056995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:29.057009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:29.057022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:29.057073Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:29.057097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:29.057120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:29.058680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:29.058710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:29.058727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:29.058743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:29.058756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:29.059068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:29.059087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:29.059255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:29.059475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:29.059738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:29.059876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:29.059954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.059971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.059986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.060001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.060044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:29.060133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:29.060337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:29.060357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:29.060479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.060501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:29.060770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:29.060783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:29.060795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:29.060809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:29.060833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:29.063002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 670
2025-10-10T14:07:29.063092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 670, pipe: [1:7559594481893792116:8635]
2025-10-10T14:07:29.063164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 670
2025-10-10T14:07:29.063517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594481893792078:9365], now have 1 active actors on pipe
2025-10-10T14:07:29.063555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594481893792116:8635], now have 1 active actors on pipe
2025-10-10T14:07:29.063579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594481893792026:2442], now have 1 active actors on pipe
2025-10-10T14:07:29.063625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:29.063646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:29.063733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:29.063766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:29.063784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:29.063795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:29.063831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:29.063872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:29.063923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:29.064396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:29.064415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:29.064476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:29.066313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f216764f-27420ac0-ed3f9d7d-9a84cc19_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:29.064757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 671 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0
2025-10-10T14:07:29.102234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0] Write session: try to update token
2025-10-10T14:07:29.102295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:29.244931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:29.244967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:29.244980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:29.245033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:29.245049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:29.245063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:29.245074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:29.245085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:29.245121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.253311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.253339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.253363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.253604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:29.253634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:29.253646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:29.253970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:29.254004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:29.254031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:29.254058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:29.269656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:29.287409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId: src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:29.310409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:29.415199Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:29.428649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:29.428713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:29.428784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:29.428800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:29.428842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594480315870482:8366]
2025-10-10T14:07:29.429087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:29.429510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:29.429483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:29.429513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:29.433492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594481893792116:8635]
2025-10-10T14:07:29.433622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:29.473368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 671 reason: error at write: Disconnected sessionId: src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0
2025-10-10T14:07:29.473671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 671 sessionId: src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0 is DEAD
2025-10-10T14:07:29.477388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:29.477464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0] Write session will restart in 0.006500s
2025-10-10T14:07:29.477639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0] Write session: Do CDS request
2025-10-10T14:07:29.477705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:29.518377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:29.531287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:29.539465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 672
2025-10-10T14:07:29.539673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594486188759611:8635]
2025-10-10T14:07:29.540058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:29.540196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:29.540214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:29.540226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:29.545417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 672 sessionId:  describe result for acl check
2025-10-10T14:07:29.545561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:29.545573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:29.545582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:29.545601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594486188759622:9371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:29.548562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594486188759622:9371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:29.581076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594486188759622:9371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:29.601566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594486188759622:9371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:29.601627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594486188759622:9371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:29.601644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594486188759622:9371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:29.601682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:29.722471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:29.724464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:29.725388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:29.725404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:29.725451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:29.725728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:29.725926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594484610838059:8372]
2025-10-10T14:07:29.728333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:29.730395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:29.730656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:29.732003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:29.732357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:29.732366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:29.732374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:29.732383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:29.732391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:29.732399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:29.732408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:29.732417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:29.732425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:29.732433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:29.732441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:29.732453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:29.732504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:29.732620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:29.732675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:29.732729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:29.732778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:29.732828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:29.732878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:29.732927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:29.732973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:29.733020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:29.733094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:29.733159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:29.733207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:29.733282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:29.733349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:29.733407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:29.733462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:29.738375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:29.738467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:29.738534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:29.738588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:29.738651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:29.738700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:29.738763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:29.738820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:29.738899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:29.738952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:29.739012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:29.739067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:29.739127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:29.739177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:29.739236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:29.739292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:29.739350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:29.739398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:29.739480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:29.739979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:29.773693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:29.869471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:29.869523Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:29.869539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:29.869558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:29.869582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 671 [2:7559594484610838059:8372]
2025-10-10T14:07:29.869638Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:29.869696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:29.869713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:29.869727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:29.869738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:29.869788Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:29.869812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:29.869833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:29.875802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:29.875820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:29.875833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:29.875848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:29.875860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:29.876126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:29.876142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:29.876282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:29.876458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:29.876676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:29.876787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:29.876869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:29.876882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:29.876897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:29.876910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:29.876949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:29.877030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:29.877540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:29.877557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:29.877569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:29.877580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:29.878961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:29.878980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:29.879142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594486188759584:2442], now have 1 active actors on pipe
2025-10-10T14:07:29.879165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594486188759708:9371], now have 1 active actors on pipe
2025-10-10T14:07:29.879187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594486188759611:8635], now have 1 active actors on pipe
2025-10-10T14:07:29.879209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:29.879249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:29.879447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:29.881485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 671
2025-10-10T14:07:29.881605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 671
2025-10-10T14:07:29.881663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 671, pipe: [1:7559594486188759611:8635]
2025-10-10T14:07:29.881979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:29.882013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:29.882080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:29.882110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:29.882127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:29.882137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:29.882183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:29.882227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:29.882274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:29.884352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:29.884382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:29.884466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:29.889516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 672 partition: 0 MaxSeqNo: 36 sessionId: src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0
2025-10-10T14:07:29.890360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b9baa94-8c4b0eed-589b65a-4283e950_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:29.966570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0] Write session: try to update token
2025-10-10T14:07:29.966623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:29.973092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:29.973147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:29.973160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:30.057501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:30.057546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:30.057571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:30.057591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:30.057606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:30.057657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:30.057703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:30.057747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:30.057784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:30.058062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:30.058116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:30.058139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:30.058279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:30.058307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:30.058335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:30.058366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:30.077875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:30.124231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId: src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:30.172978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:30.264958Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:30.276323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:30.276368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:30.276418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:30.276428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:30.276459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594484610838054:8372]
2025-10-10T14:07:30.278168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:30.281291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:30.281452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:30.281465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:30.278829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:30.288963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594486188759611:8635]
2025-10-10T14:07:30.348248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 672 reason: error at write: Disconnected sessionId: src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0
2025-10-10T14:07:30.348558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 672 sessionId: src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0 is DEAD
2025-10-10T14:07:30.353161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:30.353213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0] Write session will restart in 0.009106s
2025-10-10T14:07:30.353338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0] Write session: Do CDS request
2025-10-10T14:07:30.353380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:30.385285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594490483727211:8635]
2025-10-10T14:07:30.399348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:30.401457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:30.401492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 673
2025-10-10T14:07:30.405366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:30.405531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:30.405547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:30.405557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:30.410985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 673 sessionId:  describe result for acl check
2025-10-10T14:07:30.411112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:30.411123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:30.411132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:30.411148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594490483727232:9386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:30.418378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594490483727232:9386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:30.446964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594490483727232:9386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:30.473831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594490483727232:9386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:30.473875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594490483727232:9386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:30.473894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594490483727232:9386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:30.473924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:30.572366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:30.581655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:30.582606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:30.582628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:30.582678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:30.582987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:30.583199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594488905805643:8386]
2025-10-10T14:07:30.586037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:30.588553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:30.588801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:30.590070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:30.590394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:30.590402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:30.590409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:30.590415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:30.590421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:30.590429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:30.590435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:30.590442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:30.590449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:30.590455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:30.590462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:30.590470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:30.590515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:30.590623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:30.590672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:30.590718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:30.590762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:30.590806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:30.590865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:30.590912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:30.590957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:30.591005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:30.591049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:30.591092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:30.591135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:30.591198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:30.591252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:30.591304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:30.591348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:30.591400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:30.591445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:30.591494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:30.591539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:30.591592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:30.591634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:30.591686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:30.591730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:30.591781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:30.591824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:30.591874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:30.591923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:30.591972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:30.592014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:30.592066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:30.592111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:30.592161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:30.592205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:30.592256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:30.594566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:30.699222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:30.716430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:30.716476Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:30.716494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:30.716515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:30.716541Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 672 [2:7559594488905805643:8386]
2025-10-10T14:07:30.716598Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:30.716664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:30.716680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:30.716693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:30.716704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:30.716755Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:30.716778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:30.716802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:30.718572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:30.718590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:30.718604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:30.718617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:30.718629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:30.718941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:30.718959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:30.719106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:30.721443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 672, pipe: [1:7559594490483727211:8635]
2025-10-10T14:07:30.721582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 672
2025-10-10T14:07:30.721663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 672
2025-10-10T14:07:30.722005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:30.722307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:30.722429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:30.722539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594490483727211:8635], now have 1 active actors on pipe
2025-10-10T14:07:30.722563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594490483727322:9386], now have 1 active actors on pipe
2025-10-10T14:07:30.722585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594490483727187:2442], now have 1 active actors on pipe
2025-10-10T14:07:30.722635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:30.722659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:30.722717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:30.722732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:30.722745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:30.722760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:30.722802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:30.722906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:30.723087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:30.723105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:30.723168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:30.723199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:30.723218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:30.723229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:30.723282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:30.723328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:30.723473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:30.723496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:30.723540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:30.725106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:30.725149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:30.725161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:30.725172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:30.725197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:30.728593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:30.728632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:30.728716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:30.737112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 673 partition: 0 MaxSeqNo: 36 sessionId: src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0
2025-10-10T14:07:30.743353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e894958-acba3d87-2d2d1c84-88840fc3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:30.792975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0] Write session: try to update token
2025-10-10T14:07:30.793038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0] Send 10 message(s) (0 left), first sequence number is 37
E1010 14:07:30.796303201  106874 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:07:30.799248Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:07:30.918127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:30.918157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:30.918166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:30.918215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:30.918228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:30.918244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:30.918257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:30.918267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:30.918295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:30.918322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:30.918346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:30.918363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:30.918509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:30.918531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:30.918539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:30.919495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:30.922098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:30.922144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:30.922174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:30.922200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:30.972572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId: src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:31.005762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:31.069494Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:31.079547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:31.079609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:31.079692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:31.079708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:31.079757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594488905805638:8386]
2025-10-10T14:07:31.080368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:31.080870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:31.081068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:31.081260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594490483727211:8635]
2025-10-10T14:07:31.081355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:31.081380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:31.091789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 673 reason: error at write: Disconnected sessionId: src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0
2025-10-10T14:07:31.092064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 673 sessionId: src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0 is DEAD
2025-10-10T14:07:31.093590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:31.093689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0] Write session will restart in 0.007879s
2025-10-10T14:07:31.093899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0] Write session: Do CDS request
2025-10-10T14:07:31.093944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:31.108752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:31.108802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 674
2025-10-10T14:07:31.109749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:31.110444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:31.110580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:31.110595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:31.110607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:31.114347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 674 sessionId:  describe result for acl check
2025-10-10T14:07:31.114488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:31.114499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:31.114510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:31.114527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594494778694776:9395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:31.125684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594494778694776:9395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:31.135556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594494778694776:9395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:31.151046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594494778694776:9395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:31.151099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594494778694776:9395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:31.151120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594494778694776:9395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:31.151156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:31.185304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594494778694847:8635]
2025-10-10T14:07:31.342667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:31.353585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:31.354437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:31.354455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:31.354498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:31.354757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:31.354958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594493200773204:8389]
2025-10-10T14:07:31.357038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:31.365759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:31.366074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:31.367319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:31.367636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:31.367645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:31.367652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:31.367659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:31.367666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:31.367680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:31.367690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:31.367697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:31.367704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:31.367711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:31.367718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:31.367723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:31.367770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:31.367871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:31.367916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:31.367969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:31.368013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:31.368057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:31.368098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:31.368143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:31.368187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:31.368231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:31.368275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:31.368319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:31.368358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:31.368415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:31.368468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:31.368518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:31.368563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:31.368611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:31.368659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:31.368712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:31.368755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:31.368802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:31.368841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:31.368897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:31.368942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:31.368993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:31.369035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:31.369083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:31.369146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:31.369190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:31.369230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:31.369281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:31.369326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:31.369374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:31.369415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:31.369462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:31.369875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:31.419780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:31.470490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:31.470538Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:31.470551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:31.470567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:31.470588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 673 [2:7559594493200773204:8389]
2025-10-10T14:07:31.470633Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:31.470686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:31.470699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:31.470711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:31.470722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:31.470767Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:31.470790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:31.470811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:31.477805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:31.477835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:31.477849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:31.477860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:31.477870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:31.478149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:31.478165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:31.478308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:31.478457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:31.478649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:31.478746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:31.478819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594493200773199:8389]
2025-10-10T14:07:31.478849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594493200773199:8389]
2025-10-10T14:07:31.478862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594493200773199:8389]
2025-10-10T14:07:31.478874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594493200773199:8389]
2025-10-10T14:07:31.478907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:31.478985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:31.479141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:31.479155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:31.479283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594493200773199:8389]
2025-10-10T14:07:31.479301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:31.481802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:31.481823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:31.481835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:31.481845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:31.481868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:31.485604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 673, pipe: [1:7559594494778694847:8635]
2025-10-10T14:07:31.485733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 673
2025-10-10T14:07:31.485810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 673
2025-10-10T14:07:31.490606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594494778694847:8635], now have 1 active actors on pipe
2025-10-10T14:07:31.490650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594494778694810:9395], now have 1 active actors on pipe
2025-10-10T14:07:31.490670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594494778694766:2442], now have 1 active actors on pipe
2025-10-10T14:07:31.490724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:31.490746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:31.490852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:31.490888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:31.490906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:31.490918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:31.490956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:31.490999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:31.491045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:31.496620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:31.496660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:31.496736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:31.497277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 674 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0
2025-10-10T14:07:31.502239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ec420-a759dc1f-8d4103a1-e31a042a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:31.549481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0] Write session: try to update token
2025-10-10T14:07:31.549538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:31.577264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:31.577294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:31.577306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:31.717455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:31.717499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:31.717515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:31.717527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:31.717539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:31.717574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594493200773199:8389]
2025-10-10T14:07:31.717601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594493200773199:8389]
2025-10-10T14:07:31.717627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594493200773199:8389]
2025-10-10T14:07:31.717650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594493200773199:8389]
2025-10-10T14:07:31.717827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:31.717840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:31.717854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:31.717900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:31.717926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:31.717939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:31.718357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:31.718397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:31.718432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:31.718463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:31.745626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:31.797316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId: src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:31.842952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:31.923743Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:31.928304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:31.928359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:31.932239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:31.931681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594494778694847:8635]
2025-10-10T14:07:31.931791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:31.931805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:31.937319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:31.970228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 674 reason: error at write: Disconnected sessionId: src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0
2025-10-10T14:07:31.970615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 674 sessionId: src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0 is DEAD
2025-10-10T14:07:31.973990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:31.974058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0] Write session will restart in 0.008229s
2025-10-10T14:07:31.974218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0] Write session: Do CDS request
2025-10-10T14:07:31.974257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:31.987197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:31.987237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 675
2025-10-10T14:07:31.987433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:31.994234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:31.994429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:31.994449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:31.994463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:31.996286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 675 sessionId:  describe result for acl check
2025-10-10T14:07:31.996430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:31.996442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:31.996453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:31.996472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594494778695093:9413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:31.999586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594494778695093:9413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:32.015415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594494778695093:9413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:32.027829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594494778695093:9413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:32.027885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594494778695093:9413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:32.027904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594494778695093:9413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:32.027940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:32.033275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594499073662438:8635]
2025-10-10T14:07:32.166888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:32.177718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:32.179707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:32.179738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:32.179789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:32.180118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:32.180337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594497495740769:8401]
2025-10-10T14:07:32.182488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:32.189455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:32.189738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:32.191075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:32.191411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:32.191419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:32.191424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:32.191431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:32.191437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:32.191443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:32.191450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:32.191456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:32.191463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:32.191468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:32.191474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:32.191480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:32.191523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:32.191624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:32.191672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:32.191740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:32.191798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:32.191844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:32.191885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:32.191927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:32.191970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:32.192013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:32.192053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:32.192093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:32.192136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:32.192197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:32.192251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:32.192301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:32.192344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:32.192394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:32.192434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:32.192480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:32.192522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:32.192568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:32.192607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:32.192656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:32.192697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:32.192745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:32.192786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:32.192830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:32.192900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:32.192951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:32.192990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:32.193035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:32.193075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:32.194149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:32.194223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:32.194274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:32.194677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:32.240878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:32.261351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:32.261398Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:32.261415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:32.261436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:32.261461Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 674 [2:7559594497495740769:8401]
2025-10-10T14:07:32.261515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:32.261579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:32.261593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:32.261605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:32.261616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:32.261664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:32.261685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:32.261709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:32.366063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:32.366092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:32.366104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:32.366115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:32.366125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:32.366277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:32.366289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:32.366301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:32.366496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:32.366513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:32.366636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:32.366792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:32.367003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:32.367105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:32.367177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.367192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.367205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.367215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.367257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:32.367331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:32.367483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:32.367499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:32.367618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.367638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:32.369281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:32.369303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:32.369314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:32.369324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:32.369351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:32.374520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594499073662438:8635], now have 1 active actors on pipe
2025-10-10T14:07:32.374554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594499073662427:9413], now have 1 active actors on pipe
2025-10-10T14:07:32.374576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594494778695077:2442], now have 1 active actors on pipe
2025-10-10T14:07:32.375048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:32.375082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:32.375177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:32.375211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:32.375230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:32.375242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:32.375278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:32.375325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:32.375373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:32.373402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 674, pipe: [1:7559594499073662438:8635]
2025-10-10T14:07:32.373536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 674
2025-10-10T14:07:32.373624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 674
2025-10-10T14:07:32.385212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 675 partition: 0 MaxSeqNo: 36 sessionId: src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0
2025-10-10T14:07:32.386199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4ee065-9e2ff44a-da0a0ab8-4fe475f1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:32.378609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:32.378645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:32.378723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:32.473037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0] Write session: try to update token
2025-10-10T14:07:32.473104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:32.473258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:32.473298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:32.473312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:32.554314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:32.554357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:32.554403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.554536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:32.556329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:32.578831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:32.579991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:32.597432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:32.598663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:32.600325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:32.600701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:32.600714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:32.600727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:32.600789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:32.779920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId: src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:32.795182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:32.795214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:32.795225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:32.795280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:32.795293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:32.795305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:32.795316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:32.795326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:32.795367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.795390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.795411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.795432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594497495740763:8401]
2025-10-10T14:07:32.795572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:32.795599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:32.795610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:32.796731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:32.797234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:32.797263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:32.797291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:32.797318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:32.887515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:32.992802Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:32.994649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:32.994682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:32.996596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:32.996627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:33.005187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:33.080947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 675 reason: error at write: Disconnected sessionId: src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0
2025-10-10T14:07:33.081428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 675 sessionId: src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0 is DEAD
2025-10-10T14:07:33.088622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:33.088681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0] Write session will restart in 0.006100s
2025-10-10T14:07:33.088825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0] Write session: Do CDS request
2025-10-10T14:07:33.088873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:33.090885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594499073662438:8635]
2025-10-10T14:07:33.090966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:33.111694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:33.117285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:33.117324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 676
2025-10-10T14:07:33.117878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:33.118011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:33.118026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:33.118038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:33.126517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 676 sessionId:  describe result for acl check
2025-10-10T14:07:33.126649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:33.126660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:33.126669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:33.126687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594503368629986:9422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:33.133240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594503368629986:9422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:33.153118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594503368629986:9422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:33.190704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594503368630022:8635]
2025-10-10T14:07:33.195742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594503368629986:9422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:33.195785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594503368629986:9422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:33.195802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594503368629986:9422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:33.195831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:33.426156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:33.426695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:33.427480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:33.427499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:33.427543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:33.427789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:33.427975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594501790708366:8410]
2025-10-10T14:07:33.434412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:33.462039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:33.462319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:33.463590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:33.463909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:33.463916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:33.463923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:33.463931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:33.463938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:33.463946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:33.463954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:33.463961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:33.463969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:33.463976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:33.463983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:33.463990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:33.464034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:33.464136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:33.464183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:33.464229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:33.464275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:33.464319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:33.464360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:33.464403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:33.464444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:33.464489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:33.464531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:33.464573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:33.464612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:33.464676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:33.464734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:33.464786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:33.464831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:33.464880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:33.464922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:33.464974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:33.465020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:33.465072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:33.465114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:33.481561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:33.481662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:33.481722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:33.481773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:33.481835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:33.481889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:33.481950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:33.482006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:33.482073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:33.482129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:33.482191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:33.482241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:33.482300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:33.482749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:33.648724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:33.677364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:33.677413Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:33.677429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:33.677451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:33.677482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 675 [2:7559594501790708366:8410]
2025-10-10T14:07:33.677559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:33.677631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:33.677648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:33.677663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:33.677676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:33.677729Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:33.677755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:33.677777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:33.711270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:33.711304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:33.711316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:33.711327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:33.711338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:33.711623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:33.711640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:33.711773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:33.712979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 675
2025-10-10T14:07:33.713081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 675
2025-10-10T14:07:33.713166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 675, pipe: [1:7559594503368630022:8635]
2025-10-10T14:07:33.713995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:33.714278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:33.714405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:33.714498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594503368630027:9422], now have 1 active actors on pipe
2025-10-10T14:07:33.720262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594503368629973:2442], now have 1 active actors on pipe
2025-10-10T14:07:33.720407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594503368630022:8635], now have 1 active actors on pipe
2025-10-10T14:07:33.720487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:33.720525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:33.720591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:33.720608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:33.720624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:33.720639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:33.720687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:33.720792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:33.721002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:33.721021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:33.721088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:33.721149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:33.721171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:33.721183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:33.721220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:33.721267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:33.723373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:33.723406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:33.723472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:33.729616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 676 partition: 0 MaxSeqNo: 36 sessionId: src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0
2025-10-10T14:07:33.724074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:33.724108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:33.724122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:33.724135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:33.724167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:33.727987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:33.728025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:33.728121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:33.734051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a89485-db271dcb-5bbaa832-5b307af0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:33.778445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:33.778479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:33.778492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:33.810560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0] Write session: try to update token
2025-10-10T14:07:33.810628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:34.002025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:34.002064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:34.002079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:34.002203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:34.002220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:34.002238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:34.002252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:34.002264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:34.002304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:34.002332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:34.002361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:34.002388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:34.005649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:34.005698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:34.005727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:34.005754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:34.010921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId: src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:34.038159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:34.038217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:34.038232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:34.039425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:34.066458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:34.404755Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:34.406568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:34.406588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:34.406638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594501790708361:8410]
2025-10-10T14:07:34.406822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:34.406848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:34.408954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:34.408988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:34.413273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:34.413438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594503368630022:8635]
2025-10-10T14:07:34.407225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:34.416447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:34.449121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 676 reason: error at write: Disconnected sessionId: src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0
2025-10-10T14:07:34.449470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 676 sessionId: src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0 is DEAD
2025-10-10T14:07:34.457387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:34.457433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0] Write session will restart in 0.009074s
2025-10-10T14:07:34.457542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0] Write session: Do CDS request
2025-10-10T14:07:34.457574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:34.477826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:34.476699Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:34.476740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 677
2025-10-10T14:07:34.478554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:34.478685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:34.478703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:34.478714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:34.480240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 677 sessionId:  describe result for acl check
2025-10-10T14:07:34.480351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:34.480363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:34.480373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:34.480391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594507663597591:9437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:34.483257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594507663597591:9437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:34.495983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594507663597591:9437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:34.517521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594507663597624:8635]
2025-10-10T14:07:34.526641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594507663597591:9437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:34.526687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594507663597591:9437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:34.526706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594507663597591:9437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:34.526735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:34.712877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:34.715638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:34.716590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:34.716609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:34.716656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:34.716930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:34.717148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594506085675967:8428]
2025-10-10T14:07:34.719857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:34.721022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:34.721274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:34.722689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:34.723039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:34.723047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:34.723055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:34.723064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:34.723072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:34.723080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:34.723089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:34.723097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:34.723105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:34.723115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:34.723126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:34.723136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:34.723188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:34.723312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:34.723369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:34.723422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:34.723492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:34.723546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:34.723600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:34.723654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:34.723709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:34.723762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:34.723811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:34.723895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:34.723951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:34.724031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:34.724097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:34.724159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:34.724216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:34.724281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:34.724336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:34.724396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:34.724452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:34.724513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:34.724567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:34.724630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:34.724839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:34.724905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:34.724960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:34.725022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:34.725083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:34.725161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:34.725213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:34.725273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:34.725323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:34.725377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:34.725427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:34.725484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:34.725990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:34.779151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:34.795020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:34.795074Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:34.795095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:34.795119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:34.795145Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 676 [2:7559594506085675967:8428]
2025-10-10T14:07:34.795208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:34.795268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:34.795286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:34.795300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:34.795313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:34.795361Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:34.795384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:34.795407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:34.797261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:34.797281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:34.797300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:34.797316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:34.797328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:34.801339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 676
2025-10-10T14:07:34.801451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 676
2025-10-10T14:07:34.801528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 676, pipe: [1:7559594507663597624:8635]
2025-10-10T14:07:34.799495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:34.799534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:34.799696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:34.799905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:34.800172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:34.800306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:34.800397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594507663597575:2442], now have 1 active actors on pipe
2025-10-10T14:07:34.800424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594507663597624:8635], now have 1 active actors on pipe
2025-10-10T14:07:34.800449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594507663597629:9437], now have 1 active actors on pipe
2025-10-10T14:07:34.800480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:34.800496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:34.800509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:34.800523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:34.800573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:34.800665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:34.800870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:34.800888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:34.801022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:34.801044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:34.801256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:34.801269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:34.801280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:34.801293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:34.801319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:34.802721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:34.802776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:34.802881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:34.802922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:34.802942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:34.802954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:34.802990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:34.803034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:34.803090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:34.803884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:34.803916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:34.803986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:34.804378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 677 partition: 0 MaxSeqNo: 36 sessionId: src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0
2025-10-10T14:07:34.809358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b21493f2-8680e430-b1ad3cc-11e72e46_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:34.888449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0] Write session: try to update token
2025-10-10T14:07:34.888513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:34.993150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:34.993194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:34.993238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:34.993367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:34.993380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:34.993393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:34.993464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:34.995363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:34.996267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:34.996923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:34.998273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:34.999616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:35.029835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:35.030375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:35.121255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId: src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:35.147785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:35.147822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:35.147835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:35.147896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:35.147913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:35.147928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:35.147940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:35.147952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:35.147996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:35.148027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:35.148053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:35.148080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594506085675962:8428]
2025-10-10T14:07:35.148229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:35.148261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:35.148273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:35.150834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:35.150903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:35.150950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:35.150989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:35.164237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:35.190321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:35.321786Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:35.324629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:35.324663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:35.326144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594507663597624:8635]
2025-10-10T14:07:35.326261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:35.326273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:35.333847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:35.420758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:35.429756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594511958565174:8635]
2025-10-10T14:07:35.532949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 677 reason: error at write: Disconnected sessionId: src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0
2025-10-10T14:07:35.544206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 677 sessionId: src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0 is DEAD
2025-10-10T14:07:35.549481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:35.549521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0] Write session will restart in 0.005641s
2025-10-10T14:07:35.549629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0] Write session: Do CDS request
2025-10-10T14:07:35.549661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:35.574003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:35.577286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:35.577326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 678
2025-10-10T14:07:35.577996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:35.578136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:35.578153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:35.578163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:35.579685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 678 sessionId:  describe result for acl check
2025-10-10T14:07:35.579805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:35.579816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:35.579825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:35.579840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594511958565324:9450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:35.582360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594511958565324:9450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:35.615551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594511958565324:9450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:35.648938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594511958565324:9450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:35.648981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594511958565324:9450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:35.648999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594511958565324:9450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:35.649032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:35.677732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:35.686032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:35.686960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:35.686980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:35.687027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:35.687318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:35.687507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594510380643545:8434]
2025-10-10T14:07:35.690090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:35.697045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:35.697346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:35.698868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:35.699258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:35.699267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:35.699275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:35.699283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:35.699290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:35.699299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:35.699308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:35.699315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:35.699322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:35.699330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:35.699338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:35.699345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:35.699397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:35.699512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:35.699566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:35.699618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:35.699673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:35.699724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:35.699776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:35.699828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:35.699876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:35.699923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:35.699974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:35.700023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:35.700070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:35.700143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:35.700208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:35.700272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:35.700328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:35.700389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:35.700437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:35.700496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:35.700551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:35.700613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:35.700664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:35.700721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:35.700773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:35.700837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:35.700889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:35.700946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:35.700998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:35.701057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:35.701108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:35.702477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:35.702569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:35.702631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:35.702682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:35.702763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:35.703275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:35.748307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:35.802897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:35.802948Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:35.802966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:35.802986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:35.803009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 677 [2:7559594510380643545:8434]
2025-10-10T14:07:35.803068Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:35.803128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:35.803143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:35.803157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:35.803168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:35.803215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:35.803238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:35.803261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:35.806290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:35.806325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:35.806340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:35.806354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:35.806365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:35.806652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:35.806670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:35.806828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:35.807021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:35.807252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:35.807409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:35.807491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:35.807509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:35.807522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:35.807538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:35.807579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:35.807665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:35.807857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:35.807875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:35.808005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:35.808028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:35.809876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 677, pipe: [1:7559594511958565174:8635]
2025-10-10T14:07:35.809980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 677
2025-10-10T14:07:35.810055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 677
2025-10-10T14:07:35.808698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:35.808718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:35.808725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:35.808734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:35.808751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:35.809188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594511958565174:8635], now have 1 active actors on pipe
2025-10-10T14:07:35.809217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594511958565413:9450], now have 1 active actors on pipe
2025-10-10T14:07:35.809240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594511958565170:2442], now have 1 active actors on pipe
2025-10-10T14:07:35.818253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:35.818302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:35.818433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:35.818480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:35.818499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:35.818524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:35.818561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:35.818614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:35.818669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:35.820675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:35.820721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:35.820814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:35.825549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 678 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0
2025-10-10T14:07:35.828100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c629ad-1e0a49a4-220ce43-58d7c5ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:35.860608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:35.860648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:35.860685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:35.860823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:35.860822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:35.864339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:35.869244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0] Write session: try to update token
2025-10-10T14:07:35.869302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:35.877604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:35.890082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:35.892424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:35.901779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:36.042434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:36.042474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:36.042487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:36.042548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:36.088932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId: src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:36.128029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:36.171781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:36.171840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:36.171896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:36.171908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:36.171918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:36.171974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:36.171988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:36.172002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:36.172012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:36.172024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:36.172063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:36.172087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:36.172110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:36.172133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594510380643540:8434]
2025-10-10T14:07:36.172312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:36.172338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:36.172350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:36.173276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:36.173310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:36.173337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:36.173364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:36.177595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:36.373840Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:36.387335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:07:36.387859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:36.389291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594511958565174:8635]
2025-10-10T14:07:36.389358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:36.493621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594516253532775:8635]
2025-10-10T14:07:36.633204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:36.633240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:36.633326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 678 reason: error at write: Disconnected sessionId: src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0
2025-10-10T14:07:36.633605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 678 sessionId: src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0 is DEAD
2025-10-10T14:07:36.639021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:36.639068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0] Write session will restart in 0.009866s
2025-10-10T14:07:36.639181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0] Write session: Do CDS request
2025-10-10T14:07:36.639214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:36.660381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:36.712833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:36.712873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 679
2025-10-10T14:07:36.728892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:36.729031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:36.729047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:36.729056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:36.738511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 679 sessionId:  describe result for acl check
2025-10-10T14:07:36.738645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:36.738655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:36.738664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:36.738681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594516253532931:9462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:36.741086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594516253532931:9462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:36.773805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594516253532931:9462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:36.787825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594516253532931:9462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:36.787872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594516253532931:9462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:36.787889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594516253532931:9462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:36.787921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:36.826189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:36.842291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:36.843239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:36.843275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:36.843324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:36.843585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:36.843792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594514675611134:8449]
2025-10-10T14:07:36.846121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:36.854153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:36.854424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:36.855659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:36.855987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:36.855995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:36.856002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:36.856008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:36.856015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:36.856022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:36.856028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:36.856035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:36.856041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:36.856048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:36.856054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:36.856061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:36.856103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:36.856202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:36.856241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:36.856280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:36.856319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:36.856357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:36.856395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:36.856432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:36.856469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:36.856507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:36.856542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:36.856577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:36.856612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:36.856668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:36.856714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:36.856758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:36.856796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:36.856840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:36.856874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:36.856915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:36.856952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:36.856993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:36.857029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:36.857070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:36.857108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:36.858033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:36.858095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:36.858142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:36.858183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:36.858227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:36.858265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:36.858311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:36.858364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:36.858417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:36.858455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:36.858500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:36.858912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:36.928080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:36.943601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:36.943652Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:36.943669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:36.943690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:36.943720Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 678 [2:7559594514675611134:8449]
2025-10-10T14:07:36.943777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:36.943847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:36.943866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:36.943877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:36.943890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:36.943943Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:36.943965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:36.943989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:36.945437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:36.945453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:36.945466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:36.945481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:36.945491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:36.945817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:36.945846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:36.945987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:36.946161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:36.946405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:36.946514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:36.946590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:36.946605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:36.946618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:36.946630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:36.946673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:36.946768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:36.946944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:36.946962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:36.947095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:36.947115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:36.947551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:36.947563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:36.947590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:36.947603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:36.947625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:36.948327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594516253533027:9462], now have 1 active actors on pipe
2025-10-10T14:07:36.948353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594516253532760:2442], now have 1 active actors on pipe
2025-10-10T14:07:36.948374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594516253532775:8635], now have 1 active actors on pipe
2025-10-10T14:07:36.950463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 678, pipe: [1:7559594516253532775:8635]
2025-10-10T14:07:36.950573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 678
2025-10-10T14:07:36.950638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 678
2025-10-10T14:07:36.954997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:36.955043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:36.955155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:36.955201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:36.955218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:36.955228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:36.955267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:36.955313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:36.955361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:36.965588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:36.965633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:36.965713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:36.968640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 679 partition: 0 MaxSeqNo: 36 sessionId: src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0
2025-10-10T14:07:36.969840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eda0e1-20f6f1f6-3aee3f7e-ce185635_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:36.991735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0] Write session: try to update token
2025-10-10T14:07:36.991796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:37.045450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:37.045482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:37.045502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:37.147719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId: src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:37.195852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:37.220320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:37.220354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:37.220368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:37.220376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:37.220386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:37.220420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:37.220444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:37.220467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:37.220487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:37.220705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:37.220718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:37.220728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:37.220815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:37.220840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:37.220872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:37.220896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:37.220906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:37.221634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:37.221678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:37.221709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:37.221738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:37.222655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:37.376429Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:37.389852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:37.389892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:37.389939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594514675611129:8449]
2025-10-10T14:07:37.394534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:37.394566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:37.393067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:37.394075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:37.437998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:37.438120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594516253532775:8635]
2025-10-10T14:07:37.438235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 679 reason: error at write: Disconnected sessionId: src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0
2025-10-10T14:07:37.438501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 679 sessionId: src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0 is DEAD
2025-10-10T14:07:37.440147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:37.440214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0] Write session will restart in 0.008328s
2025-10-10T14:07:37.440388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0] Write session: Do CDS request
2025-10-10T14:07:37.440444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:37.461029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:37.461095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 680
2025-10-10T14:07:37.465265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:37.468038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:37.468188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:37.468204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:37.468215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:37.469624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 680 sessionId:  describe result for acl check
2025-10-10T14:07:37.469746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:37.469757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:37.469767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:37.469783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594520548500391:9475] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:37.474598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594520548500391:9475] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:37.487607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594520548500391:9475] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:37.510306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594520548500391:9475] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:37.510359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594520548500391:9475] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:37.510379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594520548500391:9475] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:37.510414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:37.541474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594520548500478:8635]
2025-10-10T14:07:37.687628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:37.702547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:37.703437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:37.703475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:37.703523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:37.703795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:37.704010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594518970578714:8459]
2025-10-10T14:07:37.706272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:37.713919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:37.714202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:37.715570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:37.715937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:37.715945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:37.715952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:37.715959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:37.715967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:37.715974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:37.715981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:37.715988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:37.715996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:37.716003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:37.716010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:37.716016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:37.716064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:37.716173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:37.716221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:37.716270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:37.716314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:37.716363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:37.716405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:37.716449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:37.716498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:37.716547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:37.716597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:37.716642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:37.716684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:37.716750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:37.716807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:37.716858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:37.716908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:37.716960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:37.717004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:37.717063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:37.717111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:37.718101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:37.718168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:37.718222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:37.718269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:37.718319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:37.718363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:37.718414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:37.718460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:37.718512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:37.718554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:37.718604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:37.718649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:37.718718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:37.718759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:37.718809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:37.719238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:37.780009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:37.802018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:37.802080Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:37.802097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:37.802118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:37.802142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 679 [2:7559594518970578714:8459]
2025-10-10T14:07:37.802194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:37.802263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:37.802277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:37.802287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:37.802299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:37.802345Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:37.802366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:37.802388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:37.809327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:37.809366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:37.809380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:37.809396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:37.809407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:37.809694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:37.809712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:37.809857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:37.810078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:37.810320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:37.810441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:37.810525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:37.810549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:37.810565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:37.810579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:37.810612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:37.810710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:37.810903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:37.810919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:37.811042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:37.811065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:37.811438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:37.811450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:37.811461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:37.811473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:37.811497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:37.813691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594520548500372:2442], now have 1 active actors on pipe
2025-10-10T14:07:37.813732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594520548500478:8635], now have 1 active actors on pipe
2025-10-10T14:07:37.813763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594520548500457:9475], now have 1 active actors on pipe
2025-10-10T14:07:37.813315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 679
2025-10-10T14:07:37.813427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 679, pipe: [1:7559594520548500478:8635]
2025-10-10T14:07:37.813521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 679
2025-10-10T14:07:37.815639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:37.815683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:37.815761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|580ce154-1835b0f2-88147612-e41aef29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:37.815801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:37.815828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:37.815840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:37.815877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:37.815927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:37.815982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:37.818957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:37.819000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:37.819073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:37.822591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 680 partition: 0 MaxSeqNo: 36 sessionId: src_id|580ce154-1835b0f2-88147612-e41aef29_0
2025-10-10T14:07:37.824566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46778bba-23cdc58d-2a8e44dc-54f0d18e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|580ce154-1835b0f2-88147612-e41aef29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:37.885060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|580ce154-1835b0f2-88147612-e41aef29_0] Write session: try to update token
2025-10-10T14:07:37.885137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|580ce154-1835b0f2-88147612-e41aef29_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:38.090559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:38.090594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:38.090606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:38.090734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:38.090748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:38.090762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:38.090771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:38.090782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:38.090819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:38.090845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:38.090867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:38.090885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:38.093341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:38.093388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:38.093419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:38.093450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:38.131713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId: src_id|580ce154-1835b0f2-88147612-e41aef29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:38.167648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:38.167700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:38.167712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:38.168946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:38.225412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:38.514445Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:38.516262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:38.516283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:38.516332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594518970578709:8459]
2025-10-10T14:07:38.516506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:38.516520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:38.516533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:38.517399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:38.518476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:38.518719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594520548500478:8635]
2025-10-10T14:07:38.518852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:38.523981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 680 reason: status is not ok: tablet will be restarted right now sessionId: src_id|580ce154-1835b0f2-88147612-e41aef29_0
2025-10-10T14:07:38.524328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 680 sessionId: src_id|580ce154-1835b0f2-88147612-e41aef29_0 is DEAD
2025-10-10T14:07:38.526142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580ce154-1835b0f2-88147612-e41aef29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:07:38.526190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580ce154-1835b0f2-88147612-e41aef29_0] Write session will restart in 0.009627s
2025-10-10T14:07:38.526299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580ce154-1835b0f2-88147612-e41aef29_0] Write session: Do CDS request
2025-10-10T14:07:38.526333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580ce154-1835b0f2-88147612-e41aef29_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:38.541310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|580ce154-1835b0f2-88147612-e41aef29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:38.541310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:38.541361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 681
2025-10-10T14:07:38.545356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:38.545558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:38.545577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:38.545588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:38.551171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 681 sessionId:  describe result for acl check
2025-10-10T14:07:38.551406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:38.551430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:38.551447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:38.552562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594524843467972:9485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:38.556478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594524843467972:9485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:38.587711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594524843467972:9485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:38.619524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594524843467972:9485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:38.619587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594524843467972:9485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:38.619605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594524843467972:9485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:38.619640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:38.620625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594524843468008:8635]
2025-10-10T14:07:38.823857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:38.846195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:38.847076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:38.847094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:38.847135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:38.847389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:38.847566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594523265546310:8470]
2025-10-10T14:07:38.854264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:38.862189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:38.862454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:38.863762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:38.864075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:38.864083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:38.864089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:38.864096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:38.864103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:38.864109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:38.864116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:38.864122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:38.864128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:38.864135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:38.864142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:38.864149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:38.864194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:38.864298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:38.864345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:38.864388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:38.864430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:38.864471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:38.864514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:38.864557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:38.864600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:38.864644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:38.864686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:38.864730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:38.864770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:38.864832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:38.864887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:38.864938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:38.864988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:38.865039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:38.865085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:38.869202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:38.869297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:38.869357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:38.869415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:38.869466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:38.869508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:38.869558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:38.869603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:38.869656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:38.869700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:38.869750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:38.869790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:38.869833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:38.869874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:38.869923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:38.869965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:38.870028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:38.870456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:39.017901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:39.033657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:39.033703Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:39.033717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:39.033734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:39.033757Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 680 [2:7559594523265546310:8470]
2025-10-10T14:07:39.033808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:39.033859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:39.033873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:39.033885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:39.033896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:39.033943Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:39.033964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:39.033984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:39.036351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:39.036365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:39.036376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:39.036388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:39.036399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:39.037602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 680
2025-10-10T14:07:39.037700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 680
2025-10-10T14:07:39.037756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 680, pipe: [1:7559594524843468008:8635]
2025-10-10T14:07:39.037572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:39.037603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:39.037727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:39.037888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:39.038094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:39.038201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:39.038243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594524843467961:2442], now have 1 active actors on pipe
2025-10-10T14:07:39.038264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594524843468006:9485], now have 1 active actors on pipe
2025-10-10T14:07:39.038286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594524843468008:8635], now have 1 active actors on pipe
2025-10-10T14:07:39.038388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:39.038410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:39.038448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594523265546301:8470]
2025-10-10T14:07:39.038462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594523265546301:8470]
2025-10-10T14:07:39.038474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594523265546301:8470]
2025-10-10T14:07:39.038485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594523265546301:8470]
2025-10-10T14:07:39.038524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:39.038600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:39.038782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:39.038803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:39.038873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:39.038904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:39.038923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:39.038933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:39.038967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:39.039012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:39.039143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594523265546301:8470]
2025-10-10T14:07:39.039162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:39.039202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:39.040174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:39.040196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:39.040206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:39.040218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:39.040241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:39.042913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:39.042944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:39.043010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:39.043344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 681 partition: 0 MaxSeqNo: 36 sessionId: src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0
2025-10-10T14:07:39.044235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|580ce154-1835b0f2-88147612-e41aef29_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:39.083680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0] Write session: try to update token
2025-10-10T14:07:39.083733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:39.134357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:39.134389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:39.134401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:39.310206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:39.310240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:39.310251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:39.310310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:39.310325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:39.310339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:39.310350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:39.310360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:39.310397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594523265546301:8470]
2025-10-10T14:07:39.310423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594523265546301:8470]
2025-10-10T14:07:39.310445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594523265546301:8470]
2025-10-10T14:07:39.310465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594523265546301:8470]
2025-10-10T14:07:39.310608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:39.310633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:39.310644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:39.311730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:39.313644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:39.313686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:39.313715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:39.313742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:39.390437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId: src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:39.459963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:39.735279Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:39.794802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:39.794848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:39.798839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:39.798997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:39.799008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:39.822444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:39.850950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594524843468008:8635]
2025-10-10T14:07:39.892106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 681 reason: error at write: Disconnected sessionId: src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0
2025-10-10T14:07:39.892485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 681 sessionId: src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0 is DEAD
2025-10-10T14:07:39.893563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:39.893607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0] Write session will restart in 0.007235s
2025-10-10T14:07:39.893713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0] Write session: Do CDS request
2025-10-10T14:07:39.893746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:39.908332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:39.913307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:39.913355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 682
2025-10-10T14:07:39.913978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:39.914100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:39.914117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:39.914129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:39.922501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 682 sessionId:  describe result for acl check
2025-10-10T14:07:39.922663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:39.922674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:39.922685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:39.922704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594529138435618:9503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:39.955238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594529138435620:8635]
2025-10-10T14:07:39.975722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594529138435618:9503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:40.005741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594529138435618:9503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:40.038825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594529138435618:9503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:40.038880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594529138435618:9503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:40.038897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594529138435618:9503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:40.038928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:40.104074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:40.116344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:40.117314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:40.117333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:40.117379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:40.117638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:40.117827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594531855481209:8481]
2025-10-10T14:07:40.119838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:40.122781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:40.123007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:40.124470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:40.124794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:40.124802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:40.124808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:40.124815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:40.124821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:40.124827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:40.124832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:40.124839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:40.124844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:40.124850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:40.124855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:40.124862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:40.124903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:40.125018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:40.125061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:40.125105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:40.125163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:40.125204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:40.125245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:40.125283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:40.125324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:40.125366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:40.125423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:40.125464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:40.125504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:40.125560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:40.125613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:40.125662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:40.125703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:40.125747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:40.125784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:40.125828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:40.125869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:40.125914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:40.125952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:40.126005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:40.126042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:40.126086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:40.126126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:40.126170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:40.126208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:40.126250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:40.126283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:40.126326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:40.126366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:40.126407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:40.126443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:40.126486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:40.126876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:40.191299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:40.339707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:40.339759Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:40.339778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:40.339800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:40.339827Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 681 [2:7559594531855481209:8481]
2025-10-10T14:07:40.339888Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:40.339953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:40.339970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:40.339983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:40.339995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:40.340047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:40.340071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:40.340095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:40.347282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 681
2025-10-10T14:07:40.347389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 681
2025-10-10T14:07:40.347451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 681, pipe: [1:7559594529138435620:8635]
2025-10-10T14:07:40.345873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:40.345902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:40.345918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:40.345935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:40.345947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:40.346271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:40.346292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:40.346460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:40.346686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:40.346935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:40.347066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:40.347161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594529138435569:2442], now have 1 active actors on pipe
2025-10-10T14:07:40.347189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594533433403053:9503], now have 1 active actors on pipe
2025-10-10T14:07:40.347215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594529138435620:8635], now have 1 active actors on pipe
2025-10-10T14:07:40.347241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.347257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.347272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.347285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.347338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:40.347426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:40.347622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:40.347640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:40.347775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.347797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:40.347818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:40.347833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:40.347845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:40.347856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:40.347895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:40.350558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:40.350593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:40.350693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:40.350763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:40.350786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:40.350798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:40.350836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:40.350882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:40.350932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:40.358082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:40.358123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:40.358224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:40.358792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 682 partition: 0 MaxSeqNo: 36 sessionId: src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0
2025-10-10T14:07:40.361757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc05854c-582de86e-5327c1a2-da6b5dd2_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:40.409628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0] Write session: try to update token
2025-10-10T14:07:40.409688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:40.512019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:40.512054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:40.512067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:40.512127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:40.512143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:40.512158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:40.512171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:40.512183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:40.512223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.512253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.512279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.512304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.512453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:40.512490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:40.512513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:40.512522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:40.512542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:40.512553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:40.512554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:40.514548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:40.597295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId: src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:40.619733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:40.671935Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:40.754699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:40.754746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:40.754813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:40.754828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:40.754871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594531855481204:8481]
2025-10-10T14:07:40.755185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:40.755493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:40.756786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594529138435620:8635]
2025-10-10T14:07:40.756965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:40.757222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:40.757266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:40.857471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594533433403189:8635]
2025-10-10T14:07:40.862994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 682 reason: error at write: Disconnected sessionId: src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0
2025-10-10T14:07:40.863361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 682 sessionId: src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0 is DEAD
2025-10-10T14:07:40.867138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:40.867188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0] Write session will restart in 0.009451s
2025-10-10T14:07:40.867304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0] Write session: Do CDS request
2025-10-10T14:07:40.867340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:40.886299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:40.887877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:40.887915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 683
2025-10-10T14:07:40.888535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:40.888664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:40.888680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:40.888690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:40.902718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 683 sessionId:  describe result for acl check
2025-10-10T14:07:40.902917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:40.902930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:40.902941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:40.902959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594533433403233:9509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:40.906894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594533433403233:9509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:40.946334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594533433403233:9509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:40.984922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594533433403233:9509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:40.984974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594533433403233:9509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:40.984992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594533433403233:9509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:40.985026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:41.079746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:41.098814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:41.099668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:41.099687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:41.099733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:41.099981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:41.100167Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594536150448791:8490]
2025-10-10T14:07:41.110378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:41.114312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:41.114591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:41.115918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:41.116254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:41.116261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:41.116268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:41.116275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:41.116282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:41.116289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:41.116297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:41.116304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:41.116310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:41.116317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:41.116324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:41.116333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:41.116379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:41.116485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:41.116528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:41.116571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:41.116612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:41.116656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:41.116697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:41.116737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:41.116780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:41.116822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:41.116862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:41.116903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:41.116939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:41.117002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:41.117059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:41.117108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:41.118104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:41.118176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:41.118224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:41.118281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:41.118332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:41.118390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:41.118434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:41.118492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:41.118539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:41.118595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:41.118655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:41.118711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:41.118760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:41.118815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:41.118860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:41.118912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:41.118959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:41.119012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:41.119076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:41.119130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:41.119566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:41.181531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:41.200189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:41.200243Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:41.200260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:41.200280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:41.200304Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 682 [2:7559594536150448791:8490]
2025-10-10T14:07:41.200359Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:41.200422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:41.200437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:41.200450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:41.200460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:41.200508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:41.200531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:41.200553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:41.202950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:41.202981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:41.202996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:41.203009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:41.203021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:41.203436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:41.203456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:41.203609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:41.203797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:41.204027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:41.204155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:41.204242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.204259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.204272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.204286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.204331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:41.204416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:41.204612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:41.204638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:41.204778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.204800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:41.205490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:41.205516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:41.205528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:41.205542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:41.205571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:41.206734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594533433403349:9509], now have 1 active actors on pipe
2025-10-10T14:07:41.206770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594533433403163:2442], now have 1 active actors on pipe
2025-10-10T14:07:41.206800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594533433403189:8635], now have 1 active actors on pipe
2025-10-10T14:07:41.208879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 682
2025-10-10T14:07:41.208969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 682
2025-10-10T14:07:41.209030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 682, pipe: [1:7559594533433403189:8635]
2025-10-10T14:07:41.210233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:41.210279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:41.210383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:41.210418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:41.210438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:41.210450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:41.210487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:41.210533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:41.210588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:41.216542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:41.216577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:41.216659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:41.217819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 683 partition: 0 MaxSeqNo: 36 sessionId: src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0
2025-10-10T14:07:41.220079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662f0e6f-8e64b70f-8e6ee6c1-6d8a89ad_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:41.301674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:41.301711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:41.301725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:41.361044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0] Write session: try to update token
2025-10-10T14:07:41.361106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:41.402487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:41.402521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:41.402534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:41.529004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:41.529052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:41.529066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:41.529076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:41.529087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:41.529136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.529161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.529184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.529210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.529443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:41.529462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:41.529473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:41.529519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:41.529545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:41.529556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:41.531011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:41.532193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:41.532227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:41.532258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:41.532284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:41.586772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId: src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:41.665704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:41.764186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:41.806289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:41.806338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:41.806400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:41.806414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:41.806457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594536150448778:8490]
2025-10-10T14:07:41.808133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:41.809791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:41.810972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:41.811004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:41.948347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:41.948534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594533433403189:8635]
2025-10-10T14:07:41.948687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 683 reason: error at write: Disconnected sessionId: src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0
2025-10-10T14:07:41.948981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 683 sessionId: src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0 is DEAD
2025-10-10T14:07:41.950260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:41.950331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0] Write session will restart in 0.007413s
2025-10-10T14:07:41.950510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0] Write session: Do CDS request
2025-10-10T14:07:41.950564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:41.965661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:42.004756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:42.004807Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 684
2025-10-10T14:07:42.010086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:42.010209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:42.010227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:42.010236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:42.014294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 684 sessionId:  describe result for acl check
2025-10-10T14:07:42.014397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:42.014408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:42.014415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:42.014426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594542023338258:9525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:42.017075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594542023338258:9525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:42.038572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594542023338258:9525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:42.046189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594542023338334:8635]
2025-10-10T14:07:42.047372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594542023338258:9525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:42.047402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594542023338258:9525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:42.047420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594542023338258:9525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:42.047452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:42.056769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:42.059264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:42.060142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:42.060160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:42.060204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:42.060463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:42.060650Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594540445416388:8500]
2025-10-10T14:07:42.062805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:42.063870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:42.064076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:42.065420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:42.065767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:42.065775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:42.065781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:42.065788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:42.065795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:42.065803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:42.065811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:42.065817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:42.065823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.065828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.065835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.065842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.065889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:42.065998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:42.066048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:42.066094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:42.066137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:42.066181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:42.066226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:42.066272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:42.066313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.066360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.066400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.066444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.066487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:42.066548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:42.066618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:42.066671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:42.066719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:42.066771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:42.066816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:42.066869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:42.066913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:42.066962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:42.067006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:42.067054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:42.067099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:42.067150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:42.067193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:42.067241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:42.067287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.067335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.067377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.067430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.067474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.067525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.067567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.067615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.068033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:42.097027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:42.143263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:42.143306Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:42.143324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:42.143343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:42.143367Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 683 [2:7559594540445416388:8500]
2025-10-10T14:07:42.143422Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:42.143484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:42.143499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:42.143511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:42.143522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:42.143571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:42.143595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:42.143618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:42.144960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.144978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.144992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.145004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.145017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:42.147806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 683
2025-10-10T14:07:42.147939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 683
2025-10-10T14:07:42.148003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 683, pipe: [1:7559594542023338334:8635]
2025-10-10T14:07:42.153807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:42.153842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.153985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.154159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.154368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.154484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:42.154527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594537728370821:2442], now have 1 active actors on pipe
2025-10-10T14:07:42.154551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594542023338337:9525], now have 1 active actors on pipe
2025-10-10T14:07:42.154571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594542023338334:8635], now have 1 active actors on pipe
2025-10-10T14:07:42.154658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:42.154681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:42.154773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594540445416383:8500]
2025-10-10T14:07:42.154788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594540445416383:8500]
2025-10-10T14:07:42.154801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594540445416383:8500]
2025-10-10T14:07:42.154813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594540445416383:8500]
2025-10-10T14:07:42.154859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:42.154990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:42.155026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:42.155044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:42.155054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:42.155096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:42.155147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:42.155205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:42.155392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:42.155408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:42.155552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:42.155613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594540445416383:8500]
2025-10-10T14:07:42.155633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:42.156416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:42.156435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:42.156447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:42.156458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:42.156482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:42.161833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:42.161871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:42.161948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:42.165535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 684 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0
2025-10-10T14:07:42.166573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8456e036-b9d610ff-5981d0dd-9a84f687_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:42.225736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0] Write session: try to update token
2025-10-10T14:07:42.225798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:42.245318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:42.245351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:42.245364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:42.318883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:42.318917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:42.318932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:42.318943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:42.318954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:42.318992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594540445416383:8500]
2025-10-10T14:07:42.319020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594540445416383:8500]
2025-10-10T14:07:42.319044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594540445416383:8500]
2025-10-10T14:07:42.319066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594540445416383:8500]
2025-10-10T14:07:42.319213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:42.319242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.319255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:42.321301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:42.321338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:42.321371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:42.321400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:42.342298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:42.438446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId: src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:42.486092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:42.623186Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:42.641944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:42.641988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:42.644856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:42.645006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:42.645016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:42.645682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594542023338334:8635]
2025-10-10T14:07:42.649367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:42.655129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 684 reason: error at write: Disconnected sessionId: src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0
2025-10-10T14:07:42.655500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 684 sessionId: src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0 is DEAD
2025-10-10T14:07:42.657820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:42.657855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0] Write session will restart in 0.005608s
2025-10-10T14:07:42.657952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0] Write session: Do CDS request
2025-10-10T14:07:42.657981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:42.667414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:42.667465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 685
2025-10-10T14:07:42.672521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:42.677591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:42.677763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:42.677783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:42.677793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:42.684036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 685 sessionId:  describe result for acl check
2025-10-10T14:07:42.684184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:42.684196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:42.684206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:42.684224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594542023338370:9533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:42.689880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594542023338370:9533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:42.745743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594542023338428:8635]
2025-10-10T14:07:42.756628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594542023338370:9533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:42.777447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594542023338370:9533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:42.777496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594542023338370:9533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:42.777516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594542023338370:9533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:42.777548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:42.898681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:42.902470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:42.903513Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:42.903546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:42.903595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:42.903880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:42.904106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594540445416650:8511]
2025-10-10T14:07:42.906764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:42.908018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:42.908294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:42.909833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:42.910202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:42.910211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:42.910220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:42.910228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:42.910237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:42.910245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:42.910252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:42.910260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:42.910268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.910275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.910282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.910290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.910345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:42.910473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:42.910530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:42.910597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:42.910651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:42.910708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:42.910760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:42.910812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:42.910862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.910913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.910968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.911020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.911073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:42.911150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:42.911222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:42.911287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:42.911346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:42.911410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:42.911464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:42.911527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:42.911580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:42.911640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:42.911691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:42.911756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:42.911811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:42.911869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:42.911922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:42.911983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:42.912036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.912096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.912148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.912207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.912268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.912332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.912387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.912451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.912979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:42.961718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:42.982424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:42.982474Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:42.982495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:42.982521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:42.982548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 684 [2:7559594540445416650:8511]
2025-10-10T14:07:42.982634Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:42.982704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:42.982729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:42.982743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:42.982758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:42.982812Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:42.982843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:42.982868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:42.984568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.984595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.984614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.984630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.984643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:42.984961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:42.984985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:42.985222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:42.985457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:42.985749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:42.985903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:42.985996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:42.986013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:42.986030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:42.986046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:42.986092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:42.986187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:42.986399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:42.986418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:42.986560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:42.986596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:42.986866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:42.986880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:42.986892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:42.986907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:42.986934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:42.987959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594542023338509:9533], now have 1 active actors on pipe
2025-10-10T14:07:42.987990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594542023338428:8635], now have 1 active actors on pipe
2025-10-10T14:07:42.988017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594542023338361:2442], now have 1 active actors on pipe
2025-10-10T14:07:42.988522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 684
2025-10-10T14:07:42.988618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 684, pipe: [1:7559594542023338428:8635]
2025-10-10T14:07:42.988699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 684
2025-10-10T14:07:42.988845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:42.988879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:42.988991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:42.989042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:42.989065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:42.989077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:42.989147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:42.989198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:42.989268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:42.998328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:42.998369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:42.998462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:43.001559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 685 partition: 0 MaxSeqNo: 36 sessionId: src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0
2025-10-10T14:07:43.005403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b4e557-7af6d91b-7cfde96d-6de8d5d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:43.085344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:43.085380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:43.085392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:43.085987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0] Write session: try to update token
2025-10-10T14:07:43.086040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:43.160331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:43.160367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:43.160379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:43.160391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:43.160403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:43.160438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:43.160466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:43.160491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:43.160515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:43.160754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:43.160793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:43.160823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:43.160852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:43.224421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:43.224475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:43.224487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:43.226038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:43.321228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId: src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:43.368695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:43.402296Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:43.407844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:43.407875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:43.407917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594540445416645:8511]
2025-10-10T14:07:43.408065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:43.408087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:43.408368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:43.409638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:43.412328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:43.437181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 685 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0
2025-10-10T14:07:43.437447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 685 sessionId: src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0 is DEAD
2025-10-10T14:07:43.441032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:07:43.441077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0] Write session will restart in 0.005008s
2025-10-10T14:07:43.441205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0] Write session: Do CDS request
2025-10-10T14:07:43.441237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:43.453601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594542023338428:8635]
2025-10-10T14:07:43.453663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:43.455688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:43.455727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 686
2025-10-10T14:07:43.457971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:43.461380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:43.461547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:43.461565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:43.461576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:43.470462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 686 sessionId:  describe result for acl check
2025-10-10T14:07:43.470626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:43.470638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:43.470647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:43.470667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594546318305992:9545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:43.473789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594546318305992:9545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:43.511520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594546318305992:9545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:43.530234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594546318305992:9545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:43.530287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594546318305992:9545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:43.530302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594546318305992:9545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:43.530325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:43.553448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594546318306151:8635]
2025-10-10T14:07:43.596456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:43.606736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:43.607645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:43.607662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:43.607710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:43.607983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:43.608180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594544740384258:8521]
2025-10-10T14:07:43.610286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:43.612317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:43.612540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:43.613890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:43.614239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:43.614259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:43.614266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:43.614274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:43.614281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:43.614290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:43.614297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:43.614305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:43.614311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:43.614319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:43.614327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:43.614334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:43.614380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:43.614495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:43.614547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:43.614609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:43.614654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:43.614705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:43.614777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:43.614823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:43.614867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:43.614913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:43.614958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:43.615001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:43.615043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:43.615110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:43.615167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:43.615221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:43.615268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:43.615320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:43.615362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:43.615413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:43.615464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:43.615517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:43.615559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:43.615612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:43.615658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:43.615706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:43.615751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:43.615800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:43.615844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:43.615905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:43.615950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:43.616007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:43.616053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:43.616102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:43.616143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:43.616194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:43.616615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:43.647612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:43.680830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:43.681099Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:43.681121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:43.681156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:43.681181Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 685 [2:7559594544740384258:8521]
2025-10-10T14:07:43.681236Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:43.681303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:43.681317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:43.681328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:43.681338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:43.681386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:43.681407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:43.681428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:43.682805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:43.682822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:43.682835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:43.682848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:43.682860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:43.683155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:43.683172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:43.683318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:43.683497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:43.683723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:43.683836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:43.683916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594544740384251:8521]
2025-10-10T14:07:43.683932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594544740384251:8521]
2025-10-10T14:07:43.683945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594544740384251:8521]
2025-10-10T14:07:43.683957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594544740384251:8521]
2025-10-10T14:07:43.684004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:43.684086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:43.684146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:43.684162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:43.684174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:43.684186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:43.684265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:43.684284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:43.684416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594544740384251:8521]
2025-10-10T14:07:43.684438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:43.684470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:43.684526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594546318306114:9545], now have 1 active actors on pipe
2025-10-10T14:07:43.684547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594546318306151:8635], now have 1 active actors on pipe
2025-10-10T14:07:43.684567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594546318305970:2442], now have 1 active actors on pipe
2025-10-10T14:07:43.685629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 685
2025-10-10T14:07:43.685728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 685, pipe: [1:7559594546318306151:8635]
2025-10-10T14:07:43.685803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 685
2025-10-10T14:07:43.688319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:43.688360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:43.688451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:43.688500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:43.688520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:43.688530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:43.688570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:43.688617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:43.688665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:43.692387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 686 partition: 0 MaxSeqNo: 36 sessionId: src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0
2025-10-10T14:07:43.693747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c81611-a2e0a8ab-849da3cb-2e63e8e3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:43.691827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:43.691872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:43.691951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:43.746503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0] Write session: try to update token
2025-10-10T14:07:43.746583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:43.815819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:43.815851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:43.815864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:43.815921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:43.815936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:43.815951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:43.815964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:43.815975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:43.816014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594544740384251:8521]
2025-10-10T14:07:43.816044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594544740384251:8521]
2025-10-10T14:07:43.816071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594544740384251:8521]
2025-10-10T14:07:43.816097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594544740384251:8521]
2025-10-10T14:07:43.816242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:43.816269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:43.816280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:43.816434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:43.816470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:43.816505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:43.816538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:43.825035Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:43.872337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId: src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0 grpc read done: success: 1 data:  write_request[data omitted]
E1010 14:07:43.874030723  112381 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:07:43.877316Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:07:43.940318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:43.977029Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:43.978946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:43.978986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:43.980195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:43.980243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:43.980339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594546318306151:8635]
2025-10-10T14:07:43.980441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:43.989724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 686 reason: error at write: Disconnected sessionId: src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0
2025-10-10T14:07:43.990040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 686 sessionId: src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0 is DEAD
2025-10-10T14:07:43.993827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:43.993889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0] Write session will restart in 0.008786s
2025-10-10T14:07:43.994041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0] Write session: Do CDS request
2025-10-10T14:07:43.994099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:44.018120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:44.020948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:44.022071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:44.022126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 687
2025-10-10T14:07:44.022794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:44.022999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:44.023022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:44.023044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:44.025544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 687 sessionId:  describe result for acl check
2025-10-10T14:07:44.025737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:44.025760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:44.025780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:44.025817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594550613273557:9554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:44.029548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594550613273557:9554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:44.038263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594550613273557:9554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:44.060545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594550613273557:9554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:44.060597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594550613273557:9554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:44.060614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594550613273557:9554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:44.060644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:44.081271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594550613273624:8635]
2025-10-10T14:07:44.183195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:44.197964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:44.198907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:44.198925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:44.198975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:44.199237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:44.199427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594549035351830:8532]
2025-10-10T14:07:44.203335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:44.205144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:44.205403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:44.206662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:44.207000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:44.207016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:44.207023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:44.207031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:44.207038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:44.207044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:44.207051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:44.207058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:44.207065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:44.207072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:44.207078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:44.207084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:44.207130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:44.207231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:44.207274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:44.207317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:44.207363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:44.207407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:44.207450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:44.207496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:44.207547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:44.207595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:44.207638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:44.207680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:44.207729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:44.207793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:44.207850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:44.207904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:44.207952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:44.208010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:44.208063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:44.208112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:44.208165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:44.208217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:44.208264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:44.208322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:44.208371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:44.208424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:44.208472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:44.208530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:44.208581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:44.208634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:44.208680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:44.208742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:44.208793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:44.208849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:44.208897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:44.208956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:44.209474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:44.246606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:44.260377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:44.260425Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:44.260442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:44.260462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:44.260487Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 686 [2:7559594549035351830:8532]
2025-10-10T14:07:44.260542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:44.260609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:44.260628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:44.260640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:44.260652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:44.260699Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:44.260722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:44.260744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:44.310353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:44.310383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:44.310392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:44.310401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:44.310411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:44.310701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:44.310723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:44.310844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:44.310996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:44.311185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:44.311288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:44.311352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.311371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.311384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.311395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.311430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:44.311503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:44.311671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:44.311687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:44.311705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:44.311726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:44.311738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:44.311749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:44.311827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594546318306248:2442], now have 1 active actors on pipe
2025-10-10T14:07:44.311848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594550613273603:9554], now have 1 active actors on pipe
2025-10-10T14:07:44.311863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.311884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:44.311890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:44.312005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594550613273624:8635], now have 1 active actors on pipe
2025-10-10T14:07:44.314944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 686
2025-10-10T14:07:44.315056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 686
2025-10-10T14:07:44.315119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 686, pipe: [1:7559594550613273624:8635]
2025-10-10T14:07:44.316007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:44.316051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:44.316141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:44.316176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:44.316196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:44.316208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:44.316247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:44.316292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:44.316341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:44.316892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:44.316915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:44.316981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:44.317292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 687 partition: 0 MaxSeqNo: 36 sessionId: src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0
2025-10-10T14:07:44.318063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61cfdc45-94ff92af-d7ed79b3-c4acc4df_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:44.339261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0] Write session: try to update token
2025-10-10T14:07:44.339322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:44.368122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:44.368151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:44.368163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:44.368219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:44.368231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:44.368267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.368378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:44.369281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:44.381207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:44.382407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:44.399346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:44.404054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:44.411108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:44.411660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:44.465907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:44.465934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:44.465945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:44.478025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId: src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:44.530545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:44.572653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:44.572709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:44.572755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:44.572773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:44.572790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:44.572804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:44.572819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:44.572864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.572894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.572923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.572952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594549035351825:8532]
2025-10-10T14:07:44.573147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:44.573163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:44.573158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:44.573176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:44.573200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:44.573233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:44.573264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:44.573264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:44.573295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:44.573311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:44.574374Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:44.866663Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:44.887632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:07:44.889107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:44.955063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:44.955109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:44.955275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 687 reason: error at write: Disconnected sessionId: src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0
2025-10-10T14:07:44.955572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 687 sessionId: src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0 is DEAD
2025-10-10T14:07:44.961382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:44.961428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0] Write session will restart in 0.007769s
2025-10-10T14:07:44.961530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0] Write session: Do CDS request
2025-10-10T14:07:44.961558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:44.985975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:45.035406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594550613273624:8635]
2025-10-10T14:07:45.035498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:45.035595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:45.035609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 688
2025-10-10T14:07:45.039031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:45.039178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:45.039195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:45.039206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:45.040827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 688 sessionId:  describe result for acl check
2025-10-10T14:07:45.040954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:45.040965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:45.040975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:45.040995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594554908241206:9567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:45.043865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594554908241206:9567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:45.061507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594554908241206:9567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:45.103391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594554908241206:9567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:45.103439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594554908241206:9567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:45.103456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594554908241206:9567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:45.103486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:45.136035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594554908241409:8635]
2025-10-10T14:07:45.151738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:45.154458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:45.155524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:45.155542Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:45.155589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:45.155857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:45.156062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594553330319416:8541]
2025-10-10T14:07:45.160572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:45.162372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:45.162651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:45.164094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:45.164421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:45.164430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:45.164437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:45.164445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:45.164451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:45.164458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:45.164464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:45.164471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:45.164478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:45.164486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:45.164494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:45.164501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:45.164552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:45.164673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:45.164725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:45.164778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:45.164827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:45.164875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:45.164923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:45.164971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:45.165019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:45.165072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:45.165121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:45.165197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:45.165239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:45.165310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:45.165373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:45.165433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:45.165484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:45.165538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:45.165587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:45.165641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:45.165689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:45.165740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:45.165787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:45.165843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:45.165891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:45.165947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:45.165993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:45.166048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:45.166098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:45.166151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:45.168509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:45.168601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:45.168658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:45.168722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:45.168772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:45.168829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:45.169352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:45.205497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:45.222091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:45.222140Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:45.222158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:45.222191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:45.222217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 687 [2:7559594553330319416:8541]
2025-10-10T14:07:45.222276Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:45.222352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:45.222368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:45.222380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:45.222391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:45.222442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:45.222465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:45.222488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:45.225949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:45.225986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:45.226001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:45.226015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:45.226026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:45.226307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:45.226325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:45.226478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:45.226690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:45.226943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:45.227059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:45.227135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594553330319411:8541]
2025-10-10T14:07:45.227150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594553330319411:8541]
2025-10-10T14:07:45.227163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594553330319411:8541]
2025-10-10T14:07:45.227176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594553330319411:8541]
2025-10-10T14:07:45.227223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:45.227303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:45.227477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:45.227493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:45.227619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594553330319411:8541]
2025-10-10T14:07:45.227639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:45.230566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 687
2025-10-10T14:07:45.230651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 687, pipe: [1:7559594554908241409:8635]
2025-10-10T14:07:45.230719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 687
2025-10-10T14:07:45.228342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:45.228360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:45.228372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:45.228384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:45.228408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:45.232552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594554908241339:9567], now have 1 active actors on pipe
2025-10-10T14:07:45.232603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594554908241409:8635], now have 1 active actors on pipe
2025-10-10T14:07:45.232626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594554908241192:2442], now have 1 active actors on pipe
2025-10-10T14:07:45.233455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:45.233490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:45.233595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:45.233635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:45.233655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:45.233667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:45.233709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:45.233759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:45.233812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:45.240193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:45.240227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:45.240313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:45.241059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 688 partition: 0 MaxSeqNo: 36 sessionId: src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0
2025-10-10T14:07:45.249393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61f76f5a-be968f6c-f6cab122-78fcc9f4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:45.321292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:45.321322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:45.321334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:45.323459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0] Write session: try to update token
2025-10-10T14:07:45.323513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:45.393634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:45.393665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:45.393680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:45.393690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:45.393702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:45.393742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594553330319411:8541]
2025-10-10T14:07:45.393770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594553330319411:8541]
2025-10-10T14:07:45.393794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594553330319411:8541]
2025-10-10T14:07:45.393818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594553330319411:8541]
2025-10-10T14:07:45.393966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:45.393968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:45.393995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:45.394006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:45.394020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:45.394051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:45.394097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:45.395138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:45.476041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId: src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:45.539341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:45.606913Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:45.608825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:45.608857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:45.610801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:45.610834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:45.613414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594554908241409:8635]
2025-10-10T14:07:45.613496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:45.613188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:45.713558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594554908241459:8635]
2025-10-10T14:07:45.771070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 688 reason: error at write: Disconnected sessionId: src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0
2025-10-10T14:07:45.771468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 688 sessionId: src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0 is DEAD
2025-10-10T14:07:45.774574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:45.774607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0] Write session will restart in 0.009555s
2025-10-10T14:07:45.774707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0] Write session: Do CDS request
2025-10-10T14:07:45.774739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:45.790209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:45.797486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:45.797534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 689
2025-10-10T14:07:45.801583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:45.801760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:45.801777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:45.801788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:45.808670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 689 sessionId:  describe result for acl check
2025-10-10T14:07:45.808817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:45.808827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:45.808838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:45.808855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594554908241560:9577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:45.811618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594554908241560:9577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:45.859406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594554908241560:9577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:45.879271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594554908241560:9577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:45.879326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594554908241560:9577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:45.879347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594554908241560:9577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:45.879379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:45.928140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:45.930801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:45.931837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:45.931858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:45.931910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:45.932306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:45.932534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594553330319707:8551]
2025-10-10T14:07:45.935542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:46.005729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:46.006045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:46.013891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:46.014489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:46.014501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:46.014510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:46.014536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:46.014545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:46.014554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:46.014563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:46.014573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:46.014580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.014590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.014599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.014608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.014665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:46.014801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:46.014859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:46.014917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:46.014977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:46.015035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:46.015088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:46.015143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:46.015197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.015251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.015306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.015359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.015413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:46.015496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:46.015569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:46.015635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:46.015695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:46.015761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:46.015816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:46.015879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:46.015939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:46.015999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:46.016054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:46.016115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:46.016167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:46.016225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:46.016281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:46.016343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:46.016422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.016486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.016538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.016602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.016657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.016720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.016774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.016836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.018557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:46.050743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:46.063395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:46.063443Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:46.063464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:46.063486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:46.063513Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 688 [2:7559594553330319707:8551]
2025-10-10T14:07:46.063579Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:46.063642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:46.063666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:46.063679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:46.063692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:46.063745Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:46.063775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:46.063799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:46.065228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.065253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.065269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.065287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.065299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:46.065608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:46.065628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.065799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.066009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.067273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 688
2025-10-10T14:07:46.067364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 688, pipe: [1:7559594554908241459:8635]
2025-10-10T14:07:46.067400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 688
2025-10-10T14:07:46.066260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.066429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:46.066543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594554908241677:9577], now have 1 active actors on pipe
2025-10-10T14:07:46.066570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594554908241445:2442], now have 1 active actors on pipe
2025-10-10T14:07:46.066593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594554908241459:8635], now have 1 active actors on pipe
2025-10-10T14:07:46.066619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594553330319702:8551]
2025-10-10T14:07:46.066635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594553330319702:8551]
2025-10-10T14:07:46.066650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594553330319702:8551]
2025-10-10T14:07:46.066664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594553330319702:8551]
2025-10-10T14:07:46.066701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:46.066783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:46.066969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:46.066987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:46.067112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594553330319702:8551]
2025-10-10T14:07:46.067136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:46.067574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:46.067588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:46.067601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:46.067613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:46.067640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:46.068337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:46.068371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:46.068451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67d146bd-16d-d83b56c2-5acb19c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:46.068485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:46.068504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:46.068515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:46.068552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:46.068594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:46.068656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:46.069646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:46.069672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:46.069745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:46.070127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 689 partition: 0 MaxSeqNo: 36 sessionId: src_id|67d146bd-16d-d83b56c2-5acb19c9_0
2025-10-10T14:07:46.074864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51972d38-b0a0fbf1-39c2da23-ba745bbc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|67d146bd-16d-d83b56c2-5acb19c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:46.151501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67d146bd-16d-d83b56c2-5acb19c9_0] Write session: try to update token
2025-10-10T14:07:46.151547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67d146bd-16d-d83b56c2-5acb19c9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:46.207563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:46.207596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:46.207609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:46.207670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:46.207687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:46.207702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:46.207715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:46.207729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:46.207764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594553330319702:8551]
2025-10-10T14:07:46.207792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594553330319702:8551]
2025-10-10T14:07:46.207821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594553330319702:8551]
2025-10-10T14:07:46.207846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594553330319702:8551]
2025-10-10T14:07:46.208001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:46.208035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.208049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:46.209390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:46.209624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:46.209670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:46.209703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:46.209742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:46.372793Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:46.381322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:46.381365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:46.381437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 689 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|67d146bd-16d-d83b56c2-5acb19c9_0
2025-10-10T14:07:46.381809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 689 sessionId: src_id|67d146bd-16d-d83b56c2-5acb19c9_0 is DEAD
2025-10-10T14:07:46.382155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:46.382295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594554908241459:8635]
2025-10-10T14:07:46.384818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d146bd-16d-d83b56c2-5acb19c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:07:46.384871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d146bd-16d-d83b56c2-5acb19c9_0] Write session will restart in 0.005646s
2025-10-10T14:07:46.385035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d146bd-16d-d83b56c2-5acb19c9_0] Write session: Do CDS request
2025-10-10T14:07:46.385081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d146bd-16d-d83b56c2-5acb19c9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:46.399591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67d146bd-16d-d83b56c2-5acb19c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:46.400776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:46.400819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 690
2025-10-10T14:07:46.401161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:46.401277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:46.401304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:46.401316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:46.403149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 690 sessionId:  describe result for acl check
2025-10-10T14:07:46.403270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:46.403280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:46.403293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:46.403312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594559203209042:9582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:46.406354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594559203209042:9582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:46.419593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594559203209042:9582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:46.431741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594559203209042:9582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:46.431789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594559203209042:9582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:46.431806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594559203209042:9582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:46.431841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:46.485319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594559203209108:8635]
2025-10-10T14:07:46.632602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:46.647462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:46.648362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:46.648380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:46.648430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:46.648703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:46.648870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594557625287293:8555]
2025-10-10T14:07:46.651121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:46.652517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:46.652739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:46.653901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:46.654213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:46.654220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:46.654226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:46.654233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:46.654239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:46.654246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:46.654252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:46.654258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:46.654265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.654272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.654279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.654287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.654331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:46.654432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:46.654474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:46.654534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:46.654575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:46.654619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:46.654663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:46.654707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:46.654761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.654805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.654845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.654894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.654927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:46.654982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:46.655034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:46.655081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:46.655125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:46.655170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:46.655210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:46.655258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:46.655300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:46.655347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:46.655407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:46.655453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:46.655495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:46.655540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:46.655584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:46.655627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:46.655671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.655721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.655761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.655812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.655854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.655900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.655940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.655988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.656395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:46.698020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:46.719413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:46.719454Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:46.719470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:46.719488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:46.719509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 689 [2:7559594557625287293:8555]
2025-10-10T14:07:46.719557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:46.719610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:46.719623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:46.719636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:46.719647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:46.719696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:46.719717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:46.719737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:46.721880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.721903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.721916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.721929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.721939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:46.722192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:46.722211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:46.722341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:46.722498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:46.722719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:46.722830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:46.722920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:46.722939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:46.722950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:46.722963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:46.723003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:46.723084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:46.723254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:46.723276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:46.723404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:46.723427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:46.723658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:46.723675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:46.723687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:46.723699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:46.723721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:46.724830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594559203209075:9582], now have 1 active actors on pipe
2025-10-10T14:07:46.724857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594559203209032:2442], now have 1 active actors on pipe
2025-10-10T14:07:46.724877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594559203209108:8635], now have 1 active actors on pipe
2025-10-10T14:07:46.725521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:46.725550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:46.725637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:46.725672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:46.725690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:46.725700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:46.725739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:46.725782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:46.725828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:46.727533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:46.727562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:46.727628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:46.725213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 689
2025-10-10T14:07:46.725327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 689
2025-10-10T14:07:46.725402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 689, pipe: [1:7559594559203209108:8635]
2025-10-10T14:07:46.727993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 690 partition: 0 MaxSeqNo: 36 sessionId: src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0
2025-10-10T14:07:46.729359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d146bd-16d-d83b56c2-5acb19c9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:46.780955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0] Write session: try to update token
2025-10-10T14:07:46.781013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:46.820117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:46.820145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:46.820158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:47.021388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:47.021418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:47.021429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:47.021486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:47.021498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:47.021511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:47.021521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:47.021531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:47.021569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:47.021593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:47.021615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:47.021634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:47.021827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:47.021852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:47.021861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:47.022591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:47.022623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:47.022652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:47.022678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:47.022993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:47.084699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId: src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:47.128154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:47.179865Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:47.198435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:47.198474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:47.198544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:47.198556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:47.198594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594557625287287:8555]
2025-10-10T14:07:47.201486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:47.203160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:47.203192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:47.205304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:47.205542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594559203209108:8635]
2025-10-10T14:07:47.205152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:47.214619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 690 reason: error at write: Disconnected sessionId: src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0
2025-10-10T14:07:47.214976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 690 sessionId: src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0 is DEAD
2025-10-10T14:07:47.221411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:47.221484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0] Write session will restart in 0.006409s
2025-10-10T14:07:47.221599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0] Write session: Do CDS request
2025-10-10T14:07:47.221645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:47.246816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:47.247781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:47.247818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 691
2025-10-10T14:07:47.248204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:47.248319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:47.248336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:47.248345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:47.265931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 691 sessionId:  describe result for acl check
2025-10-10T14:07:47.266096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:47.266107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:47.266116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:47.266136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594563498176662:9600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:47.276870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594563498176662:9600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:47.287582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594563498176662:9600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:47.303144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594563498176662:9600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:47.303197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594563498176662:9600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:47.303217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594563498176662:9600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:47.303245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:47.307534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594563498176699:8635]
2025-10-10T14:07:47.535901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:47.543371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:47.544125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:47.544136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:47.544168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:47.544457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:47.544654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594561920254894:8567]
2025-10-10T14:07:47.546349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:47.547665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:47.547833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:47.548773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:47.548995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:47.549000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:47.549006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:47.549010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:47.549014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:47.549018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:47.549022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:47.549027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:47.549031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:47.549035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:47.549039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:47.549044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:47.549087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:47.549211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:47.549257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:47.549301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:47.549345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:47.549392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:47.549436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:47.549479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:47.549525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:47.549571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:47.549613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:47.549655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:47.549695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:47.549760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:47.549815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:47.549865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:47.549913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:47.549965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:47.550008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:47.550058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:47.550101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:47.550151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:47.550195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:47.550246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:47.550290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:47.550341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:47.550386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:47.550435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:47.550466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:47.550518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:47.550550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:47.550588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:47.550629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:47.550668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:47.550711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:47.550754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:47.551098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:47.579552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:47.593806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:47.593854Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:47.593872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:47.593893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:47.593919Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 690 [2:7559594561920254894:8567]
2025-10-10T14:07:47.593974Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:47.594043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:47.594057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:47.594068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:47.594080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:47.594129Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:47.594156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:47.594178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:47.609405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:47.609431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:47.609440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:47.609450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:47.609460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:47.609749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:47.609764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:47.609896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:47.610056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:47.610259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:47.610371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:47.610450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:47.610466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:47.610480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:47.610506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:47.610553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:47.610639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:47.610816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:47.610833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:47.610970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:47.610992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:47.614020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 690, pipe: [1:7559594563498176699:8635]
2025-10-10T14:07:47.614130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 690
2025-10-10T14:07:47.614196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 690
2025-10-10T14:07:47.611771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:47.611789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:47.611801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:47.611813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:47.611837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:47.621749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594563498176699:8635], now have 1 active actors on pipe
2025-10-10T14:07:47.621795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594563498176697:9600], now have 1 active actors on pipe
2025-10-10T14:07:47.621817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594563498176649:2442], now have 1 active actors on pipe
2025-10-10T14:07:47.621877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:47.621900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:47.622001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9551d81b-4065fa53-c482ff36-d85714e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:47.622037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:47.622056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:47.622066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:47.622106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:47.622151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:47.622199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:47.623055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:47.623079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:47.623137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:47.623711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 691 partition: 0 MaxSeqNo: 36 sessionId: src_id|9551d81b-4065fa53-c482ff36-d85714e7_0
2025-10-10T14:07:47.624508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4658ff94-409cd6dd-1a86f459-c715c75c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9551d81b-4065fa53-c482ff36-d85714e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:47.686302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9551d81b-4065fa53-c482ff36-d85714e7_0] Write session: try to update token
2025-10-10T14:07:47.686364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9551d81b-4065fa53-c482ff36-d85714e7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:47.697336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:47.697365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:47.697377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:47.802801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:47.802839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:47.802857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:47.802872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:47.802886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:47.802931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:47.802963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:47.802992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:47.803018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:47.803264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:47.803276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:47.803287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:47.803336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:47.803364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:47.803375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:47.803614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:47.803653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:47.803684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:47.803713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:47.804655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:47.853395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId: src_id|9551d81b-4065fa53-c482ff36-d85714e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:47.888329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:47.983618Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:48.026780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:48.026828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:48.026900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:48.026914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:48.026958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594561920254888:8567]
2025-10-10T14:07:48.027589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:48.028556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:48.036588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594563498176699:8635]
2025-10-10T14:07:48.036674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:48.039490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:48.074225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 691 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9551d81b-4065fa53-c482ff36-d85714e7_0
2025-10-10T14:07:48.074635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 691 sessionId: src_id|9551d81b-4065fa53-c482ff36-d85714e7_0 is DEAD
2025-10-10T14:07:48.079037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9551d81b-4065fa53-c482ff36-d85714e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:07:48.079072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9551d81b-4065fa53-c482ff36-d85714e7_0] Write session will restart in 0.005425s
2025-10-10T14:07:48.079164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9551d81b-4065fa53-c482ff36-d85714e7_0] Write session: Do CDS request
2025-10-10T14:07:48.079191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9551d81b-4065fa53-c482ff36-d85714e7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:48.090467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9551d81b-4065fa53-c482ff36-d85714e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:48.089604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:48.089641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 692
2025-10-10T14:07:48.091112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:48.091229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:48.091243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:48.091252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:48.092590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 692 sessionId:  describe result for acl check
2025-10-10T14:07:48.092689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:48.092698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:48.092706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:48.092722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594567793144247:9606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:48.095142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594567793144247:9606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:48.103612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594567793144247:9606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:48.130854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594567793144247:9606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:48.130905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594567793144247:9606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:48.130924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594567793144247:9606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:48.130956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:48.137942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594567793144304:8635]
2025-10-10T14:07:48.259499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:48.263437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:48.264322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:48.264347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:48.264392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:48.264644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:48.264835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594566215222459:8574]
2025-10-10T14:07:48.267090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:48.268207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:48.268434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:48.269916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:48.270296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:48.270305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:48.270312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:48.270318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:48.270324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:48.270330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:48.270337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:48.270344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:48.270351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:48.270358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:48.270366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:48.270373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:48.270425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:48.270554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:48.270606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:48.270656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:48.270701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:48.270746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:48.270788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:48.270832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:48.270895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:48.270939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:48.270981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:48.271021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:48.271063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:48.271129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:48.271190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:48.271247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:48.271294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:48.271349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:48.271394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:48.271448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:48.271505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:48.271559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:48.271602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:48.271655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:48.271701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:48.271755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:48.271801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:48.271852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:48.271900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:48.271951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:48.271997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:48.272050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:48.272095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:48.272152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:48.272198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:48.272248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:48.272693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:48.412876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:48.479198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:48.479244Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:48.479260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:48.479278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:48.479302Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 691 [2:7559594566215222459:8574]
2025-10-10T14:07:48.479353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:48.480020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:48.480043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:48.480054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:48.480066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:48.493279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:48.493322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:48.493345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:48.505184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:48.505216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:48.505227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:48.505237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:48.505249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:48.505523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:48.505539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:48.505661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:48.505816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:48.506006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:48.506105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:48.506175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.506188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.506200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.506212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.506254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:48.506327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:48.506494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:48.506510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:48.506633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.506651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:48.507331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:48.507348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:48.507360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:48.507371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:48.507393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:48.509273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 691, pipe: [1:7559594567793144304:8635]
2025-10-10T14:07:48.509390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 691
2025-10-10T14:07:48.509546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 691
2025-10-10T14:07:48.510219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594567793144293:9606], now have 1 active actors on pipe
2025-10-10T14:07:48.510255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594567793144304:8635], now have 1 active actors on pipe
2025-10-10T14:07:48.510278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594567793144233:2442], now have 1 active actors on pipe
2025-10-10T14:07:48.510342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:48.510361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:48.510436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:48.510487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:48.510507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:48.510518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:48.510555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:48.510601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:48.510648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:48.511465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:48.511488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:48.511547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:48.511911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 692 partition: 0 MaxSeqNo: 36 sessionId: src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0
2025-10-10T14:07:48.512845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9551d81b-4065fa53-c482ff36-d85714e7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:48.595663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0] Write session: try to update token
2025-10-10T14:07:48.595722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:48.597259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:48.597292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:48.597304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:48.712340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:48.712369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:48.712381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:48.712435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:48.712450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:48.712466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:48.712477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:48.712487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:48.712527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.712555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.712584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.712607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.712817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:48.712844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:48.712857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:48.714189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:48.717755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:48.717791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:48.717817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:48.717843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:48.822527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId: src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:48.849106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:48.933000Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:48.969986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:48.970029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:48.970084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:48.970096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:48.970134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594566215222454:8574]
2025-10-10T14:07:48.970400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:48.973477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:48.973511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:48.977306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594567793144304:8635]
2025-10-10T14:07:48.977378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:48.973077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:48.989378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:48.989420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0] Write session will restart in 0.006206s
2025-10-10T14:07:48.989515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0] Write session: Do CDS request
2025-10-10T14:07:48.989543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:48.986136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 692 reason: error at write: Disconnected sessionId: src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0
2025-10-10T14:07:48.994839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 692 sessionId: src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0 is DEAD
2025-10-10T14:07:49.006851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:49.013280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:49.013317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 693
2025-10-10T14:07:49.013711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:49.013816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:49.013829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:49.013841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:49.016620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 693 sessionId:  describe result for acl check
2025-10-10T14:07:49.016808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:49.016818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:49.016827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:49.016843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594572088111868:9622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:49.022267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594572088111868:9622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:49.038882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594572088111868:9622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:49.053035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594572088111868:9622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:49.053087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594572088111868:9622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:49.053106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594572088111868:9622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:49.053155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:49.077346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594572088111934:8635]
2025-10-10T14:07:49.163933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:49.174523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:49.175516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:49.175536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:49.175585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:49.175870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:49.176058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594570510190075:8586]
2025-10-10T14:07:49.178258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:49.182354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:49.182642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:49.184058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:49.184422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:49.184433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:49.184440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:49.184450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:49.184458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:49.184467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:49.184475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:49.184483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:49.184490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:49.184498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:49.184505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:49.184514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:49.184564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:49.184677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:49.184726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:49.184776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:49.184820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:49.184876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:49.184924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:49.184970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:49.185019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:49.185069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:49.185114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:49.185534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:49.185585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:49.185663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:49.185725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:49.185791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:49.185850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:49.185927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:49.185986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:49.186039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:49.186088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:49.186139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:49.186185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:49.186235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:49.186283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:49.186338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:49.186382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:49.186445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:49.186519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:49.186570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:49.186613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:49.186668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:49.186710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:49.186761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:49.186805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:49.186852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:49.187279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:49.238657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:49.274547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:49.274591Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:49.274609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:49.274631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:49.274659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 692 [2:7559594570510190075:8586]
2025-10-10T14:07:49.274718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:49.274790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:49.274807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:49.274819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:49.274831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:49.274888Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:49.274912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:49.274937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:49.276354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:49.276370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:49.276384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:49.276397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:49.276408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:49.276678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:49.276695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:49.276845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:49.277024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:49.279757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 692
2025-10-10T14:07:49.279871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 692
2025-10-10T14:07:49.279944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 692, pipe: [1:7559594572088111934:8635]
2025-10-10T14:07:49.284843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:49.284976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:49.285086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594572088111905:9622], now have 1 active actors on pipe
2025-10-10T14:07:49.285111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594567793144560:2442], now have 1 active actors on pipe
2025-10-10T14:07:49.285153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594572088111934:8635], now have 1 active actors on pipe
2025-10-10T14:07:49.285222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:49.285249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:49.285311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.285328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.285343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.285356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.285400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:49.285490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:49.285689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:49.285709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:49.285780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:49.285815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:49.285835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:49.285845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:49.285883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:49.285929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:49.286072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.286095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:49.286138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:49.286357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:49.286371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:49.286381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:49.286393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:49.286418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:49.292968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:49.293010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:49.293111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:49.296819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 693 partition: 0 MaxSeqNo: 36 sessionId: src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0
2025-10-10T14:07:49.297731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f6b2e-6b069554-c4d06f91-a44e5071_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:49.375350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:49.375384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:49.375397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:49.377881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0] Write session: try to update token
2025-10-10T14:07:49.377946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:49.587658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:49.587681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:49.587689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:49.587733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:49.587743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:49.587753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:49.587762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:49.587771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:49.587796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.587816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.587834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.587851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.587997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:49.588015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:49.588024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:49.590351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:49.593310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:49.593365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:49.593401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:49.593432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:49.654689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId: src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:49.681117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:49.795609Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:49.839594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:49.839629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:49.839696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:49.839711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:49.839754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594570510190070:8586]
2025-10-10T14:07:49.840147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:49.840359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:49.842795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:49.842849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:49.844936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:49.845247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594572088111934:8635]
2025-10-10T14:07:49.881397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 693 reason: error at write: Disconnected sessionId: src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0
2025-10-10T14:07:49.881742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 693 sessionId: src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0 is DEAD
2025-10-10T14:07:49.893542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:49.893586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0] Write session will restart in 0.005638s
2025-10-10T14:07:49.893685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0] Write session: Do CDS request
2025-10-10T14:07:49.893714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:49.909928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:49.909794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:49.909834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 694
2025-10-10T14:07:49.910575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:49.910700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:49.910717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:49.910727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:49.912530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 694 sessionId:  describe result for acl check
2025-10-10T14:07:49.912639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:49.912651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:49.912662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:49.912677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594572088112167:9629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:49.915504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594572088112167:9629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:49.945979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594572088112167:9629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:49.951933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594572088112202:8635]
2025-10-10T14:07:49.968654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594572088112167:9629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:49.968700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594572088112167:9629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:49.968718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594572088112167:9629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:49.968747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:50.050546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:50.064267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:50.065781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:50.065835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:50.065930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:50.068325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:50.068598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594574805157655:8595]
2025-10-10T14:07:50.070821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:50.072384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:50.072656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:50.073928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:50.074255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:50.074263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:50.074271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:50.074278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:50.074284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:50.074291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:50.074298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:50.074304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:50.074310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.074317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.074324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.074331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.074381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:50.074500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:50.074549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:50.074593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:50.074638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:50.074683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:50.074725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:50.074767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:50.074807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.074848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.074891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.074933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.074971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:50.075033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:50.075087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:50.075138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:50.075182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:50.075229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:50.075278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:50.075333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:50.075381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:50.075440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:50.075490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:50.075564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:50.081497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:50.081590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:50.081646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:50.081700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:50.081752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.081805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.081864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.081920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.081964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.082015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.082056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.082105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.082547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:50.148693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:50.169699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:50.172594Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:50.172632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:50.172653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:50.172677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 693 [2:7559594574805157655:8595]
2025-10-10T14:07:50.172734Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:50.172791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:50.172806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:50.172819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:50.172830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:50.172879Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:50.172901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:50.172922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:50.175375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.175404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.175420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.175434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.175446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:50.175717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:50.175737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.175892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.176103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.176370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.176498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:50.176581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594574805157649:8595]
2025-10-10T14:07:50.176598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594574805157649:8595]
2025-10-10T14:07:50.176620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594574805157649:8595]
2025-10-10T14:07:50.176632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594574805157649:8595]
2025-10-10T14:07:50.176675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:50.176761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:50.176951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:50.176968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:50.177095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594574805157649:8595]
2025-10-10T14:07:50.177115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:50.177405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:50.177420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:50.177433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:50.177445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:50.177471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:50.178295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594572088112238:9629], now have 1 active actors on pipe
2025-10-10T14:07:50.178331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594572088112154:2442], now have 1 active actors on pipe
2025-10-10T14:07:50.178361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594572088112202:8635], now have 1 active actors on pipe
2025-10-10T14:07:50.178587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 693
2025-10-10T14:07:50.178686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 693
2025-10-10T14:07:50.178747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 693, pipe: [1:7559594572088112202:8635]
2025-10-10T14:07:50.180479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:50.180518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:50.180633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:50.180667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:50.180687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:50.180699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:50.180735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:50.180775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:50.181201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:50.184491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:50.184526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:50.184606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:50.189440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 694 partition: 0 MaxSeqNo: 36 sessionId: src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0
2025-10-10T14:07:50.190448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae22d80-d5970d51-e59f7724-8f26f23e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:50.273491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:50.273523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:50.273535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:50.279347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0] Write session: try to update token
2025-10-10T14:07:50.279407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:50.462360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:50.462397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:50.462409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:50.462491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:50.462505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:50.462519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:50.462529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:50.462541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:50.462580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594574805157649:8595]
2025-10-10T14:07:50.462609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594574805157649:8595]
2025-10-10T14:07:50.462637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594574805157649:8595]
2025-10-10T14:07:50.462660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594574805157649:8595]
2025-10-10T14:07:50.462807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:50.462835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.462848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:50.463992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:50.464750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:50.464800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:50.464830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:50.464859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:50.613446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId: src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:50.652529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:50.669903Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:50.675957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:50.676010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:50.679605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:50.681299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:50.695175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:50.695316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594572088112202:8635]
2025-10-10T14:07:50.697804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:07:50.697868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0] Write session will restart in 0.007440s
2025-10-10T14:07:50.698014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0] Write session: Do CDS request
2025-10-10T14:07:50.698056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:50.695389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 694 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0
2025-10-10T14:07:50.695847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 694 sessionId: src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0 is DEAD
2025-10-10T14:07:50.716109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:50.716134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 695
2025-10-10T14:07:50.723748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:50.724539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:50.724681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:50.724696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:50.724705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:50.726564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 695 sessionId:  describe result for acl check
2025-10-10T14:07:50.726680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:50.726692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:50.726701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:50.726716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594576383079768:9641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:50.729254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594576383079768:9641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:50.739610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594576383079768:9641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:50.765310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594576383079768:9641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:50.765354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594576383079768:9641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:50.765370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594576383079768:9641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:50.765400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:50.782299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594576383079831:8635]
2025-10-10T14:07:50.926458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:50.930845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:50.931857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:50.931882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:50.931929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:50.932214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:50.932425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594574805157971:8605]
2025-10-10T14:07:50.934732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:50.935964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:50.936251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:50.937846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:50.938214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:50.938231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:50.938238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:50.938246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:50.938254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:50.938262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:50.938270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:50.938277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:50.938288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.938295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.938303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.938311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.938366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:50.938511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:50.938575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:50.938635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:50.938695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:50.938757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:50.938813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:50.938868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:50.938926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.938983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.939038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.939097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.939148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:50.939228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:50.939303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:50.939372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:50.939433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:50.939496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:50.939555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:50.939623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:50.939684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:50.939760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:50.939816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:50.940388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:50.940463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:50.940531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:50.940583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:50.940647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:50.940706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.940765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:50.940819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.940884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:50.940939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.941001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:50.941052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.941111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:50.941665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:50.985109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:51.004376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:51.004433Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:51.004453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:51.004476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:51.004500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 694 [2:7559594574805157971:8605]
2025-10-10T14:07:51.004560Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:51.004630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:51.004648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:51.004662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:51.004674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:51.004726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:51.004747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:51.004770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:51.010463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:51.010497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:51.010515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:51.010530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:51.010543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:51.010836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:51.010855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:51.011023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:51.011229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:51.011481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:51.011613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:51.011692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.011708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.011722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.011736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.011781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:51.011871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:51.012074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:51.012092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:51.012228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.012251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:51.013062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:51.013082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:51.013094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:51.013109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:51.013151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:51.016479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 694
2025-10-10T14:07:51.016582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 694, pipe: [1:7559594576383079831:8635]
2025-10-10T14:07:51.016677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 694
2025-10-10T14:07:51.018665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594576383079811:9641], now have 1 active actors on pipe
2025-10-10T14:07:51.018711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594576383079831:8635], now have 1 active actors on pipe
2025-10-10T14:07:51.018738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594576383079761:2442], now have 1 active actors on pipe
2025-10-10T14:07:51.018796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:51.018824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:51.018925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:51.018963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:51.018983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:51.018996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:51.019037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:51.019083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:51.019140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:51.025017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:51.025059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:51.025165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:51.027307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 695 partition: 0 MaxSeqNo: 36 sessionId: src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0
2025-10-10T14:07:51.028305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83567448-9d5119ad-fdab9d89-a6489e5c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:51.128720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0] Write session: try to update token
2025-10-10T14:07:51.128781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:51.172454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:51.172484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:51.172497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:51.172568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:51.172582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:51.172628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.172775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:51.173255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:51.174543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:51.175725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:51.202193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:51.203691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:51.222135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:51.222585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:51.269803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:51.269831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:51.269843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:51.459928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId: src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:51.568120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:51.582859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:51.582886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:51.582899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:51.582963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:51.582979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:51.582993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:51.583003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:51.583014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:51.583056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.583082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.583105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.583128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594574805157966:8605]
2025-10-10T14:07:51.583319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:51.583348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:51.583386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:51.583416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:51.583427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:51.584572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:51.585720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:51.585758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:51.585790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:51.585819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:51.818271Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:51.822067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:51.822213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:51.822226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:51.825322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594576383079831:8635]
2025-10-10T14:07:51.825933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:51.882772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 695 reason: error at write: Disconnected sessionId: src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0
2025-10-10T14:07:51.883150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 695 sessionId: src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0 is DEAD
2025-10-10T14:07:51.885782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:51.885813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0] Write session will restart in 0.006194s
2025-10-10T14:07:51.885917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0] Write session: Do CDS request
2025-10-10T14:07:51.885949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:51.901593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:51.901623Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 696
2025-10-10T14:07:51.904013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:51.905323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:51.905464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:51.905478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:51.905488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:51.911315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 696 sessionId:  describe result for acl check
2025-10-10T14:07:51.911442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:51.911451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:51.911461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:51.911479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594580678047398:9654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:51.913720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594580678047398:9654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:51.929808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594580678047404:8635]
2025-10-10T14:07:51.944885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594580678047398:9654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:51.981424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594580678047398:9654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:51.981466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594580678047398:9654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:51.981483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594580678047398:9654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:51.981516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:52.111952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:52.118762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:52.119801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:52.119822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:52.119875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:52.120148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:52.120390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594583395092870:8616]
2025-10-10T14:07:52.122509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:52.127440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:52.127742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:52.129026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:52.129372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:52.129381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:52.129389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:52.129395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:52.129401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:52.129410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:52.129416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:52.129423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:52.129429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.129436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.129443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.129449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.129492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:52.129595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:52.129640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:52.129684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:52.129726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:52.129765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:52.129810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:52.129852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:52.129893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.129938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.129981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.130023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.130068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:52.130128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:52.130187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:52.130239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:52.130288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:52.130335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:52.130377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:52.130448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:52.130495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:52.130543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:52.130587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:52.130638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:52.130683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:52.130731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:52.130774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:52.130823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:52.130867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.130919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.130962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.131013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.131055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.131105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.131145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.131194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.131607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:52.205412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:52.224885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 695
2025-10-10T14:07:52.224965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 695, pipe: [1:7559594580678047404:8635]
2025-10-10T14:07:52.225033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 695
2025-10-10T14:07:52.221213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:52.221260Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:52.221276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:52.221298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:52.221326Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 695 [2:7559594583395092870:8616]
2025-10-10T14:07:52.221384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:52.221454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:52.221471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:52.221483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:52.221494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:52.221547Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:52.221571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:52.221595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:52.224094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.224112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.224126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.224139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.224149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:52.227755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:52.227788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.227931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.228110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.228324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.228434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:52.228484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594580678047471:9654], now have 1 active actors on pipe
2025-10-10T14:07:52.228507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594580678047404:8635], now have 1 active actors on pipe
2025-10-10T14:07:52.228527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594580678047378:2442], now have 1 active actors on pipe
2025-10-10T14:07:52.228579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:52.228601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:52.228716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.228731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.228742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.228754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.228797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:52.228915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:52.228952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:52.228972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:52.228982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:52.229023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:52.229079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:52.229164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:52.229340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:52.229358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:52.229509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:52.229565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.229588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:52.230569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:52.230592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:52.230604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:52.230614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:52.230643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:52.232430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:52.232461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:52.232542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:52.232938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 696 partition: 0 MaxSeqNo: 36 sessionId: src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0
2025-10-10T14:07:52.234824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c6e29b9-5773c632-e209a53b-616bdaff_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:52.315959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0] Write session: try to update token
2025-10-10T14:07:52.316021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:52.379416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:52.379443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:52.379456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:52.379581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:52.379595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:52.379608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:52.379619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:52.379631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:52.379669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.379697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.379720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.379741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.380483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:52.380516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:52.380547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:52.380575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:52.413195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:52.413249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.413261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:52.414411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:52.531776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId: src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:52.565473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:52.643137Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:52.652369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:52.652398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:52.652439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594583395092865:8616]
2025-10-10T14:07:52.652584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:52.652607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:52.652962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:52.658367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:52.658421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:52.655047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:52.684135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 696 reason: error at write: Disconnected sessionId: src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0
2025-10-10T14:07:52.684482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 696 sessionId: src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0 is DEAD
2025-10-10T14:07:52.685707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:52.685735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0] Write session will restart in 0.006187s
2025-10-10T14:07:52.685833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0] Write session: Do CDS request
2025-10-10T14:07:52.685860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:52.700760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:52.737047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594580678047404:8635]
2025-10-10T14:07:52.737161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:52.737556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:52.737572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 697
2025-10-10T14:07:52.741510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:52.741655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:52.741669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:52.741679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:52.744133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 697 sessionId:  describe result for acl check
2025-10-10T14:07:52.744239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:52.744249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:52.744257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:52.744275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594584973015015:9666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:52.760143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594584973015015:9666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:52.792863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594584973015015:9666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:52.835722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594584973015207:8635]
2025-10-10T14:07:52.844659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594584973015015:9666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:52.844707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594584973015015:9666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:52.844728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594584973015015:9666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:52.844764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:52.855684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:52.864040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:52.865013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:52.865049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:52.865096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:52.865417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:52.865645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594583395093174:8631]
2025-10-10T14:07:52.868586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:52.869785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:52.870025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:52.871269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:52.871608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:52.871617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:52.871623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:52.871630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:52.871637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:52.871643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:52.871649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:52.871655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:52.871661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.871667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.871673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.871680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.871723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:52.871827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:52.871873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:52.871919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:52.871962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:52.872009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:52.872053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:52.872095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:52.872138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.872194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.872238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.872279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.872342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:52.872410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:52.872463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:52.872502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:52.872531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:52.872569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:52.872613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:52.872654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:52.872685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:52.872720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:52.872748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:52.872784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:52.872814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:52.872861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:52.872891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:52.872927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:52.872972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.873006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.873034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.873073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.873116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.873181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.873225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.873275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.873690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:52.912994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:52.932365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:52.932686Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:52.932706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:52.932725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:52.932748Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 696 [2:7559594583395093174:8631]
2025-10-10T14:07:52.932797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:52.932861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:52.932877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:52.932890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:52.932901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:52.932949Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:52.932972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:52.932995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:52.975910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.975943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.975955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.975968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.975978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:52.976253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:52.976270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:52.976399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:52.976552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:52.976750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:52.976849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:52.976924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:52.976938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:52.976951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:52.976964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:52.977007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:52.977087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:52.977275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:52.977293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:52.977423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:52.977443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:52.980061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:52.980078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:52.980089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:52.980099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:52.980123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:52.980878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594584973015253:9666], now have 1 active actors on pipe
2025-10-10T14:07:52.980917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594584973015010:2442], now have 1 active actors on pipe
2025-10-10T14:07:52.980940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594584973015207:8635], now have 1 active actors on pipe
2025-10-10T14:07:52.981620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 696
2025-10-10T14:07:52.981704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 696
2025-10-10T14:07:52.981764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 696, pipe: [1:7559594584973015207:8635]
2025-10-10T14:07:52.982090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:52.982127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:52.982229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|918a0e07-b3f1b395-b762a147-8432edaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:52.982271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:52.982292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:52.982302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:52.982340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:52.982412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:52.982473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:52.982861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:52.982885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:52.982942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:52.983298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 697 partition: 0 MaxSeqNo: 36 sessionId: src_id|918a0e07-b3f1b395-b762a147-8432edaa_0
2025-10-10T14:07:52.986675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f4849d3-2decaa6d-5b7e00c6-1b3ccf56_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|918a0e07-b3f1b395-b762a147-8432edaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:53.019005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|918a0e07-b3f1b395-b762a147-8432edaa_0] Write session: try to update token
2025-10-10T14:07:53.019093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|918a0e07-b3f1b395-b762a147-8432edaa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:53.022789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:53.022820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:53.022856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:53.022986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:53.023594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:53.034351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:53.035696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:53.036900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:53.038128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:53.039890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:53.040221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:53.040234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:53.040247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:53.040304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:53.196712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:53.196742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:53.196753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:53.196762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:53.196769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:53.196808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:53.196829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:53.196848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:53.196868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594583395093169:8631]
2025-10-10T14:07:53.197035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:53.197046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:53.197057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:53.197101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:53.197649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:53.197680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:53.197705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:53.197735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:53.201362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:53.201423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:53.202490Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:53.218675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId: src_id|918a0e07-b3f1b395-b762a147-8432edaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:53.240830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:53.480117Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:53.482398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:53.482440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:53.485213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:53.485362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594584973015207:8635]
2025-10-10T14:07:53.485439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:53.485450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:53.490163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:53.542991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 697 reason: error at write: Disconnected sessionId: src_id|918a0e07-b3f1b395-b762a147-8432edaa_0
2025-10-10T14:07:53.543359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 697 sessionId: src_id|918a0e07-b3f1b395-b762a147-8432edaa_0 is DEAD
2025-10-10T14:07:53.549463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918a0e07-b3f1b395-b762a147-8432edaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:53.549543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918a0e07-b3f1b395-b762a147-8432edaa_0] Write session will restart in 0.006132s
2025-10-10T14:07:53.549724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918a0e07-b3f1b395-b762a147-8432edaa_0] Write session: Do CDS request
2025-10-10T14:07:53.549779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918a0e07-b3f1b395-b762a147-8432edaa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:53.563149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|918a0e07-b3f1b395-b762a147-8432edaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:53.565286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:53.565335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 698
2025-10-10T14:07:53.573296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:53.573443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:53.573458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:53.573469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:53.582356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 698 sessionId:  describe result for acl check
2025-10-10T14:07:53.582493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:53.582504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:53.582514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:53.582530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594589267982630:9676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:53.586902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594589267982640:8635]
2025-10-10T14:07:53.586959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594589267982630:9676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:53.608506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594589267982630:9676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:53.631248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594589267982630:9676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:53.631294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594589267982630:9676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:53.631312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594589267982630:9676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:53.631349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:53.648537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:07:53.648602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-10-10T14:07:53.730506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:53.734537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:53.735434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:53.735454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:53.735507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:53.735770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:53.735996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594587690060779:8636]
2025-10-10T14:07:53.738140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:53.739283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:53.739493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:53.741656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:53.742061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:53.742089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:53.742096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:53.742102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:53.742109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:53.742115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:53.742123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:53.742130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:53.742137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:53.742143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:53.742150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:53.742157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:53.742204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:53.742312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:53.742373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:53.742421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:53.742464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:53.742508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:53.742553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:53.742606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:53.742651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:53.742697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:53.742752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:53.742793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:53.742835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:53.742897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:53.742953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:53.743009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:53.743061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:53.743111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:53.743157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:53.743203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:53.743258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:53.743309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:53.743352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:53.743409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:53.743456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:53.743513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:53.743568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:53.743631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:53.743678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:53.743729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:53.743776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:53.743828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:53.743874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:53.743923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:53.743966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:53.744020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:53.744473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:53.800730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:53.815360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:53.815407Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:53.815425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:53.815445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:53.815468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 697 [2:7559594587690060779:8636]
2025-10-10T14:07:53.815523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:53.815575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:53.815586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:53.815595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:53.815603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:53.815637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:53.815653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:53.815668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:53.818651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 697
2025-10-10T14:07:53.818765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 697
2025-10-10T14:07:53.818838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 697, pipe: [1:7559594589267982640:8635]
2025-10-10T14:07:53.821110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 17 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:07:53.821285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:07:53.817774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:53.817806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:53.817819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:53.817832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:53.817844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:53.818150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:53.818170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:53.818312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:53.818508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:53.818706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:53.818853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:53.818950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594589267982598:2442], now have 1 active actors on pipe
2025-10-10T14:07:53.819010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594589267982730:9676], now have 1 active actors on pipe
2025-10-10T14:07:53.819046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594589267982640:8635], now have 1 active actors on pipe
2025-10-10T14:07:53.819091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:53.819115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:53.819138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:53.819155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:53.819192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:53.819231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:53.819244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:53.819256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:53.819257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:53.819266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:53.819429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:53.819445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:53.819501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:53.819522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:53.819712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:53.819752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:53.819773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:53.819825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|607bcd7-88a38d02-d6a8199-84652e22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:53.819854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:53.819907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:53.819919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:53.819954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:53.819997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:53.820210Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:07:53.820357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:53.821469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:53.821495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:53.821585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:53.821944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 698 partition: 0 MaxSeqNo: 36 sessionId: src_id|607bcd7-88a38d02-d6a8199-84652e22_0
2025-10-10T14:07:53.825410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|918a0e07-b3f1b395-b762a147-8432edaa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|607bcd7-88a38d02-d6a8199-84652e22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:53.865055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607bcd7-88a38d02-d6a8199-84652e22_0] Write session: try to update token
2025-10-10T14:07:53.865111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607bcd7-88a38d02-d6a8199-84652e22_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:54.013584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:54.013637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:54.013652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:54.013664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:54.013673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:54.013712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:54.013738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:54.013759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:54.013777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:54.013965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:54.013986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:54.013996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:54.014107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:54.014141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:54.014152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:54.014260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:54.014291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:54.014317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:54.014348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:54.022411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:54.046455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId: src_id|607bcd7-88a38d02-d6a8199-84652e22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:54.085089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:54.227615Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:54.241061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:54.241113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:54.241202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:54.241216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:54.241259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594587690060774:8636]
2025-10-10T14:07:54.241578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:54.247737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:54.242663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:54.247882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:54.247898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:54.271337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594589267982640:8635]
2025-10-10T14:07:54.271433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 698 reason: error at write: Disconnected sessionId: src_id|607bcd7-88a38d02-d6a8199-84652e22_0
2025-10-10T14:07:54.271763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 698 sessionId: src_id|607bcd7-88a38d02-d6a8199-84652e22_0 is DEAD
2025-10-10T14:07:54.273695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607bcd7-88a38d02-d6a8199-84652e22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:54.273725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607bcd7-88a38d02-d6a8199-84652e22_0] Write session will restart in 0.007387s
2025-10-10T14:07:54.273816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607bcd7-88a38d02-d6a8199-84652e22_0] Write session: Do CDS request
2025-10-10T14:07:54.273843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607bcd7-88a38d02-d6a8199-84652e22_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:54.288719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|607bcd7-88a38d02-d6a8199-84652e22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
E1010 14:07:54.309496087  107740 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:07:54.305646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:54.305676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 699
2025-10-10T14:07:54.313295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:54.313442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:54.313458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:54.313468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:54.317519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 699 sessionId:  describe result for acl check
2025-10-10T14:07:54.317642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:54.317651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:54.317660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:54.317677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594593562950234:9687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:54.320227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594593562950234:9687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:54.343263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594593562950234:9687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:54.360582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594593562950234:9687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:54.360624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594593562950234:9687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:54.360643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594593562950234:9687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:54.360674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:54.371669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594593562950366:8635]
2025-10-10T14:07:54.428132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:54.445741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:54.446714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:54.446731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:54.446777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:54.447043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:54.447264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594591985028370:8651]
2025-10-10T14:07:54.449826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:54.450920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:54.451140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:54.452562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:54.452900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:54.452908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:54.452915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:54.452921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:54.452928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:54.452935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:54.452941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:54.452949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:54.452956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:54.452963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:54.452971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:54.452978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:54.453029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:54.453172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:54.453226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:54.453277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:54.453325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:54.453377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:54.453425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:54.453476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:54.453527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:54.453581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:54.453630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:54.453679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:54.453722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:54.453794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:54.453876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:54.453935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:54.453989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:54.454047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:54.454099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:54.454156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:54.454208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:54.454266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:54.454314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:54.454382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:54.454427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:54.454483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:54.454531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:54.454581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:54.454630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:54.454686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:54.454735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:54.454791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:54.454840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:54.454896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:54.454945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:54.455001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:54.455483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:54.537361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:54.550809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:54.550858Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:54.550877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:54.551075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:54.551103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 698 [2:7559594591985028370:8651]
2025-10-10T14:07:54.551166Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:54.551229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:54.551246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:54.551260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:54.551273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:54.551320Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:54.551342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:54.551365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:54.554246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:54.554274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:54.554291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:54.554305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:54.554318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:54.554633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:54.554653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:54.554815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:54.555015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:54.555268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:54.555402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:54.555492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594593562950208:2442], now have 1 active actors on pipe
2025-10-10T14:07:54.555517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594593562950366:8635], now have 1 active actors on pipe
2025-10-10T14:07:54.555542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594593562950337:9687], now have 1 active actors on pipe
2025-10-10T14:07:54.555569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.555583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.555600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.555614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.555659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:54.555746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:54.555415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 698
2025-10-10T14:07:54.555516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 698, pipe: [1:7559594593562950366:8635]
2025-10-10T14:07:54.555600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 698
2025-10-10T14:07:54.555943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:54.555972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:54.556126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.556156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:54.556005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:54.556258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:54.556271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:54.556283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:54.556309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:54.556512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:54.556551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:54.556626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:54.556664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:54.556682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:54.556692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:54.556726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:54.556766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:54.556813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:54.557987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:54.558023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:54.558093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:54.561367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 699 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0
2025-10-10T14:07:54.567921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|607bcd7-88a38d02-d6a8199-84652e22_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:54.613098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0] Write session: try to update token
2025-10-10T14:07:54.613177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:54.669309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:54.669343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:54.669378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.669491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:54.669504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:54.669513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:54.669572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:54.669625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:54.682148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:54.689326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:54.717681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:54.718895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:54.720393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:54.720842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:54.781231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId: src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:54.811184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:54.820175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:54.820207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:54.820218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:54.820228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:54.820237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:54.820275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.820300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.820320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.820340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594591985028365:8651]
2025-10-10T14:07:54.820435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:54.820459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:54.820483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:54.820508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:54.820819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:54.820831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:54.820842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:54.820931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:54.820955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:54.820989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:54.821013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:54.821023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:54.821990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:54.972181Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:54.975696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:54.975845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594593562950366:8635]
2025-10-10T14:07:54.975924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:54.975935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:54.984081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:55.021590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 699 reason: error at write: Disconnected sessionId: src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0
2025-10-10T14:07:55.021921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 699 sessionId: src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0 is DEAD
2025-10-10T14:07:55.022408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:55.022494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0] Write session will restart in 0.009590s
2025-10-10T14:07:55.022692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0] Write session: Do CDS request
2025-10-10T14:07:55.022752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:55.037882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:55.037918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 700
2025-10-10T14:07:55.038870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:55.039392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:55.039517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:55.039532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:55.039542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:55.044559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 700 sessionId:  describe result for acl check
2025-10-10T14:07:55.044677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:55.044687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:55.044695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:55.044711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594597857917846:9697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:55.048576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594597857917846:9697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:55.060871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594597857917846:9697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:55.074264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594597857917948:8635]
2025-10-10T14:07:55.076132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594597857917846:9697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:55.076174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594597857917846:9697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:55.076191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594597857917846:9697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:55.076222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:55.141214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:55.158174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:55.159133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:55.159152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:55.159198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:55.159467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:55.159649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594596279995964:8657]
2025-10-10T14:07:55.165960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:55.171269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:55.171522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:55.172752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:55.173066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:55.173073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:55.173079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:55.173085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:55.173092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:55.173099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:55.173106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:55.173112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:55.173118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.173141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.173148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.173155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.173204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:55.173309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:55.173359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:55.173402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:55.173448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:55.173495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:55.173537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:55.173580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:55.173623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.173666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.173711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.173750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.173791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:55.173859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:55.173916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:55.173969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:55.174016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:55.174069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:55.174115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:55.174169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:55.174215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:55.174267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:55.174309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:55.174376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:55.174422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:55.174470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:55.174516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:55.174566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:55.174610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.174658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.174702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.174752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.174796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.174849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.174893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.174942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.175360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:55.217441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:55.329193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:55.329242Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:55.329256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:55.329273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:55.329297Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 699 [2:7559594596279995964:8657]
2025-10-10T14:07:55.329350Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:55.329409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:55.329423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:55.329435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:55.329445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:55.329491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:55.329513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:55.329534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:55.332755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.332779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.332791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.332803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.332813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:55.333096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:55.333111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.333260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.333430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.333641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.333751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:55.333824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594596279995954:8657]
2025-10-10T14:07:55.333837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594596279995954:8657]
2025-10-10T14:07:55.333850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594596279995954:8657]
2025-10-10T14:07:55.333863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594596279995954:8657]
2025-10-10T14:07:55.333895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:55.333974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:55.334139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:55.334155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:55.334281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594596279995954:8657]
2025-10-10T14:07:55.334300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:55.334618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:55.334631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:55.334640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:55.334651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:55.334672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:55.336167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594597857917948:8635], now have 1 active actors on pipe
2025-10-10T14:07:55.336200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594597857917951:9697], now have 1 active actors on pipe
2025-10-10T14:07:55.336222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594593562950527:2442], now have 1 active actors on pipe
2025-10-10T14:07:55.337585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 699, pipe: [1:7559594597857917948:8635]
2025-10-10T14:07:55.337707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 699
2025-10-10T14:07:55.337827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 699
2025-10-10T14:07:55.339831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:55.339884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:55.339987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69a2ea31-f382d5a0-55af1017-125367db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:55.340027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:55.340044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:55.340054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:55.340098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:55.340142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:55.340188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:55.344400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:55.344437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:55.344521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:55.353692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 700 partition: 0 MaxSeqNo: 36 sessionId: src_id|69a2ea31-f382d5a0-55af1017-125367db_0
2025-10-10T14:07:55.357688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b1eac9c-f3e8f90a-9c7b84ea-7c4c6bfe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|69a2ea31-f382d5a0-55af1017-125367db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:55.406393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a2ea31-f382d5a0-55af1017-125367db_0] Write session: try to update token
2025-10-10T14:07:55.406451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a2ea31-f382d5a0-55af1017-125367db_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:55.429775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:55.429808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:55.429818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:55.487603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:55.487643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:55.487657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:55.487668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:55.487678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:55.487714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594596279995954:8657]
2025-10-10T14:07:55.487739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594596279995954:8657]
2025-10-10T14:07:55.487761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594596279995954:8657]
2025-10-10T14:07:55.487782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594596279995954:8657]
2025-10-10T14:07:55.487934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:55.487961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.487971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:55.493114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:55.493181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:55.493209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:55.493233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:55.501283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:55.613652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId: src_id|69a2ea31-f382d5a0-55af1017-125367db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:55.647660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:55.705936Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:55.708761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:55.708814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:55.713450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594597857917948:8635]
2025-10-10T14:07:55.713525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:55.713638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:55.713647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:55.713325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:55.745570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 700 reason: error at write: Disconnected sessionId: src_id|69a2ea31-f382d5a0-55af1017-125367db_0
2025-10-10T14:07:55.745904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 700 sessionId: src_id|69a2ea31-f382d5a0-55af1017-125367db_0 is DEAD
2025-10-10T14:07:55.747116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a2ea31-f382d5a0-55af1017-125367db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:55.747147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a2ea31-f382d5a0-55af1017-125367db_0] Write session will restart in 0.005303s
2025-10-10T14:07:55.747242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a2ea31-f382d5a0-55af1017-125367db_0] Write session: Do CDS request
2025-10-10T14:07:55.747273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a2ea31-f382d5a0-55af1017-125367db_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:55.774477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69a2ea31-f382d5a0-55af1017-125367db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:55.777729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:55.777758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 701
2025-10-10T14:07:55.778198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:55.778360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:55.778377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:55.778387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:55.786261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 701 sessionId:  describe result for acl check
2025-10-10T14:07:55.790126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:55.790151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:55.790160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:55.790182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594597857918168:9709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:55.792772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594597857918168:9709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:55.817764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594597857918209:8635]
2025-10-10T14:07:55.831925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594597857918168:9709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:55.864589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594597857918168:9709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:55.864635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594597857918168:9709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:55.864657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594597857918168:9709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:55.864691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:55.940911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:55.945321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:55.946261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:55.946289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:55.946349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:55.946616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:55.946805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594596279996282:8672]
2025-10-10T14:07:55.948975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:55.953526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:55.953802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:55.955201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:55.955570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:55.955578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:55.955585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:55.955593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:55.955599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:55.955605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:55.955612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:55.955619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:55.955624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.955630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.955639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.955645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.955691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:55.955789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:55.955834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:55.955879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:55.955920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:55.955964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:55.956007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:55.956047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:55.956090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.956133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.956176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.956216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.956259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:55.956321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:55.956379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:55.956433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:55.956478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:55.956532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:55.956577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:55.956630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:55.956676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:55.956726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:55.956768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:55.956819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:55.956861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:55.956912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:55.956954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:55.957001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:55.957044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.957093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:55.958252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.958343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:55.958395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.958446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:55.958487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.958536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:55.958949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:56.069032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:56.111092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:56.111136Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:56.111150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:56.111169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:56.111193Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 700 [2:7559594596279996282:8672]
2025-10-10T14:07:56.111246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:56.111308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:56.111323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:56.111335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:56.111345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:56.111396Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:56.111420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:56.111443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:56.114330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:56.114356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:56.114367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:56.114381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:56.114391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:56.114684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:56.114701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:56.114831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:56.114989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:56.115191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:56.115296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:56.115374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.115391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.115403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.115416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.115465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:56.115545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:56.115706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:56.115723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:56.115875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.115894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:56.116337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:56.116349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:56.116359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:56.116369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:56.116391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:56.121897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594597857918306:9709], now have 1 active actors on pipe
2025-10-10T14:07:56.121928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594597857918209:8635], now have 1 active actors on pipe
2025-10-10T14:07:56.121946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594597857918126:2442], now have 1 active actors on pipe
2025-10-10T14:07:56.125467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 700
2025-10-10T14:07:56.125558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 700, pipe: [1:7559594597857918209:8635]
2025-10-10T14:07:56.125635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 700
2025-10-10T14:07:56.126019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:56.126060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:56.126162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:56.126197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:56.126217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:56.126228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:56.126265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:56.126312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:56.126387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:56.127933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:56.127973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:56.128052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:56.129824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69a2ea31-f382d5a0-55af1017-125367db_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:56.128944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 701 partition: 0 MaxSeqNo: 36 sessionId: src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0
2025-10-10T14:07:56.159474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0] Write session: try to update token
2025-10-10T14:07:56.159532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:56.211377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:56.211412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:56.211426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:07:56.274819334  107740 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:07:56.287306Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:07:56.389443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId: src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:56.397911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:56.397945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:56.397957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:56.398059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:56.398073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:56.398086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:56.398097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:56.398109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:56.398143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.398171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.398196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.398220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.398897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:56.398931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:56.398963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:56.398995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:56.447250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:56.455422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:56.455466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:56.455477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:56.456476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:56.601398Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:56.603230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:56.603254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:56.603302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594596279996277:8672]
2025-10-10T14:07:56.603454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:56.603480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:56.603818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:56.604577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:56.606327Z :ERROR: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:07:56.607053Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:07:56.607108Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:07:56.607160Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Reconnecting session to cluster  in 0.007985s
2025-10-10T14:07:56.604582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:56.604608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:56.604653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594597857918209:8635]
2025-10-10T14:07:56.605308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:56.605459Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:07:56.605928Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 7 consumer shared/user session shared/user_1_7_7318788858938900782_v1 is DEAD
2025-10-10T14:07:56.606645Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559594249965540894:8632] disconnected; active server actors: 1
2025-10-10T14:07:56.606680Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559594249965540894:8632] client user disconnected session shared/user_1_7_7318788858938900782_v1
2025-10-10T14:07:56.622003Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Successfully connected. Initializing session
2025-10-10T14:07:56.622374Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:07:56.622398Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 8
2025-10-10T14:07:56.623719Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 8 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:07:56.624004Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 read init: from# ipv6:[::1]:40068, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:07:56.624517Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 auth for : user
2025-10-10T14:07:56.629613Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 Handle describe topics response
2025-10-10T14:07:56.629763Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 auth is DEAD
2025-10-10T14:07:56.629837Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:07:56.631011Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:07:56.631788Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got InitResponse. ReadSessionId: shared/user_1_8_1343463284912049680_v1
2025-10-10T14:07:56.632446Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559594602152885765:9719] connected; active server actors: 1
2025-10-10T14:07:56.632560Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559594602152885765:9719] session shared/user_1_8_1343463284912049680_v1
2025-10-10T14:07:56.632666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:07:56.632820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:07:56.632894Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_8_1343463284912049680_v1" (Sender=[1:7559594602152885761:9719], Pipe=[1:7559594602152885765:9719], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:07:56.632930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:07:56.633004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:07:56.633064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_8_1343463284912049680_v1" (Sender=[1:7559594602152885761:9719], Pipe=[1:7559594602152885765:9719], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:07:56.633122Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_8_1343463284912049680_v1" sender [1:7559594602152885761:9719] lock partition 0 for ReadingSession "shared/user_1_8_1343463284912049680_v1" (Sender=[1:7559594602152885761:9719], Pipe=[1:7559594602152885765:9719], Partitions=[], ActiveFamilyCount=1) generation 1 step 8
2025-10-10T14:07:56.633186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:07:56.633221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000187s
2025-10-10T14:07:56.634121Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 8 Session: "shared/user_1_8_1343463284912049680_v1" ClientId: "user" PipeClient { RawX1: 7559594602152885765 RawX2: 4503603922347511 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:07:56.634234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:07:56.641981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 701 reason: error at write: Disconnected sessionId: src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0
2025-10-10T14:07:56.642299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 701 sessionId: src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0 is DEAD
2025-10-10T14:07:56.645886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:56.645968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0] Write session will restart in 0.007823s
2025-10-10T14:07:56.646147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0] Write session: Do CDS request
2025-10-10T14:07:56.646207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:56.661678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:56.661611Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:56.661642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 702
2025-10-10T14:07:56.662222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:56.662373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:56.662390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:56.662400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:56.667026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 702 sessionId:  describe result for acl check
2025-10-10T14:07:56.667159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:56.667176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:56.667187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:56.667204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594602152885780:9723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:56.669313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594602152885780:9723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:56.675060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594602152885780:9723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:56.694374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594602152885780:9723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:56.694417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594602152885780:9723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:56.694437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594602152885780:9723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:56.694470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:56.741643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:56.748069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:56.748879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:56.748910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:56.748947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:56.749219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:56.749388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594600574963880:8677]
2025-10-10T14:07:56.751578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:56.753372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:56.753632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:56.755092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:56.755508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:56.755526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:56.755534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:56.755542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:56.755550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:56.755558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:56.755565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:56.755573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:56.755581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:56.755589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:56.755598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:56.755607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:56.755657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:56.755773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:56.755829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:56.755891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:56.755942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:56.755995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:56.756044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:56.756091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:56.756142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:56.756193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:56.756244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:56.756294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:56.756341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:56.756411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:56.756474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:56.756534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:56.756587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:56.756642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:56.756691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:56.756748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:56.756797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:56.756855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:56.756905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:56.756962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:56.757011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:56.757066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:56.757113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:56.757724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:56.757796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:56.757854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:56.757911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:56.757974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:56.758032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:56.758095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:56.758164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:56.758228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:56.758723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:56.796197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:56.815711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:56.815746Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:56.815757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:56.815771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:56.815788Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 701 [2:7559594600574963880:8677]
2025-10-10T14:07:56.815826Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:56.815869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:56.815880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:56.815890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:56.815898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:56.815930Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:56.815951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:56.815972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:56.818343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:56.818366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:56.818380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:56.818394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:56.818405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:56.818641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:56.818664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:56.818792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:56.818955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:56.819153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:56.819255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:56.819316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:56.819329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:56.819340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:56.819352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:56.819390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:56.819461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:56.819625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:56.819640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:56.819754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:56.819773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:56.821215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:56.821243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:56.821256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:56.821269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:56.821298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:56.821506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594602152885867:9723], now have 1 active actors on pipe
2025-10-10T14:07:56.821549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594602152885755:2442], now have 1 active actors on pipe
2025-10-10T14:07:56.821688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594602152885768:9722], now have 1 active actors on pipe
2025-10-10T14:07:56.823107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 701, pipe: [1:7559594602152885768:9722]
2025-10-10T14:07:56.823186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 701
2025-10-10T14:07:56.823202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 701
2025-10-10T14:07:56.823521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:56.823556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:56.823591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_8_1343463284912049680_v1 on pipe: [1:7559594602152885768:9722]
2025-10-10T14:07:56.823646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:56.823660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:56.823721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:56.823743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:56.823754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:56.823827Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_8_1343463284912049680_v1
2025-10-10T14:07:56.823841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:56.823993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7766759-c6eed5a7-47919372-458d4cd8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:56.824019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:07:56.824046Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:07:56.824484Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_8_1343463284912049680_v1:1 with generation 701
2025-10-10T14:07:56.837487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:07:56.837571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:07:56.837598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:56.837622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:56.837635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:56.837674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:56.837719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:56.837748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:07:56.837786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:07:56.837834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:56.841418Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1760104766000 SizeLag: 18742722 WriteTimestampEstimateMS: 1760105276816 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:07:56.841479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-10T14:07:56.841566Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 sending to client partition status
2025-10-10T14:07:56.842043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:56.842085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:56.842167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:56.845621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|132050a1-5be8cbe-21361f20-8ebe28f0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7766759-c6eed5a7-47919372-458d4cd8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:56.844823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 702 partition: 0 MaxSeqNo: 36 sessionId: src_id|7766759-c6eed5a7-47919372-458d4cd8_0
2025-10-10T14:07:56.878630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7766759-c6eed5a7-47919372-458d4cd8_0] Write session: try to update token
2025-10-10T14:07:56.878683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7766759-c6eed5a7-47919372-458d4cd8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:56.955033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:56.955065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:56.955095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:56.955200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:56.955217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:56.955229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:56.955240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:56.955355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:07:56.957572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:07:56.964731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:56.965859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:56.966877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:07:56.975264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:07:57.026982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId: src_id|7766759-c6eed5a7-47919372-458d4cd8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:57.025343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:07:57.025499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:57.025514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:57.025526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:57.025537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:57.025547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:57.025585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:57.025611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:57.025635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:57.025657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594600574963873:8677]
2025-10-10T14:07:57.025794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:57.025819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:57.025830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:57.026851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:57.027446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:57.027478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:57.027509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:57.027535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:57.069484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:57.192953Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:57.200697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:57.200740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:57.202141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_8_1343463284912049680_v1
2025-10-10T14:07:57.202174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:57.203868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594602152885768:9722]
2025-10-10T14:07:57.204019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:57.207187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:57.205509Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_8_1343463284912049680_v1
2025-10-10T14:07:57.264027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7766759-c6eed5a7-47919372-458d4cd8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:07:57.264103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7766759-c6eed5a7-47919372-458d4cd8_0] Write session will restart in 0.005009s
2025-10-10T14:07:57.264285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7766759-c6eed5a7-47919372-458d4cd8_0] Write session: Do CDS request
2025-10-10T14:07:57.264343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7766759-c6eed5a7-47919372-458d4cd8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:57.263277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 702 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7766759-c6eed5a7-47919372-458d4cd8_0
2025-10-10T14:07:57.263579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 702 sessionId: src_id|7766759-c6eed5a7-47919372-458d4cd8_0 is DEAD
2025-10-10T14:07:57.276645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7766759-c6eed5a7-47919372-458d4cd8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:57.276197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:57.276235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 703
2025-10-10T14:07:57.277272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:57.277427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:57.277443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:57.277455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:57.282990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 703 sessionId:  describe result for acl check
2025-10-10T14:07:57.283137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:57.283149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:57.283159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:57.283178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594606447853376:9730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:57.288249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594606447853376:9730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:57.299374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594606447853376:9730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:57.304646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594606447853470:9722]
2025-10-10T14:07:57.314426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594606447853376:9730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:57.314465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594606447853376:9730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:57.314482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594606447853376:9730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:57.314514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:57.391211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:57.410650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:57.411553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:57.411584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:57.411632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:57.411907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:57.412095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594604869931486:8686]
2025-10-10T14:07:57.414271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:57.415455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:57.415680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:57.416904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:57.417250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:57.417258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:57.417265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:57.417271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:57.417278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:57.417285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:57.417319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:57.417333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:57.417341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:57.417348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:57.417354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:57.417361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:57.417411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:57.417525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:57.417572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:57.417616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:57.417659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:57.417704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:57.417746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:57.417803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:57.417848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:57.417894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:57.417941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:57.418017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:57.418071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:57.418138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:57.418198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:57.418247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:57.418312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:57.418365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:57.418411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:57.418463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:57.418516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:57.418568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:57.418615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:57.418666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:57.418714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:57.418772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:57.418820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:57.418873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:57.418951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:57.419022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:57.419068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:57.419124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:57.419178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:57.419230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:57.419276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:57.419328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:57.420521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:57.589393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:57.627690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:57.627740Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:57.627756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:57.627776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:57.627800Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 702 [2:7559594604869931486:8686]
2025-10-10T14:07:57.627859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:57.627926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:57.627943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:57.627953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:57.627964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:57.628017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:57.628039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:57.628061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:57.630822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:57.630845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:57.630860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:57.630873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:57.630884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:57.631173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:57.631190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:57.631334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:57.631515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:57.631731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:57.631838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:57.631909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:57.631925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:57.631936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:57.631950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:57.631992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:57.632071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:57.632238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:57.632255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:57.632380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:57.632400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:57.633486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 702
2025-10-10T14:07:57.636092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 702
2025-10-10T14:07:57.636172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 702, pipe: [1:7559594606447853470:9722]
2025-10-10T14:07:57.633246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:57.633264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:57.633276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:57.633287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:57.633313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:57.646103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594606447853525:9730], now have 1 active actors on pipe
2025-10-10T14:07:57.646199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:57.646224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:57.646267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594606447853350:2442], now have 1 active actors on pipe
2025-10-10T14:07:57.646304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594606447853470:9722], now have 1 active actors on pipe
2025-10-10T14:07:57.646391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:57.646431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:57.646452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:57.646464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:57.646506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:57.646558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:57.646611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:57.655051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7766759-c6eed5a7-47919372-458d4cd8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:57.653454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:57.653494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:57.653579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:57.654269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 703 partition: 0 MaxSeqNo: 36 sessionId: src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0
2025-10-10T14:07:57.701523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0] Write session: try to update token
2025-10-10T14:07:57.701582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:57.726933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:57.726961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:57.726970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:57.839651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:57.839683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:57.839695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:57.839706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:57.839715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:57.839750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:57.839778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:57.839799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:57.839818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:57.841323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:57.841361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:57.841385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:57.841407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:57.849329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:57.849359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:57.849369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:57.886048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:57.886105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:57.886224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:57.893849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:57.932671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId: src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:57.956141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:58.120866Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:58.122864Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:58.122894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:58.122942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594604869931481:8686]
2025-10-10T14:07:58.123090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:58.123105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:58.123130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:58.123896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:58.125758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594606447853470:9722]
2025-10-10T14:07:58.125918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:58.129886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:58.179885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 703 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0
2025-10-10T14:07:58.185365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:07:58.180267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 703 sessionId: src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0 is DEAD
2025-10-10T14:07:58.185416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0] Write session will restart in 0.009871s
2025-10-10T14:07:58.185541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0] Write session: Do CDS request
2025-10-10T14:07:58.185601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:58.202365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:58.202221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:58.202254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 704
2025-10-10T14:07:58.202914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:58.203047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:58.203065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:58.203077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:58.204665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 704 sessionId:  describe result for acl check
2025-10-10T14:07:58.204797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:58.204810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:58.204819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:58.204837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594610742820996:9746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:58.207956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594610742820996:9746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:58.229717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594610742821024:9722]
2025-10-10T14:07:58.232376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594610742820996:9746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:58.278548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594610742820996:9746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:58.278596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594610742820996:9746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:58.278614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594610742820996:9746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:58.278648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:58.376322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:58.382346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:58.383335Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:58.383355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:58.383402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:58.383719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:58.383928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594609164899096:8697]
2025-10-10T14:07:58.390514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:58.397539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:58.397876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:58.399348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:58.399726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:58.399734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:58.399741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:58.399748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:58.399756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:58.399762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:58.399769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:58.399776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:58.399782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:58.399788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:58.399795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:58.399801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:58.399849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:58.399958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:58.400004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:58.400051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:58.400098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:58.400148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:58.400192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:58.400235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:58.400278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:58.400321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:58.400366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:58.400406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:58.400448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:58.400510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:58.400567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:58.400616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:58.400666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:58.400717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:58.400760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:58.400812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:58.400858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:58.400912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:58.400958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:58.401011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:58.401054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:58.401102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:58.413271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:58.413384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:58.413449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:58.413506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:58.413557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:58.413614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:58.413663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:58.413718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:58.413766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:58.413822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:58.414286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:58.470510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:58.556222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:58.556269Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:58.556285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:58.556305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:58.556327Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 703 [2:7559594609164899096:8697]
2025-10-10T14:07:58.556382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:58.556449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:58.556465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:58.556477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:58.556487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:58.556533Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:58.556554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:58.556576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:58.566645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:58.566673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:58.566689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:58.566702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:58.566713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:58.566985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:58.567003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:58.567146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:58.567314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:58.567533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:58.567643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:58.567717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.567732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.567744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.567757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.567789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:58.567866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:58.568034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:58.568050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:58.568218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.568238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:58.574641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 703, pipe: [1:7559594610742821024:9722]
2025-10-10T14:07:58.574749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 703
2025-10-10T14:07:58.574817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 703
2025-10-10T14:07:58.573211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:58.573232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:58.573243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:58.573254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:58.573284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:58.574707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594610742821024:9722], now have 1 active actors on pipe
2025-10-10T14:07:58.574739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594610742821072:9746], now have 1 active actors on pipe
2025-10-10T14:07:58.574758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594610742820984:2442], now have 1 active actors on pipe
2025-10-10T14:07:58.578484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:58.578538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:58.578658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:58.578695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:58.578713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:58.578722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:58.578760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:58.578807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:58.578855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:58.579843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:58.579872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:58.579936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:58.581078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 704 partition: 0 MaxSeqNo: 36 sessionId: src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0
2025-10-10T14:07:58.589419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf07c6e1-170d71e8-86c64f1c-893ea3a5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:58.656857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0] Write session: try to update token
2025-10-10T14:07:58.656918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:58.656999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:58.657033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:58.657044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:58.776367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:58.776412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:58.776435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:58.776448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:58.776459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:58.776493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.776517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.776537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.776557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.776694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:58.776732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:58.776772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:58.776776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:58.776790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:58.776800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:58.776804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:58.776841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:58.776865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:58.776875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:58.779261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:58.844387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId: src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:58.874336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:58.923211Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:58.943224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:58.943261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:58.943317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:58.943326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:58.943368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594609164899091:8697]
2025-10-10T14:07:58.943680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:58.944404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:58.947521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594610742821024:9722]
2025-10-10T14:07:58.947719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:07:58.947909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:58.957794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 704 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0
2025-10-10T14:07:58.958191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 704 sessionId: src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0 is DEAD
2025-10-10T14:07:58.959230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:07:58.959320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0] Write session will restart in 0.006884s
2025-10-10T14:07:58.959693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0] Write session: Do CDS request
2025-10-10T14:07:58.959805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:58.972954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:58.980440Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:58.980469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 705
2025-10-10T14:07:58.985325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:58.985578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:58.985595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:58.985609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:58.987121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 705 sessionId:  describe result for acl check
2025-10-10T14:07:58.987239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:58.987251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:58.987261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:58.987276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594610742821310:9755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:58.990212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594610742821310:9755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:59.011838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594610742821310:9755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:59.032388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594610742821310:9755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:59.032427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594610742821310:9755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:59.032445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594610742821310:9755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:59.032478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:59.049545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594615037788717:9722]
2025-10-10T14:07:59.169266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:59.182854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:59.183704Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:59.183722Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:59.183769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:59.184032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:59.184215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594613459866702:8712]
2025-10-10T14:07:59.186692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:59.192432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:59.192715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:59.194078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:59.194476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:59.194498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:59.194505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:59.194511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:59.194518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:59.194525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:59.194532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:59.194539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:59.194546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.194552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.194560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.194566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.194616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:59.194723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:59.194774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:59.194821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:59.194869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:59.194915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:59.194962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:59.195010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:59.195059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.195109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.195153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.195199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.195245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:59.195314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:59.195374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:59.195433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:59.195485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:59.195539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:59.195586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:59.195643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:59.195732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:59.195795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:59.195845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:59.195898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:59.195944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:59.195995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:59.196040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:59.196091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:59.196143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.196194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.196242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.196296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.196343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.196401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.196447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.196500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.196941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:07:59.230693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:07:59.302272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:07:59.302319Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:07:59.302336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:07:59.302354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:07:59.302377Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 704 [2:7559594613459866702:8712]
2025-10-10T14:07:59.302434Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:07:59.302493Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:07:59.302507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:59.302520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:59.302531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:59.302580Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:07:59.302602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:07:59.302625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:07:59.305664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.305690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.305704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.305719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.305730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:07:59.306030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:07:59.306048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.306195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.306411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.306644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.306771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:07:59.306850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.306866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.306880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.306893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.306940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:07:59.307028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:07:59.307216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:07:59.307235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:07:59.307368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.307390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:07:59.308481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:07:59.308501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:07:59.308512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:07:59.308526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:07:59.308551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:07:59.313431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 704
2025-10-10T14:07:59.313550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 704
2025-10-10T14:07:59.313626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 704, pipe: [1:7559594615037788717:9722]
2025-10-10T14:07:59.317074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594610742821294:2442], now have 1 active actors on pipe
2025-10-10T14:07:59.317121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594615037788717:9722], now have 1 active actors on pipe
2025-10-10T14:07:59.317164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594615037788688:9755], now have 1 active actors on pipe
2025-10-10T14:07:59.317219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:59.317244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:59.317336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d24b330-7b43a419-98c19297-12e7f264_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:07:59.317368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:59.317387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:59.317400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:07:59.317434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:59.317478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:07:59.317529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:59.318443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:59.318470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:59.318536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:07:59.319844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b995f157-5d0ad098-6986f51f-670e0bc7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d24b330-7b43a419-98c19297-12e7f264_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:07:59.318947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 705 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d24b330-7b43a419-98c19297-12e7f264_0
2025-10-10T14:07:59.374704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d24b330-7b43a419-98c19297-12e7f264_0] Write session: try to update token
2025-10-10T14:07:59.374766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d24b330-7b43a419-98c19297-12e7f264_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:07:59.501957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:07:59.501991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:07:59.502003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:07:59.502062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:07:59.502078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:59.502094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:07:59.502108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:07:59.502121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:07:59.502159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.502190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.502217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.502240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.502478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:07:59.502506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.502527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:07:59.503098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:07:59.503132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:07:59.503164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:07:59.503194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:07:59.509950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:07:59.567940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId: src_id|2d24b330-7b43a419-98c19297-12e7f264_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:07:59.592320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:07:59.663670Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:07:59.676775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:07:59.676824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:07:59.676899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:07:59.676915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:07:59.676961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594613459866696:8712]
2025-10-10T14:07:59.677462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:07:59.678354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:07:59.678101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:07:59.678108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594615037788717:9722]
2025-10-10T14:07:59.678128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:07:59.678177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:07:59.708623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 705 reason: error at write: Disconnected sessionId: src_id|2d24b330-7b43a419-98c19297-12e7f264_0
2025-10-10T14:07:59.708937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 705 sessionId: src_id|2d24b330-7b43a419-98c19297-12e7f264_0 is DEAD
2025-10-10T14:07:59.714782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d24b330-7b43a419-98c19297-12e7f264_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:07:59.714822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d24b330-7b43a419-98c19297-12e7f264_0] Write session will restart in 0.007728s
2025-10-10T14:07:59.714922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d24b330-7b43a419-98c19297-12e7f264_0] Write session: Do CDS request
2025-10-10T14:07:59.714953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d24b330-7b43a419-98c19297-12e7f264_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:07:59.730783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d24b330-7b43a419-98c19297-12e7f264_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:59.730411Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:07:59.730446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 706
2025-10-10T14:07:59.731665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:07:59.731804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:07:59.731821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:07:59.731831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:07:59.733380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 706 sessionId:  describe result for acl check
2025-10-10T14:07:59.733514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:07:59.733526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:07:59.733536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:07:59.733554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594615037788934:9768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:07:59.736339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594615037788934:9768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:07:59.745644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594615037788934:9768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:07:59.767178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594615037788934:9768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:07:59.767220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594615037788934:9768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:07:59.767238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594615037788934:9768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:07:59.767272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:07:59.780811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594615037788983:9722]
2025-10-10T14:07:59.934360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:07:59.941404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:07:59.942353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:07:59.942371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:07:59.942419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:07:59.942672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:07:59.942842Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594613459867018:8717]
2025-10-10T14:07:59.944880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:07:59.946275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:07:59.946506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:07:59.947960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:07:59.948251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:59.948259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:59.948265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:59.948272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:59.948277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:59.948283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:59.948289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:59.948296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:59.948302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.948309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.948315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.948320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.948363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:59.948466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:59.948512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:59.948556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:59.948598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:59.948640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:59.948679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:59.948724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:59.948767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.948808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.948847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.948885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.948920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:59.948975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:07:59.949029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:59.949078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:07:59.949120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:59.949188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:07:59.949225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:59.949270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:07:59.949315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:59.949363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:07:59.949403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:59.949449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:07:59.949490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:59.949536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:07:59.949576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:59.949624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:07:59.949668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.949715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:07:59.949753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.949799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:07:59.949840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.949888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:07:59.949929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.949978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:07:59.950391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:00.002579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:00.027682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:00.027836Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:00.027856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:00.027876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:00.027897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 705 [2:7559594613459867018:8717]
2025-10-10T14:08:00.027952Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:00.028010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:00.028022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:00.028034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:00.028044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:00.028091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:00.028113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:00.028134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:00.074679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:00.074714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:00.074725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:00.074738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:00.074750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:00.075049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:00.075065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:00.075200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:00.075385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:00.075608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:00.075723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:00.075801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594613459867012:8717]
2025-10-10T14:08:00.075819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594613459867012:8717]
2025-10-10T14:08:00.075832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594613459867012:8717]
2025-10-10T14:08:00.075846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594613459867012:8717]
2025-10-10T14:08:00.075995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:00.076006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:00.076017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:00.076027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:00.079879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:00.080008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:00.080195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:00.082215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:00.082302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594615037788983:9722], now have 1 active actors on pipe
2025-10-10T14:08:00.082328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594615037788972:9768], now have 1 active actors on pipe
2025-10-10T14:08:00.082349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594615037788920:2442], now have 1 active actors on pipe
2025-10-10T14:08:00.082499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:00.082521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:00.082575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594613459867012:8717]
2025-10-10T14:08:00.082611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:00.082735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fab5f820-127342e4-9a587826-c8140051_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:00.082767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:00.082787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:00.082797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:00.082834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:00.082877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:00.082960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:00.084149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:00.086289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:00.086334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:00.086411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:00.081385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 705, pipe: [1:7559594615037788983:9722]
2025-10-10T14:08:00.081498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 705
2025-10-10T14:08:00.081563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 705
2025-10-10T14:08:00.086791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 706 partition: 0 MaxSeqNo: 36 sessionId: src_id|fab5f820-127342e4-9a587826-c8140051_0
2025-10-10T14:08:00.087666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d24b330-7b43a419-98c19297-12e7f264_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fab5f820-127342e4-9a587826-c8140051_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:00.127875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:00.127905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:00.127916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:00.142551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fab5f820-127342e4-9a587826-c8140051_0] Write session: try to update token
2025-10-10T14:08:00.142614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fab5f820-127342e4-9a587826-c8140051_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:00.243163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:00.243197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:00.243208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:00.243265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:00.243279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:00.243291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:00.243302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:00.243314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:00.243350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594613459867012:8717]
2025-10-10T14:08:00.243376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594613459867012:8717]
2025-10-10T14:08:00.243397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594613459867012:8717]
2025-10-10T14:08:00.243418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594613459867012:8717]
2025-10-10T14:08:00.243559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:00.243585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:00.243596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:00.243901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:00.243929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:00.243953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:00.243976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:00.250533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:00.409786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId: src_id|fab5f820-127342e4-9a587826-c8140051_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:00.433057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:00.605476Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:00.608323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:00.608369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:00.611256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594615037788983:9722]
2025-10-10T14:08:00.611370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:00.611385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:00.616503Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:00.642526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 706 reason: error at write: Disconnected sessionId: src_id|fab5f820-127342e4-9a587826-c8140051_0
2025-10-10T14:08:00.642866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 706 sessionId: src_id|fab5f820-127342e4-9a587826-c8140051_0 is DEAD
2025-10-10T14:08:00.645577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab5f820-127342e4-9a587826-c8140051_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:00.645626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab5f820-127342e4-9a587826-c8140051_0] Write session will restart in 0.007070s
2025-10-10T14:08:00.645732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab5f820-127342e4-9a587826-c8140051_0] Write session: Do CDS request
2025-10-10T14:08:00.645765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab5f820-127342e4-9a587826-c8140051_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:00.658481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:00.660144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fab5f820-127342e4-9a587826-c8140051_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:00.660154Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:00.660179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 707
2025-10-10T14:08:00.661504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:00.661652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:00.661671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:00.661682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:00.664242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 707 sessionId:  describe result for acl check
2025-10-10T14:08:00.664363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:00.664373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:00.664383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:00.664399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594619332756566:9781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:00.667348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594619332756566:9781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:00.676458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594619332756566:9781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:00.698320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594619332756566:9781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:00.698365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594619332756566:9781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:00.698384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594619332756566:9781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:00.698419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:00.711606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594619332756738:9722]
2025-10-10T14:08:00.746425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:00.751324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:00.752282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:00.752316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:00.752371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:00.752664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:00.752877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594617754834617:8732]
2025-10-10T14:08:00.754661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:00.755659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:00.755909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:00.757330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:00.757683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:00.757701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:00.757707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:00.757714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:00.757721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:00.757728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:00.757736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:00.757743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:00.757750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:00.757757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:00.757764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:00.757771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:00.758087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:00.758215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:00.758284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:00.758338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:00.758387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:00.758439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:00.758486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:00.758535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:00.758603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:00.758654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:00.758700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:00.758748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:00.758791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:00.758863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:00.758930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:00.758988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:00.759041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:00.759099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:00.759149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:00.759206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:00.759260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:00.759316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:00.759364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:00.759424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:00.759471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:00.759529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:00.759576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:00.759628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:00.759677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:00.759738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:00.759789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:00.759846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:00.759900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:00.759956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:00.760005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:00.760053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:00.760397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:00.811827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:00.825266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:00.825349Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:00.825371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:00.825392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:00.825419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 706 [2:7559594617754834617:8732]
2025-10-10T14:08:00.825480Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:00.825542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:00.825558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:00.825572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:00.825584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:00.825636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:00.825659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:00.825683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:00.863801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:00.863834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:00.863850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:00.863865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:00.863878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:00.864158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:00.864177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:00.864332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:00.864542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:00.864796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:00.864923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:00.865023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594619332756555:2442], now have 1 active actors on pipe
2025-10-10T14:08:00.865060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594619332756738:9722], now have 1 active actors on pipe
2025-10-10T14:08:00.865092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594619332756673:9781], now have 1 active actors on pipe
2025-10-10T14:08:00.865139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:00.865156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:00.865170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:00.865183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:00.865215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:00.865298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:00.865305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:00.865320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:00.865331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:00.865344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:00.865548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:00.865573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:00.865637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:00.865665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:00.865812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:00.865849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:00.865921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|509efc9d-c9928ae3-7452336-ce7cf721_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:00.865960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:00.865978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:00.865990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:00.866025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:00.866065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:00.866243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:00.866663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:00.867142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:00.865025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 706
2025-10-10T14:08:00.865159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 706
2025-10-10T14:08:00.865234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 706, pipe: [1:7559594619332756738:9722]
2025-10-10T14:08:00.867177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:00.867255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:00.867614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 707 partition: 0 MaxSeqNo: 36 sessionId: src_id|509efc9d-c9928ae3-7452336-ce7cf721_0
2025-10-10T14:08:00.868361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fab5f820-127342e4-9a587826-c8140051_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|509efc9d-c9928ae3-7452336-ce7cf721_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:00.912629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|509efc9d-c9928ae3-7452336-ce7cf721_0] Write session: try to update token
2025-10-10T14:08:00.912690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|509efc9d-c9928ae3-7452336-ce7cf721_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:00.932581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:00.932617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:00.932630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:00.932687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:00.932702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:00.932739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:00.932867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:00.932868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:00.937246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:00.938592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:00.939905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:00.941556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:00.956850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:00.957448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:01.063669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:01.063707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:01.063722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:01.063778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:01.063797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:01.063810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:01.063822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:01.063833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:01.063879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:01.063908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:01.063933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:01.063958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594617754834612:8732]
2025-10-10T14:08:01.064094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:01.064106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:01.064130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:01.064135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:01.064147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:01.064162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:01.064201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:01.065447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:01.077185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId: src_id|509efc9d-c9928ae3-7452336-ce7cf721_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:01.121390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:01.248128Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:01.250982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:01.251029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:01.258265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:01.261337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:01.261663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594619332756738:9722]
2025-10-10T14:08:01.261812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:01.317746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 707 reason: status is not ok: tablet will be restarted right now sessionId: src_id|509efc9d-c9928ae3-7452336-ce7cf721_0
2025-10-10T14:08:01.318081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 707 sessionId: src_id|509efc9d-c9928ae3-7452336-ce7cf721_0 is DEAD
2025-10-10T14:08:01.319436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509efc9d-c9928ae3-7452336-ce7cf721_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:01.319509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509efc9d-c9928ae3-7452336-ce7cf721_0] Write session will restart in 0.005390s
2025-10-10T14:08:01.319678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509efc9d-c9928ae3-7452336-ce7cf721_0] Write session: Do CDS request
2025-10-10T14:08:01.319727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509efc9d-c9928ae3-7452336-ce7cf721_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:01.331755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:01.331784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 708
2025-10-10T14:08:01.332461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|509efc9d-c9928ae3-7452336-ce7cf721_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:01.334654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:01.334926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:01.334959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:01.334972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:01.336475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 708 sessionId:  describe result for acl check
2025-10-10T14:08:01.336585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:01.336597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:01.336606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:01.336624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594623627724178:9789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:01.340262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594623627724178:9789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:01.359749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594623627724178:9789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:01.361511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594623627724237:9722]
2025-10-10T14:08:01.381397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594623627724178:9789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:01.381441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594623627724178:9789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:01.381459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594623627724178:9789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:01.381491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:01.438702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:01.449542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:01.450637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:01.450662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:01.450714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:01.451058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:01.451300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594622049802215:8737]
2025-10-10T14:08:01.453985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:01.455519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:01.455827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:01.457154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:01.457503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:01.457512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:01.457519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:01.457527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:01.457535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:01.457543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:01.457550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:01.457558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:01.457564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:01.457572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:01.457579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:01.457587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:01.457634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:01.457749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:01.457800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:01.457850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:01.457896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:01.457944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:01.457990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:01.458040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:01.458087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:01.458135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:01.458181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:01.458241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:01.458288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:01.458355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:01.458415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:01.458473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:01.458524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:01.458579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:01.458626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:01.458682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:01.458731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:01.458789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:01.458838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:01.458893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:01.458939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:01.458992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:01.459037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:01.459090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:01.459142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:01.459198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:01.459241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:01.459299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:01.459347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:01.459402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:01.459445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:01.459497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:01.461470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:01.491969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:01.576406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:01.576457Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:01.576474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:01.576494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:01.576519Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 707 [2:7559594622049802215:8737]
2025-10-10T14:08:01.576577Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:01.576634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:01.576650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:01.576663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:01.576676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:01.576726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:01.576748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:01.576774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:01.581478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:01.581514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:01.581530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:01.581546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:01.581559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:01.581866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:01.581885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:01.582045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:01.582264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:01.582525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:01.582648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:01.582729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.582745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.582759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.582775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.582817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:01.582903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:01.583092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:01.583111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:01.583242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.583265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:01.583640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:01.583657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:01.583669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:01.583683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:01.583711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:01.583826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594623627724237:9722], now have 1 active actors on pipe
2025-10-10T14:08:01.583860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594623627724151:2442], now have 1 active actors on pipe
2025-10-10T14:08:01.584274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594623627724317:9789], now have 1 active actors on pipe
2025-10-10T14:08:01.584635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 707, pipe: [1:7559594623627724237:9722]
2025-10-10T14:08:01.584756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 707
2025-10-10T14:08:01.584842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 707
2025-10-10T14:08:01.587112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 708 partition: 0 MaxSeqNo: 36 sessionId: src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0
2025-10-10T14:08:01.585445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:01.585477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:01.585551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:01.585586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:01.585603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:01.585614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:01.585649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:01.585690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:01.585736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:01.586592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:01.586617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:01.586688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:01.590536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|509efc9d-c9928ae3-7452336-ce7cf721_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:01.663724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0] Write session: try to update token
2025-10-10T14:08:01.663788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:01.709288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:01.709326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:01.709361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.709488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:01.709498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:01.709507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:01.709572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:01.710632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:01.730256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:01.731587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:01.732912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:01.751709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:01.754489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:01.755022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:01.871650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:01.871678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:01.871690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:01.871755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:01.871769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:01.871781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:01.871790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:01.871800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:01.871842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.871867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.871888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.871910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594622049802210:8737]
2025-10-10T14:08:01.872041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:01.872065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:01.872075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:01.873044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:01.878021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:01.878057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:01.878093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:01.878114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:01.881261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId: src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:01.925692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:02.082241Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:02.096635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:02.096686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:02.098437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:02.098440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:02.098469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:02.105514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594623627724237:9722]
2025-10-10T14:08:02.105693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:02.121569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:02.121617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0] Write session will restart in 0.009459s
2025-10-10T14:08:02.121726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0] Write session: Do CDS request
2025-10-10T14:08:02.121756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:02.119886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 708 reason: error at write: Disconnected sessionId: src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0
2025-10-10T14:08:02.120246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 708 sessionId: src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0 is DEAD
2025-10-10T14:08:02.150252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:02.150945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:02.150977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 709
2025-10-10T14:08:02.151371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:02.151507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:02.151526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:02.151536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:02.153071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 709 sessionId:  describe result for acl check
2025-10-10T14:08:02.153231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:02.153243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:02.153255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:02.153278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594627922691793:9804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:02.162655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594627922691793:9804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:02.173511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594627922691793:9804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:02.200942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594627922691793:9804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:02.200986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594627922691793:9804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:02.201005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594627922691793:9804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:02.201040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:02.209278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594627922691851:9722]
2025-10-10T14:08:02.318904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:02.324126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:02.325055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:02.325088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:02.325147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:02.325450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:02.325656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594626344769841:8747]
2025-10-10T14:08:02.328067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:02.329210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:02.329452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:02.330862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:02.331220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:02.331231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:02.331238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:02.331246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:02.331255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:02.331262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:02.331269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:02.331277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:02.331286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:02.331293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:02.331301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:02.331309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:02.331364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:02.331498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:02.331556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:02.331605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:02.331666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:02.331726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:02.331778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:02.331831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:02.331887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:02.331941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:02.331996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:02.332051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:02.332102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:02.332183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:02.333145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:02.333228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:02.333286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:02.333348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:02.333403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:02.333467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:02.333523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:02.333583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:02.333643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:02.333707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:02.333766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:02.333825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:02.333887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:02.333969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:02.334023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:02.334081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:02.334133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:02.334209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:02.334265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:02.334328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:02.334381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:02.334443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:02.334955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:02.396764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:02.410379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:02.410429Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:02.410446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:02.410466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:02.410492Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 708 [2:7559594626344769841:8747]
2025-10-10T14:08:02.410552Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:02.410617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:02.410635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:02.410649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:02.410660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:02.410712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:02.410734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:02.410757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:02.412965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:02.412982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:02.412998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:02.413013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:02.413026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:02.414244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:02.414274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:02.414431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:02.414637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:02.414888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:02.415013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:02.415103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594627922691831:9804], now have 1 active actors on pipe
2025-10-10T14:08:02.415129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594627922691851:9722], now have 1 active actors on pipe
2025-10-10T14:08:02.415153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594627922691774:2442], now have 1 active actors on pipe
2025-10-10T14:08:02.415179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.415195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.415209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.415224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.415265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:02.415353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:02.415549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:02.415569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:02.415670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:02.415688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:02.415698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.415701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:02.415712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:02.415719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:02.415741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:02.417482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 708
2025-10-10T14:08:02.417567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 708, pipe: [1:7559594627922691851:9722]
2025-10-10T14:08:02.417641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 708
2025-10-10T14:08:02.418041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:02.418079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:02.418154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4c9cadf-430e0199-c4079347-456835d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:02.418189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:02.418228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:02.418240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:02.418290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:02.418332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:02.418394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:02.419064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:02.419085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:02.419147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:02.419449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 709 partition: 0 MaxSeqNo: 36 sessionId: src_id|e4c9cadf-430e0199-c4079347-456835d0_0
2025-10-10T14:08:02.420234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4441b43-4d8ff354-d2d7352d-9b238faf_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e4c9cadf-430e0199-c4079347-456835d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:02.462756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c9cadf-430e0199-c4079347-456835d0_0] Write session: try to update token
2025-10-10T14:08:02.462810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c9cadf-430e0199-c4079347-456835d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:02.484514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:02.484548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:02.484589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.484719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:02.485243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:02.493048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:02.494455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:02.495746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:02.596603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:02.620153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:02.620856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:02.620878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:02.620890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:02.620947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:02.671572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId: src_id|e4c9cadf-430e0199-c4079347-456835d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:02.719391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:02.719430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:02.719444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:02.719455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:02.719466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:02.719506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.719532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.719556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.719578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594626344769836:8747]
2025-10-10T14:08:02.719731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:02.719745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:02.719757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:02.719804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:02.719828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:02.719841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:02.720199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:02.720236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:02.720267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:02.720295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:02.720952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:02.739640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:02.950480Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:02.952509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:02.952547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:02.955615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:02.955644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:02.956919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594627922691851:9722]
2025-10-10T14:08:02.957074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:02.954772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:02.994480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 709 reason: error at write: Disconnected sessionId: src_id|e4c9cadf-430e0199-c4079347-456835d0_0
2025-10-10T14:08:02.994782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 709 sessionId: src_id|e4c9cadf-430e0199-c4079347-456835d0_0 is DEAD
2025-10-10T14:08:02.997611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c9cadf-430e0199-c4079347-456835d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:02.997646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c9cadf-430e0199-c4079347-456835d0_0] Write session will restart in 0.006173s
2025-10-10T14:08:02.997748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c9cadf-430e0199-c4079347-456835d0_0] Write session: Do CDS request
2025-10-10T14:08:02.997780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c9cadf-430e0199-c4079347-456835d0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:03.013407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:03.013439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 710
2025-10-10T14:08:03.014376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c9cadf-430e0199-c4079347-456835d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:03.015217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:03.015356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:03.015372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:03.015382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:03.018518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 710 sessionId:  describe result for acl check
2025-10-10T14:08:03.018662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:03.018673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:03.018684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:03.018704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594632217659420:9814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:03.021643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594632217659420:9814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:03.039082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594632217659420:9814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:03.058768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594632217659420:9814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:03.058809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594632217659420:9814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:03.058829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594632217659420:9814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:03.058864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:03.061205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594632217659478:9722]
2025-10-10T14:08:03.197437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:03.211167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:03.212052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:03.212070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:03.212111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:03.212368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:03.212537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594630639737456:8757]
2025-10-10T14:08:03.215443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:03.218903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:03.219154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:03.220460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:03.220808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:03.220817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:03.220825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:03.220832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:03.220840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:03.220846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:03.220853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:03.220860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:03.220868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.220876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.220884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.220891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.220940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:03.221049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:03.221097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:03.221168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:03.221216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:03.221264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:03.221310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:03.221356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:03.221420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.221468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.221513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.221559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.221599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:03.221669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:03.221730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:03.221788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:03.221837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:03.221893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:03.221942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:03.221996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:03.222044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:03.222097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:03.222144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:03.222214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:03.222263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:03.222318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:03.222363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:03.222414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:03.222463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.222513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.222560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.222619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.222667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.222721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.222766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.222822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.223267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:03.264707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:03.280178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:03.280223Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:03.280242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:03.280261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:03.280285Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 709 [2:7559594630639737456:8757]
2025-10-10T14:08:03.280343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:03.280398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:03.280413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:03.280426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:03.280437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:03.280487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:03.280509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:03.280533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:03.282678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.282709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.282724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.282739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.282751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:03.283032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:03.283060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.283209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.283405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.283668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.283794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:03.283885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594632217659478:9722], now have 1 active actors on pipe
2025-10-10T14:08:03.283912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594627922692109:2442], now have 1 active actors on pipe
2025-10-10T14:08:03.283937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594632217659472:9814], now have 1 active actors on pipe
2025-10-10T14:08:03.283964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.283982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.283996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.284011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.284061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:03.284115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:03.284143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:03.284148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:03.284155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:03.284167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:03.284343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:03.284360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:03.284494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.284535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:03.284575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:03.285313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 709, pipe: [1:7559594632217659478:9722]
2025-10-10T14:08:03.285437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 709
2025-10-10T14:08:03.285502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 709
2025-10-10T14:08:03.286224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:03.286262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:03.286352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:03.286383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:03.286401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:03.286413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:03.286447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:03.286484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:03.286531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:03.290693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:03.290753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:03.290840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:03.295287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4c9cadf-430e0199-c4079347-456835d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:03.293668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 710 partition: 0 MaxSeqNo: 36 sessionId: src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0
2025-10-10T14:08:03.334071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0] Write session: try to update token
2025-10-10T14:08:03.334134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:03.356049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:03.361457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:03.361524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.361700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:03.362262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:03.391204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:03.392419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:03.394238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:03.395612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:03.397381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:03.397864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:03.397891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:03.397902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:03.397962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:03.502822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:03.503664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:03.503686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:03.503696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:03.503706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:03.503745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.503768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.503789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.503819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594630639737442:8757]
2025-10-10T14:08:03.504167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:03.504182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:03.504192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:03.504238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:03.504264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.504274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:03.505012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:03.505041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:03.505067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:03.505091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:03.505760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:03.537801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId: src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:03.566320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:03.683583Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:03.686921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:03.686958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:03.690733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594632217659478:9722]
2025-10-10T14:08:03.690812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:03.690921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:03.690932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:03.695747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:03.728276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 710 reason: error at write: Disconnected sessionId: src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0
2025-10-10T14:08:03.728614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 710 sessionId: src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0 is DEAD
2025-10-10T14:08:03.734049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:03.734152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0] Write session will restart in 0.009735s
2025-10-10T14:08:03.734455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0] Write session: Do CDS request
2025-10-10T14:08:03.734528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:03.754281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:03.754306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 711
2025-10-10T14:08:03.757872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:03.765267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:03.765414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:03.765430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:03.765439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:03.767000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 711 sessionId:  describe result for acl check
2025-10-10T14:08:03.767114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:03.767124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:03.767132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:03.767151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594632217659732:9822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:03.769774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594632217659732:9822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:03.788599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594632217659751:9722]
2025-10-10T14:08:03.806433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594632217659732:9822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:03.833561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594632217659732:9822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:03.833601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594632217659732:9822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:03.833617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594632217659732:9822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:03.833646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:03.934916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:03.939069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:03.940011Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:03.940029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:03.940075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:03.940331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:03.940512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594630639737762:8767]
2025-10-10T14:08:03.942614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:03.944401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:03.944619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:03.945878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:03.946186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:03.946194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:03.946201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:03.946208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:03.946214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:03.946220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:03.946226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:03.946233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:03.946239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.946245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.946254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.946278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.946322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:03.946423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:03.946467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:03.946511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:03.946556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:03.946598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:03.946638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:03.946678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:03.946720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.946762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.946803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.946843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.946880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:03.946940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:03.946993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:03.947046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:03.947091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:03.947141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:03.947181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:03.947229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:03.947273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:03.947321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:03.947365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:03.947413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:03.947457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:03.947507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:03.947547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:03.947596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:03.947642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.947692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:03.947732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.947779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:03.947821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.947869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:03.947908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.947957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:03.948366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:04.024694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:04.048645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:04.048696Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:04.048712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:04.048729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:04.048752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 710 [2:7559594630639737762:8767]
2025-10-10T14:08:04.048803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:04.048856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:04.048870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:04.048881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:04.048892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:04.048939Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:04.048960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:04.048981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:04.050551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.050577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:04.050590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:04.050603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:04.050614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:04.050891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:04.050908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.051039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:04.051212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:04.051427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:04.051534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:04.051612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594630639737757:8767]
2025-10-10T14:08:04.051628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594630639737757:8767]
2025-10-10T14:08:04.051642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594630639737757:8767]
2025-10-10T14:08:04.051655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594630639737757:8767]
2025-10-10T14:08:04.051700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:04.051782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:04.051951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:04.051969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:04.052111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594630639737757:8767]
2025-10-10T14:08:04.052131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:04.052480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:04.052492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:04.052503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:04.052515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:04.052538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:04.056248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 710, pipe: [1:7559594632217659751:9722]
2025-10-10T14:08:04.056379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 710
2025-10-10T14:08:04.056456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 710
2025-10-10T14:08:04.069015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594632217659847:9822], now have 1 active actors on pipe
2025-10-10T14:08:04.069070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594632217659713:2442], now have 1 active actors on pipe
2025-10-10T14:08:04.069093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594632217659751:9722], now have 1 active actors on pipe
2025-10-10T14:08:04.069174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:04.069200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:04.069302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:04.069341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:04.069360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:04.069371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:04.069410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:04.069457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:04.069510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:04.074346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:04.074395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:04.074487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:04.077571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 711 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0
2025-10-10T14:08:04.081383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04d4f5b-aaf8a351-27a4093c-77455703_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:04.132017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0] Write session: try to update token
2025-10-10T14:08:04.132087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:04.234199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:04.234232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:04.234244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:04.234307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:04.234322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:04.234336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:04.234347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:04.234358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:04.234394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594630639737757:8767]
2025-10-10T14:08:04.234420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594630639737757:8767]
2025-10-10T14:08:04.234445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594630639737757:8767]
2025-10-10T14:08:04.234469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594630639737757:8767]
2025-10-10T14:08:04.234611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:04.234605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:04.234636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:04.234642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.234653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:04.234658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:04.234679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:04.235663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:04.319010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId: src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:04.341020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:04.427431Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:04.432345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:04.432391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:04.434975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:04.435194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594632217659751:9722]
2025-10-10T14:08:04.435296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:04.435309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:04.435767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:04.477514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 711 reason: error at write: Disconnected sessionId: src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0
2025-10-10T14:08:04.490664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 711 sessionId: src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0 is DEAD
2025-10-10T14:08:04.493340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:04.493378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0] Write session will restart in 0.006084s
2025-10-10T14:08:04.493478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0] Write session: Do CDS request
2025-10-10T14:08:04.493509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:04.508764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:04.508815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 712
2025-10-10T14:08:04.514046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:04.514846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:04.515029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:04.515048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:04.515058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:04.517860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 712 sessionId:  describe result for acl check
2025-10-10T14:08:04.517983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:04.517993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:04.518001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:04.518018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594636512627380:9834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:04.520799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594636512627380:9834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:04.535540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594636512627403:9722]
2025-10-10T14:08:04.550836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594636512627380:9834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:04.576326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594636512627380:9834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:04.576374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594636512627380:9834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:04.576392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594636512627380:9834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:04.576422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:04.657264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:04.665533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:04.666451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:04.666471Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:04.666522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:04.666811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:04.667008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594634934705364:8777]
2025-10-10T14:08:04.669298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:04.670565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:04.670802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:04.672058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:04.672399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:04.672407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:04.672414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:04.672421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:04.672429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:04.672435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:04.672443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:04.672450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:04.672457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.672464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:04.672470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:04.672477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:04.672524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:04.672631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:04.672678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:04.672725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:04.672768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:04.672812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:04.672857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:04.672902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:04.672942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.672988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:04.673031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:04.673076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:04.673120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:04.673225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:04.673284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:04.673335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:04.673385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:04.673433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:04.673474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:04.673524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:04.673569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:04.673622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:04.673666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:04.673717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:04.673762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:04.673814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:04.673860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:04.673914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:04.673959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.675091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.675166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:04.675229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:04.675277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:04.675332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:04.675378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:04.675426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:04.675863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:04.717883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:04.732537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:04.732587Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:04.732604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:04.732625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:04.732650Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 711 [2:7559594634934705364:8777]
2025-10-10T14:08:04.732706Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:04.732779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:04.732794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:04.732807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:04.732818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:04.732865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:04.732885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:04.732907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:04.792247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.792523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:04.792538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:04.792548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:04.792557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:04.792850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:04.792865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.793002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:04.793171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:04.793358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:04.793455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:04.793527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594634934705359:8777]
2025-10-10T14:08:04.793542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594634934705359:8777]
2025-10-10T14:08:04.793554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594634934705359:8777]
2025-10-10T14:08:04.793565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594634934705359:8777]
2025-10-10T14:08:04.793607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:04.793682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:04.793834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:04.793852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:04.793971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594634934705359:8777]
2025-10-10T14:08:04.793990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:04.794776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:04.794793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:04.794805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:04.794814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:04.794837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:04.797239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594636512627504:9834], now have 1 active actors on pipe
2025-10-10T14:08:04.797274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594636512627403:9722], now have 1 active actors on pipe
2025-10-10T14:08:04.797296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594636512627338:2442], now have 1 active actors on pipe
2025-10-10T14:08:04.798435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:04.798470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:04.798551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e235d1b2-736b818e-a154af73-b647bdd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:04.798590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:04.798607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:04.798617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:04.798653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:04.798700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:04.798745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:04.799538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:04.799580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:04.799674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:04.796975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 711
2025-10-10T14:08:04.797052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 711, pipe: [1:7559594636512627403:9722]
2025-10-10T14:08:04.801046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea14a913-2c2d2c65-9a5f2fc1-9ad459dc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e235d1b2-736b818e-a154af73-b647bdd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:04.797121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 711
2025-10-10T14:08:04.800195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 712 partition: 0 MaxSeqNo: 36 sessionId: src_id|e235d1b2-736b818e-a154af73-b647bdd9_0
2025-10-10T14:08:04.831086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:04.831116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:04.831129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:04.846570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e235d1b2-736b818e-a154af73-b647bdd9_0] Write session: try to update token
2025-10-10T14:08:04.846630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e235d1b2-736b818e-a154af73-b647bdd9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:04.957677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:04.957702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:04.957711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:04.957757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:04.957767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:04.957776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:04.957784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:04.957794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:04.957821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594634934705359:8777]
2025-10-10T14:08:04.957849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594634934705359:8777]
2025-10-10T14:08:04.957864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594634934705359:8777]
2025-10-10T14:08:04.957876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594634934705359:8777]
2025-10-10T14:08:04.957987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:04.958005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:04.958013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:04.958071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:04.958108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:04.958141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:04.958186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:04.989823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:05.052984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId: src_id|e235d1b2-736b818e-a154af73-b647bdd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:05.089988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:05.182423Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:05.196061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:05.196108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:05.199801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:05.199558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594636512627403:9722]
2025-10-10T14:08:05.199637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:05.199760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:05.199771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:05.217394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e235d1b2-736b818e-a154af73-b647bdd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:05.217456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e235d1b2-736b818e-a154af73-b647bdd9_0] Write session will restart in 0.006938s
2025-10-10T14:08:05.217610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e235d1b2-736b818e-a154af73-b647bdd9_0] Write session: Do CDS request
2025-10-10T14:08:05.217649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e235d1b2-736b818e-a154af73-b647bdd9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:05.215703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 712 reason: error at write: Disconnected sessionId: src_id|e235d1b2-736b818e-a154af73-b647bdd9_0
2025-10-10T14:08:05.216047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 712 sessionId: src_id|e235d1b2-736b818e-a154af73-b647bdd9_0 is DEAD
2025-10-10T14:08:05.234206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e235d1b2-736b818e-a154af73-b647bdd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:05.235586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:05.236373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 713
2025-10-10T14:08:05.240505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:05.240641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:05.240657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:05.240667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:05.242168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 713 sessionId:  describe result for acl check
2025-10-10T14:08:05.242282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:05.242292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:05.242302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:05.242319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594640807594960:9841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:05.245516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594640807594960:9841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:05.258868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594640807594960:9841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:05.274666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594640807594960:9841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:05.274709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594640807594960:9841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:05.274726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594640807594960:9841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:05.274758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:05.299675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594640807595002:9722]
2025-10-10T14:08:05.381050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:05.389562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:05.390495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:05.390532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:05.390579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:05.390880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:05.391085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594639229672994:8786]
2025-10-10T14:08:05.393727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:05.394949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:05.395214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:05.396688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:05.397052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:05.397074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:05.397084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:05.397091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:05.397099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:05.397107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:05.397114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:05.397139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:05.397148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:05.397156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:05.397163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:05.397172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:05.397226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:05.397345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:05.397399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:05.397456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:05.397514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:05.397570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:05.397626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:05.397680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:05.397735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:05.397794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:05.397846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:05.397893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:05.397942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:05.398016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:05.398082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:05.398159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:05.398215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:05.398276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:05.398328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:05.398390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:05.398447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:05.398524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:05.398581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:05.398649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:05.398710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:05.398775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:05.398832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:05.398899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:05.398963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:05.399032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:05.399091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:05.399159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:05.399209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:05.399272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:05.399323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:05.399383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:05.399895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:05.436282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:05.451627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:05.451682Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:05.451703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:05.451723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:05.451747Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 712 [2:7559594639229672994:8786]
2025-10-10T14:08:05.451807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:05.451865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:05.451880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:05.451898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:05.451910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:05.451963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:05.451986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:05.452008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:05.478352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:05.478374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:05.478383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:05.478392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:05.478401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:05.478620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:05.478631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:05.478748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:05.478878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:05.479030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:05.479111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:05.479157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.479169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.479178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.479186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.479208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:05.479236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:05.479251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:05.479264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:05.479265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:05.479276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:05.479418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:05.479429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:05.479461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594640807594989:9841], now have 1 active actors on pipe
2025-10-10T14:08:05.479480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594640807594947:2442], now have 1 active actors on pipe
2025-10-10T14:08:05.479496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594640807595002:9722], now have 1 active actors on pipe
2025-10-10T14:08:05.479583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.479604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:05.479974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:05.483485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 712
2025-10-10T14:08:05.483582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 712
2025-10-10T14:08:05.483656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 712, pipe: [1:7559594640807595002:9722]
2025-10-10T14:08:05.484122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:05.484161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:05.484256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d252cccf-fe332331-22a23da3-9cc5725a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:05.484291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:05.484311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:05.484322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:05.484362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:05.484405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:05.484460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:05.486721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:05.486765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:05.486866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:05.487277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 713 partition: 0 MaxSeqNo: 36 sessionId: src_id|d252cccf-fe332331-22a23da3-9cc5725a_0
2025-10-10T14:08:05.488094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e235d1b2-736b818e-a154af73-b647bdd9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d252cccf-fe332331-22a23da3-9cc5725a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:05.518469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d252cccf-fe332331-22a23da3-9cc5725a_0] Write session: try to update token
2025-10-10T14:08:05.518574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d252cccf-fe332331-22a23da3-9cc5725a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:05.521299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:05.521332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:05.521370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.521497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:05.522846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:05.524065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:05.537914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:05.542719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:05.544061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:05.550282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:05.550901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:05.553530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:05.553553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:05.553581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:05.662497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:05.662531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:05.662545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:05.662557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:05.662569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:05.662610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.662638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.662665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.662689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594639229672988:8786]
2025-10-10T14:08:05.662858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:05.662884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:05.662895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:05.662938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:05.662965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:05.662976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:05.664267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:05.665298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:05.665337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:05.665371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:05.665400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:05.686492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId: src_id|d252cccf-fe332331-22a23da3-9cc5725a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:05.714013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:05.818365Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:05.820906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:05.820946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:05.822155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:05.822770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:05.822795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:05.885510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:05.885662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594640807595002:9722]
2025-10-10T14:08:05.885858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 713 reason: error at write: Disconnected sessionId: src_id|d252cccf-fe332331-22a23da3-9cc5725a_0
2025-10-10T14:08:05.886164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 713 sessionId: src_id|d252cccf-fe332331-22a23da3-9cc5725a_0 is DEAD
2025-10-10T14:08:05.888358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252cccf-fe332331-22a23da3-9cc5725a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:05.888392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252cccf-fe332331-22a23da3-9cc5725a_0] Write session will restart in 0.006497s
2025-10-10T14:08:05.888487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252cccf-fe332331-22a23da3-9cc5725a_0] Write session: Do CDS request
2025-10-10T14:08:05.888515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252cccf-fe332331-22a23da3-9cc5725a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:05.902643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d252cccf-fe332331-22a23da3-9cc5725a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:05.914754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:05.914784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 714
2025-10-10T14:08:05.915383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:05.915501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:05.915518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:05.915528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:05.916836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 714 sessionId:  describe result for acl check
2025-10-10T14:08:05.916934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:05.916945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:05.916955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:05.916971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594640807595357:9854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:05.919963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594640807595357:9854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:05.932990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594640807595357:9854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:05.953036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594640807595357:9854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:05.953066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594640807595357:9854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:05.953078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594640807595357:9854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:05.953102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:05.985664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594640807595565:9722]
2025-10-10T14:08:05.993121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:05.995194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:05.996095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:05.996114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:05.996159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:05.996424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:05.996612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594639229673292:8795]
2025-10-10T14:08:05.998980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:06.000133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:06.000360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:06.001792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:06.002174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:06.002184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:06.002192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:06.002200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:06.002209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:06.002217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:06.002226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:06.002233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:06.002240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.002247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.002255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.002263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.002315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:06.002625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:06.002679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:06.002730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:06.002780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:06.002830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:06.002878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:06.002932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:06.002985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.003040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.003092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.003144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.003189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:06.003262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:06.003330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:06.003388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:06.003440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:06.003496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:06.003544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:06.003601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:06.003654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:06.003792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:06.003844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:06.003907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:06.003961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:06.004019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:06.004067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:06.004122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:06.004173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.004245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.004291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.004355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.004408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.004467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.004514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.004570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.005055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:06.054596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:06.069798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:06.069849Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:06.069870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:06.069892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:06.069918Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 713 [2:7559594639229673292:8795]
2025-10-10T14:08:06.069984Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:06.070050Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:06.070066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:06.070079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:06.070093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:06.070161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:06.070184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:06.070206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:06.071716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.071743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.071761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.071778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.071791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:06.072091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:06.072119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.072275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.072478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.072719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.072847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:06.072920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.072948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.072964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.072977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.073011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:06.073070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:06.073083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:06.073094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:06.073095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:06.073108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:06.073468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 713, pipe: [1:7559594640807595565:9722]
2025-10-10T14:08:06.073571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 713
2025-10-10T14:08:06.073659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 713
2025-10-10T14:08:06.073555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:06.073580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:06.073723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594640807595565:9722], now have 1 active actors on pipe
2025-10-10T14:08:06.073749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594640807595474:9854], now have 1 active actors on pipe
2025-10-10T14:08:06.073773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594640807595289:2442], now have 1 active actors on pipe
2025-10-10T14:08:06.073793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.073823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:06.073900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:06.074081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:06.074110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:06.074214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b783ea50-858638a-e9fe3939-3563fe75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:06.074246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:06.074264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:06.074276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:06.074311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:06.074355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:06.074404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:06.075032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:06.075062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:06.075126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:06.075519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 714 partition: 0 MaxSeqNo: 36 sessionId: src_id|b783ea50-858638a-e9fe3939-3563fe75_0
2025-10-10T14:08:06.076120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d252cccf-fe332331-22a23da3-9cc5725a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b783ea50-858638a-e9fe3939-3563fe75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:06.098353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b783ea50-858638a-e9fe3939-3563fe75_0] Write session: try to update token
2025-10-10T14:08:06.098401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b783ea50-858638a-e9fe3939-3563fe75_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:06.148025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:06.148058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:06.148097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.148220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:06.148232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:06.150075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:06.151442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:06.153097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:06.154867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:06.161618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:06.162101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:06.188213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId: src_id|b783ea50-858638a-e9fe3939-3563fe75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:06.208023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:06.208050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:06.208059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:06.208107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:06.208120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:06.208136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:06.208150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:06.208162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:06.208204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.208232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.208249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.208266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594639229673287:8795]
2025-10-10T14:08:06.208379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:06.208402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:06.208421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:06.208429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.208441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:06.208457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:06.208487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:06.209895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:06.217099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:06.350719Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:06.354552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594640807595565:9722]
2025-10-10T14:08:06.354626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:06.354634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:06.357258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:06.352931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:06.352980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:06.354166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:06.407932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b783ea50-858638a-e9fe3939-3563fe75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:06.408001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b783ea50-858638a-e9fe3939-3563fe75_0] Write session will restart in 0.007088s
2025-10-10T14:08:06.408160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b783ea50-858638a-e9fe3939-3563fe75_0] Write session: Do CDS request
2025-10-10T14:08:06.408190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b783ea50-858638a-e9fe3939-3563fe75_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:06.407305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 714 reason: error at write: Disconnected sessionId: src_id|b783ea50-858638a-e9fe3939-3563fe75_0
2025-10-10T14:08:06.407546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 714 sessionId: src_id|b783ea50-858638a-e9fe3939-3563fe75_0 is DEAD
2025-10-10T14:08:06.421637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b783ea50-858638a-e9fe3939-3563fe75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:06.429303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:06.429337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 715
2025-10-10T14:08:06.430885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:06.431061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:06.431099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:06.431112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:06.432843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 715 sessionId:  describe result for acl check
2025-10-10T14:08:06.432982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:06.433009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:06.433023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:06.433041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594645102562895:9861] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:06.436337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594645102562895:9861] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:06.452326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594645102562895:9861] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:06.459757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594645102562943:9722]
2025-10-10T14:08:06.486092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594645102562895:9861] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:06.486146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594645102562895:9861] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:06.486158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594645102562895:9861] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:06.486181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:06.590688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:06.601641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:06.602547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:06.602568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:06.602618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:06.602891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:06.603087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594643524640903:8806]
2025-10-10T14:08:06.605515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:06.610096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:06.610366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:06.611638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:06.611940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:06.611947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:06.611954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:06.611961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:06.611967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:06.611975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:06.611981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:06.611988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:06.611995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.612002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.612009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.612016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.612063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:06.612171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:06.612219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:06.612264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:06.612308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:06.612353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:06.612395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:06.612436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:06.612482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.612527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.612569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.612612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.612651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:06.612716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:06.612774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:06.612828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:06.612876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:06.612930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:06.612973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:06.613024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:06.613071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:06.613121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:06.617291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:06.617372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:06.617426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:06.617483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:06.617529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:06.617585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:06.617636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.617691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.617735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.617789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.617837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.617887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.617930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.617981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.618423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:06.661566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:06.679179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:06.679228Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:06.679248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:06.679267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:06.679291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 714 [2:7559594643524640903:8806]
2025-10-10T14:08:06.679350Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:06.679413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:06.679429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:06.679441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:06.679452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:06.679503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:06.679524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:06.679547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:06.686263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.686298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.686314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.686330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.686341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:06.686627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:06.686645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.686795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:06.686994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:06.687226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:06.687347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:06.687424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594643524640898:8806]
2025-10-10T14:08:06.687439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594643524640898:8806]
2025-10-10T14:08:06.687454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594643524640898:8806]
2025-10-10T14:08:06.687467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594643524640898:8806]
2025-10-10T14:08:06.687512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:06.687592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:06.687773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:06.687790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:06.687919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594643524640898:8806]
2025-10-10T14:08:06.687938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:06.688206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:06.688217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:06.688229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:06.688240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:06.688263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:06.689238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594645102562943:9722], now have 1 active actors on pipe
2025-10-10T14:08:06.689268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594645102563010:9861], now have 1 active actors on pipe
2025-10-10T14:08:06.689290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594645102562882:2442], now have 1 active actors on pipe
2025-10-10T14:08:06.690785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:06.690824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:06.690914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:06.690947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:06.690965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:06.690977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:06.691013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:06.691054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:06.691103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:06.689675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 714, pipe: [1:7559594645102562943:9722]
2025-10-10T14:08:06.689782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 714
2025-10-10T14:08:06.689849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 714
2025-10-10T14:08:06.696586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:06.696629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:06.696721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:06.701359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 715 partition: 0 MaxSeqNo: 36 sessionId: src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0
2025-10-10T14:08:06.705702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b783ea50-858638a-e9fe3939-3563fe75_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:06.735668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0] Write session: try to update token
2025-10-10T14:08:06.735722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:06.805999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:06.806025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:06.806038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:06.806090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:06.806104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:06.806131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:06.806141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:06.806153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:06.806187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594643524640898:8806]
2025-10-10T14:08:06.806214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594643524640898:8806]
2025-10-10T14:08:06.806237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594643524640898:8806]
2025-10-10T14:08:06.806257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594643524640898:8806]
2025-10-10T14:08:06.806338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:06.806380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:06.806397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:06.806409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:06.806422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:06.806432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:06.806437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:06.807538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:06.874903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId: src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:06.896146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:06.969213Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:06.971092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:06.971121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:06.973290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594645102562943:9722]
2025-10-10T14:08:06.973432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:06.973456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:06.974841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:06.989633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 715 reason: error at write: Disconnected sessionId: src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0
2025-10-10T14:08:06.989978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 715 sessionId: src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0 is DEAD
2025-10-10T14:08:06.993329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:06.994971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:06.995035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0] Write session will restart in 0.007273s
2025-10-10T14:08:06.995192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0] Write session: Do CDS request
2025-10-10T14:08:06.995248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:07.018104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:07.025808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:07.025844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 716
2025-10-10T14:08:07.026340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:07.026464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:07.026481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:07.026491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:07.028099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 716 sessionId:  describe result for acl check
2025-10-10T14:08:07.028219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:07.028230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:07.028240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:07.028259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594649397530519:9872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:07.031423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594649397530519:9872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:07.050023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594649397530519:9872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:07.067845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594649397530519:9872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:07.067905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594649397530519:9872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:07.067923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594649397530519:9872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:07.067955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:07.073685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594649397530609:9722]
2025-10-10T14:08:07.160530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:07.172854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:07.173746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:07.173762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:07.173797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:07.174023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:07.174187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594647819608510:8814]
2025-10-10T14:08:07.175868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:07.178244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:07.178551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:07.179887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:07.180230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:07.180250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:07.180256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:07.180264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:07.180271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:07.180279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:07.180287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:07.180294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:07.180300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.180307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.180314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.180322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.180371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:07.180480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:07.180541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:07.180597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:07.180644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:07.180691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:07.180742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:07.180790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:07.180836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.180885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.180934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.181002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.181043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:07.181110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:07.182634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:07.182711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:07.182767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:07.182826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:07.182876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:07.182934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:07.182989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:07.183047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:07.183095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:07.183151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:07.183202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:07.183260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:07.183315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:07.183375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:07.183428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.183483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.183530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.183598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.183646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.183699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.183747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.183803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.184271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:07.316534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:07.331168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:07.331217Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:07.331235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:07.331255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:07.331279Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 715 [2:7559594647819608510:8814]
2025-10-10T14:08:07.331334Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:07.331390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:07.331404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:07.331417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:07.331428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:07.331475Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:07.331497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:07.331519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:07.334089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.334129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.334144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.334158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.334170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:07.334452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:07.334469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.334621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.334813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.335042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.335166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:07.335236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.335251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.335265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.335279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.335322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:07.338304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 715, pipe: [1:7559594649397530609:9722]
2025-10-10T14:08:07.338454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 715
2025-10-10T14:08:07.338546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 715
2025-10-10T14:08:07.335401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:07.335594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:07.335610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:07.335738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.335760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:07.335995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:07.336009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:07.336023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:07.336033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:07.336056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:07.339276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594649397530609:9722], now have 1 active actors on pipe
2025-10-10T14:08:07.339312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594649397530598:9872], now have 1 active actors on pipe
2025-10-10T14:08:07.339337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594645102563202:2442], now have 1 active actors on pipe
2025-10-10T14:08:07.339388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:07.339413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:07.339500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:07.339536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:07.339555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:07.339566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:07.339604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:07.339648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:07.339710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:07.340516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:07.340545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:07.340613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:07.340998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 716 partition: 0 MaxSeqNo: 36 sessionId: src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0
2025-10-10T14:08:07.344543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1dfd9cb-4f340f43-69320945-549ff2e6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:07.390900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0] Write session: try to update token
2025-10-10T14:08:07.390955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:07.505441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:07.505463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:07.505471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:07.505563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:07.505573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:07.505583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:07.505590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:07.505599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:07.505621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.505640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.505655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.505670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.506171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:07.506206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:07.506235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:07.506266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:07.545558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:07.545612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.545623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:07.546848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:07.570623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId: src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:07.599948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:07.692557Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:07.694472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:07.694503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:07.694548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594647819608505:8814]
2025-10-10T14:08:07.694688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:07.694697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:07.694724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:07.695708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:07.695879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594649397530609:9722]
2025-10-10T14:08:07.695955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:07.695966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:07.696051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:07.720657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 716 reason: error at write: Disconnected sessionId: src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0
2025-10-10T14:08:07.720961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 716 sessionId: src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0 is DEAD
2025-10-10T14:08:07.721707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:07.721777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0] Write session will restart in 0.008180s
2025-10-10T14:08:07.721985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0] Write session: Do CDS request
2025-10-10T14:08:07.722046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:07.738944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:07.740205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:07.740235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 717
2025-10-10T14:08:07.740583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:07.740721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:07.740738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:07.740748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:07.741959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 717 sessionId:  describe result for acl check
2025-10-10T14:08:07.742042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:07.742048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:07.742054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:07.742065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594649397530844:9884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:07.744058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594649397530844:9884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:07.753974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594649397530844:9884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:07.761932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594649397530844:9884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:07.761973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594649397530844:9884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:07.761994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594649397530844:9884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:07.762025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:07.796907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594649397530913:9722]
2025-10-10T14:08:07.873283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:07.875550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:07.876343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:07.876369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:07.876416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:07.876654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:07.876863Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594647819608829:8820]
2025-10-10T14:08:07.878653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:07.879512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:07.879709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:07.880693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:07.880897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:07.880901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:07.880906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:07.880910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:07.880914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:07.880919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:07.880923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:07.880927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:07.880931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.880936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.880940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.880945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.880974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:07.881047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:07.881078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:07.881107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:07.881172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:07.881216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:07.881257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:07.881295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:07.881348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.881389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.881427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.881465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.881499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:07.881568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:07.881624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:07.881671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:07.881712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:07.881777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:07.881823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:07.881878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:07.881923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:07.881971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:07.882013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:07.882061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:07.882116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:07.882154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:07.882180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:07.882218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:07.882250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.882280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.882305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.882356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.882398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.882448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.882493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.882544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.882828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:07.903134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:07.916497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:07.916543Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:07.916560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:07.916579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:07.916602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 716 [2:7559594647819608829:8820]
2025-10-10T14:08:07.916658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:07.916717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:07.916730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:07.916741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:07.916752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:07.916799Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:07.916821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:07.916841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:07.919160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.919189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.919204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.919218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.919229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:07.919894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 716, pipe: [1:7559594649397530913:9722]
2025-10-10T14:08:07.919998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 716
2025-10-10T14:08:07.920002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 716
2025-10-10T14:08:07.919505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:07.919532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:07.919672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:07.919856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:07.920082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:07.920199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:07.920298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594649397530913:9722], now have 1 active actors on pipe
2025-10-10T14:08:07.920321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594649397530830:2442], now have 1 active actors on pipe
2025-10-10T14:08:07.920342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594649397530885:9884], now have 1 active actors on pipe
2025-10-10T14:08:07.920405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:07.920425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:07.920462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:07.920475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:07.920489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:07.920501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:07.920537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:07.920570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:07.920585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:07.920597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:07.920610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:07.920613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:07.920792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:07.920810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:07.920863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:07.920883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:07.920895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:07.920903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:07.920927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:07.920957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:07.921075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:07.921096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:07.921119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:07.921164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:07.922729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:07.922760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:07.922827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:07.923170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 717 partition: 0 MaxSeqNo: 36 sessionId: src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0
2025-10-10T14:08:07.929409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea6a57e3-c7a6cb01-6adfe4f2-6087e96_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:07.998727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0] Write session: try to update token
2025-10-10T14:08:07.998786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:08.018110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:08.018147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:08.018159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:08.183024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId: src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:08.225966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:08.225999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:08.226011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:08.226141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:08.226156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:08.226169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:08.226180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:08.226191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:08.226224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:08.226250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:08.226273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:08.226294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:08.229607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:08.229650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:08.229693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:08.229722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:08.232397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:08.241011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:08.242147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:08.242170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:08.243393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:08.414467Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:08.416284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:08.417292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594649397530913:9722]
2025-10-10T14:08:08.416319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:08.416364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:08.416378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:08.416419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594647819608824:8820]
2025-10-10T14:08:08.416681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:08.417328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:08.417346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:08.417378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:08.418287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:08.428742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 717 reason: error at write: Disconnected sessionId: src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0
2025-10-10T14:08:08.429045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 717 sessionId: src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0 is DEAD
2025-10-10T14:08:08.443464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:08.443509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0] Write session will restart in 0.006381s
2025-10-10T14:08:08.443609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0] Write session: Do CDS request
2025-10-10T14:08:08.443640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:08.457432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:08.457469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 718
2025-10-10T14:08:08.461879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:08.466498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:08.466620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:08.466632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:08.466640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:08.468014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 718 sessionId:  describe result for acl check
2025-10-10T14:08:08.468129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:08.468138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:08.468147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:08.468164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594653692498465:9890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:08.471408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594653692498465:9890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:08.483255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594653692498465:9890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:08.502658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594653692498465:9890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:08.502698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594653692498465:9890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:08.502717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594653692498465:9890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:08.502749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:08.519989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594653692498551:9722]
2025-10-10T14:08:08.684030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:08.692077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:08.692966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:08.692986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:08.693032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:08.693319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:08.693522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594652114576457:8834]
2025-10-10T14:08:08.696138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:08.697379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:08.697637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:08.698833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:08.699141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:08.699149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:08.699156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:08.699163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:08.699170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:08.699176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:08.699182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:08.699188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:08.699194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:08.699201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:08.699209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:08.699215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:08.699257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:08.699357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:08.699404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:08.699450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:08.699492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:08.699537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:08.699579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:08.699620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:08.699660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:08.699704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:08.699743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:08.699783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:08.699823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:08.699882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:08.699939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:08.699992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:08.700038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:08.700085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:08.700127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:08.700175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:08.700221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:08.700271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:08.700316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:08.700368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:08.700417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:08.700467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:08.700510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:08.700560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:08.700603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:08.700651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:08.700695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:08.700743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:08.700786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:08.700834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:08.700876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:08.700923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:08.703116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:08.798920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:08.819161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:08.819201Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:08.819215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:08.819232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:08.819255Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 717 [2:7559594652114576457:8834]
2025-10-10T14:08:08.819310Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:08.819369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:08.819383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:08.819395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:08.819405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:08.819452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:08.819473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:08.819495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:08.821740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:08.821769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:08.821783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:08.821796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:08.821807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:08.823725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 717
2025-10-10T14:08:08.823803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 717, pipe: [1:7559594653692498551:9722]
2025-10-10T14:08:08.823884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 717
2025-10-10T14:08:08.825510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:08.825632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:08.825766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:08.825931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:08.826156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:08.826264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:08.826309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594653692498512:9890], now have 1 active actors on pipe
2025-10-10T14:08:08.826332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594653692498551:9722], now have 1 active actors on pipe
2025-10-10T14:08:08.826354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594653692498450:2442], now have 1 active actors on pipe
2025-10-10T14:08:08.826403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:08.826423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:08.826527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:08.826541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:08.826555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:08.826566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:08.826610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:08.826713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:08.826747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:08.826763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:08.826774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:08.826810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:08.826857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:08.826913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:08.827088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:08.827106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:08.827248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:08.827300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:08.827321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:08.828037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:08.828056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:08.828065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:08.828076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:08.828098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:08.835801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:08.835844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:08.835931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:08.838801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 718 partition: 0 MaxSeqNo: 36 sessionId: src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0
2025-10-10T14:08:08.841532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3c9df8-b5706f73-c26882f5-814f2cc0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:08.898130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0] Write session: try to update token
2025-10-10T14:08:08.898196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:08.919993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:08.920027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:08.920041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:09.006990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:09.007026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:09.007043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:09.007056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:09.007067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:09.007103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:09.007131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:09.007155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:09.007178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:09.007357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:09.007386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:09.007400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:09.007412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:09.007432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:09.007459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:09.007503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:09.018342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:09.085945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId: src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:09.148113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:09.179479Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:09.191457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:09.191509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:09.191618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:09.191633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:09.191678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594652114576452:8834]
2025-10-10T14:08:09.193794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594653692498551:9722]
2025-10-10T14:08:09.193913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:09.194108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:09.192342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:09.192498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:09.227753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 718 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0
2025-10-10T14:08:09.228095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 718 sessionId: src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0 is DEAD
2025-10-10T14:08:09.234326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:09.234370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0] Write session will restart in 0.006300s
2025-10-10T14:08:09.234473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0] Write session: Do CDS request
2025-10-10T14:08:09.234508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:09.250404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:09.254011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:09.254041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 719
2025-10-10T14:08:09.254474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:09.254576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:09.254590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:09.254600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:09.255887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 719 sessionId:  describe result for acl check
2025-10-10T14:08:09.255992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:09.256002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:09.256010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:09.256026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594657987466134:9906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:09.258560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594657987466134:9906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:09.272155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594657987466134:9906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:09.281589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594657987466134:9906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:09.281631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594657987466134:9906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:09.281648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594657987466134:9906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:09.281680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:09.292915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594657987466179:9722]
E1010 14:08:09.378335846  112381 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:08:09.382335Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:08:09.439369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:09.448550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:09.449477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:09.449494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:09.449541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:09.449809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:09.449996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594656409544081:8837]
2025-10-10T14:08:09.452070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:09.457471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:09.457741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:09.459039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:09.459368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:09.459375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:09.459383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:09.459389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:09.459395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:09.459402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:09.459410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:09.459417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:09.459423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:09.459430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:09.459436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:09.459444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:09.459497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:09.459607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:09.459653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:09.459699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:09.459747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:09.459792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:09.459839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:09.459882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:09.459931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:09.459981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:09.460022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:09.460065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:09.460107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:09.460174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:09.460230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:09.460282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:09.460328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:09.460380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:09.460421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:09.460470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:09.460526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:09.460581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:09.460625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:09.460675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:09.460720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:09.460773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:09.460819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:09.460868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:09.460915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:09.460964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:09.461008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:09.461061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:09.461104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:09.468699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:09.468781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:09.468848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:09.469346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:09.550025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:09.563882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:09.563931Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:09.563945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:09.563963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:09.563984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 718 [2:7559594656409544081:8837]
2025-10-10T14:08:09.564033Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:09.564090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:09.564103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:09.564115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:09.564124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:09.564169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:09.564189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:09.564210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:09.568032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 718
2025-10-10T14:08:09.568109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 718, pipe: [1:7559594657987466179:9722]
2025-10-10T14:08:09.568177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 718
2025-10-10T14:08:09.566663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:09.566689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:09.566702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:09.566714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:09.566724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:09.566998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:09.567014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:09.567137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:09.567294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:09.567499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:09.567601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:09.567681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594657987466168:9906], now have 1 active actors on pipe
2025-10-10T14:08:09.567704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594657987466179:9722], now have 1 active actors on pipe
2025-10-10T14:08:09.567724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594657987466105:2442], now have 1 active actors on pipe
2025-10-10T14:08:09.567749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:09.567764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:09.567776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:09.567788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:09.567833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:09.567910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:09.568067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:09.568083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:09.568213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:09.568234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:09.568386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:09.568398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:09.568410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:09.568419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:09.568444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:09.571721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:09.571769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:09.571884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:09.571921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:09.571940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:09.571951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:09.571992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:09.572036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:09.572084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:09.578185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:09.578228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:09.578309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:09.578786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 719 partition: 0 MaxSeqNo: 36 sessionId: src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0
2025-10-10T14:08:09.579679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8b2c8-ba7b5c1f-f133e27b-ba38fc24_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:09.633791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0] Write session: try to update token
2025-10-10T14:08:09.633852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:09.819956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:09.819989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:09.820001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:09.820057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:09.820069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:09.820081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:09.820091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:09.820101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:09.820139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:09.820168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:09.820193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:09.820215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:09.820421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:09.820447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:09.820457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:09.821561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:09.825702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:09.825738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:09.825765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:09.825791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:09.863963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId: src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:09.887690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:10.018071Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:10.029331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:10.029383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:10.029463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:10.029479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:10.029523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594656409544075:8837]
2025-10-10T14:08:10.030366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:10.030955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:10.035800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594657987466179:9722]
2025-10-10T14:08:10.035888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:10.036005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:10.056507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 719 reason: status is not ok: tablet will be restarted right now sessionId: src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0
2025-10-10T14:08:10.056886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 719 sessionId: src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0 is DEAD
2025-10-10T14:08:10.057420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:10.057499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0] Write session will restart in 0.006962s
2025-10-10T14:08:10.057701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0] Write session: Do CDS request
2025-10-10T14:08:10.057765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:10.083897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:10.093259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:10.093293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 720
2025-10-10T14:08:10.101297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:10.101474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:10.101493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:10.101505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:10.103185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 720 sessionId:  describe result for acl check
2025-10-10T14:08:10.103321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:10.103333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:10.103343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:10.103361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594662282433767:9913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:10.108535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594662282433767:9913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:10.127448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594662282433767:9913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:10.136145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594662282433838:9722]
2025-10-10T14:08:10.151317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594662282433767:9913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:10.151361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594662282433767:9913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:10.151380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594662282433767:9913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:10.151411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:10.224988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:10.237254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:10.238184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:10.238198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:10.238234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:10.238484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:10.238692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594660704511694:8854]
2025-10-10T14:08:10.241562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:10.243765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:10.244010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:10.245373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:10.245731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:10.245741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:10.245749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:10.245757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:10.245764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:10.245771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:10.245779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:10.245787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:10.245794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:10.245801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:10.245808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:10.245816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:10.245869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:10.245994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:10.246068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:10.246125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:10.246175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:10.246225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:10.246276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:10.246326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:10.246379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:10.246433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:10.246485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:10.246536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:10.246581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:10.246654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:10.246722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:10.246782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:10.246837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:10.246898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:10.246952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:10.247007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:10.247060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:10.247119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:10.247171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:10.247231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:10.247288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:10.247349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:10.247402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:10.247467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:10.247523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:10.247581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:10.247630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:10.247689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:10.247744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:10.247803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:10.247853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:10.247914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:10.248406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:10.285509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:10.343366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:10.343416Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:10.343434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:10.343455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:10.343480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 719 [2:7559594660704511694:8854]
2025-10-10T14:08:10.343539Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:10.343597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:10.343612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:10.343624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:10.343636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:10.343688Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:10.343710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:10.343731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:10.346130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:10.346158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:10.346173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:10.346187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:10.346198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:10.346476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:10.346492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:10.346642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:10.346831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:10.346990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:10.347069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:10.347119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.347129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.347139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.347148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.347179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:10.347234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:10.347383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:10.347401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:10.347524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.347538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:10.347752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:10.347772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:10.347784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:10.347797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:10.347829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:10.349317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 719
2025-10-10T14:08:10.349420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 719
2025-10-10T14:08:10.349494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 719, pipe: [1:7559594662282433838:9722]
2025-10-10T14:08:10.349231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594662282433861:9913], now have 1 active actors on pipe
2025-10-10T14:08:10.349277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594662282433741:2442], now have 1 active actors on pipe
2025-10-10T14:08:10.349301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594662282433838:9722], now have 1 active actors on pipe
2025-10-10T14:08:10.350216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:10.350246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:10.350350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:10.350387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:10.350406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:10.350417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:10.350459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:10.350510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:10.350560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:10.354170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:10.354209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:10.354289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:10.355310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 720 partition: 0 MaxSeqNo: 36 sessionId: src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0
2025-10-10T14:08:10.356217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|220a1fe1-bd9a3f05-3057953b-ac199c38_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:10.439424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0] Write session: try to update token
2025-10-10T14:08:10.439480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:10.447736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:10.447773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:10.447787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:10.447842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:10.447857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:10.447893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.447988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:10.452026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:10.454008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:10.523830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:10.525146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:10.526375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:10.528521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:10.529255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:10.584114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:10.584147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:10.584159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:10.584210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:10.584224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:10.584239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:10.584250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:10.584262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:10.584303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.584330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.584360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.584387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594660704511687:8854]
2025-10-10T14:08:10.584540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:10.584579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:10.584590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:10.585705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:10.589292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:10.589342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:10.589375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:10.589408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:10.621285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId: src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:10.665604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:10.760198Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:10.783840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:10.783881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:10.785624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:10.785648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:10.786543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594662282433838:9722]
2025-10-10T14:08:10.786679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:10.785119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:10.805989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 720 reason: error at write: Disconnected sessionId: src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0
2025-10-10T14:08:10.806354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 720 sessionId: src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0 is DEAD
2025-10-10T14:08:10.809735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:10.809768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0] Write session will restart in 0.009125s
2025-10-10T14:08:10.809874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0] Write session: Do CDS request
2025-10-10T14:08:10.809907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:10.828266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:10.828964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:10.828997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 721
2025-10-10T14:08:10.829802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:10.829927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:10.829943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:10.829953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:10.832910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 721 sessionId:  describe result for acl check
2025-10-10T14:08:10.833324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:10.833343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:10.833352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:10.833372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594662282434085:9927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:10.836090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594662282434085:9927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:10.853690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594662282434085:9927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:10.871588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594662282434085:9927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:10.871632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594662282434085:9927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:10.871650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594662282434085:9927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:10.871679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:10.887292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594662282434141:9722]
2025-10-10T14:08:11.038700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:11.043414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:11.044291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:11.044307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:11.044353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:11.044615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:11.044797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594664999479321:8859]
2025-10-10T14:08:11.046987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:11.049452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:11.049682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:11.050950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:11.051261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:11.051270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:11.051276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:11.051282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:11.051288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:11.051294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:11.051301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:11.051307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:11.051313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.051319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.051325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.051331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.051375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:11.051474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:11.051518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:11.051562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:11.051606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:11.051646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:11.051687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:11.051728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:11.051770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.051811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.051852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.051893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.051931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:11.051989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:11.052043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:11.052094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:11.052139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:11.052188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:11.052230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:11.052278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:11.052321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:11.052370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:11.053302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:11.053374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:11.053426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:11.053481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:11.053524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:11.053574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:11.053616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.053665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.053708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.053757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.053801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.053851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.053893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.053942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.054398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:11.084039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:11.098318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:11.098360Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:11.098375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:11.098395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:11.098419Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 720 [2:7559594664999479321:8859]
2025-10-10T14:08:11.098471Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:11.098533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:11.098549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:11.098560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:11.098850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:11.098906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:11.098928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:11.098951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:11.128849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.128881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.128893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.128904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.128914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:11.130462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 720
2025-10-10T14:08:11.130555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 720
2025-10-10T14:08:11.130608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 720, pipe: [1:7559594662282434141:9722]
2025-10-10T14:08:11.131081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:11.131108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.131233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.131404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.131606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.131704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:11.131794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594662282434062:2442], now have 1 active actors on pipe
2025-10-10T14:08:11.131818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594662282434121:9927], now have 1 active actors on pipe
2025-10-10T14:08:11.131838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594662282434141:9722], now have 1 active actors on pipe
2025-10-10T14:08:11.131896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:11.131915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:11.131953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.131967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.131979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.131991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.132031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:11.132109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:11.132273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:11.132290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:11.132358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:11.132389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:11.132407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:11.132418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:11.132455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:11.132498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:11.132628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.132647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:11.132687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:11.133538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:11.133561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:11.133572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:11.133584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:11.133609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:11.136948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:11.136980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:11.137053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:11.137473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 721 partition: 0 MaxSeqNo: 36 sessionId: src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0
2025-10-10T14:08:11.138500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0dc39c6-1b89dd52-74249bc2-a9e1e85c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:11.184970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0] Write session: try to update token
2025-10-10T14:08:11.185028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:11.199479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:11.199508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:11.199520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:11.306776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:11.306803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:11.306818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:11.306829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:11.306839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:11.306874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.306900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.306924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.306945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.307094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:11.307116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:11.307127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:11.309590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:11.309624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:11.309650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:11.309676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:11.456723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:11.456772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.456783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:11.471341Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:11.490846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId: src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:11.527481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:11.629443Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:11.632065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:11.632096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:11.632143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594664999479316:8859]
2025-10-10T14:08:11.632289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:11.632314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:11.634905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:11.635041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:11.635061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:11.636159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594662282434141:9722]
2025-10-10T14:08:11.633267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:11.633996Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:11.655319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:11.655393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0] Write session will restart in 0.008736s
2025-10-10T14:08:11.655589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0] Write session: Do CDS request
2025-10-10T14:08:11.655647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:11.653422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 721 reason: error at write: Disconnected sessionId: src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0
2025-10-10T14:08:11.653774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 721 sessionId: src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0 is DEAD
2025-10-10T14:08:11.676709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:11.677241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:11.677275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 722
2025-10-10T14:08:11.681555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:11.681712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:11.681729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:11.681739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:11.683317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 722 sessionId:  describe result for acl check
2025-10-10T14:08:11.683427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:11.683438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:11.683449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:11.683466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594666577401721:9934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:11.688318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594666577401721:9934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:11.695428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594666577401721:9934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:11.711199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594666577401721:9934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:11.711233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594666577401721:9934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:11.711247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594666577401721:9934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:11.711279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:11.734119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594666577401779:9722]
2025-10-10T14:08:11.814542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:11.826294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:11.827264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:11.827295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:11.827340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:11.827637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:11.827832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594664999479648:8874]
2025-10-10T14:08:11.830641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:11.833189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:11.833459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:11.835081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:11.835535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:11.835557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:11.835564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:11.835572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:11.835580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:11.835587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:11.835595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:11.835602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:11.835611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.835618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.835627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.835634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.835697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:11.835819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:11.835872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:11.835925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:11.835977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:11.836031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:11.836082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:11.836128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:11.836179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.836229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.836282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.836330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.836378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:11.836452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:11.836521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:11.836579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:11.836634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:11.836710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:11.836760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:11.836820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:11.836870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:11.836928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:11.836981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:11.837038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:11.837090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:11.838082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:11.838153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:11.838216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:11.838275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.838336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.838390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.838451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.838514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.838570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.838621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.838683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.839145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:11.882889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:11.929179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:11.929229Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:11.929247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:11.929269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:11.929295Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 721 [2:7559594664999479648:8874]
2025-10-10T14:08:11.929353Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:11.929412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:11.929427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:11.929440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:11.929454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:11.929503Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:11.929527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:11.929548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:11.931851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.931869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.931884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.931898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.931909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:11.933048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:11.933079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:11.933321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:11.933519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:11.933759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:11.933880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:11.933922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594666577401755:9934], now have 1 active actors on pipe
2025-10-10T14:08:11.933949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594666577401779:9722], now have 1 active actors on pipe
2025-10-10T14:08:11.933972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594666577401707:2442], now have 1 active actors on pipe
2025-10-10T14:08:11.934054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594664999479643:8874]
2025-10-10T14:08:11.934069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594664999479643:8874]
2025-10-10T14:08:11.934085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594664999479643:8874]
2025-10-10T14:08:11.934099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594664999479643:8874]
2025-10-10T14:08:11.934142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:11.934226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:11.934414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:11.934431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:11.934555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594664999479643:8874]
2025-10-10T14:08:11.934574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:11.935094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:11.935113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:11.935124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:11.935135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:11.935160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:11.935736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 721, pipe: [1:7559594666577401779:9722]
2025-10-10T14:08:11.935862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 721
2025-10-10T14:08:11.936033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 721
2025-10-10T14:08:11.937251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:11.937285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:11.937363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adaff0bb-85974f8d-c110f109-704f2c71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:11.937395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:11.937414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:11.937424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:11.937477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:11.937522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:11.937580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:11.938364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:11.938389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:11.938456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:11.938823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 722 partition: 0 MaxSeqNo: 36 sessionId: src_id|adaff0bb-85974f8d-c110f109-704f2c71_0
2025-10-10T14:08:11.941347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a556aac6-abed4bb1-68406ec8-f3f0d8c7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|adaff0bb-85974f8d-c110f109-704f2c71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:11.972527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adaff0bb-85974f8d-c110f109-704f2c71_0] Write session: try to update token
2025-10-10T14:08:11.972588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adaff0bb-85974f8d-c110f109-704f2c71_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:12.075965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:12.076000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:12.076012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:12.076065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:12.076081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:12.076093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:12.076105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:12.076116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:12.076149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594664999479643:8874]
2025-10-10T14:08:12.076174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594664999479643:8874]
2025-10-10T14:08:12.076200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594664999479643:8874]
2025-10-10T14:08:12.076222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594664999479643:8874]
2025-10-10T14:08:12.076336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:12.076366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:12.076390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:12.076392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:12.076401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:12.076424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:12.076453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:12.098141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:12.168222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId: src_id|adaff0bb-85974f8d-c110f109-704f2c71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:12.191829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:12.271413Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:12.274125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:12.274164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:12.277650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:12.277680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:12.277946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:12.332408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaff0bb-85974f8d-c110f109-704f2c71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:12.332460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaff0bb-85974f8d-c110f109-704f2c71_0] Write session will restart in 0.008156s
2025-10-10T14:08:12.332624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaff0bb-85974f8d-c110f109-704f2c71_0] Write session: Do CDS request
2025-10-10T14:08:12.332676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaff0bb-85974f8d-c110f109-704f2c71_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:12.330982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 722 reason: error at write: Disconnected sessionId: src_id|adaff0bb-85974f8d-c110f109-704f2c71_0
2025-10-10T14:08:12.331314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 722 sessionId: src_id|adaff0bb-85974f8d-c110f109-704f2c71_0 is DEAD
2025-10-10T14:08:12.341212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594666577401779:9722]
2025-10-10T14:08:12.341302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:12.345275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:12.345300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 723
2025-10-10T14:08:12.345624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adaff0bb-85974f8d-c110f109-704f2c71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:12.351982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:12.352132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:12.352147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:12.352157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:12.354806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 723 sessionId:  describe result for acl check
2025-10-10T14:08:12.354919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:12.354939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:12.354950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:12.354966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594670872369395:9948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:12.357515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594670872369395:9948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:12.368305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594670872369395:9948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:12.380040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594670872369395:9948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:12.380081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594670872369395:9948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:12.380100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594670872369395:9948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:12.380131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:12.427231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:12.429528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:12.430388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:12.430407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:12.430453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:12.430729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:12.430919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594669294447250:8877]
2025-10-10T14:08:12.433491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:12.436365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594670872369643:9722]
2025-10-10T14:08:12.437090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:12.437486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:12.438952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:12.439397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:12.439408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:12.439418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:12.439426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:12.439434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:12.439457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:12.439465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:12.439474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:12.439481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:12.439489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:12.439496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:12.439503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:12.439559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:12.439706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:12.439766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:12.439823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:12.439880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:12.439934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:12.439986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:12.440041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:12.440093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:12.440146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:12.440199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:12.440253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:12.440300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:12.440377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:12.440446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:12.440514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:12.440570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:12.440631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:12.440685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:12.440749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:12.440807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:12.440865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:12.440916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:12.440982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:12.441038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:12.441100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:12.441175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:12.441242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:12.441296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:12.441357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:12.441412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:12.441475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:12.441528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:12.441588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:12.441640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:12.441700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:12.442222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:12.488926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:12.506213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:12.506266Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:12.506286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:12.506310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:12.506335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 722 [2:7559594669294447250:8877]
2025-10-10T14:08:12.506400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:12.506467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:12.506482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:12.506496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:12.506508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:12.506556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:12.506579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:12.506600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:12.508001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:12.508017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:12.508032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:12.508049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:12.508063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:12.508350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:12.508383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:12.508551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:12.508776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:12.509051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:12.509595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 722
2025-10-10T14:08:12.509690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 722, pipe: [1:7559594670872369643:9722]
2025-10-10T14:08:12.510287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 722
2025-10-10T14:08:12.509649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:12.509740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594670872369525:9948], now have 1 active actors on pipe
2025-10-10T14:08:12.509768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594670872369643:9722], now have 1 active actors on pipe
2025-10-10T14:08:12.509792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594670872369359:2442], now have 1 active actors on pipe
2025-10-10T14:08:12.509820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594669294447245:8877]
2025-10-10T14:08:12.509837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594669294447245:8877]
2025-10-10T14:08:12.509853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594669294447245:8877]
2025-10-10T14:08:12.509868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594669294447245:8877]
2025-10-10T14:08:12.509904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:12.509991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:12.510207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:12.510224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:12.510349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594669294447245:8877]
2025-10-10T14:08:12.510372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:12.510980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:12.511004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:12.511017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:12.511029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:12.511053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:12.512013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:12.512045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:12.512136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6299ba32-6837545e-9218fd88-9db036fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:12.512169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:12.512187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:12.512199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:12.512232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:12.512271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:12.512323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:12.513007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:12.513034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:12.513101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:12.513715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 723 partition: 0 MaxSeqNo: 36 sessionId: src_id|6299ba32-6837545e-9218fd88-9db036fd_0
2025-10-10T14:08:12.518970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adaff0bb-85974f8d-c110f109-704f2c71_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6299ba32-6837545e-9218fd88-9db036fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:12.550380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6299ba32-6837545e-9218fd88-9db036fd_0] Write session: try to update token
2025-10-10T14:08:12.550437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6299ba32-6837545e-9218fd88-9db036fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:12.668395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:12.668430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:12.668442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:12.668497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:12.668513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:12.668528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:12.668540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:12.668551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:12.668592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594669294447245:8877]
2025-10-10T14:08:12.668621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594669294447245:8877]
2025-10-10T14:08:12.668647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594669294447245:8877]
2025-10-10T14:08:12.668670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594669294447245:8877]
2025-10-10T14:08:12.668816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:12.668845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:12.668843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:12.668856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:12.668879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:12.668923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:12.668967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:12.680047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:12.708893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId: src_id|6299ba32-6837545e-9218fd88-9db036fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:12.738180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:12.830950Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:12.834759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:12.834803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:12.838062Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:12.838811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594670872369643:9722]
2025-10-10T14:08:12.838890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:12.839022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:12.839033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:12.887395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 723 reason: error at write: Disconnected sessionId: src_id|6299ba32-6837545e-9218fd88-9db036fd_0
2025-10-10T14:08:12.887732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 723 sessionId: src_id|6299ba32-6837545e-9218fd88-9db036fd_0 is DEAD
2025-10-10T14:08:12.889194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6299ba32-6837545e-9218fd88-9db036fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:12.889232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6299ba32-6837545e-9218fd88-9db036fd_0] Write session will restart in 0.007281s
2025-10-10T14:08:12.889328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6299ba32-6837545e-9218fd88-9db036fd_0] Write session: Do CDS request
2025-10-10T14:08:12.889356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6299ba32-6837545e-9218fd88-9db036fd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:12.904793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:12.904822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 724
2025-10-10T14:08:12.905210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6299ba32-6837545e-9218fd88-9db036fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:12.909389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:12.909533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:12.909558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:12.909568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:12.914293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 724 sessionId:  describe result for acl check
2025-10-10T14:08:12.914424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:12.914442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:12.914452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:12.914469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594670872369703:9956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:12.917186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594670872369703:9956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:12.927777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594670872369703:9956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:12.937160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594670872369772:9722]
2025-10-10T14:08:12.946056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594670872369703:9956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:12.946100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594670872369703:9956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:12.946118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594670872369703:9956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:12.946151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:13.035447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:13.041216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:13.042107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:13.042125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:13.042175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:13.042449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:13.042674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594673589414873:8888]
2025-10-10T14:08:13.044827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:13.047605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:13.047857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:13.049083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:13.049418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:13.049426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:13.049434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:13.049441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:13.049448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:13.049455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:13.049461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:13.049467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:13.049475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.049481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.049488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.049496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.049545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:13.049648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:13.049695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:13.049741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:13.049787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:13.049830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:13.049870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:13.049909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:13.049955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.050017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.050062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.050110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.050151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:13.050214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:13.050270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:13.050325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:13.050373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:13.050422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:13.050463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:13.050512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:13.052516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:13.052602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:13.052656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:13.052705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:13.052750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:13.052799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:13.052840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:13.052892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:13.052939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.052989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.053035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.053084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.053155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.053208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.053254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.053305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.053748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:13.080557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:13.137366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:13.137407Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:13.137426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:13.137444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:13.137467Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 723 [2:7559594673589414873:8888]
2025-10-10T14:08:13.137522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:13.137584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:13.137599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:13.137612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:13.137623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:13.137671Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:13.137693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:13.137714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:13.141065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 723, pipe: [1:7559594670872369772:9722]
2025-10-10T14:08:13.139922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.139950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.139967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.139981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.139994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:13.140268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:13.140286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.140437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.140635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.140875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.140997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:13.141077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594670872369772:9722], now have 1 active actors on pipe
2025-10-10T14:08:13.141102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594670872369661:2442], now have 1 active actors on pipe
2025-10-10T14:08:13.141191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 723
2025-10-10T14:08:13.141217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 723
2025-10-10T14:08:13.141423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594670872369803:9956], now have 1 active actors on pipe
2025-10-10T14:08:13.141459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.141475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.141489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.141500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.141538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:13.141619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:13.141803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:13.141819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:13.141891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:13.141910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:13.142043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.142064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:13.142133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:13.142162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:13.142181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:13.142192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:13.142226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:13.142262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:13.142385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:13.142500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:13.142514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:13.142526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:13.142538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:13.142564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:13.144689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:13.144721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:13.144796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:13.145284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 724 partition: 0 MaxSeqNo: 36 sessionId: src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0
2025-10-10T14:08:13.146089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6299ba32-6837545e-9218fd88-9db036fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:13.168501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0] Write session: try to update token
2025-10-10T14:08:13.168559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:13.263506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:13.263538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:13.263551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:13.263670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:13.263688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:13.263704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:13.263716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:13.263730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:13.263764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.263793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.263819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.263845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.263974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:13.264013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:13.264049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:13.264088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:13.282577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:13.282624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.282639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:13.283713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:13.306934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId: src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:13.330014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:13.460546Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:13.473825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:13.473859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:13.473899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594673589414868:8888]
2025-10-10T14:08:13.474053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:13.474075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:13.474267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:13.475708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:13.477463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:13.477517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:13.509265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594670872369772:9722]
2025-10-10T14:08:13.509344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:13.509458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 724 reason: error at write: Disconnected sessionId: src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0
2025-10-10T14:08:13.509777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 724 sessionId: src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0 is DEAD
2025-10-10T14:08:13.513599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:13.513639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0] Write session will restart in 0.007639s
2025-10-10T14:08:13.513732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0] Write session: Do CDS request
2025-10-10T14:08:13.513758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:13.531577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:13.533859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:13.533891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 725
2025-10-10T14:08:13.534392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:13.534532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:13.534557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:13.534567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:13.537266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 725 sessionId:  describe result for acl check
2025-10-10T14:08:13.537388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:13.537404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:13.537413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:13.537433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594675167337321:9968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:13.539953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594675167337321:9968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:13.575023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594675167337321:9968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:13.598715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594675167337321:9968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:13.598762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594675167337321:9968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:13.598780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594675167337321:9968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:13.598812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:13.611844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594675167337444:9722]
2025-10-10T14:08:13.664199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:13.667118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:13.667945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:13.667962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:13.668005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:13.668237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:13.668416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594673589415204:8896]
2025-10-10T14:08:13.670500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:13.672109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:13.672311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:13.673313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:13.673653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:13.673662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:13.673670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:13.673676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:13.673684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:13.673691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:13.673699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:13.673706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:13.673712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.673719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.673725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.673732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.673784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:13.673892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:13.673942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:13.673999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:13.674045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:13.674092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:13.674137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:13.674181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:13.674226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.674278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.674332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.674378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.674421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:13.674485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:13.674547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:13.674602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:13.674652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:13.674707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:13.674752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:13.674803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:13.674851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:13.674901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:13.674951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:13.675004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:13.675047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:13.675100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:13.675143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:13.675197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:13.675244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.675309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.675358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.675414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.675461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.675516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.675566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.675618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.676060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:13.700874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:13.722545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:13.722593Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:13.722609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:13.722629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:13.722652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 724 [2:7559594673589415204:8896]
2025-10-10T14:08:13.722703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:13.722766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:13.722781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:13.722792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:13.722803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:13.722854Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:13.722876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:13.722897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:13.764627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.764658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.764669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.764679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.764690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:13.764970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:13.764985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.765115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:13.765586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:13.765809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:13.765918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:13.766023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594675167337444:9722], now have 1 active actors on pipe
2025-10-10T14:08:13.766047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594675167337431:9968], now have 1 active actors on pipe
2025-10-10T14:08:13.766067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594675167337305:2442], now have 1 active actors on pipe
2025-10-10T14:08:13.766095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594673589415199:8896]
2025-10-10T14:08:13.766111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594673589415199:8896]
2025-10-10T14:08:13.766124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594673589415199:8896]
2025-10-10T14:08:13.766137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594673589415199:8896]
2025-10-10T14:08:13.766179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:13.766261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:13.766432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:13.766452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:13.766579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594673589415199:8896]
2025-10-10T14:08:13.766597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:13.767153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:13.767174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:13.767184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:13.767194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:13.767220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:13.770488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 724, pipe: [1:7559594675167337444:9722]
2025-10-10T14:08:13.770610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 724
2025-10-10T14:08:13.770684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 724
2025-10-10T14:08:13.771143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:13.771193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:13.771298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:13.771348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:13.771368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:13.771377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:13.771416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:13.771465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:13.771515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:13.774653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:13.774687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:13.774772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:13.775295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 725 partition: 0 MaxSeqNo: 36 sessionId: src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0
2025-10-10T14:08:13.776213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc9860e8-cf4fd94e-d61a27c-2c17ca6b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:13.817010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0] Write session: try to update token
2025-10-10T14:08:13.817067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:13.823409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:13.823438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:13.823451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:13.919137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:13.919173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:13.919188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:13.919199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:13.919210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:13.919244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594673589415199:8896]
2025-10-10T14:08:13.919268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594673589415199:8896]
2025-10-10T14:08:13.919292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594673589415199:8896]
2025-10-10T14:08:13.919313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594673589415199:8896]
2025-10-10T14:08:13.919481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:13.919522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:13.919556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:13.919585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:13.919769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:13.919800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:13.919812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:13.921072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:13.998508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId: src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:14.026918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:14.124896Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:14.131468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:14.131506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:14.134211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:14.138579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594675167337444:9722]
2025-10-10T14:08:14.138806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:14.139368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:14.181760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 725 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0
2025-10-10T14:08:14.182133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 725 sessionId: src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0 is DEAD
2025-10-10T14:08:14.183512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:14.183550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0] Write session will restart in 0.009023s
2025-10-10T14:08:14.183667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0] Write session: Do CDS request
2025-10-10T14:08:14.183697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:14.199607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:14.201443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:14.201476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 726
2025-10-10T14:08:14.201845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:14.201961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:14.201999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:14.202012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:14.204555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 726 sessionId:  describe result for acl check
2025-10-10T14:08:14.204745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:14.204763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:14.204786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:14.204815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594679462304946:9978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:14.209010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594679462304946:9978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:14.227344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594679462304946:9978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:14.239009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594679462304946:9978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:14.239055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594679462304946:9978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:14.239074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594679462304946:9978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:14.239106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:14.239798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594679462304985:9722]
2025-10-10T14:08:14.400483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:14.420354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:14.421280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:14.421311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:14.421357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:14.421626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:14.421817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594677884382823:8904]
2025-10-10T14:08:14.425160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:14.427442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:14.427685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:14.429047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:14.429381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:14.429401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:14.429409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:14.429416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:14.429423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:14.429429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:14.429435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:14.429443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:14.429450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:14.429456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:14.429463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:14.429469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:14.429517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:14.429626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:14.429669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:14.429711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:14.429756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:14.429800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:14.429842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:14.429883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:14.429924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:14.429984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:14.430027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:14.430072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:14.430112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:14.430172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:14.430236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:14.430287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:14.430331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:14.430382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:14.430432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:14.430482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:14.430527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:14.430577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:14.430619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:14.430666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:14.430708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:14.430758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:14.430800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:14.430866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:14.430915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:14.430968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:14.431016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:14.431068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:14.431115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:14.431175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:14.431223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:14.431284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:14.431703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:14.490863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:14.510855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:14.510901Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:14.510917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:14.510937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:14.510961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 725 [2:7559594677884382823:8904]
2025-10-10T14:08:14.511016Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:14.511083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:14.511099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:14.511109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:14.511121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:14.511171Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:14.511192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:14.511213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:14.514280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:14.514307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:14.514321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:14.514334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:14.514346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:14.514621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:14.514637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:14.514772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:14.514942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:14.515147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:14.515253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:14.515325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594677884382817:8904]
2025-10-10T14:08:14.515339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594677884382817:8904]
2025-10-10T14:08:14.515351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594677884382817:8904]
2025-10-10T14:08:14.515363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594677884382817:8904]
2025-10-10T14:08:14.515406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:14.515484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:14.515651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:14.515669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:14.515797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594677884382817:8904]
2025-10-10T14:08:14.515814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:14.516645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:14.516663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:14.516673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:14.516684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:14.516708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:14.517725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594679462304984:9978], now have 1 active actors on pipe
2025-10-10T14:08:14.517754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594679462304985:9722], now have 1 active actors on pipe
2025-10-10T14:08:14.517774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594679462304932:2442], now have 1 active actors on pipe
2025-10-10T14:08:14.520064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 725
2025-10-10T14:08:14.520148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 725, pipe: [1:7559594679462304985:9722]
2025-10-10T14:08:14.520219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 725
2025-10-10T14:08:14.526864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:14.526913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:14.527024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:14.527060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:14.527079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:14.527091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:14.527132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:14.527182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:14.527230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:14.533584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:14.533629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:14.533715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:14.538296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 726 partition: 0 MaxSeqNo: 36 sessionId: src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0
2025-10-10T14:08:14.544036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4dba22e-7e4c40f1-5c455cb7-367b7dbc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:14.601048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0] Write session: try to update token
2025-10-10T14:08:14.601108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:14.613246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:14.613279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:14.613292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:14.690224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:14.690257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:14.690270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:14.690280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:14.690290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:14.690324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594677884382817:8904]
2025-10-10T14:08:14.690348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594677884382817:8904]
2025-10-10T14:08:14.690370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594677884382817:8904]
2025-10-10T14:08:14.690388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594677884382817:8904]
2025-10-10T14:08:14.690534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:14.690558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:14.690568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:14.690645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:14.690675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:14.690700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:14.690724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:14.691576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:14.780798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId: src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:14.809403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:14.912655Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:14.918079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:14.918127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:14.920721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:14.920769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:14.921270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:14.922498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:14.950224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594679462304985:9722]
2025-10-10T14:08:14.950465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 726 reason: error at write: Disconnected sessionId: src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0
2025-10-10T14:08:14.950811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 726 sessionId: src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0 is DEAD
2025-10-10T14:08:14.953707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:14.953750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0] Write session will restart in 0.005151s
2025-10-10T14:08:14.953858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0] Write session: Do CDS request
2025-10-10T14:08:14.953897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:14.963712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:14.973785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:14.973845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 727
2025-10-10T14:08:14.977310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:14.977494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:14.977514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:14.977525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:14.979204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 727 sessionId:  describe result for acl check
2025-10-10T14:08:14.979345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:14.979366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:14.979376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:14.979392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594679462305272:9988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:14.982459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594679462305272:9988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:15.000589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594679462305272:9988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:15.011232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594679462305272:9988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:15.011275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594679462305272:9988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:15.011291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594679462305272:9988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:15.011983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:15.050650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594683757272661:9722]
2025-10-10T14:08:15.114423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:15.131490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:15.132401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:15.132420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:15.132467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:15.132758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:15.132945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594682179350454:8912]
2025-10-10T14:08:15.135384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:15.136562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:15.136795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:15.139884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:15.140292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:15.140301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:15.140308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:15.140316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:15.140324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:15.140332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:15.140340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:15.140349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:15.140355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.140363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.140372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.140380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.140430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:15.140550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:15.140603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:15.140653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:15.140703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:15.140754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:15.140807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:15.140858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:15.140908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.140960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.141010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.141058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.141096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:15.141190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:15.141262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:15.141322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:15.141376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:15.141435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:15.141486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:15.141549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:15.141604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:15.141660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:15.141709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:15.141762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:15.141812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:15.141870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:15.141920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:15.141994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:15.142048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.142110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.142159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.142218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.142268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.142326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.142375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.142433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.142902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:15.169174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:15.188314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:15.188368Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:15.188384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:15.188406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:15.188430Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 726 [2:7559594682179350454:8912]
2025-10-10T14:08:15.188485Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:15.188551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:15.188568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:15.188579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:15.188589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:15.188639Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:15.188661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:15.188683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:15.191778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.191807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.191822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.191835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.191846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:15.192138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:15.192158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.192350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.192536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.192774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.192888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:15.192968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594682179350449:8912]
2025-10-10T14:08:15.192984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594682179350449:8912]
2025-10-10T14:08:15.192996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594682179350449:8912]
2025-10-10T14:08:15.193009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594682179350449:8912]
2025-10-10T14:08:15.193174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:15.193186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:15.193196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:15.193208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:15.193852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:15.193972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:15.194172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:15.194190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:15.194241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594683757272602:9988], now have 1 active actors on pipe
2025-10-10T14:08:15.194265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594679462305249:2442], now have 1 active actors on pipe
2025-10-10T14:08:15.194285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594683757272661:9722], now have 1 active actors on pipe
2025-10-10T14:08:15.194418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594682179350449:8912]
2025-10-10T14:08:15.194450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:15.195242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:15.197320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 726
2025-10-10T14:08:15.197429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 726
2025-10-10T14:08:15.197504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 726, pipe: [1:7559594683757272661:9722]
2025-10-10T14:08:15.197763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:15.197801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:15.197901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:15.197939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:15.197973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:15.197984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:15.198027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:15.198080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:15.198134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:15.204125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:15.204171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:15.204263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:15.205248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 727 partition: 0 MaxSeqNo: 36 sessionId: src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0
2025-10-10T14:08:15.209498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec6b638-81d7ff90-3a035731-a75b04a3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:15.257639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0] Write session: try to update token
2025-10-10T14:08:15.257695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:15.288726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:15.288755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:15.288765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:15.351604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:15.351645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:15.351661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:15.351676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:15.351686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:15.351725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594682179350449:8912]
2025-10-10T14:08:15.351753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594682179350449:8912]
2025-10-10T14:08:15.351777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594682179350449:8912]
2025-10-10T14:08:15.351797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594682179350449:8912]
2025-10-10T14:08:15.351958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:15.351993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.352004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:15.352258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:15.352322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:15.352357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:15.352397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:15.361413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:15.433489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId: src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:15.482030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:15.553590Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:15.555533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:15.555563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:15.558993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:15.557620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:15.557671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:15.558778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:15.558953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594683757272661:9722]
2025-10-10T14:08:15.649346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 727 reason: error at write: Disconnected sessionId: src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0
2025-10-10T14:08:15.649700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 727 sessionId: src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0 is DEAD
2025-10-10T14:08:15.655486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:15.655535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0] Write session will restart in 0.008931s
2025-10-10T14:08:15.655647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0] Write session: Do CDS request
2025-10-10T14:08:15.655680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:15.657361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594683757272942:9722]
2025-10-10T14:08:15.678617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:15.681366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:15.681421Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 728
2025-10-10T14:08:15.682406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:15.682682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:15.682714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:15.682739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:15.685016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 728 sessionId:  describe result for acl check
2025-10-10T14:08:15.685171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:15.685183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:15.685192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:15.685211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594683757272963:9999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:15.687778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594683757272963:9999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:15.719625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594683757272963:9999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:15.748443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594683757272963:9999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:15.748489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594683757272963:9999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:15.748509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594683757272963:9999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:15.748542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:15.796292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:15.806519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:15.807493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:15.807526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:15.807575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:15.807867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:15.808060Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594682179350764:8921]
2025-10-10T14:08:15.814787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:15.819834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:15.820127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:15.821446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:15.821770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:15.821780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:15.821787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:15.821795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:15.821803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:15.821811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:15.821819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:15.821827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:15.821834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.821840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.821846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.821853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.821901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:15.822033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:15.822084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:15.822131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:15.822175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:15.822220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:15.822264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:15.822306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:15.822352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.822401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.822447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.822488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.822527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:15.822596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:15.822662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:15.822718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:15.822763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:15.822812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:15.822857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:15.822915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:15.822961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:15.823010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:15.823053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:15.823104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:15.823146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:15.823198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:15.823244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:15.823294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:15.823338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.823389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.823431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.823487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.823531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.823583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.823627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.823679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.824114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:15.851268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:15.863288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:15.863335Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:15.863354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:15.863376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:15.863399Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 727 [2:7559594682179350764:8921]
2025-10-10T14:08:15.863459Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:15.863521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:15.863535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:15.863548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:15.863561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:15.863607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:15.863631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:15.863666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:15.864680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.864691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.864701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.864710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.864720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:15.865577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:15.865613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.865794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:15.866025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:15.866314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:15.866455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:15.866507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594683757272942:9722], now have 1 active actors on pipe
2025-10-10T14:08:15.866540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594683757272897:2442], now have 1 active actors on pipe
2025-10-10T14:08:15.866564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594683757273132:9999], now have 1 active actors on pipe
2025-10-10T14:08:15.866633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:15.866653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:15.866669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:15.866684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:15.866726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:15.866820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:15.866924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:15.866943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:15.866956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:15.866968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:15.867023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:15.867049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:15.867179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:15.867214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:15.867486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:15.868703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 727, pipe: [1:7559594683757272942:9722]
2025-10-10T14:08:15.868784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 727
2025-10-10T14:08:15.868870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 727
2025-10-10T14:08:15.875537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:15.875587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:15.875676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:15.875711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:15.875731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:15.875744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:15.875784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:15.875833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:15.875884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:15.880960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:15.881002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:15.881080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:15.882236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4079ddb3-806fd04e-9f0ddc2c-5b0162ce_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:15.881467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 728 partition: 0 MaxSeqNo: 36 sessionId: src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0
2025-10-10T14:08:15.902310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0] Write session: try to update token
2025-10-10T14:08:15.902371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:15.998717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:15.998744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:15.998754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:15.998761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:15.998768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:15.998792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:15.998810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:15.998826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:15.998840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:15.999017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:15.999024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:15.999031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:15.999068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:15.999085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:15.999093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:15.999353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:15.999385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:15.999412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:15.999440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:16.000235Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:16.010252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId: src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:16.053218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:16.195168Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:16.210849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:16.210915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:16.211000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:16.211016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:16.211061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594682179350759:8921]
2025-10-10T14:08:16.211268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:16.211670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:16.212662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:16.212856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594683757272942:9722]
2025-10-10T14:08:16.212960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:16.222707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 728 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0
2025-10-10T14:08:16.223077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 728 sessionId: src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0 is DEAD
2025-10-10T14:08:16.225058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:16.225138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0] Write session will restart in 0.009184s
2025-10-10T14:08:16.225283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0] Write session: Do CDS request
2025-10-10T14:08:16.225327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:16.246033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:16.246090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 729
2025-10-10T14:08:16.253856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:16.258020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:16.258172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:16.258201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:16.258213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:16.260176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 729 sessionId:  describe result for acl check
2025-10-10T14:08:16.260298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:16.260317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:16.260326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:16.260342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594688052240539:10005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:16.263116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594688052240539:10005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:16.283749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594688052240539:10005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:16.312238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594688052240582:9722]
2025-10-10T14:08:16.334074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594688052240539:10005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:16.334115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594688052240539:10005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:16.334132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594688052240539:10005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:16.334165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:16.422595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:16.424814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:16.425669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:16.425695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:16.425739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:16.426004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:16.426185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594686474318391:8931]
2025-10-10T14:08:16.428289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:16.434835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:16.435100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:16.436339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:16.436636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:16.436644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:16.436650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:16.436656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:16.436664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:16.436670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:16.436676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:16.436682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:16.436688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:16.436695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:16.436701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:16.436706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:16.436750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:16.436854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:16.436902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:16.436945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:16.436988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:16.437034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:16.437078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:16.437121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:16.437885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:16.437959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:16.438007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:16.438049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:16.438097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:16.438161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:16.438216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:16.438272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:16.438321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:16.438372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:16.438430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:16.438483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:16.438529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:16.438582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:16.438631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:16.438685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:16.438730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:16.438791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:16.438833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:16.438881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:16.438925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:16.438994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:16.439042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:16.439095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:16.439137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:16.439190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:16.439237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:16.439284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:16.439706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:16.475003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:16.509091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:16.513177Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:16.513226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:16.513244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:16.513266Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 728 [2:7559594686474318391:8931]
2025-10-10T14:08:16.513316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:16.513372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:16.513386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:16.513397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:16.513407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:16.513453Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:16.513473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:16.513493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:16.516563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:16.516588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:16.516601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:16.516613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:16.516623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:16.516902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:16.516919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:16.517045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:16.517224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:16.517425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:16.517528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:16.517615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594688052240582:9722], now have 1 active actors on pipe
2025-10-10T14:08:16.517640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594688052240525:2442], now have 1 active actors on pipe
2025-10-10T14:08:16.517661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594688052240597:10005], now have 1 active actors on pipe
2025-10-10T14:08:16.517685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.517701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.517713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.517725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.517764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:16.517839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:16.518016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:16.518032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:16.518161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.518183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:16.521232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:16.521261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:16.521272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:16.521285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:16.521317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:16.521601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 728, pipe: [1:7559594688052240582:9722]
2025-10-10T14:08:16.521716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 728
2025-10-10T14:08:16.521798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 728
2025-10-10T14:08:16.526603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:16.526683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:16.526789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:16.526833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:16.526853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:16.526865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:16.526903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:16.526949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:16.527006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:16.531652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:16.531694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:16.531840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:16.532600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 729 partition: 0 MaxSeqNo: 36 sessionId: src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0
2025-10-10T14:08:16.533649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d545cc-553afc7e-3e9ff0af-b578efa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:16.610002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0] Write session: try to update token
2025-10-10T14:08:16.610061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:16.622070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:16.622095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:16.622119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.622215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:16.622224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:16.622233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:16.622243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:16.622282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:16.628883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:16.630342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:16.632035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:16.635432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:16.637745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:16.638283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:16.712104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:16.712139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:16.712152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:16.712164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:16.712175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:16.712214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.712241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.712267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.712293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594686474318385:8931]
2025-10-10T14:08:16.712435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:16.712449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:16.712470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:16.712477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:16.712488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:16.712499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:16.712534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:16.713627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:16.743315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId: src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:16.763326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:16.860175Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:16.892852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:16.892911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:16.894522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:16.894905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594688052240582:9722]
2025-10-10T14:08:16.894983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:16.895106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:16.904697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:16.904778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0] Write session will restart in 0.008457s
2025-10-10T14:08:16.904928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0] Write session: Do CDS request
2025-10-10T14:08:16.904972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:16.904018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 729 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0
2025-10-10T14:08:16.904328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 729 sessionId: src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0 is DEAD
2025-10-10T14:08:16.923820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:16.935261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:16.935288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 730
2025-10-10T14:08:16.935592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:16.935717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:16.935739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:16.935749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:16.936910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 730 sessionId:  describe result for acl check
2025-10-10T14:08:16.937018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:16.937033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:16.937043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:16.937058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594688052240878:10018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:16.939637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594688052240878:10018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:16.952134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594688052240878:10018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:16.971183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594688052240878:10018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:16.971226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594688052240878:10018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:16.971238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594688052240878:10018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:16.971263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:16.993665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594688052240978:9722]
2025-10-10T14:08:17.074448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:17.084030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:17.084924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:17.084958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:17.085007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:17.085313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:17.085517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594690769286041:8938]
2025-10-10T14:08:17.087699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:17.088618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:17.088894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:17.090182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:17.090526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.090535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.090542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.090550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.090558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.090566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.090572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.090581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.090588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.090595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.090601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.090607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.090656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.090762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.090806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.090850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.090893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.090937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.090979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.091024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.091066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.091113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.091178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.091224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.091268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.091333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.091396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.091449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.091497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.091549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.091592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.091641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.091688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.091738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.091782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.091838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.091885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.091935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.091977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.092028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.092089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.092141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.092193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.092246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.092288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.092335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.092379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.092429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.092861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:17.124548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:17.165117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:17.165194Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:17.165211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:17.165231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:17.165254Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 729 [2:7559594690769286041:8938]
2025-10-10T14:08:17.165311Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:17.165377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:17.165392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:17.165403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:17.165415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:17.165464Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:17.165487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:17.165511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:17.167400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.167427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.167441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.167453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.167464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:17.167758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:17.167776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.167911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.168088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.168296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.168399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:17.168478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594690769286031:8938]
2025-10-10T14:08:17.168492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594690769286031:8938]
2025-10-10T14:08:17.168504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594690769286031:8938]
2025-10-10T14:08:17.168516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594690769286031:8938]
2025-10-10T14:08:17.168563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:17.168644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:17.168714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:17.168728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:17.168741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:17.168754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:17.168815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:17.168832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:17.168968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594690769286031:8938]
2025-10-10T14:08:17.168990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:17.169307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 729, pipe: [1:7559594688052240978:9722]
2025-10-10T14:08:17.169427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 729
2025-10-10T14:08:17.169517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 729
2025-10-10T14:08:17.169075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:17.169107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594688052240978:9722], now have 1 active actors on pipe
2025-10-10T14:08:17.169250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594688052240861:2442], now have 1 active actors on pipe
2025-10-10T14:08:17.169274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594688052240919:10018], now have 1 active actors on pipe
2025-10-10T14:08:17.169710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:17.169733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:17.169810Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:17.169855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:17.169873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:17.169884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:17.169933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:17.169980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:17.170025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:17.171495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:17.171523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:17.171587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:17.172033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 730 partition: 0 MaxSeqNo: 36 sessionId: src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0
2025-10-10T14:08:17.173705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd193ec-709ecd8e-3ad8ed90-670381d0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:17.202861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0] Write session: try to update token
2025-10-10T14:08:17.202931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:17.240310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:17.240345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:17.240360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:17.240370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:17.240383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:17.240422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594690769286031:8938]
2025-10-10T14:08:17.240449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594690769286031:8938]
2025-10-10T14:08:17.240473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594690769286031:8938]
2025-10-10T14:08:17.240494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594690769286031:8938]
2025-10-10T14:08:17.240650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:17.240685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.240697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:17.241243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:17.241286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:17.241315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:17.241343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:17.242791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:17.319914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId: src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:17.340729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:17.445300Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:17.447615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:17.447659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:17.450098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:17.450130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594688052240978:9722]
2025-10-10T14:08:17.450230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:17.450242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:17.459062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 730 reason: error at write: Disconnected sessionId: src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0
2025-10-10T14:08:17.459297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 730 sessionId: src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0 is DEAD
2025-10-10T14:08:17.459766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:17.459813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0] Write session will restart in 0.006974s
2025-10-10T14:08:17.459988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0] Write session: Do CDS request
2025-10-10T14:08:17.460052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:17.478208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:17.478256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 731
2025-10-10T14:08:17.478709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:17.479544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:17.479738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:17.479782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:17.479798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:17.477929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:17.482258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 731 sessionId:  describe result for acl check
2025-10-10T14:08:17.482454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:17.482490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:17.482511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:17.482549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594692347208512:10027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:17.486253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594692347208512:10027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:17.493046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594692347208512:10027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:17.501352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594692347208512:10027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:17.501393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594692347208512:10027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:17.501412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594692347208512:10027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:17.501444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:17.516572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:17.521526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:17.522445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:17.522466Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:17.522513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:17.522809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:17.523002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594690769286096:8944]
2025-10-10T14:08:17.524973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:17.526295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:17.526540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:17.527869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:17.528204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.528213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.528220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.528228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.528236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.528244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.528251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.528259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.528266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.528273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.528281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.528290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.528345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.528467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.528521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.528578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.528632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.528686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.528739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.528787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.528839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.528889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.528938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.528986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.529032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.529108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.529789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.529871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.529953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.530014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.530068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.530128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.530183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.530242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.530297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.530358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.530413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.530472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.530523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.530581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.530638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.530697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.530751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.530808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.530858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.530916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.530966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.531026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.531512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:17.550284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594692347208559:9722]
2025-10-10T14:08:17.553801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:17.568311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:17.568363Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:17.568386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:17.568409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:17.568434Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 730 [2:7559594690769286096:8944]
2025-10-10T14:08:17.568498Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:17.568561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:17.568583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:17.568597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:17.568610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:17.568659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:17.568687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:17.568709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:17.570582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.570612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.570629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.570646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.570658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:17.571085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:17.571114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.571291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.571511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.571779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.571758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 730
2025-10-10T14:08:17.571994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:17.571773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 730, pipe: [1:7559594692347208559:9722]
2025-10-10T14:08:17.571891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 730
2025-10-10T14:08:17.572153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594692347208551:10027], now have 1 active actors on pipe
2025-10-10T14:08:17.572189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594692347208559:9722], now have 1 active actors on pipe
2025-10-10T14:08:17.572211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594692347208503:2442], now have 1 active actors on pipe
2025-10-10T14:08:17.572268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:17.572301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:17.572340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.572360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.572374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.572393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.572436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:17.572482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:17.572507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:17.572530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:17.572535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:17.572540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:17.572751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:17.572777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:17.572863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|703c10d4-e120caf3-d5168b78-280118c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:17.572897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:17.572916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:17.572927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:17.572962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:17.573007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:17.573167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.573204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:17.573238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:17.573257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:17.574072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:17.574104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:17.574184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:17.574653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 731 partition: 0 MaxSeqNo: 36 sessionId: src_id|703c10d4-e120caf3-d5168b78-280118c5_0
2025-10-10T14:08:17.575529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e921d0aa-11b8ae65-74b18291-b97182aa_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|703c10d4-e120caf3-d5168b78-280118c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:17.597785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703c10d4-e120caf3-d5168b78-280118c5_0] Write session: try to update token
2025-10-10T14:08:17.597842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703c10d4-e120caf3-d5168b78-280118c5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:17.686684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:17.686725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:17.686740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:17.686750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:17.686760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:17.686795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.686819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.686844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.686863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.687103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:17.687116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:17.687127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:17.687176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:17.687203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.687217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:17.688273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:17.688305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:17.688334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:17.688361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:17.692798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:17.700903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId: src_id|703c10d4-e120caf3-d5168b78-280118c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:17.721661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:17.834132Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:17.850528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:17.850566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:17.850615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:17.850625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:17.850650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594690769286091:8944]
2025-10-10T14:08:17.850840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:17.851097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:17.851138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:17.851171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:17.851181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594692347208559:9722]
2025-10-10T14:08:17.851274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:17.868149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 731 reason: error at write: Disconnected sessionId: src_id|703c10d4-e120caf3-d5168b78-280118c5_0
2025-10-10T14:08:17.868390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 731 sessionId: src_id|703c10d4-e120caf3-d5168b78-280118c5_0 is DEAD
2025-10-10T14:08:17.869055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703c10d4-e120caf3-d5168b78-280118c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:17.869111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703c10d4-e120caf3-d5168b78-280118c5_0] Write session will restart in 0.007064s
2025-10-10T14:08:17.869286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703c10d4-e120caf3-d5168b78-280118c5_0] Write session: Do CDS request
2025-10-10T14:08:17.869319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703c10d4-e120caf3-d5168b78-280118c5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:17.881406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:17.881566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703c10d4-e120caf3-d5168b78-280118c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:17.881475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 732
2025-10-10T14:08:17.882554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:17.882772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:17.882816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:17.882840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:17.884653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 732 sessionId:  describe result for acl check
2025-10-10T14:08:17.884772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:17.884790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:17.884799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:17.884815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594692347208585:10032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:17.887450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594692347208585:10032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:17.893460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594692347208585:10032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:17.903628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:17.904264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594692347208585:10032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:17.904308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594692347208585:10032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:17.904327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594692347208585:10032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:17.904361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:17.910754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:17.911637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:17.911657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:17.911699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:17.911943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:17.912123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594690769286167:8952]
2025-10-10T14:08:17.914054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:17.915104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:17.915365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:17.916709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:17.917035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.917054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.917062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.917071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.917078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.917085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.917092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.917100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.917106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.917113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.917120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.917142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.917191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.917300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.917349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.917404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.917457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.917509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.917557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.917605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.917656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.917704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.917756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.917809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.917858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.917944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:17.918010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.918075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:17.918119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.918160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:17.918194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.918230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:17.918266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.918306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:17.918340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.918379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:17.918413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.918453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:17.918485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.918524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:17.918579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.918621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.918649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.918688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.918724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.918763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.918794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.918833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.919127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:17.945972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:17.953061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594692347208625:9722]
2025-10-10T14:08:17.969152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:17.969193Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:17.969209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:17.969228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:17.969250Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 731 [2:7559594690769286167:8952]
2025-10-10T14:08:17.969302Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:17.969355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:17.969368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:17.969381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:17.969390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:17.969434Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:17.969456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:17.969475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:17.971634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.971665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.971678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.971692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.971704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:17.971965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:17.971988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:17.972126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:17.972197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 731, pipe: [1:7559594692347208625:9722]
2025-10-10T14:08:17.972244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 731
2025-10-10T14:08:17.972299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 731
2025-10-10T14:08:17.972315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:17.972556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:17.972677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:17.972758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594692347208625:9722], now have 1 active actors on pipe
2025-10-10T14:08:17.972788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594692347208617:10032], now have 1 active actors on pipe
2025-10-10T14:08:17.972818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594692347208570:2442], now have 1 active actors on pipe
2025-10-10T14:08:17.972847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:17.972866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:17.972879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:17.972892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:17.972928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:17.972966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:17.972987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:17.972998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:17.973022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:17.973023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:17.973042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:17.973101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:17.973300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:17.973321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:17.973480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:17.973515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:17.973537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:17.973549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:17.973583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:17.973623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:17.973665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:17.973700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:17.973742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:17.973790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:17.974904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:17.974945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:17.975022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:17.975261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 732 partition: 0 MaxSeqNo: 36 sessionId: src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0
2025-10-10T14:08:17.975883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703c10d4-e120caf3-d5168b78-280118c5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:17.997603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0] Write session: try to update token
2025-10-10T14:08:17.997656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:18.066799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:18.066827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:18.066839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:18.066850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:18.066861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:18.066893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:18.066920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:18.066943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:18.066964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:18.067135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:18.067173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:18.067174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:18.067199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.067210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:18.067217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:18.067234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:18.068442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:18.091954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId: src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:18.114795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:18.209112Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:18.222073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:18.222121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:18.222186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:18.222203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:18.222244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594690769286161:8952]
2025-10-10T14:08:18.222466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:18.222617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:18.222644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:18.222798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:18.260579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 732 reason: error at write: Disconnected sessionId: src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0
2025-10-10T14:08:18.260869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 732 sessionId: src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0 is DEAD
2025-10-10T14:08:18.261350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:18.261406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0] Write session will restart in 0.007959s
2025-10-10T14:08:18.261574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0] Write session: Do CDS request
2025-10-10T14:08:18.261618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:18.276347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:18.278360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:18.278420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:18.278524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594692347208625:9722]
2025-10-10T14:08:18.278629Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:18.278647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 733
2025-10-10T14:08:18.279051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:18.279164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:18.279183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:18.279193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:18.280448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 733 sessionId:  describe result for acl check
2025-10-10T14:08:18.280543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:18.280559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:18.280569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:18.280586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594696642175980:10044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:18.283304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594696642175980:10044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:18.283752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:18.284710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:18.284730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:18.284765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:18.284983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:18.285114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594695064253552:8961]
2025-10-10T14:08:18.286723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:18.287604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:18.287879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:18.289445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:18.289825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:18.289833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:18.289839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:18.289846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:18.289853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:18.289859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:18.289865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:18.289872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:18.289878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.289884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.289891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.289913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.289958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:18.290062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:18.290113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:18.290155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:18.290196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:18.290239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:18.290377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594696642175980:10044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:18.290283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:18.290326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:18.290368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.290410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.290452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.290494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.290531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:18.290594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:18.290649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:18.290700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:18.290746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:18.290795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:18.290837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:18.290888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:18.290932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:18.290981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:18.291027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:18.291079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:18.291118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:18.291167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:18.291209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:18.291260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:18.291312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.291362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.291407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.291458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.291542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.291596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.291640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.291696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.292107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:18.311526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594696642175980:10044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:18.311585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594696642175980:10044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:18.311605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594696642175980:10044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:18.311637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:18.332139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:18.346171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:18.346216Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:18.346234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:18.346253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:18.346276Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 732 [2:7559594695064253552:8961]
2025-10-10T14:08:18.346329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:18.346390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:18.346410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:18.346423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:18.346433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:18.346482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:18.346507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:18.346548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:18.348892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.348919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.348931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.348943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.348956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:18.349237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:18.349259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.349555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 732
2025-10-10T14:08:18.349671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 732
2025-10-10T14:08:18.349394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.349576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.349785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.349894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:18.349991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594696642175975:2442], now have 1 active actors on pipe
2025-10-10T14:08:18.350012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594696642176012:10044], now have 1 active actors on pipe
2025-10-10T14:08:18.350071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:18.350092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:18.350128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.350143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.350155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.350166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.350206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:18.350246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:18.350260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:18.350272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:18.350282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:18.350283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:18.350441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:18.350457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:18.350522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:18.350553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:18.350570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:18.350581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:18.350631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:18.350674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:18.350804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.350830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:18.350861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:18.350874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:18.351447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:18.351469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:18.351534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:18.351827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 733 partition: 0 MaxSeqNo: 36 sessionId: src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0
2025-10-10T14:08:18.352459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b423e035-3f11aadf-496cb7c4-43e2ff0d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:18.372447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0] Write session: try to update token
2025-10-10T14:08:18.372501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:18.378645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594696642176025:9722]
2025-10-10T14:08:18.379221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 732, pipe: [1:7559594696642176025:9722]
2025-10-10T14:08:18.407651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594696642176025:9722], now have 1 active actors on pipe
2025-10-10T14:08:18.407706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:18.407719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:18.407756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.407874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:18.407885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:18.416666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:18.421861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:18.425104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:18.427730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:18.437082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:18.437769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:18.476993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:18.477026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:18.477038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:18.477108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:18.477135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:18.477150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:18.477161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:18.477171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:18.477214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.477242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.477265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.477287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594695064253545:8961]
2025-10-10T14:08:18.477414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:18.477428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:18.477455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.477456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:18.477465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:18.477498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:18.477532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:18.480879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:18.497683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId: src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:18.518783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:18.639367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:18.639530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:18.639532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594696642176025:9722]
2025-10-10T14:08:18.639539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:18.636180Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:18.638773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:18.638810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:18.639609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:18.683384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:18.685982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:18.686886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 733 reason: error at write: Disconnected sessionId: src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0
2025-10-10T14:08:18.687245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:18.687276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:18.687324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:18.688157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:18.687284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 733 sessionId: src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0 is DEAD
2025-10-10T14:08:18.688208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0] Write session will restart in 0.007815s
2025-10-10T14:08:18.688373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0] Write session: Do CDS request
2025-10-10T14:08:18.687637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:18.687924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594695064253618:8965]
2025-10-10T14:08:18.688418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:18.691608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:18.697319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:18.697601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:18.698984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:18.699323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:18.699341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:18.699349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:18.699357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:18.699362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:18.699369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:18.699375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:18.699382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:18.699388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.699394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.699400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.699406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.699452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:18.699566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:18.699616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:18.699660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:18.699705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:18.699751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:18.699807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:18.699853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:18.699907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.699961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.700021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.700079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.700120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:18.700053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:18.700085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 734
2025-10-10T14:08:18.700202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:18.700271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:18.700345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:18.700431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:18.700408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:18.700480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:18.700538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:18.700606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:18.700745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:18.700815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:18.700871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:18.700936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:18.701002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:18.700994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:18.701061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:18.701115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:18.701193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:18.701263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.701331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.701372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.701419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.701466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.701535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.701584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.701637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.702325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:18.701147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:18.701171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:18.701181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:18.703003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 734 sessionId:  describe result for acl check
2025-10-10T14:08:18.703159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:18.703178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:18.703216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:18.703245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594696642176067:10052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:18.707328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594696642176067:10052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:18.713002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594696642176067:10052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:18.723192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594696642176067:10052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:18.723232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594696642176067:10052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:18.723248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594696642176067:10052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:18.723292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:18.728924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:18.739666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594696642176100:9722]
2025-10-10T14:08:18.742747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:18.742796Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:18.742815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:18.742836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:18.742861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 733 [2:7559594695064253618:8965]
2025-10-10T14:08:18.742921Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:18.742981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:18.743004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:18.743017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:18.743028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:18.743075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:18.743098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:18.743120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:18.764395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.764424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.764435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.764448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.764460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:18.764727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:18.764743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.764890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:18.765050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:18.765296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:18.765421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:18.765492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.765508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.765523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.765537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.765568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:18.765604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:18.765621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:18.765633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:18.765645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:18.765650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:18.765844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:18.765872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:18.765931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594696642176100:9722], now have 1 active actors on pipe
2025-10-10T14:08:18.765958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594696642176043:2442], now have 1 active actors on pipe
2025-10-10T14:08:18.765981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594696642176099:10052], now have 1 active actors on pipe
2025-10-10T14:08:18.766098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.766143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:18.766457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 733, pipe: [1:7559594696642176100:9722]
2025-10-10T14:08:18.766566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 733
2025-10-10T14:08:18.766663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 733
2025-10-10T14:08:18.769215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:18.769555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:18.769594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:18.769699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:18.769731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:18.769751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:18.769763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:18.769812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:18.769854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:18.769918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:18.775970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:18.776012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:18.776098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:18.776438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 734 partition: 0 MaxSeqNo: 36 sessionId: src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0
2025-10-10T14:08:18.777337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed2f22d-723bb80c-789d3a7e-1b224454_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:18.820789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:18.820823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:18.820864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.820993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:18.821260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:18.824568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0] Write session: try to update token
2025-10-10T14:08:18.824622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:18.837674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:18.845876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:18.852444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:18.866157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:18.868247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:18.868756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:18.868778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:18.868787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:18.868834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:18.934056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:18.934088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:18.934101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:18.934112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:18.934121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:18.934161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.934189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.934214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.934240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594695064253613:8965]
2025-10-10T14:08:18.934386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:18.934402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:18.934420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:18.934432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:18.934439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:18.934489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:18.934534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:18.935699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:18.969952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId: src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:18.998790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:19.080942Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:19.082729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:19.082773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:19.083490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:19.083561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:19.096757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:19.096819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0] Write session will restart in 0.007667s
2025-10-10T14:08:19.096968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0] Write session: Do CDS request
2025-10-10T14:08:19.097029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:19.083655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:19.083673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:19.085292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594696642176100:9722]
2025-10-10T14:08:19.096169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 734 reason: error at write: Disconnected sessionId: src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0
2025-10-10T14:08:19.096517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 734 sessionId: src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0 is DEAD
2025-10-10T14:08:19.125792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:19.125821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 735
2025-10-10T14:08:19.126111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:19.126677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:19.126803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:19.126824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:19.126834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:19.128511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 735 sessionId:  describe result for acl check
2025-10-10T14:08:19.128588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:19.128599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:19.128607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:19.128624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594700937143439:10058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:19.130535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594700937143439:10058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:19.135879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594700937143439:10058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:19.146792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594700937143439:10058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:19.146826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594700937143439:10058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:19.146838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594700937143439:10058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:19.146860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:19.146951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:19.149043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:19.149820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:19.149845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:19.149896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:19.150114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:19.150292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594699359220994:8969]
2025-10-10T14:08:19.152509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:19.153463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:19.153696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:19.155108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:19.155506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.155522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.155530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.155537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.155545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.155553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.155559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.155565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.155570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.155576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.155583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.155592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.155645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.155761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.155811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.155871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.155927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.155976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.156029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.156084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.156135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.156186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.156236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.156288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.156330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.156403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.156470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.156529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.156579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.156637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.156690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.156749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.156800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.156857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.156910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.156968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.157021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.157081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.157293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.157371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.157426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.157488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.157544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.157603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.157650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.157705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.157767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.157821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.158299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:19.185551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594700937143481:9722]
2025-10-10T14:08:19.195449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:19.208657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:19.208705Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:19.208722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:19.208741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:19.208764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 734 [2:7559594699359220994:8969]
2025-10-10T14:08:19.208821Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:19.208878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:19.208892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:19.208904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:19.208917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:19.208967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:19.208989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:19.209010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:19.211332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.211364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.211380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.211394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.211406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:19.211717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:19.211745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.211894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.212103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.212345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.212472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:19.212570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594700937143475:10058], now have 1 active actors on pipe
2025-10-10T14:08:19.212605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594700937143412:2442], now have 1 active actors on pipe
2025-10-10T14:08:19.212636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594700937143481:9722], now have 1 active actors on pipe
2025-10-10T14:08:19.212662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.212678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.212703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.212717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.212753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:19.212841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:19.212850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:19.212861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:19.212871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:19.212872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:19.212884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:19.212918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:19.213107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:19.213153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:19.213327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|350abafc-c4bfff44-348a9c73-89f1235e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:19.213365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:19.213382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:19.213394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:19.213428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:19.213466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:19.213501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.213534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:19.213563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:19.213645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:19.215046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:19.215075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:19.215158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:19.216202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffcff483-69c89072-9eaf8829-ce65fd67_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|350abafc-c4bfff44-348a9c73-89f1235e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:19.212036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 734
2025-10-10T14:08:19.212131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 734
2025-10-10T14:08:19.212213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 734, pipe: [1:7559594700937143481:9722]
2025-10-10T14:08:19.215532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 735 partition: 0 MaxSeqNo: 36 sessionId: src_id|350abafc-c4bfff44-348a9c73-89f1235e_0
2025-10-10T14:08:19.255298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350abafc-c4bfff44-348a9c73-89f1235e_0] Write session: try to update token
2025-10-10T14:08:19.255349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350abafc-c4bfff44-348a9c73-89f1235e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:19.337297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:19.337327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:19.337338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:19.337349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:19.337358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:19.337393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.337417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.337440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.337457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.337548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:19.337578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:19.337622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:19.337651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:19.337657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:19.337662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:19.337671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:19.337715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:19.337739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.337753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:19.340900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:19.367405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId: src_id|350abafc-c4bfff44-348a9c73-89f1235e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:19.391857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:19.484311Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:19.514830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:19.514860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:19.514872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:19.515072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594700937143481:9722]
2025-10-10T14:08:19.514088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:19.514142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:19.514215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:19.514227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:19.514269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594699359220988:8969]
2025-10-10T14:08:19.514446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:19.514844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:19.525613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 735 reason: error at write: Disconnected sessionId: src_id|350abafc-c4bfff44-348a9c73-89f1235e_0
2025-10-10T14:08:19.525967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 735 sessionId: src_id|350abafc-c4bfff44-348a9c73-89f1235e_0 is DEAD
2025-10-10T14:08:19.526288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350abafc-c4bfff44-348a9c73-89f1235e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:19.526321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350abafc-c4bfff44-348a9c73-89f1235e_0] Write session will restart in 0.005981s
2025-10-10T14:08:19.526412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350abafc-c4bfff44-348a9c73-89f1235e_0] Write session: Do CDS request
2025-10-10T14:08:19.526455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350abafc-c4bfff44-348a9c73-89f1235e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:19.537597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|350abafc-c4bfff44-348a9c73-89f1235e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:19.538045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:19.538108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 736
2025-10-10T14:08:19.542793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:19.542955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:19.542991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:19.543004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:19.556130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 736 sessionId:  describe result for acl check
2025-10-10T14:08:19.556257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:19.556274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:19.556283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:19.556298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594700937143513:10062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:19.558738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594700937143513:10062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:19.573595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594700937143513:10062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:19.587341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594700937143513:10062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:19.587373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594700937143513:10062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:19.587384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594700937143513:10062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:19.587406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:19.587639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:19.589765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:19.590526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:19.590550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:19.590594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:19.590797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:19.590959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594699359221081:8977]
2025-10-10T14:08:19.592915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:19.593846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:19.594076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:19.595123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:19.595383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.595397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.595404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.595411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.595416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.595424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.595431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.595438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.595444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.595451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.595458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.595464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.595512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.595616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.595664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.595716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.595766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.595816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.595864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.595912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.595959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.596012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.596049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.596084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.596113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.596162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.596201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.596237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.596270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.596308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.596338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.596376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.596410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.596448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.596480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.596519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.596550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.596587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.596620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.596658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.596690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.596725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.596756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.596792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.596825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.596862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.596893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.596931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.597258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:19.615157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594700937143567:9722]
2025-10-10T14:08:19.622686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:19.638716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:19.638765Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:19.638783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:19.638803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:19.638826Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 735 [2:7559594699359221081:8977]
2025-10-10T14:08:19.638885Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:19.638943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:19.638959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:19.638971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:19.638983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:19.639028Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:19.639051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:19.639074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:19.658283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.658310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.658322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.658335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.658347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:19.658620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:19.658649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.658787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.658977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.659199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.659328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:19.659396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594699359221075:8977]
2025-10-10T14:08:19.659412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594699359221075:8977]
2025-10-10T14:08:19.659424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594699359221075:8977]
2025-10-10T14:08:19.659438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594699359221075:8977]
2025-10-10T14:08:19.659478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:19.659556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:19.659620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:19.659645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:19.659656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:19.659669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:19.659739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:19.659762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:19.659880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594699359221075:8977]
2025-10-10T14:08:19.659913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:19.659917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:19.659960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594700937143559:10062], now have 1 active actors on pipe
2025-10-10T14:08:19.659985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594700937143567:9722], now have 1 active actors on pipe
2025-10-10T14:08:19.660045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594700937143495:2442], now have 1 active actors on pipe
2025-10-10T14:08:19.660164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 735
2025-10-10T14:08:19.660261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 735, pipe: [1:7559594700937143567:9722]
2025-10-10T14:08:19.660337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 735
2025-10-10T14:08:19.660409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:19.660448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:19.660521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:19.660542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:19.660553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:19.660560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:19.660584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:19.660614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:19.660646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:19.661114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:19.661165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:19.661241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:19.661512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 736 partition: 0 MaxSeqNo: 36 sessionId: src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0
2025-10-10T14:08:19.662288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|350abafc-c4bfff44-348a9c73-89f1235e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:19.683029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0] Write session: try to update token
2025-10-10T14:08:19.683085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:19.735391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:19.735425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:19.735440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:19.735450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:19.735460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:19.735497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594699359221075:8977]
2025-10-10T14:08:19.735524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594699359221075:8977]
2025-10-10T14:08:19.735547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594699359221075:8977]
2025-10-10T14:08:19.735568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594699359221075:8977]
2025-10-10T14:08:19.735716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:19.735728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:19.735749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.735761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:19.735780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:19.735819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:19.735853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:19.737080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:19.795508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId: src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:19.824685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:19.886817Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:19.889724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:19.889765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:19.890569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:19.890628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:19.899170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 736 reason: error at write: Disconnected sessionId: src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0
2025-10-10T14:08:19.899491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 736 sessionId: src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0 is DEAD
2025-10-10T14:08:19.901435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:19.901493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0] Write session will restart in 0.009728s
2025-10-10T14:08:19.901668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0] Write session: Do CDS request
2025-10-10T14:08:19.901720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:19.919727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:19.921189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594700937143567:9722]
2025-10-10T14:08:19.921283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:19.921424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:19.921445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 737
2025-10-10T14:08:19.921817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:19.921959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:19.921980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:19.921989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:19.923289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 737 sessionId:  describe result for acl check
2025-10-10T14:08:19.923397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:19.923412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:19.923421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:19.923437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594700937143593:10073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:19.925835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594700937143593:10073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:19.929473Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:19.931590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594700937143593:10073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:19.943955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:19.946809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594700937143593:10073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:19.946851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594700937143593:10073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:19.946868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594700937143593:10073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:19.946899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:19.946310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:19.947082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:19.947100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:19.947140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:19.947411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:19.947609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594699359221144:8984]
2025-10-10T14:08:19.949725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:19.950575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:19.950774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:19.951940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:19.952219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.952227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.952233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.952242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.952249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.952256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.952262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.952268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.952274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.952280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.952287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.952294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.952339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.952439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.952486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.952531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.952572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.952616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.952657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.952698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.952740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.952785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.952827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.952868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.952905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.952967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:19.953022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.953076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:19.953145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.953198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:19.953239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.953287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:19.953333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.954121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:19.954182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.954238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:19.954283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.954340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:19.954383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.954435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:19.954490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.954544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.954593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.954648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.954699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.954754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.954801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.954852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.955269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:19.980383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:19.995502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:19.995543Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:19.995558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:19.995577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:19.995598Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 736 [2:7559594699359221144:8984]
2025-10-10T14:08:19.995650Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:19.995704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:19.995719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:19.995732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:19.995743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:19.995791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:19.995813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:19.995834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:19.998182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.998210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.998225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.998237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.998248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:19.998798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 736
2025-10-10T14:08:19.998917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 736
2025-10-10T14:08:19.998517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:19.998541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:19.998672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:19.998846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:19.999060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:19.999167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:19.999243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594700937143588:2442], now have 1 active actors on pipe
2025-10-10T14:08:19.999265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594700937143632:10073], now have 1 active actors on pipe
2025-10-10T14:08:19.999322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:19.999339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:19.999375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:19.999388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:19.999402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:19.999414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:19.999451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:19.999486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:19.999499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:19.999510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:19.999520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:19.999523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:19.999685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:19.999702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:19.999759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:19.999787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:19.999805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:19.999815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:19.999848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:19.999885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:20.000002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:20.000038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:20.000057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:20.000078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:20.000669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:20.000700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:20.000755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:20.001053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 737 partition: 0 MaxSeqNo: 36 sessionId: src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0
2025-10-10T14:08:20.001787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c2217f-e647b35a-ab0587d2-bb926ce4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:20.021660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594705232110953:9722]
2025-10-10T14:08:20.022241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 736, pipe: [1:7559594705232110953:9722]
2025-10-10T14:08:20.024639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0] Write session: try to update token
2025-10-10T14:08:20.024682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:20.066594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594705232110953:9722], now have 1 active actors on pipe
2025-10-10T14:08:20.066667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:20.066694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:20.066749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:20.066925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:20.069297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:20.070142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:20.072343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:20.075191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:20.080862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:20.082719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:20.083305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:20.112215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:20.112246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:20.112258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:20.112317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:20.112332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:20.112345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:20.112355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:20.112364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:20.112411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:20.112439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:20.112463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:20.112494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594699359221139:8984]
2025-10-10T14:08:20.112602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:20.112643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:20.112643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:20.112664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:20.112671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.112683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:20.112684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:20.114802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:20.132411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId: src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:20.153365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1010 14:08:20.241747522  106882 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:08:20.243118Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:08:20.258852Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:20.260608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:20.260648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:20.261282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:20.261406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:20.261446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594705232110953:9722]
2025-10-10T14:08:20.261530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:20.261546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:20.270988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 737 reason: error at write: Disconnected sessionId: src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0
2025-10-10T14:08:20.271367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 737 sessionId: src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0 is DEAD
2025-10-10T14:08:20.271859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:20.271921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0] Write session will restart in 0.009620s
2025-10-10T14:08:20.272122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0] Write session: Do CDS request
2025-10-10T14:08:20.272199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:20.286510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:20.286561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 738
2025-10-10T14:08:20.286739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:20.287592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:20.287797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:20.287837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:20.287853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:20.290055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 738 sessionId:  describe result for acl check
2025-10-10T14:08:20.290182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:20.290201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:20.290211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:20.290229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594705232110983:10082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:20.293538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594705232110983:10082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:20.303028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594705232110983:10082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:20.315731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594705232110983:10082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:20.315772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594705232110983:10082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:20.315791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594705232110983:10082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:20.315823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:20.315880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:20.317730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:20.318544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:20.318573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:20.318614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:20.318855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:20.319057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594703654188527:8990]
2025-10-10T14:08:20.321089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:20.321964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:20.322175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:20.323362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:20.323668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:20.323685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:20.323692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:20.323699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:20.323706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:20.323712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:20.323719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:20.323726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:20.323733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.323740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.323746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.323753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.323795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:20.323900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:20.323945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:20.323992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:20.324043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:20.324093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:20.324140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:20.324186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:20.324234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.324282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.324332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.324380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.324423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:20.324488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:20.324546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:20.324601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:20.324651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:20.324711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:20.324754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:20.324802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:20.324852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:20.324903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:20.324952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:20.325008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:20.325052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:20.325110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:20.325177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:20.325231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:20.325281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.325336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.325382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.325435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.325480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.325534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.325580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.325631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.326064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:20.349068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:20.361686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594705232111031:9722]
2025-10-10T14:08:20.365996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:20.366048Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:20.366065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:20.366085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:20.366110Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 737 [2:7559594703654188527:8990]
2025-10-10T14:08:20.366167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:20.366232Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:20.366247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:20.366260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:20.366271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:20.366318Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:20.366341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:20.366366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:20.367779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.367794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.367807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.367821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.367830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:20.368111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:20.368127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.368267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.368441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.368653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.368764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:20.368840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.368854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.368866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.368879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.368924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:20.368999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:20.369331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:20.369346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:20.369357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:20.369368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:20.370027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 737
2025-10-10T14:08:20.370137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 737, pipe: [1:7559594705232111031:9722]
2025-10-10T14:08:20.370223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 737
2025-10-10T14:08:20.369998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:20.370026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:20.370189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594705232111023:10082], now have 1 active actors on pipe
2025-10-10T14:08:20.370213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594705232111031:9722], now have 1 active actors on pipe
2025-10-10T14:08:20.370243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594705232110968:2442], now have 1 active actors on pipe
2025-10-10T14:08:20.370270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.370294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:20.370321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:20.370358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:20.370379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:20.370551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:20.370585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:20.370603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:20.370612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:20.370648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:20.370694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:20.370770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:20.372051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:20.372092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:20.372171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:20.372569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 738 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0
2025-10-10T14:08:20.373329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|852914ed-9fa3df2a-8f985a6b-58b625f9_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:20.392989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0] Write session: try to update token
2025-10-10T14:08:20.393034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:20.465584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId: src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:20.466459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:20.466490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:20.466500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:20.466508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:20.466515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:20.466549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.466569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.466587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.466606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.466696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:20.466715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:20.466733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:20.466749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:20.466809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:20.466826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:20.466836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:20.466877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:20.466899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.466908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:20.467932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:20.487293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:20.619327Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:20.632204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:20.632253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:20.632323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:20.632337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:20.632377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594703654188521:8990]
2025-10-10T14:08:20.632537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:20.632819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:20.632848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:20.632856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594705232111031:9722]
2025-10-10T14:08:20.632984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:20.632962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:20.660267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 738 reason: error at write: Disconnected sessionId: src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0
2025-10-10T14:08:20.660524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 738 sessionId: src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0 is DEAD
2025-10-10T14:08:20.660818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:20.660852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0] Write session will restart in 0.005384s
2025-10-10T14:08:20.660961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0] Write session: Do CDS request
2025-10-10T14:08:20.661003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:20.669825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:20.669869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 739
2025-10-10T14:08:20.670056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:20.670537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:20.670665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:20.670685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:20.670694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:20.671914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 739 sessionId:  describe result for acl check
2025-10-10T14:08:20.672029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:20.672045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:20.672054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:20.672069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594705232111070:10087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:20.675462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594705232111070:10087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:20.678330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:20.683920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594705232111070:10087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:20.683952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:20.684765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:20.684793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:20.684834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:20.685013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:20.685169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594703654188602:8998]
2025-10-10T14:08:20.686539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:20.687263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:20.687394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:20.688148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:20.688386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:20.688403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:20.688408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:20.688412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:20.688415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:20.688419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:20.688423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:20.688427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:20.688431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.688435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.688439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.688443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.688470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:20.688561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:20.688592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:20.688620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:20.688648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:20.688675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:20.688701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:20.688737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:20.688773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.688830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.688866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.688897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.688923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:20.688967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:20.689003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:20.689039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:20.689081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:20.689117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:20.689182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:20.689236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:20.689286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:20.689336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:20.689374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:20.689427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:20.689477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:20.689539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:20.689589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:20.689642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:20.689693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.689741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.689786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.689838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.689895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.689945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.690005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.690065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.690139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594705232111070:10087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:20.690175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594705232111070:10087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:20.690191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594705232111070:10087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:20.690218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:20.690577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:20.713966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:20.726276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:20.726308Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:20.726318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:20.726332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:20.726348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 738 [2:7559594703654188602:8998]
2025-10-10T14:08:20.726380Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:20.726424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:20.726435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:20.726444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:20.726452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:20.726486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:20.726500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:20.726515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:20.733372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594705232111107:9722]
2025-10-10T14:08:20.736036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.736066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.736079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.736091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.736101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:20.736394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:20.736418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.736544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:20.736590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 738
2025-10-10T14:08:20.736639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 738, pipe: [1:7559594705232111107:9722]
2025-10-10T14:08:20.736709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 738
2025-10-10T14:08:20.736719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:20.736924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:20.737004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:20.737063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594705232111045:2442], now have 1 active actors on pipe
2025-10-10T14:08:20.737080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594705232111107:9722], now have 1 active actors on pipe
2025-10-10T14:08:20.737092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594705232111103:10087], now have 1 active actors on pipe
2025-10-10T14:08:20.737689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:20.737717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:20.737751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.737760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.737769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.737777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.737807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:20.737848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:20.737870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:20.737879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:20.737890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:20.737898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:20.738035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:20.738051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:20.738097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:20.738126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:20.738140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:20.738148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:20.738183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:20.738226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:20.738360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.738397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:20.738431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:20.738460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:20.738855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:20.738895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:20.738955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:20.739219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 739 partition: 0 MaxSeqNo: 36 sessionId: src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0
2025-10-10T14:08:20.739955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1ea3ea-ddb2d48-d7116942-e9e89d7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:20.760653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0] Write session: try to update token
2025-10-10T14:08:20.760707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:20.777492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:20.777528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:20.777564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.777690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:20.777688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:20.779675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:20.780863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:20.782183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:20.783321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:20.784937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:20.785533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:20.852544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId: src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:20.856303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:20.856332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:20.856343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:20.856391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:20.856401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:20.856409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:20.856417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:20.856422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:20.856448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.856465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.856479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.856494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594703654188597:8998]
2025-10-10T14:08:20.856593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:20.856612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:20.856613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:20.856619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:20.856643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:20.856677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:20.856702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:20.857419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:20.876903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:21.000517Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:21.002496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:21.002540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:21.003146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594705232111107:9722]
2025-10-10T14:08:21.003260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:21.003286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:21.004399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:21.003516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:21.013016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 739 reason: error at write: Disconnected sessionId: src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0
2025-10-10T14:08:21.013439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 739 sessionId: src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0 is DEAD
2025-10-10T14:08:21.016339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:21.016392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0] Write session will restart in 0.005830s
2025-10-10T14:08:21.016534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0] Write session: Do CDS request
2025-10-10T14:08:21.016582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:21.029187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:21.042998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:21.043028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 740
2025-10-10T14:08:21.043505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:21.043624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:21.043639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:21.043651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:21.045011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 740 sessionId:  describe result for acl check
2025-10-10T14:08:21.045144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:21.045154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:21.045163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:21.045180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594709527078438:10094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:21.047399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594709527078438:10094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:21.055347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594709527078438:10094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:21.069891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:21.087895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594709527078438:10094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:21.087937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594709527078438:10094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:21.087954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594709527078438:10094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:21.087983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:21.089970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:21.090826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:21.090843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:21.090886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:21.091136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:21.091314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594707949155997:9007]
2025-10-10T14:08:21.098507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:21.099871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:21.100119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:21.101416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:21.101733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:21.101742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:21.101749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:21.101755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:21.101761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:21.101767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:21.101773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:21.101779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:21.101786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.101793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.101799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.101804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.101862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:21.101975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:21.102035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:21.102094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:21.102138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:21.102190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:21.102232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:21.102264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:21.102309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.102352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.102381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.102425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.102464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:21.102523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:21.102581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:21.102640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:21.102692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:21.102746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:21.102792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:21.102858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:21.102913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:21.102965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:21.103009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:21.103064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:21.103111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:21.103161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:21.103209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:21.103261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:21.103310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.103361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.103405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.103456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.103503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.103556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.103602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.103654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.104092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:21.105239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594709527078490:9722]
2025-10-10T14:08:21.141544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:21.154768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:21.154811Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:21.154825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:21.154842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:21.154863Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 739 [2:7559594707949155997:9007]
2025-10-10T14:08:21.154916Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:21.154975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:21.154988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:21.154998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:21.155009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:21.155055Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:21.155075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:21.155096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:21.157296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.157327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.157338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.157350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.157360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:21.159185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 739
2025-10-10T14:08:21.157634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:21.157648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.159269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 739
2025-10-10T14:08:21.157773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.159347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 739, pipe: [1:7559594709527078490:9722]
2025-10-10T14:08:21.157950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.158151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.158253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:21.158326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.158340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.158353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.158365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.158415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:21.158491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:21.158548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:21.158563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:21.158575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:21.158585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:21.158651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:21.158667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:21.158792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.158813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:21.158844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:21.158916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594709527078486:10094], now have 1 active actors on pipe
2025-10-10T14:08:21.158939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594709527078420:2442], now have 1 active actors on pipe
2025-10-10T14:08:21.158967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594709527078490:9722], now have 1 active actors on pipe
2025-10-10T14:08:21.160662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:21.160717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:21.160845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:21.160884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:21.160911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:21.160925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:21.160963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:21.161016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:21.161067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:21.161569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:21.161595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:21.161655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:21.161906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 740 partition: 0 MaxSeqNo: 36 sessionId: src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0
2025-10-10T14:08:21.162608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|618f549b-3420ca40-4c4061a9-a0b36ad6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:21.185369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0] Write session: try to update token
2025-10-10T14:08:21.185424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:21.253137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:21.253172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:21.253185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:21.253194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:21.253203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:21.253231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.253248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.253262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.253284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.253481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:21.253507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.253514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:21.254537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:21.255162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:21.255201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:21.255225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:21.255243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:21.293076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId: src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:21.315474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:21.405452Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:21.427910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:21.427962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:21.428025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:21.428039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:21.428080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594707949155991:9007]
2025-10-10T14:08:21.429574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594709527078490:9722]
2025-10-10T14:08:21.429705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:21.429729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:21.428251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:21.428733Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:21.448252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:21.448404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 740 reason: error at write: Disconnected sessionId: src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0
2025-10-10T14:08:21.448754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 740 sessionId: src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0 is DEAD
2025-10-10T14:08:21.452015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:21.452073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0] Write session will restart in 0.006203s
2025-10-10T14:08:21.452225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0] Write session: Do CDS request
2025-10-10T14:08:21.452270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:21.464254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:21.469416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:21.469445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 741
2025-10-10T14:08:21.469896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:21.470005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:21.470023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:21.470032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:21.471388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 741 sessionId:  describe result for acl check
2025-10-10T14:08:21.471494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:21.471503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:21.471512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:21.471527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594709527078529:10103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:21.474078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594709527078529:10103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:21.490309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594709527078529:10103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:21.508189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594709527078529:10103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:21.508235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594709527078529:10103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:21.508254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594709527078529:10103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:21.508289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:21.512183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:21.514478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:21.515490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:21.515519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:21.515566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:21.515830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:21.516040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594707949156069:9009]
2025-10-10T14:08:21.518886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:21.520030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:21.520255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:21.521521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:21.521838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:21.521865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:21.521872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:21.521878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:21.521885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:21.521892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:21.521898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:21.521905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:21.521912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.521920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.521927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.521932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.521979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:21.522085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:21.522136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:21.522182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:21.522233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:21.522288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:21.522331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:21.522375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:21.522420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.522466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.522508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.522551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.522592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:21.522653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:21.522711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:21.522761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:21.522810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:21.522860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:21.522904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:21.522958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:21.523004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:21.523053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:21.523098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:21.523149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:21.523195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:21.523245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:21.523289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:21.523342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:21.523394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.523442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.523487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.523541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.523585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.523639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.523680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.523734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.525429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:21.529526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594709527078590:9722]
2025-10-10T14:08:21.588526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:21.606491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:21.606545Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:21.606562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:21.606581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:21.606607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 740 [2:7559594707949156069:9009]
2025-10-10T14:08:21.606660Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:21.606728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:21.606743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:21.606754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:21.606767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:21.606816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:21.606838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:21.606859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:21.630883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.630912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.630925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.630937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.630950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:21.631229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:21.631246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.631375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:21.631530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:21.631709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:21.631808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:21.632932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 740, pipe: [1:7559594709527078590:9722]
2025-10-10T14:08:21.633064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 740
2025-10-10T14:08:21.633162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 740
2025-10-10T14:08:21.631876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.631902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.631913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.631924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.631961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:21.632036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:21.632189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:21.632205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:21.632333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.632349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:21.632678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594709527078590:9722], now have 1 active actors on pipe
2025-10-10T14:08:21.632704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594709527078583:10103], now have 1 active actors on pipe
2025-10-10T14:08:21.632714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:21.632725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594709527078519:2442], now have 1 active actors on pipe
2025-10-10T14:08:21.632726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:21.632738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:21.632750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:21.632774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:21.634049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:21.634085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:21.634217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:21.634266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:21.634285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:21.634306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:21.634365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:21.634417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:21.634466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:21.636311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:21.636359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:21.636447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:21.636758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 741 partition: 0 MaxSeqNo: 36 sessionId: src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0
2025-10-10T14:08:21.637621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526bbf2d-c9f8171f-d8512217-ea5060bb_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:21.690259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0] Write session: try to update token
2025-10-10T14:08:21.690321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:21.817682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:21.817717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:21.817729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:21.817787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:21.817803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:21.817816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:21.817828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:21.817851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:21.817889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.817921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.817949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.817977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.818199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:21.818228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:21.818240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:21.818460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:21.818496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:21.818529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:21.818562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:21.819291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:21.847335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId: src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:21.867854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:21.971417Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:21.979615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:21.979665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:21.979739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:21.979754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:21.979795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594707949156063:9009]
2025-10-10T14:08:21.979980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:21.980455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:21.981313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594709527078590:9722]
2025-10-10T14:08:21.981450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:21.985276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:21.990538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:21.990595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0] Write session will restart in 0.008498s
2025-10-10T14:08:21.990723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0] Write session: Do CDS request
2025-10-10T14:08:21.990756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:21.989823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 741 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0
2025-10-10T14:08:21.990208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 741 sessionId: src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0 is DEAD
2025-10-10T14:08:22.005763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:22.005791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 742
2025-10-10T14:08:22.008302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:22.009373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:22.009571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:22.009594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:22.009609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:22.011956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 742 sessionId:  describe result for acl check
2025-10-10T14:08:22.012142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:22.012160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:22.012181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:22.012215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594713822045920:10114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:22.015593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594713822045920:10114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:22.021677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594713822045920:10114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:22.030807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594713822045920:10114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:22.030847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594713822045920:10114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:22.030863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594713822045920:10114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:22.030891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:22.046255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:22.053469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:22.054344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:22.054363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:22.054406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:22.054662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:22.055137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594712244123460:9014]
2025-10-10T14:08:22.057288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:22.061480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:22.061717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:22.062998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:22.063333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:22.063342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:22.063349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:22.063356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:22.063362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:22.063369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:22.063377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:22.063384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:22.063391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.063398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.063405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.063413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.063460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:22.063572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:22.063622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:22.063668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:22.063715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:22.063764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:22.063813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:22.063861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:22.063905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.063952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.063996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.064041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.064079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:22.064140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:22.064195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:22.064248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:22.064298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:22.064351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:22.064396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:22.064450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:22.064500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:22.064551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:22.064599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:22.064651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:22.064698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:22.064750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:22.064791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:22.064844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:22.064891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.064946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.064991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.065041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.065091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.066242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.066306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.066371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.066937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:22.083134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594713822045969:9722]
2025-10-10T14:08:22.099344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:22.116104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:22.116136Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:22.116146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:22.116158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:22.116175Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 741 [2:7559594712244123460:9014]
2025-10-10T14:08:22.116208Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:22.116253Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:22.116263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:22.116271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:22.116278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:22.116312Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:22.116327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:22.116342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:22.121861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 741
2025-10-10T14:08:22.121954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 741, pipe: [1:7559594713822045969:9722]
2025-10-10T14:08:22.122024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 741
2025-10-10T14:08:22.118877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.118901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.118915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.118927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.118938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:22.119198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:22.119213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.119331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.119493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.119698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.119796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:22.119866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594712244123455:9014]
2025-10-10T14:08:22.119879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594712244123455:9014]
2025-10-10T14:08:22.119893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594712244123455:9014]
2025-10-10T14:08:22.119904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594712244123455:9014]
2025-10-10T14:08:22.119946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:22.120024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:22.120182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:22.120197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:22.120325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594712244123455:9014]
2025-10-10T14:08:22.120344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:22.121147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:22.121160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:22.121171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:22.121181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:22.121204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:22.122637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594713822045960:10114], now have 1 active actors on pipe
2025-10-10T14:08:22.122664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594709527078609:2442], now have 1 active actors on pipe
2025-10-10T14:08:22.122687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594713822045969:9722], now have 1 active actors on pipe
2025-10-10T14:08:22.122748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:22.122769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:22.122850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9200a312-32553405-18be796b-a3db24e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:22.122882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:22.122900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:22.122910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:22.122948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:22.122999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:22.123059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:22.124226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:22.124253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:22.124312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:22.124665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 742 partition: 0 MaxSeqNo: 36 sessionId: src_id|9200a312-32553405-18be796b-a3db24e5_0
2025-10-10T14:08:22.125769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e419c72-9547a9dd-dafb1547-4c2e9ac_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9200a312-32553405-18be796b-a3db24e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:22.186298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9200a312-32553405-18be796b-a3db24e5_0] Write session: try to update token
2025-10-10T14:08:22.186357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9200a312-32553405-18be796b-a3db24e5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:22.257081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:22.257116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:22.257147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:22.257221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:22.257241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:22.257261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:22.257272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:22.257286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:22.257328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594712244123455:9014]
2025-10-10T14:08:22.257375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594712244123455:9014]
2025-10-10T14:08:22.257417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594712244123455:9014]
2025-10-10T14:08:22.257439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594712244123455:9014]
2025-10-10T14:08:22.257579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:22.257616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.257636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:22.257730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:22.257748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:22.257766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:22.257782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:22.260457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:22.352013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId: src_id|9200a312-32553405-18be796b-a3db24e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:22.374461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:22.456565Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:22.461300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:22.461344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:22.464201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:22.464245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:22.465315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:22.465569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594713822045969:9722]
2025-10-10T14:08:22.474485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 742 reason: error at write: Disconnected sessionId: src_id|9200a312-32553405-18be796b-a3db24e5_0
2025-10-10T14:08:22.474812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 742 sessionId: src_id|9200a312-32553405-18be796b-a3db24e5_0 is DEAD
2025-10-10T14:08:22.475147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200a312-32553405-18be796b-a3db24e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:22.475191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200a312-32553405-18be796b-a3db24e5_0] Write session will restart in 0.009849s
2025-10-10T14:08:22.475308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200a312-32553405-18be796b-a3db24e5_0] Write session: Do CDS request
2025-10-10T14:08:22.475343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200a312-32553405-18be796b-a3db24e5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:22.480556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:22.494178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:22.494230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 743
2025-10-10T14:08:22.494739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9200a312-32553405-18be796b-a3db24e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:22.499246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:22.499416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:22.499433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:22.499444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:22.501951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 743 sessionId:  describe result for acl check
2025-10-10T14:08:22.502075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:22.502088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:22.502097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:22.502115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594713822046012:10119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:22.514713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594713822046012:10119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:22.530111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594713822046012:10119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:22.532844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:22.546256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:22.547200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:22.547232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:22.547279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:22.547557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:22.547759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594712244123546:9028]
2025-10-10T14:08:22.550615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:22.551879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:22.552100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:22.553323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:22.553624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:22.553632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:22.553638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:22.553644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:22.553651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:22.553657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:22.553663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:22.553670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:22.553676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.553682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.553688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.553695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.553739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:22.553853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:22.553910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:22.553952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:22.553994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:22.554036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:22.554077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:22.554116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:22.554155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.555567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594713822046012:10119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:22.555607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594713822046012:10119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:22.555624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594713822046012:10119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:22.555655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:22.554198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.554240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.554315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.554357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:22.554416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:22.554467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:22.554517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:22.554559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:22.554613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:22.554654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:22.554704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:22.554745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:22.554793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:22.554834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:22.554881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:22.554924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:22.554973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:22.555013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:22.555061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:22.555105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.555152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.555193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.555240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.555282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.555330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.555374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.555422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.555825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:22.577740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594713822046073:9722]
2025-10-10T14:08:22.601511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:22.627904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:22.627953Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:22.627969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:22.627987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:22.628011Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 742 [2:7559594712244123546:9028]
2025-10-10T14:08:22.628069Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:22.628134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:22.628148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:22.628161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:22.628171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:22.628218Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:22.628237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:22.628260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:22.630656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.630683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.630698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.630710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.630723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:22.630994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:22.631011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.631151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:22.631325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:22.631549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:22.631660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:22.631741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594713822046060:10119], now have 1 active actors on pipe
2025-10-10T14:08:22.631766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594713822046073:9722], now have 1 active actors on pipe
2025-10-10T14:08:22.631788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594713822045999:2442], now have 1 active actors on pipe
2025-10-10T14:08:22.631813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:22.631827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:22.631839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:22.631852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:22.631893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:22.631968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:22.632133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:22.632150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:22.632269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:22.632287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:22.632904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:22.632919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:22.632927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:22.632935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:22.632955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:22.635078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 742
2025-10-10T14:08:22.635157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 742, pipe: [1:7559594713822046073:9722]
2025-10-10T14:08:22.635223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 742
2025-10-10T14:08:22.638074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:22.638117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:22.638222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:22.638259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:22.638279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:22.638289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:22.638329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:22.638385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:22.638433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:22.645264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:22.645313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:22.645403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:22.649370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 743 partition: 0 MaxSeqNo: 36 sessionId: src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0
2025-10-10T14:08:22.650175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9200a312-32553405-18be796b-a3db24e5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:22.734959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0] Write session: try to update token
2025-10-10T14:08:22.735020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:22.849075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:22.849104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:22.849115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:22.861525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:22.861560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:22.861573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:22.861583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:22.861593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:22.861629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:22.861656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:22.861678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:22.861698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:22.861925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:22.861949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:22.861960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:22.862059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:22.862086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:22.862112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:22.862137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:22.877759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:22.923880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId: src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:22.956534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:23.033706Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:23.053300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:23.053348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:23.053408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:23.053420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:23.053458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594712244123541:9028]
2025-10-10T14:08:23.053919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:23.054850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:23.057417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:23.095190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594713822046073:9722]
2025-10-10T14:08:23.095274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:23.096093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:23.096136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0] Write session will restart in 0.006467s
2025-10-10T14:08:23.096284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0] Write session: Do CDS request
2025-10-10T14:08:23.096332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:23.095408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 743 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0
2025-10-10T14:08:23.095753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 743 sessionId: src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0 is DEAD
2025-10-10T14:08:23.117922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:23.122028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:23.122060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 744
2025-10-10T14:08:23.123207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:23.123317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:23.123333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:23.123343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:23.128098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 744 sessionId:  describe result for acl check
2025-10-10T14:08:23.128225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:23.128236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:23.128245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:23.128261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594718117013415:10131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:23.131673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:23.134027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594718117013415:10131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:23.141142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:23.141942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:23.141971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:23.142013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:23.142216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:23.142391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594716539090927:9032]
2025-10-10T14:08:23.143844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:23.147261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:23.147492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:23.148428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:23.148646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:23.148660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:23.148665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:23.148672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:23.148678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:23.148684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:23.148691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:23.148697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:23.148703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.148708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.148713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.148717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.148746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:23.148822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:23.148856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:23.148897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:23.148931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:23.148976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:23.149014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:23.149049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:23.149080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.149113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.149174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.149220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.149258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:23.149316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:23.149368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:23.149420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:23.149466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:23.149517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:23.149558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:23.149611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:23.149652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:23.149711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:23.149758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:23.149820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:23.149871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:23.149918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:23.149955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:23.150005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:23.150054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.150092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.150125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.150177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.150227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.150276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.150320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.150371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.150775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:23.155512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594718117013415:10131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:23.178530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594718117013415:10131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:23.178574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594718117013415:10131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:23.178591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594718117013415:10131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:23.178614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:23.190316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:23.198038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594718117013473:9722]
2025-10-10T14:08:23.204990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:23.205038Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:23.205054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:23.205075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:23.205098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 743 [2:7559594716539090927:9032]
2025-10-10T14:08:23.205172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:23.205237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:23.205253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:23.205264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:23.205275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:23.205325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:23.205358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:23.205383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:23.222884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.222917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.222930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.222943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.222954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:23.223259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:23.223287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.223439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.223644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.223862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.223971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:23.224046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594716539090922:9032]
2025-10-10T14:08:23.224060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594716539090922:9032]
2025-10-10T14:08:23.224072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594716539090922:9032]
2025-10-10T14:08:23.224083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594716539090922:9032]
2025-10-10T14:08:23.224124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:23.224204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:23.224377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:23.224395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:23.224523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594716539090922:9032]
2025-10-10T14:08:23.224543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:23.225337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:23.225351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:23.225363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:23.225374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:23.225396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:23.226963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 743
2025-10-10T14:08:23.227061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 743
2025-10-10T14:08:23.227136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 743, pipe: [1:7559594718117013473:9722]
2025-10-10T14:08:23.228556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594718117013473:9722], now have 1 active actors on pipe
2025-10-10T14:08:23.228598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594718117013471:10131], now have 1 active actors on pipe
2025-10-10T14:08:23.228620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594718117013395:2442], now have 1 active actors on pipe
2025-10-10T14:08:23.228664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:23.228692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:23.228779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:23.228811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:23.228829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:23.228838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:23.228876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:23.228920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:23.228965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:23.232423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:23.232457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:23.232527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:23.232920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 744 partition: 0 MaxSeqNo: 36 sessionId: src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0
2025-10-10T14:08:23.237693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e22dc2c9-3025951-f1c59320-fd1d00c0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:23.271070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0] Write session: try to update token
2025-10-10T14:08:23.271129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:23.305329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:23.305365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:23.305377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:23.353091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:23.353118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:23.353145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:23.353156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:23.353166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:23.353203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594716539090922:9032]
2025-10-10T14:08:23.353228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594716539090922:9032]
2025-10-10T14:08:23.353250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594716539090922:9032]
2025-10-10T14:08:23.353272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594716539090922:9032]
2025-10-10T14:08:23.353420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:23.353449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.353461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:23.353849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:23.353872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:23.353891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:23.353907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:23.355002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:23.446716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId: src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:23.476612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:23.523732Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:23.531246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:23.531298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:23.534937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594718117013473:9722]
2025-10-10T14:08:23.535043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:23.535056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:23.536514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:23.535420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:23.544078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 744 reason: error at write: Disconnected sessionId: src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0
2025-10-10T14:08:23.544406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 744 sessionId: src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0 is DEAD
2025-10-10T14:08:23.547953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:23.547978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0] Write session will restart in 0.008917s
2025-10-10T14:08:23.548045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0] Write session: Do CDS request
2025-10-10T14:08:23.548069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:23.565527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:23.565715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:23.565746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 745
2025-10-10T14:08:23.566122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:23.566226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:23.566242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:23.566252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:23.567560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 745 sessionId:  describe result for acl check
2025-10-10T14:08:23.567669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:23.567680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:23.567690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:23.567706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594718117013499:10139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:23.570127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594718117013499:10139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:23.586857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594718117013499:10139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:23.608949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594718117013499:10139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:23.609034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594718117013499:10139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:23.609050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594718117013499:10139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:23.609083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:23.615221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:23.624561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:23.625432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:23.625464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:23.625510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:23.625779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:23.625989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594716539091017:9042]
2025-10-10T14:08:23.627958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:23.629243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:23.629457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:23.630793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:23.631100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:23.631118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:23.631124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:23.631129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:23.631135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:23.631140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:23.631146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:23.631152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:23.631158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.631164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.631170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.631177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.631221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:23.631319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:23.631365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:23.631407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:23.631457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:23.631504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:23.631551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:23.631596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:23.631646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.631694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.631739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.631784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.631825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:23.631885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:23.631944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:23.632001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:23.632049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:23.632101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:23.632147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:23.632200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:23.632249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:23.632303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:23.632352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:23.632408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:23.632459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:23.632512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:23.632558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:23.632611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:23.632664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.632721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.632766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.632824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.632874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.632931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.632977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.633032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.633726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:23.634295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594718117013557:9722]
2025-10-10T14:08:23.648649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:08:23.648703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-10-10T14:08:23.661939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:23.676785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:23.676837Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:23.676852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:23.676870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:23.676894Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 744 [2:7559594716539091017:9042]
2025-10-10T14:08:23.676946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:23.677011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:23.677025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:23.677037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:23.677047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:23.677095Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:23.677120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:23.677164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:23.687377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.687409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.687421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.687434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.687445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:23.687728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:23.687744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.687878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:23.688044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:23.689204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 744
2025-10-10T14:08:23.689333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 744
2025-10-10T14:08:23.689408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 744, pipe: [1:7559594718117013557:9722]
2025-10-10T14:08:23.688974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:23.689114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:23.689231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594718117013487:2442], now have 1 active actors on pipe
2025-10-10T14:08:23.689254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594718117013557:9722], now have 1 active actors on pipe
2025-10-10T14:08:23.689274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594718117013549:10139], now have 1 active actors on pipe
2025-10-10T14:08:23.689300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:23.689314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:23.689327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:23.689338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:23.689377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:23.689460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:23.689626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:23.689643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:23.689684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:23.689697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:23.689707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:23.689718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:23.689766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:23.689787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:23.689891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:23.689923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:23.689944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:23.690075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:23.690106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:23.690124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:23.690133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:23.690168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:23.690211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:23.690368Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:08:23.690451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:23.691999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 18 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:08:23.692134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:08:23.694701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:23.694737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:23.694810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:23.696707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0e75f9-e193c3a5-268ad191-595875fd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:23.695915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 745 partition: 0 MaxSeqNo: 36 sessionId: src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0
2025-10-10T14:08:23.737839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0] Write session: try to update token
2025-10-10T14:08:23.737893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:23.964215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:23.964241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:23.964251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:23.964305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:23.964317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:23.964327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:23.964336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:23.964344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:23.964378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:23.964405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:23.964427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:23.964447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:23.964626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:23.964649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:23.964659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:23.965695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:23.969312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:23.969341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:23.969367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:23.969390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:23.991879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId: src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:24.025617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:24.149542Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:24.171346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:24.171399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:24.171476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:24.171490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:24.171535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594716539091012:9042]
2025-10-10T14:08:24.171845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:24.172092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:24.175956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:24.176271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594718117013557:9722]
2025-10-10T14:08:24.176402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:24.240158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 745 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0
2025-10-10T14:08:24.240501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 745 sessionId: src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0 is DEAD
2025-10-10T14:08:24.257749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:24.257806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0] Write session will restart in 0.005901s
2025-10-10T14:08:24.257901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0] Write session: Do CDS request
2025-10-10T14:08:24.257929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:24.263014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:24.268624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:24.265480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:24.266302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:24.266318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:24.266362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:24.266623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:24.266798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594720834058417:9052]
2025-10-10T14:08:24.268834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:24.271158Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:24.271185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 746
2025-10-10T14:08:24.270126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:24.270342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:24.271500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:24.271784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:24.271792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:24.271797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:24.271804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:24.272898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:24.273018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:24.273032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:24.273043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:24.271809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:24.271815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:24.271821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:24.271826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:24.271833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.271838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.271844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.271851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.271891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:24.271989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:24.272032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:24.272073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:24.272116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:24.272160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:24.272199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:24.272239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:24.272281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.272322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.272363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.272402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.272440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:24.272497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:24.272549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:24.272599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:24.272644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:24.272692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:24.272732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:24.272781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:24.272825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:24.272876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:24.272917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:24.272966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:24.273010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:24.273054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:24.273098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:24.275061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 746 sessionId:  describe result for acl check
2025-10-10T14:08:24.275168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:24.275177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:24.275186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:24.275202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594722411980938:10152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:24.275264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594722411980939:9722]
2025-10-10T14:08:24.277579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:24.277653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.277713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.277757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.277825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.277869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.277920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.277961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.278009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.278431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:24.279252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594722411980938:10152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:24.298370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594722411980938:10152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:24.324659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594722411980938:10152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:24.324702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594722411980938:10152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:24.324719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594722411980938:10152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:24.324751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:24.335428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:24.349675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:24.349731Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:24.349747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:24.349765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:24.349800Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 745 [2:7559594720834058417:9052]
2025-10-10T14:08:24.349854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:24.349915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:24.349928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:24.349939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:24.349950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:24.350002Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:24.350026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:24.350048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:24.352569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.352593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.352608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.352621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.352632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:24.352911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:24.352927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.353069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.353263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.353481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.353593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:24.353665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.353680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.353693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.353704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.353745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:24.353837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:24.354016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:24.354031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:24.354161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.354179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:24.357283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 745
2025-10-10T14:08:24.357382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 745
2025-10-10T14:08:24.357438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 745, pipe: [1:7559594722411980939:9722]
2025-10-10T14:08:24.355119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:24.355141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:24.355152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:24.355163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:24.355188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:24.358346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594722411980890:2442], now have 1 active actors on pipe
2025-10-10T14:08:24.358378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594722411980970:10152], now have 1 active actors on pipe
2025-10-10T14:08:24.358401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594722411980939:9722], now have 1 active actors on pipe
2025-10-10T14:08:24.358457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:24.358477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:24.358554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:24.358587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:24.358606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:24.358615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:24.358654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:24.358711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:24.358760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:24.359530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:24.359552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:24.359609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:24.359936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 746 partition: 0 MaxSeqNo: 36 sessionId: src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0
2025-10-10T14:08:24.361382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bd4eb32-aa27570e-3f3ce294-715a7cf8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:24.401584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0] Write session: try to update token
2025-10-10T14:08:24.401640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:24.536475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:24.536509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:24.536521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:24.536578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:24.536592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:24.536605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:24.536628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:24.536637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:24.536672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.536697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.536723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.536747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.536951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:24.536976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.536987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:24.537281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:24.537313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:24.537344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:24.537371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:24.546343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:24.583343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId: src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:24.611408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:24.716159Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:24.729309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:24.729360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:24.729446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:24.729461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:24.729502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594720834058412:9052]
2025-10-10T14:08:24.729993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:24.731339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594722411980939:9722]
2025-10-10T14:08:24.731425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:24.731532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:24.731544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:24.732607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:24.786796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 746 reason: error at write: Disconnected sessionId: src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0
2025-10-10T14:08:24.787103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 746 sessionId: src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0 is DEAD
2025-10-10T14:08:24.789664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:24.789728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0] Write session will restart in 0.006432s
2025-10-10T14:08:24.789941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0] Write session: Do CDS request
2025-10-10T14:08:24.789992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:24.802080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:24.804747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:24.804773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 747
2025-10-10T14:08:24.806005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:24.806127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:24.806142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:24.806151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:24.807416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 747 sessionId:  describe result for acl check
2025-10-10T14:08:24.807507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:24.807517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:24.807526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:24.807543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594722411981023:10157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:24.811084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594722411981023:10157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:24.821618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:24.829350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594722411981023:10157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:24.829814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594722411981053:9722]
2025-10-10T14:08:24.835954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:24.836889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:24.836924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:24.836971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:24.837268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:24.837468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594720834058498:9054]
2025-10-10T14:08:24.839848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:24.839517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594722411981023:10157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:24.839559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594722411981023:10157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:24.839577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594722411981023:10157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:24.839607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:24.841357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:24.841603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:24.842812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:24.843117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:24.843128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:24.843134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:24.843141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:24.843147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:24.843153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:24.843160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:24.843167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:24.843173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.843181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.843189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.843196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.843240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:24.843341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:24.843386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:24.843429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:24.843473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:24.843518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:24.843558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:24.843600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:24.843642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.843689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.843731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.843773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.843812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:24.843872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:24.843928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:24.843978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:24.844021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:24.844071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:24.844113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:24.844162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:24.844206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:24.844256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:24.844297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:24.844346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:24.844391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:24.844442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:24.844484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:24.844533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:24.844575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.844622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.844665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.844717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.844760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.844809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.844850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.844901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.846807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:24.894332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:24.907771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:24.907821Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:24.907842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:24.907863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:24.907888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 746 [2:7559594720834058498:9054]
2025-10-10T14:08:24.907950Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:24.908011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:24.908027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:24.908040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:24.908052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:24.908102Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:24.908125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:24.908147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:24.910284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.910310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.910327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.910342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.910355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:24.910639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:24.910659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:24.910820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:24.911031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:24.911289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:24.911420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:24.911489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:24.911505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:24.911520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:24.911535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:24.911580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:24.911661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:24.911859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:24.911877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:24.911999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:24.912019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:24.912711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:24.912732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:24.912744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:24.912756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:24.912778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:24.915145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594722411981063:10157], now have 1 active actors on pipe
2025-10-10T14:08:24.915183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594722411980987:2442], now have 1 active actors on pipe
2025-10-10T14:08:24.915209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594722411981053:9722], now have 1 active actors on pipe
2025-10-10T14:08:24.917366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 746
2025-10-10T14:08:24.917479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 746
2025-10-10T14:08:24.917564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 746, pipe: [1:7559594722411981053:9722]
2025-10-10T14:08:24.921384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:24.921437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:24.921558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:24.921594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:24.921612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:24.921626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:24.921666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:24.921713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:24.921791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:24.929256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:24.929308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:24.929398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:24.933734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 747 partition: 0 MaxSeqNo: 36 sessionId: src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0
2025-10-10T14:08:24.937757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8b6118c-ad1c108e-a60c803b-c359a77f_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:25.020801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0] Write session: try to update token
2025-10-10T14:08:25.020859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:25.070578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:25.070612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:25.070622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:25.070674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:25.070687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:25.070699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:25.070709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:25.070718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:25.070750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:25.070773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:25.070796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:25.070815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:25.070998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:25.071021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:25.071032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:25.071788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:25.071818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:25.071846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:25.071871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:25.081304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:25.176757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId: src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:25.227002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:25.243305Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:25.255096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:25.255135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:25.255191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:25.255204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:25.255245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594720834058492:9054]
2025-10-10T14:08:25.255437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:25.255796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:25.257787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594722411981053:9722]
2025-10-10T14:08:25.257797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:25.257976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:25.267947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 747 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0
2025-10-10T14:08:25.268286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 747 sessionId: src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0 is DEAD
2025-10-10T14:08:25.273633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:25.273673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0] Write session will restart in 0.005375s
2025-10-10T14:08:25.273803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0] Write session: Do CDS request
2025-10-10T14:08:25.273832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:25.285568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:25.285338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:25.285374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 748
2025-10-10T14:08:25.287723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:25.287870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:25.287884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:25.287894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:25.290499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 748 sessionId:  describe result for acl check
2025-10-10T14:08:25.290629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:25.290639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:25.290648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:25.290664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594726706948403:10166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:25.302194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594726706948403:10166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:25.321800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594726706948403:10166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:25.342512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594726706948403:10166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:25.342562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594726706948403:10166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:25.342579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594726706948403:10166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:25.342615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:25.359552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594726706948458:9722]
2025-10-10T14:08:25.399050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:25.400347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:25.401151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:25.401189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:25.401237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:25.401507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:25.401699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594725129025897:9066]
2025-10-10T14:08:25.404059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:25.405117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:25.405362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:25.406951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:25.407287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:25.407307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:25.407314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:25.407320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:25.407328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:25.407335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:25.407341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:25.407348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:25.407354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:25.407361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:25.407368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:25.407374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:25.407421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:25.407532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:25.407581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:25.407627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:25.407671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:25.407718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:25.407762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:25.407804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:25.407848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:25.407892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:25.407934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:25.407975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:25.408015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:25.408081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:25.408138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:25.408192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:25.408241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:25.408294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:25.408337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:25.408391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:25.408442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:25.408493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:25.408538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:25.408590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:25.408636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:25.408687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:25.408730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:25.408782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:25.408831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:25.408884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:25.408927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:25.408977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:25.409022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:25.409072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:25.409114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:25.409186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:25.409612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:25.463987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:25.528324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:25.528377Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:25.528391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:25.528411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:25.528434Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 747 [2:7559594725129025897:9066]
2025-10-10T14:08:25.528486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:25.528545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:25.528560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:25.528573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:25.528584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:25.528632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:25.528654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:25.528677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:25.568699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:25.568732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:25.568745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:25.568757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:25.568767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:25.569044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:25.569061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:25.569212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:25.569381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:25.569596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:25.569700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:25.569786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.569801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.569812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.569825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.569866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:25.569943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:25.570110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:25.570126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:25.570249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.570266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:25.572139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 747, pipe: [1:7559594726706948458:9722]
2025-10-10T14:08:25.572246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 747
2025-10-10T14:08:25.572347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 747
2025-10-10T14:08:25.571062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:25.571083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:25.571094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:25.571106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:25.571129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:25.578792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594726706948458:9722], now have 1 active actors on pipe
2025-10-10T14:08:25.578837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594726706948391:2442], now have 1 active actors on pipe
2025-10-10T14:08:25.578860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594726706948445:10166], now have 1 active actors on pipe
2025-10-10T14:08:25.578938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:25.578963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:25.579050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:25.579085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:25.579104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:25.579115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:25.579154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:25.579203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:25.579248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:25.592834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:25.592880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:25.592973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:25.593959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 748 partition: 0 MaxSeqNo: 36 sessionId: src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0
2025-10-10T14:08:25.594917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5735ef3b-3ac4efd2-97b8a221-90935537_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:25.659669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:25.659700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:25.659714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:25.659773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:25.659787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:25.659826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.659945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:25.659971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:25.674293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:25.675693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:25.676893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:25.678009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:25.679879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:25.691727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0] Write session: try to update token
2025-10-10T14:08:25.691789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:25.689989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:25.817425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:25.817457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:25.817468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:25.817524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:25.817539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:25.817553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:25.817564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:25.817576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:25.817616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.817643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.817668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.817694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594725129025892:9066]
2025-10-10T14:08:25.817800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:25.817831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:25.817863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:25.817896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:25.836331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:25.836385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:25.836397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:25.849738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:25.863242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId: src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:25.918036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:26.023433Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:26.025858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:26.025903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:26.029943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594726706948458:9722]
2025-10-10T14:08:26.030083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:26.030280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:26.027808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:26.075948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 748 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0
2025-10-10T14:08:26.076248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 748 sessionId: src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0 is DEAD
2025-10-10T14:08:26.081382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:26.081441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0] Write session will restart in 0.009003s
2025-10-10T14:08:26.081581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0] Write session: Do CDS request
2025-10-10T14:08:26.081626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:26.098653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:26.098678Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 749
2025-10-10T14:08:26.098869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:26.099485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:26.099633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:26.099649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:26.099659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:26.100943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 749 sessionId:  describe result for acl check
2025-10-10T14:08:26.101055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:26.101067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:26.101077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:26.101093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594731001915833:10178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:26.103737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594731001915833:10178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:26.114341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594731001915833:10178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:26.118216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:26.129846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594731001915862:9722]
2025-10-10T14:08:26.132285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594731001915833:10178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:26.132315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594731001915833:10178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:26.132332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594731001915833:10178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:26.132363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:26.134882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:26.135820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:26.135848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:26.135888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:26.136244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:26.136421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594729423993300:9073]
2025-10-10T14:08:26.138690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:26.145410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:26.145681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:26.147106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:26.147441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:26.147450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:26.147456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:26.147463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:26.147470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:26.147477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:26.147484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:26.147492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:26.147498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.147504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.147511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.147517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.147568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:26.147698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:26.147745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:26.147792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:26.147838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:26.147887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:26.147931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:26.147978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:26.148023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.148070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.148115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.148160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.148198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:26.148267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:26.148327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:26.148383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:26.148435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:26.148487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:26.148555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:26.148609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:26.148660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:26.148715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:26.148760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:26.148815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:26.148860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:26.148920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:26.148969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:26.149026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:26.149078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.151879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.151963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.152034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.152086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.152143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.152189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.152247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.152702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:26.192551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:26.214940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:26.214991Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:26.215010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:26.215031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:26.215055Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 748 [2:7559594729423993300:9073]
2025-10-10T14:08:26.215112Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:26.215170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:26.215185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:26.215197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:26.215209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:26.215259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:26.215282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:26.215305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:26.260377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.260404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.260417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.260428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.260439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:26.260698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:26.260713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.260845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.261011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.262328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.262468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:26.262549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594731001915802:2442], now have 1 active actors on pipe
2025-10-10T14:08:26.262572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594731001915862:9722], now have 1 active actors on pipe
2025-10-10T14:08:26.262594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594731001915865:10178], now have 1 active actors on pipe
2025-10-10T14:08:26.262618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.262633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.262645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.262658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.262697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:26.262771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:26.262944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:26.262959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:26.263071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.263089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:26.263573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:26.263591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:26.263602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:26.263614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:26.263637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:26.266556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:26.266600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:26.266692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:26.266728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:26.266757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:26.266770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:26.266809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:26.266858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:26.265867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 748
2025-10-10T14:08:26.266907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:26.265952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 748, pipe: [1:7559594731001915862:9722]
2025-10-10T14:08:26.266038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 748
2025-10-10T14:08:26.272484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:26.272527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:26.272621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:26.273110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 749 partition: 0 MaxSeqNo: 36 sessionId: src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0
2025-10-10T14:08:26.274727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae9492e2-32fce6ea-cba1ab43-78da3255_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:26.296331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0] Write session: try to update token
2025-10-10T14:08:26.296386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:26.314571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:26.314601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:26.314613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:26.467859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:26.467896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:26.467909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:26.467920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:26.467930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:26.467965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.467990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.468012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.468034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.468204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:26.468215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:26.468226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:26.469236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:26.469281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:26.469310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:26.469345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:26.498036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:26.498084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.498094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:26.499118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:26.501507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId: src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:26.535738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:26.661240Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:26.663799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:26.663833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:26.663876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594729423993293:9073]
2025-10-10T14:08:26.663997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:26.664018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:26.664044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:26.664815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:26.664795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:26.664955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594731001915862:9722]
2025-10-10T14:08:26.665030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:26.665041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:26.676404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 749 reason: error at write: Disconnected sessionId: src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0
2025-10-10T14:08:26.676692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 749 sessionId: src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0 is DEAD
2025-10-10T14:08:26.680689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:26.680761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0] Write session will restart in 0.007474s
2025-10-10T14:08:26.680918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0] Write session: Do CDS request
2025-10-10T14:08:26.680965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:26.693850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:26.694159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:26.694195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 750
2025-10-10T14:08:26.696118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:26.696244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:26.696277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:26.696291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:26.697722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 750 sessionId:  describe result for acl check
2025-10-10T14:08:26.697845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:26.697861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:26.697870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:26.697886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594731001915928:10187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:26.701373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594731001915928:10187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:26.708332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594731001915928:10187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:26.715181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594731001915928:10187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:26.715222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594731001915928:10187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:26.715239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594731001915928:10187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:26.715268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:26.765688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594731001915984:9722]
2025-10-10T14:08:26.774593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:26.777537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:26.778381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:26.778418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:26.778462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:26.778713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:26.778906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594729423993396:9085]
2025-10-10T14:08:26.780960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:26.789460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:26.789736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:26.791055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:26.791390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:26.791399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:26.791405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:26.791411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:26.791419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:26.791426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:26.791433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:26.791440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:26.791447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.791453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.791460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.791467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.791518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:26.791622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:26.791672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:26.791723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:26.791770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:26.791815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:26.791861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:26.791906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:26.791947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.791992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.792036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.792080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.792122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:26.792186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:26.792243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:26.792299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:26.792344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:26.792398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:26.792443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:26.792497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:26.792545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:26.792597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:26.792640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:26.792691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:26.792739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:26.792794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:26.792837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:26.792889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:26.792936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.792984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.793027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.793080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.804370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.804524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.804591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.804648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.805181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:26.883016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:26.911265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:26.911320Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:26.911339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:26.911362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:26.911388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 749 [2:7559594729423993396:9085]
2025-10-10T14:08:26.911447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:26.911510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:26.911527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:26.911541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:26.911553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:26.911602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:26.911625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:26.911646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:26.992089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.992113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.992121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.992127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.992135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:26.992321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:26.992331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:26.992419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:26.992539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:26.992682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:26.992752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:26.992792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594729423993391:9085]
2025-10-10T14:08:26.992802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594729423993391:9085]
2025-10-10T14:08:26.992811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594729423993391:9085]
2025-10-10T14:08:26.992819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594729423993391:9085]
2025-10-10T14:08:26.992851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:26.992924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:26.993053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:26.993064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:26.993098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:26.993114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:26.993144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:26.993156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:26.993373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594731001915957:10187], now have 1 active actors on pipe
2025-10-10T14:08:26.993391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594731001915915:2442], now have 1 active actors on pipe
2025-10-10T14:08:26.993406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594729423993391:9085]
2025-10-10T14:08:26.993428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:26.993473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594731001915984:9722], now have 1 active actors on pipe
2025-10-10T14:08:26.993485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:26.993341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 749
2025-10-10T14:08:26.993429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 749
2025-10-10T14:08:26.994865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 749, pipe: [1:7559594731001915984:9722]
2025-10-10T14:08:26.995573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:26.995602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:26.995666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:26.995690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:26.995703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:26.995710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:26.995735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:26.995764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:26.995796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:26.996291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:26.996317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:26.996382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:26.996913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 750 partition: 0 MaxSeqNo: 36 sessionId: src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0
2025-10-10T14:08:27.000570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3f8ac-7b10dfb0-887ad324-b9fe8056_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:27.012003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:27.012045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:27.012058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:27.048161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0] Write session: try to update token
2025-10-10T14:08:27.048217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:27.073244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:27.073279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:27.073293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:27.073305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:27.073315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:27.073350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594729423993391:9085]
2025-10-10T14:08:27.073376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594729423993391:9085]
2025-10-10T14:08:27.073402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594729423993391:9085]
2025-10-10T14:08:27.073424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594729423993391:9085]
2025-10-10T14:08:27.073549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:27.073576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:27.073593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:27.073605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.073616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:27.073624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:27.073652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:27.074843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:27.185260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId: src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:27.238633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:27.272362Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:27.275436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:27.275479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:27.278315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:27.278281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594731001915984:9722]
2025-10-10T14:08:27.278373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:27.278385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:27.279278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:27.303620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 750 reason: error at write: Disconnected sessionId: src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0
2025-10-10T14:08:27.303921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 750 sessionId: src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0 is DEAD
2025-10-10T14:08:27.309359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:27.309408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0] Write session will restart in 0.006868s
2025-10-10T14:08:27.309513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0] Write session: Do CDS request
2025-10-10T14:08:27.309543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:27.326159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:27.333297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:27.333334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 751
2025-10-10T14:08:27.333882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:27.334007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:27.334024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:27.334035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:27.335449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 751 sessionId:  describe result for acl check
2025-10-10T14:08:27.335559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:27.335570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:27.335579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:27.335596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594735296883340:10195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:27.341781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594735296883340:10195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:27.359496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594735296883340:10195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:27.359108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:27.375341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594735296883340:10195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:27.375387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594735296883340:10195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:27.375405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594735296883340:10195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:27.375436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:27.375572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:27.376431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:27.376450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:27.376493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:27.376745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:27.376923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594733718960799:9094]
2025-10-10T14:08:27.379414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:27.382346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:27.382588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:27.383967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:27.384270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:27.384279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:27.384288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:27.384295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:27.384301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:27.384308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:27.384316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:27.384324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:27.384330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.384338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.384345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.384352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.384400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:27.384519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:27.384571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:27.384620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:27.384669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:27.384720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:27.384767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:27.384818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:27.384865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.384915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.384962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.385010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.385049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:27.385120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:27.387087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:27.387173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:27.387228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:27.387286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:27.387335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:27.387390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:27.387444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:27.387502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:27.387552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:27.387611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:27.387663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:27.385306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594735296883401:9722]
2025-10-10T14:08:27.387721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:27.387771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:27.387832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:27.387887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.387945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.387996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.388051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.388101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.388158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.388206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.388262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.388734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:27.428679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:27.444776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:27.444839Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:27.444857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:27.444878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:27.444903Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 750 [2:7559594733718960799:9094]
2025-10-10T14:08:27.444959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:27.445022Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:27.445040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:27.445051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:27.445063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:27.445113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:27.445153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:27.445179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:27.470939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.470973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.470984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.470995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.471006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:27.471310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:27.471341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.471475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.471654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.471875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.471995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:27.472077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.472101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.472112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.472124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.472163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:27.472245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:27.472418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:27.472435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:27.472564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.472583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:27.472828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:27.472841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:27.472853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:27.472865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:27.472889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:27.475457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594735296883305:2442], now have 1 active actors on pipe
2025-10-10T14:08:27.475495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594735296883401:9722], now have 1 active actors on pipe
2025-10-10T14:08:27.475518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594735296883397:10195], now have 1 active actors on pipe
2025-10-10T14:08:27.475576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:27.475597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:27.475673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:27.475707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:27.475725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:27.475737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:27.475773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:27.475818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:27.475860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:27.474640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 750, pipe: [1:7559594735296883401:9722]
2025-10-10T14:08:27.474740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 750
2025-10-10T14:08:27.474810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 750
2025-10-10T14:08:27.477175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:27.477206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:27.477292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:27.477712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 751 partition: 0 MaxSeqNo: 36 sessionId: src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0
2025-10-10T14:08:27.481354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c347c9f4-e9dbd500-e729c447-7cc6bd1_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:27.537291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0] Write session: try to update token
2025-10-10T14:08:27.537350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:27.549293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:27.549332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:27.549344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:27.645169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:27.645200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:27.645212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:27.645222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:27.645231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:27.645262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.645285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.645309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.645332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.645462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:27.645508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:27.645537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:27.645575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:27.655554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:27.655609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.655621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:27.656886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:27.680748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId: src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:27.708434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:27.819633Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:27.822323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:27.822355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:27.822396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594733718960793:9094]
2025-10-10T14:08:27.822532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:27.822558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:27.822852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:27.823689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:27.829790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:27.829958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594735296883401:9722]
2025-10-10T14:08:27.830035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:27.847932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 751 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0
2025-10-10T14:08:27.848234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 751 sessionId: src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0 is DEAD
2025-10-10T14:08:27.849367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 367 BytesWritten: 81100862 MessagesWritten: 36 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 15769614 MessagesInflight: 10 }
2025-10-10T14:08:27.849459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:27.849486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0] Write session will restart in 0.006586s
2025-10-10T14:08:27.849576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0] Write session: Do CDS request
2025-10-10T14:08:27.849605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:27.861324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:27.863881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:27.863940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 752
2025-10-10T14:08:27.864488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:27.864629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:27.864658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:27.864668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:27.866993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 752 sessionId:  describe result for acl check
2025-10-10T14:08:27.867191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:27.867225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:27.867248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:27.867277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594735296883440:10209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:27.870490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594735296883440:10209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:27.879152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594735296883440:10209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:27.889400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594735296883440:10209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:27.889442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594735296883440:10209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:27.889459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594735296883440:10209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:27.889490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:27.904366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:27.910066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:27.910744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:27.910757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:27.910785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:27.910962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:27.911078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594733718960883:9098]
2025-10-10T14:08:27.912502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:27.913232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:27.913385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:27.914235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:27.914450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:27.914456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:27.914461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:27.914465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:27.914470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:27.914475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:27.914480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:27.914485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:27.914490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.914495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.914499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.914503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.914536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:27.914620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:27.914656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:27.914690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:27.914725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:27.914759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:27.914791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:27.914823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:27.914854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.914885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.914919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.914951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.914976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:27.915024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:27.915062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:27.915100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:27.915135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:27.915173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:27.915203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:27.915238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:27.915272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:27.915311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:27.915341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:27.915378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:27.915409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:27.915444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:27.915473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:27.915510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:27.915544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.915580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.915610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.915649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.915681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.915717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.915748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.915785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.916089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:27.929479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594735296883502:9722]
2025-10-10T14:08:27.942436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:27.964072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:27.964117Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:27.964135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:27.964157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:27.964181Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 751 [2:7559594733718960883:9098]
2025-10-10T14:08:27.964240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:27.964304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:27.964319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:27.964332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:27.964344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:27.964391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:27.964415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:27.964438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:27.967117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.967147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.967162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.967178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.967188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:27.967457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:27.967483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:27.967635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:27.967849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:27.968104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:27.968241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:27.968319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:27.968334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:27.968347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:27.968361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:27.968402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:27.968487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:27.968681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:27.968707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:27.968828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:27.968856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:27.969031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:27.969052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:27.969065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:27.969076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:27.969101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:27.969819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594735296883502:9722], now have 1 active actors on pipe
2025-10-10T14:08:27.969858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594735296883494:10209], now have 1 active actors on pipe
2025-10-10T14:08:27.969883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594735296883428:2442], now have 1 active actors on pipe
2025-10-10T14:08:27.971063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:27.971108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:27.971205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:27.971258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:27.971276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:27.971293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:27.971329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:27.971369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:27.971420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:27.970029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 751, pipe: [1:7559594735296883502:9722]
2025-10-10T14:08:27.970139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 751
2025-10-10T14:08:27.973218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:27.970210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 751
2025-10-10T14:08:27.973254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:27.973330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:27.973679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 752 partition: 0 MaxSeqNo: 36 sessionId: src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0
2025-10-10T14:08:27.981384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5959b6e6-83a8f865-a1769a03-b279de4e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:28.034611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0] Write session: try to update token
2025-10-10T14:08:28.034675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:28.080068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:28.080105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:28.080118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:28.080179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:28.080194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:28.080207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:28.080216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:28.080229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:28.080266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:28.080292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:28.080315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:28.080335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:28.080442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:28.080468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:28.080497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:28.080526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:28.100059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:28.100113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:28.100126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:28.101225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:28.186193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId: src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:28.207009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:28.404923Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:28.407589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:28.407623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:28.407667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594733718960878:9098]
2025-10-10T14:08:28.407829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:28.407869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:28.409746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:28.412454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:28.411259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:28.411410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594735296883502:9722]
2025-10-10T14:08:28.411488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:28.411499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:28.437225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:28.437287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0] Write session will restart in 0.006158s
2025-10-10T14:08:28.437463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0] Write session: Do CDS request
2025-10-10T14:08:28.437515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:28.436485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 752 reason: error at write: Disconnected sessionId: src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0
2025-10-10T14:08:28.436788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 752 sessionId: src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0 is DEAD
2025-10-10T14:08:28.448239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:28.448271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 753
2025-10-10T14:08:28.448534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:28.449043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:28.449250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:28.449275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:28.449286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:28.450977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 753 sessionId:  describe result for acl check
2025-10-10T14:08:28.451090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:28.451102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:28.451111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:28.451128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594739591850850:10220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:28.453586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594739591850850:10220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:28.461994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594739591850850:10220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:28.478699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594739591850850:10220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:28.478743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594739591850850:10220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:28.478763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594739591850850:10220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:28.478793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:28.513263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594739591850907:9722]
2025-10-10T14:08:28.528755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:28.534580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:28.535395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:28.535413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:28.535455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:28.535717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:28.535921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594738013928286:9108]
2025-10-10T14:08:28.538016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:28.539212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:28.539462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:28.540664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:28.540988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:28.540997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:28.541004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:28.541011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:28.541018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:28.541024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:28.541031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:28.541038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:28.541045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:28.541052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:28.541060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:28.541067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:28.541116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:28.541249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:28.541299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:28.541343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:28.541391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:28.541438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:28.541483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:28.541527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:28.541572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:28.541618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:28.541661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:28.541704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:28.541762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:28.541824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:28.541885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:28.541939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:28.541987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:28.542040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:28.542085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:28.542136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:28.542183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:28.542236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:28.542285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:28.542337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:28.542382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:28.542434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:28.542477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:28.542527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:28.542577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:28.544480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:28.544555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:28.544619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:28.544669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:28.544727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:28.544773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:28.544825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:28.545290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:28.615461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:28.635449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:28.635498Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:28.635514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:28.635534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:28.635558Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 752 [2:7559594738013928286:9108]
2025-10-10T14:08:28.635615Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:28.635679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:28.635695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:28.635709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:28.635721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:28.635769Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:28.635791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:28.635812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:28.638445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:28.638475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:28.638489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:28.638503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:28.638514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:28.638819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:28.638836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:28.638985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:28.639169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:28.639391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:28.639509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:28.639582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594738013928281:9108]
2025-10-10T14:08:28.639597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594738013928281:9108]
2025-10-10T14:08:28.639611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594738013928281:9108]
2025-10-10T14:08:28.639623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594738013928281:9108]
2025-10-10T14:08:28.639669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:28.639750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:28.639924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:28.639942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:28.640070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594738013928281:9108]
2025-10-10T14:08:28.640088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:28.640322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:28.640333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:28.640345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:28.640355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:28.640376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:28.641241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594739591850837:2442], now have 1 active actors on pipe
2025-10-10T14:08:28.641283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594739591850907:9722], now have 1 active actors on pipe
2025-10-10T14:08:28.641307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594739591850881:10220], now have 1 active actors on pipe
2025-10-10T14:08:28.642741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 752
2025-10-10T14:08:28.642831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 752, pipe: [1:7559594739591850907:9722]
2025-10-10T14:08:28.642904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 752
2025-10-10T14:08:28.645016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:28.645079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:28.645180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:28.645217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:28.645247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:28.645260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:28.645316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:28.645368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:28.645420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:28.646125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:28.646155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:28.646222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:28.646565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 753 partition: 0 MaxSeqNo: 36 sessionId: src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0
2025-10-10T14:08:28.647312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f30fce91-328c2ed3-ef580434-8f344aa5_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:28.672124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0] Write session: try to update token
2025-10-10T14:08:28.672178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:28.770335Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] Counters: { Errors: 7 CurrentSessionLifetimeMs: 543368 BytesRead: 29286416 MessagesRead: 13 BytesReadCompressed: 29286416 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-10-10T14:08:28.816385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:28.816418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:28.816430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:28.816490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:28.816504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:28.816517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:28.816528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:28.816538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:28.816576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594738013928281:9108]
2025-10-10T14:08:28.816601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594738013928281:9108]
2025-10-10T14:08:28.816624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594738013928281:9108]
2025-10-10T14:08:28.816647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594738013928281:9108]
2025-10-10T14:08:28.816758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:28.816782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:28.816791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:28.816807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:28.816817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:28.816820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:28.816848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:28.820424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:28.848779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId: src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:28.892920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:28.984384Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:28.986522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:28.986552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:28.990798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:28.989258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:28.989415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594739591850907:9722]
2025-10-10T14:08:28.989553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:28.989577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:29.043918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 753 reason: error at write: Disconnected sessionId: src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0
2025-10-10T14:08:29.044273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 753 sessionId: src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0 is DEAD
2025-10-10T14:08:29.045705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:29.045792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0] Write session will restart in 0.008195s
2025-10-10T14:08:29.045974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0] Write session: Do CDS request
2025-10-10T14:08:29.046034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:29.059920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:29.071965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:29.072000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 754
2025-10-10T14:08:29.072412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:29.072524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:29.072540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:29.072548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:29.074057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 754 sessionId:  describe result for acl check
2025-10-10T14:08:29.074154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:29.074164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:29.074172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:29.074189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594743886818281:10232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:29.076635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594743886818281:10232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:29.084338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:29.088068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594743886818281:10232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:29.089669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594743886818303:9722]
2025-10-10T14:08:29.095082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:29.095880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:29.095907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:29.095952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:29.096200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:29.096373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594742308895679:9115]
2025-10-10T14:08:29.098330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:29.099424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:29.099604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:29.100713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:29.100989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:29.100997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:29.101003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:29.101008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:29.101015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:29.101021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:29.101027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:29.101033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:29.101038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.101044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.101050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.101056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.101098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:29.101213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:29.101258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:29.101303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:29.101344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:29.101390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:29.101435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:29.101476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:29.101518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.101558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.101599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.101640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.101685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:29.101773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:29.101828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:29.101879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:29.101924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:29.101976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:29.102017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:29.102069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:29.102115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:29.102163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:29.102203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:29.102252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:29.102299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:29.102347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:29.102390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:29.102456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:29.102507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.102558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.102609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.102659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.102704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.102753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.102792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.102838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.103248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:29.114756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594743886818281:10232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:29.114793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594743886818281:10232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:29.114812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594743886818281:10232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:29.114842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:29.142716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:29.157913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:29.157959Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:29.157974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:29.157994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:29.158019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 753 [2:7559594742308895679:9115]
2025-10-10T14:08:29.158071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:29.158128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:29.158144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:29.158154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:29.158164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:29.158209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:29.158231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:29.158255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:29.198300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.198330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.198342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.198354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.198364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:29.198641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:29.198657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.198792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.198954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.199162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.199266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:29.199339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.199354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.199367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.199378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.199416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:29.199494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:29.199660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:29.199676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:29.199799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.199817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:29.200804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:29.200826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:29.200838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:29.200849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:29.200874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:29.201636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594739591850944:2442], now have 1 active actors on pipe
2025-10-10T14:08:29.201669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594743886818316:10232], now have 1 active actors on pipe
2025-10-10T14:08:29.201689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594743886818303:9722], now have 1 active actors on pipe
2025-10-10T14:08:29.205794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:29.205833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:29.205915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75817206-7b95ee01-e79e15e0-2a4338de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:29.205950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:29.205969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:29.205977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:29.206017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:29.206063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:29.206108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:29.206815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:29.206847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:29.206906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:29.208025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2531e6c4-f7f9ca5b-d56a1cb-31d88f2b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|75817206-7b95ee01-e79e15e0-2a4338de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:29.205221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 753
2025-10-10T14:08:29.205329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 753
2025-10-10T14:08:29.205392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 753, pipe: [1:7559594743886818303:9722]
2025-10-10T14:08:29.207270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 754 partition: 0 MaxSeqNo: 36 sessionId: src_id|75817206-7b95ee01-e79e15e0-2a4338de_0
2025-10-10T14:08:29.256566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75817206-7b95ee01-e79e15e0-2a4338de_0] Write session: try to update token
2025-10-10T14:08:29.256609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75817206-7b95ee01-e79e15e0-2a4338de_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:29.258654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:29.258701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:29.258713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:29.391297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:29.391322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:29.391332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:29.391339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:29.391347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:29.391373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.391390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.391406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.391421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.391589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:29.391597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:29.391604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:29.391640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:29.391660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.391666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:29.393244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:29.393276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:29.393303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:29.393332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:29.406879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:29.423177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId: src_id|75817206-7b95ee01-e79e15e0-2a4338de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:29.443610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:29.552235Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:29.566106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:29.566153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:29.566221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:29.566233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:29.566272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594742308895673:9115]
2025-10-10T14:08:29.569254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:29.569800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:29.574298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:29.575983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:29.576265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594743886818303:9722]
2025-10-10T14:08:29.658048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 754 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75817206-7b95ee01-e79e15e0-2a4338de_0
2025-10-10T14:08:29.658416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 754 sessionId: src_id|75817206-7b95ee01-e79e15e0-2a4338de_0 is DEAD
2025-10-10T14:08:29.660891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75817206-7b95ee01-e79e15e0-2a4338de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:29.660961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75817206-7b95ee01-e79e15e0-2a4338de_0] Write session will restart in 0.006442s
2025-10-10T14:08:29.661276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75817206-7b95ee01-e79e15e0-2a4338de_0] Write session: Do CDS request
2025-10-10T14:08:29.661329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75817206-7b95ee01-e79e15e0-2a4338de_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:29.674210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:29.676461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594743886818401:9722]
2025-10-10T14:08:29.676952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:29.678026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:29.678055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:29.678097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:29.678382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:29.678578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594742308895781:9121]
2025-10-10T14:08:29.678715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:29.678745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 755
2025-10-10T14:08:29.679796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75817206-7b95ee01-e79e15e0-2a4338de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:29.680429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:29.680558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:29.680573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:29.680584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:29.680954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:29.682644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 755 sessionId:  describe result for acl check
2025-10-10T14:08:29.682769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:29.682779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:29.682789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:29.682806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594743886818404:5835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:29.686080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:29.686353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:29.686357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594743886818404:5835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:29.687721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:29.688076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:29.688096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:29.688104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:29.688112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:29.688120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:29.688129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:29.688136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:29.688143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:29.688150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.688158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.688166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.688174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.688224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:29.688344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:29.688398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:29.688448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:29.688509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:29.688564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:29.688613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:29.688662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:29.688714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.688780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.688830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.688880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.688924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:29.688995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:29.689059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:29.689167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:29.689224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:29.689286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:29.689333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:29.689405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:29.689455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:29.689510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:29.689565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:29.689632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:29.689692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:29.689771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:29.689820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:29.689881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:29.689935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.689991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.690043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.690101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.690154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.690210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.690271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.690328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.690819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:29.693797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594743886818404:5835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:29.712703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594743886818404:5835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:29.712746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594743886818404:5835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:29.712766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594743886818404:5835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:29.712799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:29.762995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:29.782857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:29.782913Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:29.782933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:29.782955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:29.782980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 754 [2:7559594742308895781:9121]
2025-10-10T14:08:29.783044Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:29.783109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:29.783126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:29.783140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:29.783153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:29.783209Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:29.783233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:29.783257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:29.784580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.784611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.784626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.784640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.784652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:29.784968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:29.784990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:29.785169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:29.785389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:29.785630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:29.785776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:29.785885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594743886818358:2442], now have 1 active actors on pipe
2025-10-10T14:08:29.785910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594743886818437:5835], now have 1 active actors on pipe
2025-10-10T14:08:29.785932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594743886818401:9722], now have 1 active actors on pipe
2025-10-10T14:08:29.785960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:29.785977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:29.785991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:29.786004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:29.786044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:29.786091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:29.786108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:29.786122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:29.786129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:29.786165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:29.786325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:29.786342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:29.786537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:29.786561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:29.786595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:29.786625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:29.786652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:29.786740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:29.786772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:29.786790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:29.786801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:29.786833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:29.786873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:29.786963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:29.788417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:29.788453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:29.788541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:29.785857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 754
2025-10-10T14:08:29.785946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 754
2025-10-10T14:08:29.785998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 754, pipe: [1:7559594743886818401:9722]
2025-10-10T14:08:29.789005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 755 partition: 0 MaxSeqNo: 36 sessionId: src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0
2025-10-10T14:08:29.789767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75817206-7b95ee01-e79e15e0-2a4338de_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:29.827269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0] Write session: try to update token
2025-10-10T14:08:29.827329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:30.011744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:30.011783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:30.011794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:30.011911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:30.011924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:30.011936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:30.011946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:30.011957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:30.011991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:30.012016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:30.012038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:30.012056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:30.012165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:30.012187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:30.012204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:30.012224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:30.052567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId: src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:30.078862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:30.078915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.078924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:30.080091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:30.109667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:30.270267Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:30.273091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:30.273141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:30.273186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594742308895775:9121]
2025-10-10T14:08:30.273321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:30.273354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:30.273454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:30.274284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:30.274430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:30.274922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594743886818401:9722]
2025-10-10T14:08:30.274148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:30.285140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 755 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0
2025-10-10T14:08:30.291463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 755 sessionId: src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0 is DEAD
2025-10-10T14:08:30.293432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:30.293516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0] Write session will restart in 0.005013s
2025-10-10T14:08:30.293711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0] Write session: Do CDS request
2025-10-10T14:08:30.293767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:30.307111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:30.306659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:30.306694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 756
2025-10-10T14:08:30.307649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:30.307797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:30.307814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:30.307824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:30.309296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 756 sessionId:  describe result for acl check
2025-10-10T14:08:30.309399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:30.309410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:30.309420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:30.309438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594748181785760:5844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:30.312393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594748181785760:5844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:30.323081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594748181785760:5844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:30.331095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594748181785760:5844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:30.331150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594748181785760:5844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:30.331168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594748181785760:5844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:30.331204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:30.374726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594748181785837:9722]
2025-10-10T14:08:30.381238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:30.385014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:30.385994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:30.386014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:30.386060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:30.386381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:30.386577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594746603863207:9130]
2025-10-10T14:08:30.388823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:30.390587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:30.390819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:30.392118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:30.392447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:30.392463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:30.392469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:30.392476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:30.392482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:30.392491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:30.392498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:30.392505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:30.392512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.392519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.392526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.392532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.392584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:30.392692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:30.392742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:30.392793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:30.392842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:30.392890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:30.392936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:30.392979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:30.393025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.393069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.393120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.393179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.393223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:30.393289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:30.393345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:30.393402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:30.393452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:30.393501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:30.393551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:30.393608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:30.393657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:30.393733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:30.393781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:30.393863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:30.393914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:30.393963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:30.394008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:30.394058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:30.394106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.394159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.394199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.394249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.394295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.394344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.394387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.394435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.394960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:30.436200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:30.455383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:30.455431Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:30.455449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:30.455467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:30.455492Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 755 [2:7559594746603863207:9130]
2025-10-10T14:08:30.455546Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:30.455607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:30.455623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:30.455636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:30.455647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:30.455695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:30.455717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:30.455740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:30.458307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.458324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.458336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.458349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.458360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:30.458651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:30.458667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.458799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.458969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.459181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.459286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:30.459358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.459372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.459384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.459395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.459435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:30.459511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:30.459596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:30.459611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:30.459622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:30.459634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:30.459677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:30.459692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:30.459820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.459839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:30.459890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:30.459925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594748181785748:2442], now have 1 active actors on pipe
2025-10-10T14:08:30.459974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594748181785837:9722], now have 1 active actors on pipe
2025-10-10T14:08:30.459995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594748181785802:5844], now have 1 active actors on pipe
2025-10-10T14:08:30.460789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 755
2025-10-10T14:08:30.460886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 755, pipe: [1:7559594748181785837:9722]
2025-10-10T14:08:30.460972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 755
2025-10-10T14:08:30.462043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:30.462082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:30.462159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:30.462201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:30.462225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:30.462236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:30.462272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:30.462323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:30.462372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:30.462865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:30.462902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:30.462957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:30.464198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85dda0c-994880b6-fd818f12-4c075bc4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:30.463375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 756 partition: 0 MaxSeqNo: 36 sessionId: src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0
2025-10-10T14:08:30.488062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0] Write session: try to update token
2025-10-10T14:08:30.488123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:30.615967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:30.616006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:30.616019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:30.616030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:30.616040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:30.616075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.616103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.616131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.616154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.616325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:30.616349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:30.616360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:30.616456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:30.616479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.616490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:30.616609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:30.616635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:30.616660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:30.616684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:30.634650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:30.686563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId: src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:30.709815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:30.794009Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:30.808891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:30.808942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:30.809011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:30.809026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:30.809074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594746603863202:9130]
2025-10-10T14:08:30.810720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:30.812009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:30.812033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:30.812094Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:30.851300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 756 reason: error at write: Disconnected sessionId: src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0
2025-10-10T14:08:30.851592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 756 sessionId: src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0 is DEAD
2025-10-10T14:08:30.852533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:30.852557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0] Write session will restart in 0.007423s
2025-10-10T14:08:30.852621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0] Write session: Do CDS request
2025-10-10T14:08:30.852640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:30.868346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:30.884496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:30.884660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594748181785837:9722]
2025-10-10T14:08:30.884696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:30.884707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 757
2025-10-10T14:08:30.885980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:30.886117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:30.886133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:30.886146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:30.890368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 757 sessionId:  describe result for acl check
2025-10-10T14:08:30.890491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:30.890507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:30.890515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:30.890531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594748181785897:5818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:30.897553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594748181785897:5818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:30.906018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594748181785897:5818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:30.920266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594748181785897:5818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:30.920310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594748181785897:5818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:30.920327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594748181785897:5818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:30.920360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:30.920342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:30.930389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:30.931298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:30.931318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:30.931361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:30.931619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:30.931804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594746603863294:9138]
2025-10-10T14:08:30.934276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:30.938648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:30.938912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:30.940219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:30.940547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:30.940556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:30.940562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:30.940568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:30.940575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:30.940582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:30.940589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:30.940595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:30.940603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.940610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.940616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.940623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.940669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:30.940776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:30.940824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:30.940870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:30.940911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:30.940956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:30.941000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:30.941045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:30.941089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.941158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.941200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.941279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.941323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:30.941385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:30.941443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:30.941495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:30.941545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:30.941596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:30.941639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:30.941708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:30.941754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:30.941807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:30.941854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:30.941902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:30.941947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:30.941997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:30.942041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:30.942088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:30.942134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.942184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:30.942226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.942279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:30.942324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.942375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:30.942418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.942469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:30.942883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:30.985396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594748181785966:9722]
2025-10-10T14:08:30.994313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:31.011656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:31.011711Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:31.011729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:31.011748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:31.011771Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 756 [2:7559594746603863294:9138]
2025-10-10T14:08:31.011826Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:31.011890Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:31.011906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:31.011917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:31.011928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:31.011977Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:31.011998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:31.012020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:31.013402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.013417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:31.013431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:31.013444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:31.013455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:31.013753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:31.013781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.013921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:31.014100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:31.014317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:31.014426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:31.014501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.014516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.014529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.014542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.014590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:31.014670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:31.014803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:31.014828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:31.014841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:31.014845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:31.014854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:31.014862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:31.015005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.015028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:31.015133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:31.015195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594748181785884:2442], now have 1 active actors on pipe
2025-10-10T14:08:31.015219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594748181785966:9722], now have 1 active actors on pipe
2025-10-10T14:08:31.015710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594748181785956:5818], now have 1 active actors on pipe
2025-10-10T14:08:31.019004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:31.019044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:31.019143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:31.019180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:31.019198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:31.019209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:31.019247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:31.019293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:31.019343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:31.017788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 756, pipe: [1:7559594748181785966:9722]
2025-10-10T14:08:31.017900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 756
2025-10-10T14:08:31.017976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 756
2025-10-10T14:08:31.020497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:31.020543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:31.020611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:31.021310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 757 partition: 0 MaxSeqNo: 36 sessionId: src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0
2025-10-10T14:08:31.025492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcfa0cad-2df3a8db-d6654bb4-a080bab4_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:31.063024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0] Write session: try to update token
2025-10-10T14:08:31.063087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:31.074900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:31.074938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:31.074978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.075104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:31.076327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:31.076969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:31.080671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:31.087343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:31.090871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:31.095795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:31.097052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:31.112086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:31.112131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:31.112144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:31.150461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:31.150500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:31.150514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:31.150525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:31.150538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:31.150580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.150607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.150633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.150655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594746603863288:9138]
2025-10-10T14:08:31.150813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:31.150851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.150863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:31.151906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:31.153305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:31.153385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:31.153439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:31.153499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:31.204279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId: src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:31.224111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:31.319352Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:31.321149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:31.321195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:31.326509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:31.326672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594748181785966:9722]
2025-10-10T14:08:31.326748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:31.326759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:31.326399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:31.340279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 757 reason: error at write: Disconnected sessionId: src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0
2025-10-10T14:08:31.340656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 757 sessionId: src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0 is DEAD
2025-10-10T14:08:31.349445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:31.349490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0] Write session will restart in 0.009391s
2025-10-10T14:08:31.349607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0] Write session: Do CDS request
2025-10-10T14:08:31.349641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:31.364317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:31.364346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 758
2025-10-10T14:08:31.364754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:31.365620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:31.365871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:31.365906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:31.365929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:31.372722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 758 sessionId:  describe result for acl check
2025-10-10T14:08:31.372868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:31.372887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:31.372899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:31.372917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594752476753299:5802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:31.376927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594752476753299:5802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:31.395312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594752476753299:5802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:31.404569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594752476753299:5802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:31.404610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594752476753299:5802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:31.404639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594752476753299:5802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:31.404669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:31.426993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594752476753364:9722]
2025-10-10T14:08:31.434665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:31.436751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:31.437626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:31.437646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:31.437708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:31.437987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:31.438183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594750898830702:9145]
2025-10-10T14:08:31.440505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:31.446105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:31.446382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:31.447795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:31.448169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:31.448190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:31.448198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:31.448205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:31.448212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:31.448219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:31.448227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:31.448234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:31.448242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.448250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:31.448257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:31.448264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:31.448314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:31.448427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:31.448477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:31.448525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:31.448583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:31.448641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:31.448687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:31.448733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:31.448779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.448824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:31.448872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:31.448923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:31.448963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:31.449030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:31.449089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:31.450469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:31.450534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:31.450594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:31.450643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:31.450699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:31.450750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:31.450808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:31.450875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:31.450932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:31.450983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:31.451043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:31.451087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:31.451143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:31.451194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.451252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.451299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:31.451353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:31.451402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:31.451456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:31.451500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:31.451558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:31.452012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:31.482186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:31.496572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:31.496614Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:31.496631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:31.496651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:31.496674Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 757 [2:7559594750898830702:9145]
2025-10-10T14:08:31.496731Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:31.496787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:31.496800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:31.496812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:31.496823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:31.496870Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:31.496899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:31.496921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:31.499317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.499349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:31.499363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:31.499377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:31.499387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:31.499628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:31.499651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.499782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:31.499949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:31.500007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 757
2025-10-10T14:08:31.500120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 757
2025-10-10T14:08:31.500149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:31.500204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 757, pipe: [1:7559594752476753364:9722]
2025-10-10T14:08:31.500271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:31.500353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594752476753333:5802], now have 1 active actors on pipe
2025-10-10T14:08:31.500382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594752476753273:2442], now have 1 active actors on pipe
2025-10-10T14:08:31.500408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594752476753364:9722], now have 1 active actors on pipe
2025-10-10T14:08:31.500462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:31.500489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:31.500543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.500563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.500584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.500599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.500635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:31.500662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:31.500680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:31.500688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:31.500696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:31.500719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:31.500904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:31.500926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:31.500986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:31.501016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:31.501033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:31.501043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:31.501075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:31.501117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:31.501290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.501322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:31.501362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:31.501370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:31.505799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:31.505841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:31.505917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:31.509365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 758 partition: 0 MaxSeqNo: 36 sessionId: src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0
2025-10-10T14:08:31.513900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5200fbe0-1b57d27e-dfb3eeb1-bbdee15c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:31.551293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:31.551333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:31.551375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.551510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:31.551527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:31.555935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:31.557795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0] Write session: try to update token
2025-10-10T14:08:31.557846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:31.568173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:31.569252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:31.570390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:31.571704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:31.574970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:31.596987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:31.597022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:31.597033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:31.704078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId: src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:31.780275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:31.787016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:31.787055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:31.787066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:31.787124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:31.787138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:31.787152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:31.787164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:31.787175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:31.787215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.787241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.787261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.787283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594750898830697:9145]
2025-10-10T14:08:31.787466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:31.787492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:31.787527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:31.787553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:31.787563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:31.788562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:31.789251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:31.789292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:31.789329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:31.789356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:31.933898Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:31.941895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:31.942182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:31.942209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:31.955577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:31.955711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594752476753364:9722]
2025-10-10T14:08:31.974284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:31.974359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0] Write session will restart in 0.008194s
2025-10-10T14:08:31.974557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0] Write session: Do CDS request
2025-10-10T14:08:31.974608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:31.973526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 758 reason: error at write: Disconnected sessionId: src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0
2025-10-10T14:08:31.973856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 758 sessionId: src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0 is DEAD
2025-10-10T14:08:31.987311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:31.990236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:31.990266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 759
2025-10-10T14:08:31.994324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:31.994449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:31.994463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:31.994472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:31.995825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 759 sessionId:  describe result for acl check
2025-10-10T14:08:31.995919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:31.995928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:31.995936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:31.995952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594752476753448:5775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:31.998384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594752476753448:5775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:32.003530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:32.009861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594752476753448:5775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:32.013695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:32.014536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:32.014561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:32.014604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:32.014838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:32.015016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594755193798100:9157]
2025-10-10T14:08:32.016811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:32.018158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:32.018496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:32.019861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:32.020181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.020190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.020196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.020202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.020209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.020216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.020223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.020229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.020236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.020243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.020248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.020254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.020300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.020398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.020440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.020483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.020524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.020565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.020607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.020660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.020709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.020757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.020804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.020852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.020894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.020958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.021015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.021073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.021992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.022103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.022181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.022244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.022298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.022356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.022400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.022455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.022506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.022565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.022613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.022665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.022715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.022769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.022818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.022870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.022929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.022986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.023038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.023091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.023514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:32.024822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594752476753448:5775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:32.024864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594752476753448:5775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:32.024883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594752476753448:5775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:32.024915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:32.049352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:32.055781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594756771720778:9722]
2025-10-10T14:08:32.063624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:32.063675Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:32.063695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:32.063715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:32.063741Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 758 [2:7559594755193798100:9157]
2025-10-10T14:08:32.063806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:32.063872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:32.063888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:32.063901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:32.063913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:32.063967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:32.063989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:32.064012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:32.090756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.090800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.090814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.090828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.090840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:32.091166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:32.091198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.091350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.091559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.091805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.091485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 758
2025-10-10T14:08:32.091581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 758, pipe: [1:7559594756771720778:9722]
2025-10-10T14:08:32.091662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 758
2025-10-10T14:08:32.091949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:32.092045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594756771720774:5775], now have 1 active actors on pipe
2025-10-10T14:08:32.092073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594756771720778:9722], now have 1 active actors on pipe
2025-10-10T14:08:32.092097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594752476753399:2442], now have 1 active actors on pipe
2025-10-10T14:08:32.092154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:32.092177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:32.092235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594755193798094:9157]
2025-10-10T14:08:32.092250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594755193798094:9157]
2025-10-10T14:08:32.092264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594755193798094:9157]
2025-10-10T14:08:32.092279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594755193798094:9157]
2025-10-10T14:08:32.092321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:32.092366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:32.092381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:32.092393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:32.092403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:32.092404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:32.092599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:32.092617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:32.092680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:32.092723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:32.092742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:32.092754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:32.092787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:32.092826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:32.092963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594755193798094:9157]
2025-10-10T14:08:32.093002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:32.093037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:32.093050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:32.093861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:32.093900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:32.093968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:32.094636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 759 partition: 0 MaxSeqNo: 36 sessionId: src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0
2025-10-10T14:08:32.095627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e6910a7-57c8121b-58ec6cf8-7147825d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:32.118212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0] Write session: try to update token
2025-10-10T14:08:32.118267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:32.181569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:32.181609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:32.181621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:32.181685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:32.181701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:32.181715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:32.181726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:32.181736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:32.181771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594755193798094:9157]
2025-10-10T14:08:32.181798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594755193798094:9157]
2025-10-10T14:08:32.181820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594755193798094:9157]
2025-10-10T14:08:32.181840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594755193798094:9157]
2025-10-10T14:08:32.181984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:32.182012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.182024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:32.182448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:32.182485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:32.182514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:32.182542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:32.184157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:32.245682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId: src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:32.268183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:32.340764Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:32.343431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:32.343483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:32.346995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:32.347028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:32.347958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:32.379531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594756771720778:9722]
2025-10-10T14:08:32.379623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:32.404126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 759 reason: error at write: Disconnected sessionId: src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0
2025-10-10T14:08:32.404480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 759 sessionId: src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0 is DEAD
2025-10-10T14:08:32.405506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:32.405538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0] Write session will restart in 0.009137s
2025-10-10T14:08:32.405632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0] Write session: Do CDS request
2025-10-10T14:08:32.405677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:32.426608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:32.426320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:32.426353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 760
2025-10-10T14:08:32.427807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:32.427934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:32.427955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:32.427964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:32.428326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:32.429096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 760 sessionId:  describe result for acl check
2025-10-10T14:08:32.429219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:32.429225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:32.429230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:32.429242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594756771720864:5762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:32.430928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:32.431214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594756771720864:5762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:32.431666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:32.431693Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:32.431738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:32.431943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:32.432077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594755193798207:9160]
2025-10-10T14:08:32.434171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:32.435094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:32.435307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:32.436525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:32.436848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.436867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.436874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.436880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.436886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.436894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.436900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.436906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.436912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.436919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.436925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.436932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.436977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.437078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.437145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.437191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.437240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.437284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.437332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.437379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.437428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.437482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.437525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.437568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.437609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.437685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.437741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.437792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.437840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.437890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.437932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.437982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.438027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.438077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.438121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.438169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.438212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.438266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.438312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.438364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.438412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.438459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.438505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.438555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.439781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594756771720864:5762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:32.438601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.438653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.438695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.438747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.439174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:32.452306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594756771720864:5762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:32.452351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594756771720864:5762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:32.452369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594756771720864:5762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:32.452404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:32.463828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:32.482276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:32.482328Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:32.482345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:32.482364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:32.482388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 759 [2:7559594755193798207:9160]
2025-10-10T14:08:32.482446Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:32.482507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:32.482522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:32.482534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:32.482545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:32.482595Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:32.482615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:32.482636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:32.485251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594756771720896:9722]
2025-10-10T14:08:32.491480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.491510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.491522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.491545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.491558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:32.491856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:32.491873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.492008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.492177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.492386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.492491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:32.492567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594755193798202:9160]
2025-10-10T14:08:32.492582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594755193798202:9160]
2025-10-10T14:08:32.492594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594755193798202:9160]
2025-10-10T14:08:32.492606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594755193798202:9160]
2025-10-10T14:08:32.492640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:32.492720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:32.492889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:32.492905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:32.493031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594755193798202:9160]
2025-10-10T14:08:32.493050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:32.493286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:32.493302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:32.493313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:32.493325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:32.493349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:32.494063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594756771720895:5762], now have 1 active actors on pipe
2025-10-10T14:08:32.494098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594756771720896:9722], now have 1 active actors on pipe
2025-10-10T14:08:32.494118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594756771720797:2442], now have 1 active actors on pipe
2025-10-10T14:08:32.496091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 759
2025-10-10T14:08:32.496166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 759, pipe: [1:7559594756771720896:9722]
2025-10-10T14:08:32.496234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 759
2025-10-10T14:08:32.498865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:32.498906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:32.499011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|489f3a41-f2a122be-e6aff964-37094d53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:32.499048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:32.499067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:32.499078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:32.499119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:32.499166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:32.499215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:32.500009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:32.500063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:32.500165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:32.502838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|177759e7-f338f642-3c4a27ce-a94c2d57_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|489f3a41-f2a122be-e6aff964-37094d53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:32.502078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 760 partition: 0 MaxSeqNo: 36 sessionId: src_id|489f3a41-f2a122be-e6aff964-37094d53_0
2025-10-10T14:08:32.523343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489f3a41-f2a122be-e6aff964-37094d53_0] Write session: try to update token
2025-10-10T14:08:32.523392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489f3a41-f2a122be-e6aff964-37094d53_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:32.568179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:32.568221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:32.568237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:32.568250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:32.568264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:32.568305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594755193798202:9160]
2025-10-10T14:08:32.568334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594755193798202:9160]
2025-10-10T14:08:32.568363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594755193798202:9160]
2025-10-10T14:08:32.568393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594755193798202:9160]
2025-10-10T14:08:32.568521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:32.568552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:32.568573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:32.568580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.568592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:32.568608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:32.568641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:32.569801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:32.618058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId: src_id|489f3a41-f2a122be-e6aff964-37094d53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:32.637187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:32.725754Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:32.727616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:32.727667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:32.728389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:32.728432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:32.729350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594756771720896:9722]
2025-10-10T14:08:32.729469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:32.738773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 760 reason: error at write: Disconnected sessionId: src_id|489f3a41-f2a122be-e6aff964-37094d53_0
2025-10-10T14:08:32.739476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489f3a41-f2a122be-e6aff964-37094d53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:32.739521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489f3a41-f2a122be-e6aff964-37094d53_0] Write session will restart in 0.005854s
2025-10-10T14:08:32.739720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489f3a41-f2a122be-e6aff964-37094d53_0] Write session: Do CDS request
2025-10-10T14:08:32.739778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489f3a41-f2a122be-e6aff964-37094d53_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:32.739107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 760 sessionId: src_id|489f3a41-f2a122be-e6aff964-37094d53_0 is DEAD
2025-10-10T14:08:32.747708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:32.750624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|489f3a41-f2a122be-e6aff964-37094d53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:32.750616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:32.750655Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 761
2025-10-10T14:08:32.751335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:32.751561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:32.751597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:32.751614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:32.753681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 761 sessionId:  describe result for acl check
2025-10-10T14:08:32.753843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:32.753869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:32.753885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:32.753907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594756771720919:5744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:32.756811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594756771720919:5744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:32.763187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594756771720919:5744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:32.774021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594756771720919:5744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:32.774082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594756771720919:5744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:32.774107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594756771720919:5744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:32.774156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:32.801864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:32.804495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:32.805569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:32.805599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:32.805657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:32.805950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:32.806180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594755193798293:9165]
2025-10-10T14:08:32.808249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:32.810413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:32.810642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:32.812043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:32.812391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.812408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.812415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.812421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.812428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.812435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.812441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.812447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.812453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.812459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.812466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.812472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.812517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.812630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.812679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.812726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.812778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.812831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.812882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.812934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.812984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.813038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.813083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.813147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.813196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.813266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:32.813348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.813411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:32.813460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.813514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:32.813564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.813620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:32.813679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.813733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:32.813779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.813834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:32.813885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.813944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:32.813991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.814058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:32.814109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.814165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.814208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.814260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.814309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.814361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.814412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.814463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.814899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:32.829582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594756771720991:9722]
2025-10-10T14:08:32.848139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:32.861893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:32.861939Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:32.861954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:32.861968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:32.861987Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 760 [2:7559594755193798293:9165]
2025-10-10T14:08:32.862038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:32.862089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:32.862100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:32.862111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:32.862122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:32.862169Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:32.862186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:32.862203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:32.879956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.879986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.879996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.880005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.880014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:32.880281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:32.880304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.880429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:32.880599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:32.880649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 760, pipe: [1:7559594756771720991:9722]
2025-10-10T14:08:32.880747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 760
2025-10-10T14:08:32.880794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:32.880809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 760
2025-10-10T14:08:32.880894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:32.880974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594756771720991:9722], now have 1 active actors on pipe
2025-10-10T14:08:32.881003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594756771720979:5744], now have 1 active actors on pipe
2025-10-10T14:08:32.881020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594756771720908:2442], now have 1 active actors on pipe
2025-10-10T14:08:32.881062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:32.881081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:32.881145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.881162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.881174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.881185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.881219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:32.881257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:32.881278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:32.881288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:32.881290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:32.881311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:32.881445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:32.881466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:32.881521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:32.881558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:32.881578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:32.881587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:32.881624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:32.881677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:32.881805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.881836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:32.881870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:32.881880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:32.882319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:32.882345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:32.882400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:32.882640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 761 partition: 0 MaxSeqNo: 36 sessionId: src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0
2025-10-10T14:08:32.883400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|489f3a41-f2a122be-e6aff964-37094d53_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:32.909786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:32.909816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:32.909846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.909970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:32.909976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:32.911992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0] Write session: try to update token
2025-10-10T14:08:32.912045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:32.918812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:32.920074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:32.921424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:32.922876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:32.925113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:32.925718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:32.992548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:32.992605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:32.992629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:32.992730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:32.992759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:32.992786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:32.992808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:32.992830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:32.992899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.992958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.993003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.993042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594755193798288:9165]
2025-10-10T14:08:32.993230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:32.993256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:32.993281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:32.993295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:32.993312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:32.993338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:32.993374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:32.997628Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:33.022451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId: src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:33.045839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1010 14:08:33.105315452  106874 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:08:33.146868Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:33.149309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:33.149349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:33.150029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594756771720991:9722]
2025-10-10T14:08:33.150141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:33.150146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:33.150157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:33.150374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:33.159838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 761 reason: error at write: Disconnected sessionId: src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0
2025-10-10T14:08:33.160165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 761 sessionId: src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0 is DEAD
2025-10-10T14:08:33.161580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:33.161618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0] Write session will restart in 0.006785s
2025-10-10T14:08:33.161735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0] Write session: Do CDS request
2025-10-10T14:08:33.161769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:33.174000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:33.175236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:33.175315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 762
2025-10-10T14:08:33.176085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:33.176326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:33.176370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:33.176391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:33.178500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 762 sessionId:  describe result for acl check
2025-10-10T14:08:33.178637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:33.178657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:33.178668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:33.178696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594761066688311:5747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:33.182395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594761066688311:5747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:33.188845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594761066688311:5747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:33.197825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594761066688311:5747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:33.197868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594761066688311:5747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:33.197886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594761066688311:5747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:33.197917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:33.223632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:33.225826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:33.226725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:33.226756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:33.226804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:33.227071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:33.227315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594759488765690:9173]
2025-10-10T14:08:33.229002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:33.230413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:33.230630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:33.231725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:33.232018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:33.232025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:33.232030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:33.232037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:33.232043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:33.232050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:33.232056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:33.232061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:33.232068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.232075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.232081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.232087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.232128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:33.232265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:33.232309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:33.232350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:33.232390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:33.232431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:33.232467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:33.232507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:33.232546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.232585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.232622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.232664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.232702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:33.232760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:33.232812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:33.232860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:33.232903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:33.232950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:33.232990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:33.233037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:33.233079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:33.233146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:33.233199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:33.233248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:33.233289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:33.233374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:33.233414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:33.233461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:33.233508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.233556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.233598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.233663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.233707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.233757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.233795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.233839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.234237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:33.250222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594761066688385:9722]
2025-10-10T14:08:33.261859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:33.283119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:33.283163Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:33.283178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:33.283197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:33.283219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 761 [2:7559594759488765690:9173]
2025-10-10T14:08:33.283268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:33.283327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:33.283339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:33.283349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:33.283359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:33.283406Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:33.283426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:33.283449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:33.285877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.285907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.285920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.285932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.285942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:33.288083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 761, pipe: [1:7559594761066688385:9722]
2025-10-10T14:08:33.288089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 761
2025-10-10T14:08:33.286230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:33.288182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 761
2025-10-10T14:08:33.286255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.286380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.286541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.286735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.286837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:33.286908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.286922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.286934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.286946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.286990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:33.287068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:33.287110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:33.287123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:33.287133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:33.287143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:33.287234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:33.287250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:33.287380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.287400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:33.287422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:33.287496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594761066688301:2442], now have 1 active actors on pipe
2025-10-10T14:08:33.287518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594761066688385:9722], now have 1 active actors on pipe
2025-10-10T14:08:33.287538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594761066688344:5747], now have 1 active actors on pipe
2025-10-10T14:08:33.288313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:33.288336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:33.288402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:33.288434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:33.288450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:33.288460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:33.288494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:33.288533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:33.288561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:33.290335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:33.290399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:33.290468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:33.298762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 762 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0
2025-10-10T14:08:33.299528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74aa435b-e4285f2e-27559ac4-5a83ae0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:33.334186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:33.334219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:33.334256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.334381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:33.334730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:33.338946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:33.340519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:33.341906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:33.342910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0] Write session: try to update token
2025-10-10T14:08:33.342984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:33.344726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:33.346678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:33.347190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:33.401276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:33.401311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:33.401323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:33.401386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:33.401401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:33.401415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:33.401426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:33.401437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:33.401481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.401508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.401531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.401552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594759488765685:9173]
2025-10-10T14:08:33.401710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:33.401744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.401756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:33.402863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:33.405264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:33.405301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:33.405332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:33.405361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:33.503528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId: src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:33.526916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:33.559828Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:33.562520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:33.562564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:33.563386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:33.563542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594761066688385:9722]
2025-10-10T14:08:33.563622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:33.563633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:33.563287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:33.572246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 762 reason: error at write: Disconnected sessionId: src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0
2025-10-10T14:08:33.572730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 762 sessionId: src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0 is DEAD
2025-10-10T14:08:33.573226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:33.573260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0] Write session will restart in 0.008226s
2025-10-10T14:08:33.573377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0] Write session: Do CDS request
2025-10-10T14:08:33.573438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:33.587085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:33.594711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:33.594742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 763
2025-10-10T14:08:33.595733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:33.595860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:33.595875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:33.595885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:33.598250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 763 sessionId:  describe result for acl check
2025-10-10T14:08:33.598366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:33.598375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:33.598382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:33.598397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594761066688434:5717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:33.602536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594761066688434:5717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:33.619549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594761066688434:5717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:33.647788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594761066688434:5717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:33.647819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594761066688434:5717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:33.647830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594761066688434:5717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:33.647852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:33.663570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594761066688505:9722]
2025-10-10T14:08:33.664740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:33.670206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:33.671111Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:33.671129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:33.671175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:33.671444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:33.671659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594759488765812:9182]
2025-10-10T14:08:33.674409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:33.675376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:33.675592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:33.676886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:33.677262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:33.677282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:33.677290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:33.677297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:33.677304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:33.677311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:33.677320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:33.677328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:33.677336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.677343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.677352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.677359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.677410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:33.677521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:33.677572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:33.677619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:33.677678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:33.677721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:33.677766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:33.677824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:33.677873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.677918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.677963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.678010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.678069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:33.678131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:33.678192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:33.678245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:33.678308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:33.678369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:33.678420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:33.678476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:33.678527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:33.678582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:33.678629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:33.678684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:33.678733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:33.678793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:33.678841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:33.678900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:33.678956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.679019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.679077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.679140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.679193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.679246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.679295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.679355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.679844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:33.707384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:33.722039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:33.722086Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:33.722100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:33.722118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:33.722140Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 762 [2:7559594759488765812:9182]
2025-10-10T14:08:33.722187Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:33.722242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:33.722256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:33.722268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:33.722279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:33.722327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:33.722348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:33.722369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:33.745364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.745396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.745408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.745419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.745429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:33.745709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:33.745731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.745848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:33.746023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:33.746222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:33.746325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:33.746397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594759488765807:9182]
2025-10-10T14:08:33.746416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594759488765807:9182]
2025-10-10T14:08:33.746427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594759488765807:9182]
2025-10-10T14:08:33.746438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594759488765807:9182]
2025-10-10T14:08:33.746478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:33.746556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:33.746612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:33.746625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:33.746637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:33.746648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:33.746712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:33.746732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:33.746850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594759488765807:9182]
2025-10-10T14:08:33.746877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:33.746921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:33.746957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594761066688505:9722], now have 1 active actors on pipe
2025-10-10T14:08:33.746982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594761066688496:5717], now have 1 active actors on pipe
2025-10-10T14:08:33.747027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594761066688426:2442], now have 1 active actors on pipe
2025-10-10T14:08:33.747114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 762, pipe: [1:7559594761066688505:9722]
2025-10-10T14:08:33.747223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 762
2025-10-10T14:08:33.747291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 762
2025-10-10T14:08:33.747431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:33.747473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:33.747576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|448f825-5745d7c4-44877d38-2600944b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:33.747614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:33.747637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:33.747646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:33.747689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:33.747736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:33.747796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:33.748801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:33.748829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:33.748899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:33.749196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 763 partition: 0 MaxSeqNo: 36 sessionId: src_id|448f825-5745d7c4-44877d38-2600944b_0
2025-10-10T14:08:33.750038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b3aaeb-65eca769-6fd1fd79-44766941_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|448f825-5745d7c4-44877d38-2600944b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:33.784981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448f825-5745d7c4-44877d38-2600944b_0] Write session: try to update token
2025-10-10T14:08:33.785038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448f825-5745d7c4-44877d38-2600944b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:33.833549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:33.833581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:33.833592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:33.833667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:33.833681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:33.833694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:33.833704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:33.833714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:33.833747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594759488765807:9182]
2025-10-10T14:08:33.833772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594759488765807:9182]
2025-10-10T14:08:33.833795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594759488765807:9182]
2025-10-10T14:08:33.833812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594759488765807:9182]
2025-10-10T14:08:33.833955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:33.833989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:33.834000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:33.834753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:33.834789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:33.834817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:33.834844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:33.835002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:33.919200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId: src_id|448f825-5745d7c4-44877d38-2600944b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:33.939382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:34.002499Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:34.003783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:34.003813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:34.004528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594761066688505:9722]
2025-10-10T14:08:34.004628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:34.004643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:34.012278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:34.021722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:34.031587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 763 reason: error at write: Disconnected sessionId: src_id|448f825-5745d7c4-44877d38-2600944b_0
2025-10-10T14:08:34.031944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 763 sessionId: src_id|448f825-5745d7c4-44877d38-2600944b_0 is DEAD
2025-10-10T14:08:34.033610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448f825-5745d7c4-44877d38-2600944b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:34.033673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448f825-5745d7c4-44877d38-2600944b_0] Write session will restart in 0.007876s
2025-10-10T14:08:34.033826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448f825-5745d7c4-44877d38-2600944b_0] Write session: Do CDS request
2025-10-10T14:08:34.033885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448f825-5745d7c4-44877d38-2600944b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:34.047590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:34.047619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 764
2025-10-10T14:08:34.049462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448f825-5745d7c4-44877d38-2600944b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:34.050021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:34.050116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:34.050132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:34.050139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:34.051230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 764 sessionId:  describe result for acl check
2025-10-10T14:08:34.051311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:34.051316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:34.051323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:34.051334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594765361655879:5690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:34.053734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594765361655879:5690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:34.059653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594765361655879:5690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:34.065302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:34.070888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594765361655879:5690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:34.070927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594765361655879:5690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:34.070944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594765361655879:5690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:34.070976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:34.070281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:34.071107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:34.071125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:34.071165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:34.071402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:34.071577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594763783733201:9186]
2025-10-10T14:08:34.074112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:34.075110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:34.075316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:34.076421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:34.076698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.076712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.076719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.076725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.076731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.076737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.076744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.076750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.076757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.076764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.076770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.076776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.076818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.076911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.076955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.076998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.077044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.077088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.077151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.077199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.077246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.077292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.077340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.077385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.077428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.077491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.077549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.077597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.077659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.077710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.077755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.077802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.077850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.077898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.077941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.077991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.078036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.078089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.078134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.078186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.078236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.078282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.078328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.078375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.078420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.078474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.078516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.078567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.078947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:34.104790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594765361655918:9722]
2025-10-10T14:08:34.106372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:34.135386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:34.135435Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:34.135454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:34.135474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:34.135500Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 763 [2:7559594763783733201:9186]
2025-10-10T14:08:34.135563Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:34.135623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:34.135640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:34.135652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:34.135666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:34.135715Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:34.135737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:34.135760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:34.137037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.137069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.137084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.137099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.137111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:34.137571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:34.137603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.137776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.137997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.138253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.138379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:34.138453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594763783733196:9186]
2025-10-10T14:08:34.138471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594763783733196:9186]
2025-10-10T14:08:34.138485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594763783733196:9186]
2025-10-10T14:08:34.138499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594763783733196:9186]
2025-10-10T14:08:34.138540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:34.138624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:34.138803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:34.138818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:34.138921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594763783733196:9186]
2025-10-10T14:08:34.138938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:34.139404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:34.139415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594765361655910:5690], now have 1 active actors on pipe
2025-10-10T14:08:34.139432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:34.139443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:34.139452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594765361655918:9722], now have 1 active actors on pipe
2025-10-10T14:08:34.139455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:34.139480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:34.139640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 763
2025-10-10T14:08:34.139643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 763, pipe: [1:7559594765361655918:9722]
2025-10-10T14:08:34.139747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594765361655835:2442], now have 1 active actors on pipe
2025-10-10T14:08:34.139822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:34.139853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:34.139921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:34.139923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 763
2025-10-10T14:08:34.139961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:34.139980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:34.139992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:34.140035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:34.140081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:34.140151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:34.140519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:34.140544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:34.140604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:34.140917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 764 partition: 0 MaxSeqNo: 36 sessionId: src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0
2025-10-10T14:08:34.145375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448f825-5745d7c4-44877d38-2600944b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:34.185178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0] Write session: try to update token
2025-10-10T14:08:34.185247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:34.227870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:34.227906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:34.227922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:34.227933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:34.227944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:34.227983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594763783733196:9186]
2025-10-10T14:08:34.228012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594763783733196:9186]
2025-10-10T14:08:34.228037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594763783733196:9186]
2025-10-10T14:08:34.228058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594763783733196:9186]
2025-10-10T14:08:34.228186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:34.228207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:34.228219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:34.228232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.228245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:34.228247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:34.228272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:34.229984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:34.298066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId: src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:34.337580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:34.382725Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:34.385075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:34.385105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:34.390021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:34.390179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:34.390191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:34.390715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:34.394536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594765361655918:9722]
2025-10-10T14:08:34.424454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 764 reason: error at write: Disconnected sessionId: src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0
2025-10-10T14:08:34.424824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 764 sessionId: src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0 is DEAD
2025-10-10T14:08:34.425559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:34.425593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0] Write session will restart in 0.009837s
2025-10-10T14:08:34.425707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0] Write session: Do CDS request
2025-10-10T14:08:34.425735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:34.441610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:34.441854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:34.441881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 765
2025-10-10T14:08:34.442138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:34.442234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:34.442247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:34.442256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:34.443960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 765 sessionId:  describe result for acl check
2025-10-10T14:08:34.444078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:34.444095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:34.444104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:34.444121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594765361655979:5698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:34.446591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594765361655979:5698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:34.454459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594765361655979:5698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:34.461461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:34.463347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594765361655979:5698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:34.463392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594765361655979:5698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:34.463415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594765361655979:5698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:34.463446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:34.469159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:34.469956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:34.469980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:34.470018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:34.470255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:34.470458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594763783733320:9191]
2025-10-10T14:08:34.472424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:34.474057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:34.474263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:34.475398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:34.475690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.475704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.475711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.475717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.475723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.475729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.475736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.475742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.475748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.475754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.475760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.475767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.475808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.475905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.475950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.475992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.476044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.476088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.476128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.476173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.476214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.476260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.476306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.476350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.476388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.476451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.476522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.476577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.476624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.476672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.476716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.476768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.476816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.476867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.476912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.476963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.477011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.477064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.477109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.477835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.477886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.477922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.477951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.477989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.478028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.478079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.478123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.478176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.478614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:34.494934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594765361656030:9722]
2025-10-10T14:08:34.501014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:34.515254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:34.515299Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:34.515314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:34.515349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:34.515372Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 764 [2:7559594763783733320:9191]
2025-10-10T14:08:34.515426Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:34.515485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:34.515499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:34.515510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:34.515520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:34.515563Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:34.515585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:34.515605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:34.524247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.524275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.524288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.524298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.524307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:34.524587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:34.524613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.524731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.524888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.525091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.525215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:34.525287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.525301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.525314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.525324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.525352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:34.525430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:34.525523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:34.525534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:34.525543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:34.525553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:34.525590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:34.525606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:34.525762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594765361656030:9722], now have 1 active actors on pipe
2025-10-10T14:08:34.525784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594765361655930:2442], now have 1 active actors on pipe
2025-10-10T14:08:34.525802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594765361656024:5698], now have 1 active actors on pipe
2025-10-10T14:08:34.525821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.525847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:34.525995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:34.526442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 764, pipe: [1:7559594765361656030:9722]
2025-10-10T14:08:34.526548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 764
2025-10-10T14:08:34.526618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 764
2025-10-10T14:08:34.527094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:34.527134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:34.527212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:34.527259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:34.527283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:34.527294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:34.527331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:34.527383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:34.527431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:34.528552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:34.528587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:34.528650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:34.528925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 765 partition: 0 MaxSeqNo: 36 sessionId: src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0
2025-10-10T14:08:34.530581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16b89553-2e4f281d-3afa7d0e-de409e71_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:34.566366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0] Write session: try to update token
2025-10-10T14:08:34.566430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:34.610547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:34.610579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:34.610593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:34.610603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:34.610613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:34.610648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.610673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.610693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.610714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.610912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:34.610936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.610946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:34.611515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:34.611553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:34.611581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:34.611607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:34.623894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:34.708165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId: src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:34.729055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:34.817303Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:34.838108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:34.838161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:34.838229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:34.838244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:34.838289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594763783733309:9191]
2025-10-10T14:08:34.838614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:34.839276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594765361656030:9722]
2025-10-10T14:08:34.839374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:34.839564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:34.839596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:34.840211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:34.847600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 765 reason: error at write: Disconnected sessionId: src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0
2025-10-10T14:08:34.853651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:34.853699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0] Write session will restart in 0.008531s
2025-10-10T14:08:34.853796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0] Write session: Do CDS request
2025-10-10T14:08:34.853831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:34.855052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 765 sessionId: src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0 is DEAD
2025-10-10T14:08:34.871125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:34.871014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:34.871050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 766
2025-10-10T14:08:34.872260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:34.872415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:34.872434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:34.872447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:34.877402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 766 sessionId:  describe result for acl check
2025-10-10T14:08:34.877533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:34.877543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:34.877553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:34.877571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594765361656054:5669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:34.880423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594765361656054:5669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:34.891243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594765361656054:5669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:34.926755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594765361656054:5669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:34.926800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594765361656054:5669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:34.926816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594765361656054:5669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:34.926853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:34.935471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:34.939666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:34.940578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:34.940596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:34.940644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:34.940912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:34.941113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594763783733428:9203]
2025-10-10T14:08:34.943252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:34.945247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:34.945532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:34.946894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:34.947231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.947242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.947248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.947255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.947262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.947268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.947274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.947281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.947289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.947295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.947302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.947307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.947353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.947474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.947519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.947564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.947606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.947663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.947710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.947753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.947793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.947836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.947878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.947917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.947958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.948020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:34.948073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.948123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:34.948168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.948216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:34.948258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.948306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:34.948351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.948406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:34.948445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.948495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:34.948542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.950568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:34.950645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.950710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:34.950759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.950834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:34.950880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.950943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:34.950988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.951037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:34.951080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.951132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:34.951555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:34.963659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594765361656134:9722]
2025-10-10T14:08:35.020198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:35.037617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:35.037663Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:35.037677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:35.037695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:35.037719Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 765 [2:7559594763783733428:9203]
2025-10-10T14:08:35.037771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:35.037831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:35.037846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:35.037857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:35.037869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:35.037917Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:35.037940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:35.037963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:35.040269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.040285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.040298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.040311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.040322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:35.040598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:35.040615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.040743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.040902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.041099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.041910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 765, pipe: [1:7559594765361656134:9722]
2025-10-10T14:08:35.042016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 765
2025-10-10T14:08:35.042092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 765
2025-10-10T14:08:35.042413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:35.042519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594765361656134:9722], now have 1 active actors on pipe
2025-10-10T14:08:35.042543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594765361656125:5669], now have 1 active actors on pipe
2025-10-10T14:08:35.042564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594765361656045:2442], now have 1 active actors on pipe
2025-10-10T14:08:35.042590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594763783733423:9203]
2025-10-10T14:08:35.042605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594763783733423:9203]
2025-10-10T14:08:35.042618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594763783733423:9203]
2025-10-10T14:08:35.042632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594763783733423:9203]
2025-10-10T14:08:35.042670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:35.042766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:35.042936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:35.042956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:35.043089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594763783733423:9203]
2025-10-10T14:08:35.043110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:35.045216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:35.045248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:35.045258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:35.045270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:35.045301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:35.047978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:35.048025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:35.048144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e881791-cfbc93f-23860702-18138b95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:35.048191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:35.048210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:35.048221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:35.048261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:35.048319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:35.048373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:35.061272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:35.061323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:35.061411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:35.062680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 766 partition: 0 MaxSeqNo: 36 sessionId: src_id|1e881791-cfbc93f-23860702-18138b95_0
2025-10-10T14:08:35.063723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d82e3f9-cc985d8-df90d64a-5e2ae2e8_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1e881791-cfbc93f-23860702-18138b95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:35.091722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e881791-cfbc93f-23860702-18138b95_0] Write session: try to update token
2025-10-10T14:08:35.091772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e881791-cfbc93f-23860702-18138b95_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:35.128941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:35.128972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:35.128981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:35.128990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:35.128997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:35.129021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594763783733423:9203]
2025-10-10T14:08:35.129040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594763783733423:9203]
2025-10-10T14:08:35.129055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594763783733423:9203]
2025-10-10T14:08:35.129068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594763783733423:9203]
2025-10-10T14:08:35.129200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:35.129207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:35.129219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.129226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:35.129237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:35.129275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:35.129306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:35.130159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:35.252550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId: src_id|1e881791-cfbc93f-23860702-18138b95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:35.274735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:35.327100Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:35.329750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:35.329795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:35.333352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594765361656134:9722]
2025-10-10T14:08:35.333519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:35.333534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:35.334295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:35.399195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 766 reason: error at write: Disconnected sessionId: src_id|1e881791-cfbc93f-23860702-18138b95_0
2025-10-10T14:08:35.399286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:35.399532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 766 sessionId: src_id|1e881791-cfbc93f-23860702-18138b95_0 is DEAD
2025-10-10T14:08:35.405384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e881791-cfbc93f-23860702-18138b95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:35.405451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e881791-cfbc93f-23860702-18138b95_0] Write session will restart in 0.007020s
2025-10-10T14:08:35.405623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e881791-cfbc93f-23860702-18138b95_0] Write session: Do CDS request
2025-10-10T14:08:35.405672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e881791-cfbc93f-23860702-18138b95_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:35.422451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e881791-cfbc93f-23860702-18138b95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:35.426104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:35.426143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 767
2025-10-10T14:08:35.426586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:35.426728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:35.426746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:35.426756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:35.428866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 767 sessionId:  describe result for acl check
2025-10-10T14:08:35.428974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:35.428990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:35.428999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:35.429016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594769656623526:5673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:35.426742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:35.432215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594769656623526:5673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:35.432846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594769656623532:9722]
2025-10-10T14:08:35.433262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:35.434194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:35.434229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:35.434273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:35.434539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:35.434771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594768078700826:9206]
2025-10-10T14:08:35.437231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:35.438367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:35.438600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:35.439944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:35.440286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:35.440306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:35.440314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:35.440321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:35.440328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:35.440337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:35.440345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:35.440352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:35.440359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.440367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.440374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.440382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.440435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:35.440550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:35.440603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:35.440654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:35.440702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:35.440754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:35.440801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:35.440853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:35.440903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.440953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.441002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.441056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.441099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:35.441203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:35.441268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:35.441330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:35.441382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:35.441444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:35.441493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:35.441555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:35.441630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:35.441690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:35.441741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:35.441796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:35.441846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:35.441903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:35.441952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:35.442033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:35.442092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.442153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.442206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.442264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.442314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.442371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.442419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.442493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.442994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:35.444160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594769656623526:5673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:35.458649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594769656623526:5673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:35.458704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594769656623526:5673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:35.458723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594769656623526:5673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:35.458754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:35.473475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:35.491818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 766
2025-10-10T14:08:35.491931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 766, pipe: [1:7559594769656623532:9722]
2025-10-10T14:08:35.492028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 766
2025-10-10T14:08:35.489190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:35.489239Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:35.489256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:35.489276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:35.489303Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 766 [2:7559594768078700826:9206]
2025-10-10T14:08:35.489361Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:35.489424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:35.489440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:35.489453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:35.489465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:35.489512Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:35.489533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:35.489557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:35.490777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.490797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.490809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.490822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.490832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:35.491124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:35.491142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.491282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.491472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.491718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.491832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:35.491920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594769656623570:5673], now have 1 active actors on pipe
2025-10-10T14:08:35.491942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594769656623487:2442], now have 1 active actors on pipe
2025-10-10T14:08:35.491963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594769656623532:9722], now have 1 active actors on pipe
2025-10-10T14:08:35.491989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594768078700820:9206]
2025-10-10T14:08:35.492004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594768078700820:9206]
2025-10-10T14:08:35.492017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594768078700820:9206]
2025-10-10T14:08:35.492029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594768078700820:9206]
2025-10-10T14:08:35.492075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:35.492137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:35.492154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:35.492154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:35.492166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:35.492177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:35.492323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:35.492339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:35.492489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:35.492511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:35.492559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594768078700820:9206]
2025-10-10T14:08:35.492608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:35.497694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:35.497902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:35.497943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:35.497963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:35.497975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:35.498017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:35.498070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:35.498216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:35.507833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:35.507898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:35.508004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:35.511466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 767 partition: 0 MaxSeqNo: 36 sessionId: src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0
2025-10-10T14:08:35.513754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e881791-cfbc93f-23860702-18138b95_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:35.569738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0] Write session: try to update token
2025-10-10T14:08:35.569801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:35.592061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:35.592096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:35.592109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:35.592120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:35.592132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:35.592170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594768078700820:9206]
2025-10-10T14:08:35.592196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594768078700820:9206]
2025-10-10T14:08:35.592222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594768078700820:9206]
2025-10-10T14:08:35.592246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594768078700820:9206]
2025-10-10T14:08:35.592421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:35.592434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:35.592445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:35.592490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:35.592515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.592526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:35.593622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:35.594142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:35.594171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:35.594198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:35.594225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:35.703382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId: src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:35.730636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:35.759391Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:35.761454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:35.761490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:35.763951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:35.763980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:35.765271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:35.765464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594769656623532:9722]
2025-10-10T14:08:35.767048Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:35.820402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:35.820444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0] Write session will restart in 0.006406s
2025-10-10T14:08:35.820541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0] Write session: Do CDS request
2025-10-10T14:08:35.820569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:35.819723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 767 reason: error at write: Disconnected sessionId: src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0
2025-10-10T14:08:35.822987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 767 sessionId: src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0 is DEAD
2025-10-10T14:08:35.836990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:35.836085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:35.836123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 768
2025-10-10T14:08:35.837672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:35.837801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:35.837817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:35.837828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:35.839112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:35.845091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:35.846009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:35.846026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:35.846065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:35.857250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:35.857530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594768078700935:9211]
2025-10-10T14:08:35.860066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:35.859904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 768 sessionId:  describe result for acl check
2025-10-10T14:08:35.860063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:35.860073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:35.860082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:35.860099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594769656623639:5665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:35.862752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594769656623639:5665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:35.866147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594769656623660:9722]
2025-10-10T14:08:35.866696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:35.866977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:35.871422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:35.872688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:35.872713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:35.872721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:35.872728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:35.872736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:35.872744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:35.872751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:35.872758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:35.872766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.872773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.872780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.872787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.872834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:35.872946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:35.872994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:35.873175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:35.873269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:35.873325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:35.873371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:35.873416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:35.873462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.873529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.873576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.873635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.873689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:35.873755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:35.873812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:35.873862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:35.873911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:35.873963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:35.874006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:35.874055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:35.874103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:35.874153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:35.874194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:35.874242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:35.874287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:35.874353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:35.875170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594769656623639:5665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:35.874395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:35.874454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:35.874500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.874548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.874590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.874641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.874687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.874736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.874777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.874823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.875226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:35.899280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594769656623639:5665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:35.899319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594769656623639:5665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:35.899338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594769656623639:5665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:35.899368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:35.910271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:35.939162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:35.939217Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:35.939236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:35.939256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:35.939281Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 767 [2:7559594768078700935:9211]
2025-10-10T14:08:35.939338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:35.939400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:35.939415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:35.939428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:35.939440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:35.939488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:35.939509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:35.939530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:35.941815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.941855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.941871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.941886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.941899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:35.942187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:35.942215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:35.942373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:35.942574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:35.942837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:35.942967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:35.943041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:35.943057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:35.943070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:35.943083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:35.943129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:35.943214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:35.943412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:35.943429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:35.943555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:35.943575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:35.943913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:35.943925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:35.943936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:35.943948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:35.943971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:35.946447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594769656623673:5665], now have 1 active actors on pipe
2025-10-10T14:08:35.946502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594769656623660:9722], now have 1 active actors on pipe
2025-10-10T14:08:35.946541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594769656623584:2442], now have 1 active actors on pipe
2025-10-10T14:08:35.948539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:35.948576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:35.948672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b33433b-57455d6-94885596-ffbd3b89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:35.948695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:35.948707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:35.948715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:35.948741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:35.948773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:35.948815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:35.945278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 767
2025-10-10T14:08:35.945360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 767, pipe: [1:7559594769656623660:9722]
2025-10-10T14:08:35.945430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 767
2025-10-10T14:08:35.949617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:35.949649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:35.949725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:35.954005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 768 partition: 0 MaxSeqNo: 36 sessionId: src_id|1b33433b-57455d6-94885596-ffbd3b89_0
2025-10-10T14:08:35.954876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb7720f5-bf7af1f5-712873ec-51f887a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1b33433b-57455d6-94885596-ffbd3b89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:35.992384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b33433b-57455d6-94885596-ffbd3b89_0] Write session: try to update token
2025-10-10T14:08:35.992446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b33433b-57455d6-94885596-ffbd3b89_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:36.036772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:36.036806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:36.036819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:36.138744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:36.138783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:36.138795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:36.138806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:36.138817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:36.138850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:36.138877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:36.138902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:36.138925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:36.139085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:36.139097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:36.139109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:36.141253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:36.141311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:36.141365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:36.141415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:36.183310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:36.183349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:36.183357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:36.184196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:36.205390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId: src_id|1b33433b-57455d6-94885596-ffbd3b89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:36.241037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
E1010 14:08:36.327663013  301195 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:08:36.333331Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:08:36.333969Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:36.350716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:36.350751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:36.350792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594768078700928:9211]
2025-10-10T14:08:36.350955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:36.350982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:36.357904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:36.358900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:36.358929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:36.360074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594769656623660:9722]
2025-10-10T14:08:36.360244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:36.360520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:36.370014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 768 reason: error at write: Disconnected sessionId: src_id|1b33433b-57455d6-94885596-ffbd3b89_0
2025-10-10T14:08:36.370344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 768 sessionId: src_id|1b33433b-57455d6-94885596-ffbd3b89_0 is DEAD
2025-10-10T14:08:36.373556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b33433b-57455d6-94885596-ffbd3b89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:36.373613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b33433b-57455d6-94885596-ffbd3b89_0] Write session will restart in 0.008209s
2025-10-10T14:08:36.373720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b33433b-57455d6-94885596-ffbd3b89_0] Write session: Do CDS request
2025-10-10T14:08:36.373750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b33433b-57455d6-94885596-ffbd3b89_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:36.407798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b33433b-57455d6-94885596-ffbd3b89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:36.408367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:36.408403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 769
2025-10-10T14:08:36.408908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:36.409032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:36.409049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:36.409060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:36.412833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 769 sessionId:  describe result for acl check
2025-10-10T14:08:36.413028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:36.413040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:36.413053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:36.413071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594773951590997:5640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:36.415955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594773951590997:5640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:36.435312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594773951590997:5640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:36.460548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594773951591072:9722]
2025-10-10T14:08:36.463744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594773951590997:5640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:36.464059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594773951590997:5640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:36.464085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594773951590997:5640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:36.464123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:36.481000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:36.518993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:36.520207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:36.520225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:36.520272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:36.520554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:36.520739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594772373668369:9220]
2025-10-10T14:08:36.522971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:36.525046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:36.525320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:36.526782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:36.527135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:36.527142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:36.527150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:36.527159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:36.527166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:36.527173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:36.527181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:36.527189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:36.527197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:36.527205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:36.527212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:36.527219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:36.527274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:36.527392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:36.527443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:36.527491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:36.527541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:36.527592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:36.527643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:36.527694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:36.527742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:36.527791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:36.527836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:36.527883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:36.527921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:36.527991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:36.528050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:36.528102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:36.528156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:36.528211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:36.528276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:36.528334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:36.528386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:36.528441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:36.528489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:36.528546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:36.528598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:36.528654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:36.528704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:36.528762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:36.528845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:36.528911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:36.528961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:36.529021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:36.529076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:36.529149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:36.529197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:36.529251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:36.529771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:36.594319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:36.626973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:36.627024Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:36.627041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:36.627061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:36.627084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 768 [2:7559594772373668369:9220]
2025-10-10T14:08:36.627142Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:36.627201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:36.627216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:36.627228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:36.627239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:36.627337Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:36.627389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:36.627455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:36.650500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:36.650533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:36.650545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:36.650558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:36.650569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:36.650859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:36.650876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:36.651020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:36.651211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:36.651452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:36.651573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:36.651642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594772373668342:9220]
2025-10-10T14:08:36.651658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594772373668342:9220]
2025-10-10T14:08:36.651672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594772373668342:9220]
2025-10-10T14:08:36.651686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594772373668342:9220]
2025-10-10T14:08:36.651718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:36.651748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:36.651762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:36.651774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:36.651784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:36.651800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:36.651979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:36.651997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:36.652042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594773951591072:9722], now have 1 active actors on pipe
2025-10-10T14:08:36.652065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594773951590981:2442], now have 1 active actors on pipe
2025-10-10T14:08:36.652087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594773951591077:5640], now have 1 active actors on pipe
2025-10-10T14:08:36.652208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594772373668342:9220]
2025-10-10T14:08:36.652241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:36.652259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:36.657906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:36.657956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:36.658031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95996c83-e1f1afd1-8812d117-144a49ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:36.658065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:36.658081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:36.657333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 768, pipe: [1:7559594773951591072:9722]
2025-10-10T14:08:36.658092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:36.658135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:36.657466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 768
2025-10-10T14:08:36.658177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:36.657555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 768
2025-10-10T14:08:36.658219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:36.661205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:36.661252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:36.661331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:36.665388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 769 partition: 0 MaxSeqNo: 36 sessionId: src_id|95996c83-e1f1afd1-8812d117-144a49ed_0
2025-10-10T14:08:36.666333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b33433b-57455d6-94885596-ffbd3b89_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|95996c83-e1f1afd1-8812d117-144a49ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:36.704878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95996c83-e1f1afd1-8812d117-144a49ed_0] Write session: try to update token
2025-10-10T14:08:36.704937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95996c83-e1f1afd1-8812d117-144a49ed_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:36.751997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:36.752034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:36.752047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:36.752102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:36.752117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:36.752131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:36.752142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:36.752153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:36.752188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594772373668342:9220]
2025-10-10T14:08:36.752216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594772373668342:9220]
2025-10-10T14:08:36.752240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594772373668342:9220]
2025-10-10T14:08:36.752261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594772373668342:9220]
2025-10-10T14:08:36.752394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:36.752420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:36.752431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:36.753466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:36.755925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:36.755974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:36.756005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:36.756036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:36.873253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId: src_id|95996c83-e1f1afd1-8812d117-144a49ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:36.912607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:36.915425Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:36.920861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:36.920888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:37.008948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95996c83-e1f1afd1-8812d117-144a49ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:37.009018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95996c83-e1f1afd1-8812d117-144a49ed_0] Write session will restart in 0.009539s
2025-10-10T14:08:37.007935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594773951591072:9722]
2025-10-10T14:08:37.008022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:37.008134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 769 reason: error at write: Disconnected sessionId: src_id|95996c83-e1f1afd1-8812d117-144a49ed_0
2025-10-10T14:08:37.008500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 769 sessionId: src_id|95996c83-e1f1afd1-8812d117-144a49ed_0 is DEAD
2025-10-10T14:08:37.009517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95996c83-e1f1afd1-8812d117-144a49ed_0] Write session: Do CDS request
2025-10-10T14:08:37.009593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95996c83-e1f1afd1-8812d117-144a49ed_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:37.028048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95996c83-e1f1afd1-8812d117-144a49ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:37.032219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:37.032263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 770
2025-10-10T14:08:37.039126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:37.039306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:37.039334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:37.039345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:37.044914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 770 sessionId:  describe result for acl check
2025-10-10T14:08:37.045045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:37.045057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:37.045065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:37.045082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594778246558476:5608] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:37.047874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594778246558476:5608] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:37.066138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:37.070666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:37.071553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:37.071576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:37.071619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:37.071869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:37.072078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594776668635762:9228]
2025-10-10T14:08:37.076181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:37.073541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594778246558476:5608] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:37.079266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:37.079497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:37.080925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:37.081327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:37.081351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:37.081359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:37.081367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:37.081375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:37.081382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:37.081390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:37.081399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:37.081406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.081413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.081421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.081429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.081480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:37.081599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:37.081646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:37.081688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:37.081729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:37.081769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:37.081822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:37.081869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:37.081908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.081941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.081972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.082008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.082035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:37.082094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:37.082150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:37.082194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:37.082233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:37.082272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:37.082306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:37.082348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:37.082391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:37.082445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:37.082493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:37.082550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:37.082598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:37.082656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:37.082702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:37.082758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:37.082812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.082869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.083078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.083140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.083191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.083267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.083320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.083391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.083865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:37.084280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594778246558476:5608] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:37.084328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594778246558476:5608] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:37.084347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594778246558476:5608] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:37.084373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:37.103560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594778246558520:9722]
2025-10-10T14:08:37.112842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:37.148178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:37.148232Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:37.148248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:37.148268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:37.148292Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 769 [2:7559594776668635762:9228]
2025-10-10T14:08:37.148347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:37.148409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:37.148425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:37.148437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:37.148448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:37.148495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:37.148517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:37.148537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:37.150407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.150435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.150448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.150462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.150472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:37.150747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:37.150766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.150904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.151697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 769
2025-10-10T14:08:37.151814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 769
2025-10-10T14:08:37.151874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 769, pipe: [1:7559594778246558520:9722]
2025-10-10T14:08:37.151096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.151327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.151433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:37.151518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594778246558448:2442], now have 1 active actors on pipe
2025-10-10T14:08:37.151543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594778246558515:5608], now have 1 active actors on pipe
2025-10-10T14:08:37.151564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594778246558520:9722], now have 1 active actors on pipe
2025-10-10T14:08:37.151590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.151604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.151617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.151631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.151672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:37.151755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:37.151918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:37.151934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:37.152053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.152073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:37.152236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:37.152248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:37.152259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:37.152269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:37.152289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:37.153137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:37.153173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:37.153263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:37.153304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:37.153322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:37.153333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:37.153369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:37.153411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:37.153455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:37.155453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:37.155484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:37.155555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:37.155945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 770 partition: 0 MaxSeqNo: 36 sessionId: src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0
2025-10-10T14:08:37.159541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95996c83-e1f1afd1-8812d117-144a49ed_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:37.206529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0] Write session: try to update token
2025-10-10T14:08:37.206588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:37.368541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:37.368575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:37.368587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:37.368644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:37.368660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:37.368673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:37.368684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:37.368695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:37.368732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.368758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.368783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.368804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.369007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:37.369033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.369045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:37.369521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:37.369553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:37.369596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:37.369621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:37.374454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:37.425240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId: src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:37.456461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:37.551491Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:37.604812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:37.604858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:37.604919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:37.604928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:37.604957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594776668635755:9228]
2025-10-10T14:08:37.605182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:37.605506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:37.607724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:37.608061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:37.609454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594778246558520:9722]
2025-10-10T14:08:37.642331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 770 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0
2025-10-10T14:08:37.642694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 770 sessionId: src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0 is DEAD
2025-10-10T14:08:37.645479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:37.645556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0] Write session will restart in 0.005043s
2025-10-10T14:08:37.645741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0] Write session: Do CDS request
2025-10-10T14:08:37.645795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:37.668746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:37.671957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:37.672015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 771
2025-10-10T14:08:37.672830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:37.673094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:37.673122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:37.673152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:37.677671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 771 sessionId:  describe result for acl check
2025-10-10T14:08:37.677817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:37.677830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:37.677840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:37.677858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594778246558572:5597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:37.680870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594778246558572:5597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:37.690967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594778246558572:5597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:37.705781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:37.709820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594778246558635:9722]
2025-10-10T14:08:37.719125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:37.719776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:37.719802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:37.719844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:37.720031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:37.720171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594776668635893:9240]
2025-10-10T14:08:37.717333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594778246558572:5597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:37.717377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594778246558572:5597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:37.717394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594778246558572:5597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:37.717419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:37.721907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:37.723777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:37.723933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:37.724797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:37.725017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:37.725029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:37.725034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:37.725039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:37.725043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:37.725047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:37.725050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:37.725054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:37.725059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.725063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.725067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.725072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.725104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:37.725201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:37.725232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:37.725261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:37.725290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:37.725320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:37.725348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:37.725374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:37.725401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.725438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.725478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.725507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.725531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:37.725593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:37.725642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:37.725680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:37.725709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:37.725743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:37.725769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:37.725800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:37.725829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:37.725861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:37.725890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:37.725923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:37.725960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:37.725992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:37.726021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:37.726054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:37.726087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.726134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.726172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.726218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.726261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.726304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.726333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.726368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.726666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:37.784204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:37.800999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 770, pipe: [1:7559594778246558635:9722]
2025-10-10T14:08:37.801102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 770
2025-10-10T14:08:37.801199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 770
2025-10-10T14:08:37.797807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:37.797855Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:37.797870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:37.797889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:37.797911Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 770 [2:7559594776668635893:9240]
2025-10-10T14:08:37.797961Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:37.798019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:37.798034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:37.798046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:37.798056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:37.798104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:37.798125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:37.798147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:37.800316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.800334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.800348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.800360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.800371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:37.800655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:37.800670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.800802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:37.802013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:37.802244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:37.802350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:37.802444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594778246558635:9722], now have 1 active actors on pipe
2025-10-10T14:08:37.802467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594778246558547:2442], now have 1 active actors on pipe
2025-10-10T14:08:37.802489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594778246558638:5597], now have 1 active actors on pipe
2025-10-10T14:08:37.802535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:37.802558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:37.802616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594776668635885:9240]
2025-10-10T14:08:37.802631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594776668635885:9240]
2025-10-10T14:08:37.802644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594776668635885:9240]
2025-10-10T14:08:37.802657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594776668635885:9240]
2025-10-10T14:08:37.802697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:37.802778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:37.802948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:37.802964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:37.803031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fae50aff-434b6274-823185ad-fd40317d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:37.803062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:37.803080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:37.803092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:37.803128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:37.803171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:37.803336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594776668635885:9240]
2025-10-10T14:08:37.803357Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:37.803400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:37.803484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:37.803500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:37.803510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:37.803521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:37.803548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:37.805247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:37.805283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:37.805352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:37.805702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 771 partition: 0 MaxSeqNo: 36 sessionId: src_id|fae50aff-434b6274-823185ad-fd40317d_0
2025-10-10T14:08:37.806887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17cfa387-c80376d0-6d6db3e1-f9bc5ebc_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fae50aff-434b6274-823185ad-fd40317d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:37.836795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae50aff-434b6274-823185ad-fd40317d_0] Write session: try to update token
2025-10-10T14:08:37.836856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae50aff-434b6274-823185ad-fd40317d_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:37.940548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:37.940584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:37.940595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:37.940651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:37.940665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:37.940678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:37.940689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:37.940699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:37.940737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594776668635885:9240]
2025-10-10T14:08:37.940764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594776668635885:9240]
2025-10-10T14:08:37.940788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594776668635885:9240]
2025-10-10T14:08:37.940810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594776668635885:9240]
2025-10-10T14:08:37.940984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:37.941020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:37.941031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:37.941386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:37.941428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:37.941456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:37.941492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:37.956757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:38.081442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId: src_id|fae50aff-434b6274-823185ad-fd40317d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:38.104362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:38.207451Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:38.210029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:38.210069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:38.215047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:38.215071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:38.217588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:38.266974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594778246558635:9722]
2025-10-10T14:08:38.267049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:38.267158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 771 reason: error at write: Disconnected sessionId: src_id|fae50aff-434b6274-823185ad-fd40317d_0
2025-10-10T14:08:38.267500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 771 sessionId: src_id|fae50aff-434b6274-823185ad-fd40317d_0 is DEAD
2025-10-10T14:08:38.270275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae50aff-434b6274-823185ad-fd40317d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:38.270305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae50aff-434b6274-823185ad-fd40317d_0] Write session will restart in 0.006904s
2025-10-10T14:08:38.270400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae50aff-434b6274-823185ad-fd40317d_0] Write session: Do CDS request
2025-10-10T14:08:38.270433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae50aff-434b6274-823185ad-fd40317d_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:38.288673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fae50aff-434b6274-823185ad-fd40317d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:38.293387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:38.293419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 772
2025-10-10T14:08:38.304901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:38.305045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:38.305059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:38.305070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:38.315250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 772 sessionId:  describe result for acl check
2025-10-10T14:08:38.315391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:38.315402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:38.315426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:38.315448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594782541526027:5564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:38.318575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594782541526027:5564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:38.337668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594782541526027:5564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:38.345231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:38.354100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:38.355008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:38.355027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:38.355071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:38.355333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:38.355524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594780963603301:9247]
2025-10-10T14:08:38.357861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:38.359105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:38.359311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:38.360644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:38.361010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:38.361019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:38.361027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:38.361034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:38.361041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:38.361049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:38.361056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:38.361063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:38.361072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.361079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.361085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.361092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.361165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:38.361274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:38.361320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:38.361369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:38.361414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:38.361461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:38.361506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:38.361566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:38.361612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.361661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.361705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.361770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.361819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:38.361893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:38.361950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:38.362004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:38.362051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:38.362107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:38.362151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:38.362208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:38.362256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:38.362307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:38.362352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:38.362401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:38.362446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:38.362496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:38.362540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:38.362585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:38.362629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.362678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.362720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.362770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.362813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.362862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.362903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.362956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.363368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:38.401261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594782541526060:9722]
2025-10-10T14:08:38.404125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594782541526027:5564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:38.404167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594782541526027:5564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:38.404187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594782541526027:5564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:38.404219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:38.441341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:38.456246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:38.456297Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:38.456315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:38.456335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:38.456360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 771 [2:7559594780963603301:9247]
2025-10-10T14:08:38.456411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:38.456484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:38.456501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:38.456512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:38.456522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:38.456574Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:38.456597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:38.456621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:38.458900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.458918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.458931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.458944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.458954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:38.462156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 771, pipe: [1:7559594782541526060:9722]
2025-10-10T14:08:38.462265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 771
2025-10-10T14:08:38.462336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 771
2025-10-10T14:08:38.464028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:38.464066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.464221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.464404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.464624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.464735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:38.464780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594782541526060:9722], now have 1 active actors on pipe
2025-10-10T14:08:38.464803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594782541526065:5564], now have 1 active actors on pipe
2025-10-10T14:08:38.464836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594782541525981:2442], now have 1 active actors on pipe
2025-10-10T14:08:38.464896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:38.464921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:38.465021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.465038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.465050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.465063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.465107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:38.465241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:38.465276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:38.465294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:38.465306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:38.465349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:38.465396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:38.465450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:38.465635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:38.465652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:38.465793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:38.465844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.465865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:38.466624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:38.466645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:38.466659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:38.466671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:38.466696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:38.471835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:38.471885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:38.471972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:38.473490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 772 partition: 0 MaxSeqNo: 36 sessionId: src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0
2025-10-10T14:08:38.474266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fae50aff-434b6274-823185ad-fd40317d_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:38.556963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0] Write session: try to update token
2025-10-10T14:08:38.557025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:38.673972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:38.674005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:38.674015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:38.674071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:38.674084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:38.674096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:38.674104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:38.674114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:38.674150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.674173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.674196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.674215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.674419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:38.674444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.674454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:38.675562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:38.677656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:38.677695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:38.677720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:38.677746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:38.726147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId: src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:38.758521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:38.850348Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:38.880594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:38.880736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:38.880807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:38.880821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:38.880859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594780963603296:9247]
2025-10-10T14:08:38.881116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:38.881715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:38.881501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594782541526060:9722]
2025-10-10T14:08:38.881615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:38.881625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:38.882314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:38.942121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 772 reason: error at write: Disconnected sessionId: src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0
2025-10-10T14:08:38.942443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 772 sessionId: src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0 is DEAD
2025-10-10T14:08:38.945726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:38.945754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0] Write session will restart in 0.006132s
2025-10-10T14:08:38.945849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0] Write session: Do CDS request
2025-10-10T14:08:38.945878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:38.959303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:38.967563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:38.967613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 773
2025-10-10T14:08:38.968358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:38.968554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:38.968578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:38.968598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:38.971392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 773 sessionId:  describe result for acl check
2025-10-10T14:08:38.971506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:38.971516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:38.971526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:38.971542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594782541526169:5559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:38.974272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594782541526169:5559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:38.980696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:38.983166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594782541526180:9722]
2025-10-10T14:08:38.981189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:38.981947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:38.981965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:38.982008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:38.982748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:38.982938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594780963603421:9253]
2025-10-10T14:08:38.985078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:38.985981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:38.986193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:38.987370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:38.987650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:38.987657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:38.987663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:38.987671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:38.987678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:38.987685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:38.987691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:38.987698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:38.987705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.987711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.987718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.987724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.987768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:38.987871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:38.987914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:38.987954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:38.987992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:38.988035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:38.988074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:38.988114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:38.988156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.988198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.988240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.988281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.988321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:38.988384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:38.988435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:38.988487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:38.988537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:38.988584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:38.988625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:38.988674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:38.988718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:38.988767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:38.988807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:38.988858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:38.988904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:38.988955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:38.988998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:38.989047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:38.990218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.990297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:38.990344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.990395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:38.990440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.990486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:38.990527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.990575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:38.990998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:38.992201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594782541526169:5559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:39.005450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594782541526169:5559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:39.005489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594782541526169:5559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:39.005507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594782541526169:5559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:39.005557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:39.025469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:39.052301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:39.052339Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:39.052349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:39.052362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:39.052379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 772 [2:7559594780963603421:9253]
2025-10-10T14:08:39.052426Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:39.052477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:39.052487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:39.052496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:39.052507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:39.052545Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:39.052561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:39.052577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:39.053858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:39.053882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:39.053894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:39.053905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:39.053915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:39.054187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:39.054204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:39.054334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:39.054490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:39.054704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:39.054813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:39.054895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.054908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.054922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.054934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.054975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:39.055056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:39.055218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:39.055235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:39.055363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.055381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:39.057290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:39.057316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:39.057327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:39.057336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:39.057361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:39.057763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594782541526109:2442], now have 1 active actors on pipe
2025-10-10T14:08:39.057826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594786836493498:5559], now have 1 active actors on pipe
2025-10-10T14:08:39.057862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594782541526180:9722], now have 1 active actors on pipe
2025-10-10T14:08:39.058351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 772
2025-10-10T14:08:39.058458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 772
2025-10-10T14:08:39.058515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 772, pipe: [1:7559594782541526180:9722]
2025-10-10T14:08:39.058844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:39.058875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:39.058950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66cd647e-84f46a32-44865f8b-f9e44726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:39.058982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:39.059000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:39.059009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:39.059061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:39.059108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:39.059161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:39.066830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:39.066889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:39.066975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:39.069705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 773 partition: 0 MaxSeqNo: 36 sessionId: src_id|66cd647e-84f46a32-44865f8b-f9e44726_0
2025-10-10T14:08:39.070903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4eb9eb-4682b341-91f4055a-8ddd0984_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|66cd647e-84f46a32-44865f8b-f9e44726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:39.152654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:39.152694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:39.152708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:39.165730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66cd647e-84f46a32-44865f8b-f9e44726_0] Write session: try to update token
2025-10-10T14:08:39.165791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66cd647e-84f46a32-44865f8b-f9e44726_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:39.379644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:39.379680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:39.379691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:39.379803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:39.379817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:39.379829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:39.379839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:39.379848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:39.379880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.379906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.379927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.379946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.381232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:39.381260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:39.381286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:39.381310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:39.431803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:39.431851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:39.431862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:39.433452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:39.473245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId: src_id|66cd647e-84f46a32-44865f8b-f9e44726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:39.520602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:39.669403Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:39.678909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:39.678946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:39.678985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594780963603416:9253]
2025-10-10T14:08:39.679090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:39.679137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:39.679162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:39.680044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:39.680901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:39.681157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:39.681169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:39.681607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594782541526180:9722]
2025-10-10T14:08:39.749058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 773 reason: error at write: Disconnected sessionId: src_id|66cd647e-84f46a32-44865f8b-f9e44726_0
2025-10-10T14:08:39.749428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 773 sessionId: src_id|66cd647e-84f46a32-44865f8b-f9e44726_0 is DEAD
2025-10-10T14:08:39.764883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cd647e-84f46a32-44865f8b-f9e44726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:39.764927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cd647e-84f46a32-44865f8b-f9e44726_0] Write session will restart in 0.009171s
2025-10-10T14:08:39.765033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cd647e-84f46a32-44865f8b-f9e44726_0] Write session: Do CDS request
2025-10-10T14:08:39.765063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cd647e-84f46a32-44865f8b-f9e44726_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:39.778569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66cd647e-84f46a32-44865f8b-f9e44726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:39.782599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594786836493593:9722]
2025-10-10T14:08:39.785423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:39.785456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 774
2025-10-10T14:08:39.785913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:39.786029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:39.786046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:39.786058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:39.790626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:39.787461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 774 sessionId:  describe result for acl check
2025-10-10T14:08:39.787570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:39.787581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:39.787590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:39.787607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594786836493596:5542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:39.790180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594786836493596:5542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:39.800515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:39.801375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:39.801394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:39.801441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:39.801728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:39.801912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594785258570865:9263]
2025-10-10T14:08:39.803831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:39.807575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:39.807814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:39.809011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:39.809491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:39.809506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:39.809524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:39.809558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:39.809576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:39.809593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:39.809607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:39.809622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:39.809636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:39.809655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:39.809669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:39.809683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:39.809757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:39.809868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:39.809917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:39.809965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:39.810008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:39.810055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:39.810111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:39.810158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:39.810201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:39.810245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:39.810289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:39.810333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:39.810378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:39.810443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:39.810502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:39.810556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:39.810614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:39.810671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:39.810720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:39.810770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:39.810817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:39.810869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:39.810913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:39.810962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:39.811008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:39.811059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:39.811104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:39.812159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594786836493596:5542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:39.811160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:39.811208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:39.811258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:39.811300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:39.811352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:39.811398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:39.811451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:39.811495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:39.811549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:39.811976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:39.863368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594786836493596:5542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:39.863417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594786836493596:5542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:39.863437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594786836493596:5542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:39.863467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:39.884322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:39.913178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:39.913247Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:39.913262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:39.913289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:39.913310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 773 [2:7559594785258570865:9263]
2025-10-10T14:08:39.913368Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:39.913428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:39.913441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:39.913452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:39.913463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:39.913508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:39.913542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:39.913562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:39.916163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:39.916180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:39.916193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:39.916205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:39.916216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:39.916479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:39.916495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:39.916623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:39.916777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:39.916980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:39.917083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:39.917171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:39.917186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:39.917197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:39.917210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:39.917251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:39.917332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:39.917516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:39.917542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:39.917671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:39.917689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:39.918003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:39.918016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:39.918026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:39.918038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:39.918060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:39.919236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594786836493626:5542], now have 1 active actors on pipe
2025-10-10T14:08:39.919263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594786836493593:9722], now have 1 active actors on pipe
2025-10-10T14:08:39.919283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594786836493528:2442], now have 1 active actors on pipe
2025-10-10T14:08:39.925072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:39.923263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 773
2025-10-10T14:08:39.925122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:39.923342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 773, pipe: [1:7559594786836493593:9722]
2025-10-10T14:08:39.923407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 773
2025-10-10T14:08:39.926493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 774 partition: 0 MaxSeqNo: 36 sessionId: src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0
2025-10-10T14:08:39.929331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66cd647e-84f46a32-44865f8b-f9e44726_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:39.925247Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:39.925291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:39.925318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:39.925329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:39.925385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:39.925431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:39.925498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:39.926095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:39.926115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:39.926175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:39.980317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0] Write session: try to update token
2025-10-10T14:08:39.980374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:40.071513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:40.071571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:40.071593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:40.071693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:40.071722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:40.071754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:40.071776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:40.071797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:40.071863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:40.071915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:40.071964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:40.072013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:40.072342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:40.072392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:40.072415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:40.073333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:40.073389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:40.073437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:40.073480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:40.076305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:40.171780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId: src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:40.192157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:40.240188Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:40.283012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:40.283057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:40.283111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:40.283122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:40.283157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594785258570860:9263]
2025-10-10T14:08:40.285288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:40.285314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:40.283591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:40.285249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:40.338404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594786836493593:9722]
2025-10-10T14:08:40.338477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:40.338617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 774 reason: error at write: Disconnected sessionId: src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0
2025-10-10T14:08:40.338936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 774 sessionId: src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0 is DEAD
2025-10-10T14:08:40.345320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:40.345360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0] Write session will restart in 0.006444s
2025-10-10T14:08:40.345455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0] Write session: Do CDS request
2025-10-10T14:08:40.345482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:40.366879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:40.371257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:40.371289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 775
2025-10-10T14:08:40.378396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:40.378543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:40.378558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:40.378570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:40.380005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 775 sessionId:  describe result for acl check
2025-10-10T14:08:40.380125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:40.380135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:40.380143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:40.380160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594791131461014:5520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:40.382741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594791131461014:5520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:40.390616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:40.400980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:40.401853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:40.401871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:40.401914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:40.402177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:40.402342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594789553538262:9270]
2025-10-10T14:08:40.404399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:40.403934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594791131461014:5520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:40.409441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:40.409722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:40.410973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:40.411281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:40.411298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:40.411305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:40.411313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:40.411320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:40.411326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:40.411332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:40.411339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:40.411346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:40.411353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:40.411359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:40.411372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:40.411419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:40.411524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:40.411570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:40.411622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:40.411669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:40.411717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:40.411760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:40.411800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:40.411844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:40.411889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:40.411932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:40.411975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:40.412023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:40.412085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:40.412139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:40.412196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:40.412243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:40.412289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:40.412333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:40.412380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:40.412423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:40.412475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:40.412518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:40.412570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:40.412619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:40.412670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:40.412714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:40.412766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:40.412812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:40.412863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:40.412903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:40.412954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:40.413001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:40.413051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:40.413094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:40.417544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:40.418055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:40.421813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594791131461014:5520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:40.421856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594791131461014:5520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:40.421873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594791131461014:5520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:40.421907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:40.437959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594791131461053:9722]
2025-10-10T14:08:40.467066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:40.492273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:40.492325Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:40.492342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:40.492362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:40.492385Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 774 [2:7559594789553538262:9270]
2025-10-10T14:08:40.492443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:40.492507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:40.492523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:40.492545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:40.492557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:40.492608Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:40.492636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:40.492662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:40.496188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:40.496213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:40.496222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:40.496229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:40.496236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:40.496427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:40.496438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:40.496562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:40.496720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:40.496910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:40.497017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:40.497085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.497098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.497108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.497121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.497179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:40.497253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:40.497406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:40.497422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:40.497538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.497550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:40.497746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:40.497755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:40.497762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:40.497768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:40.497781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:40.498720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594791131461053:9722], now have 1 active actors on pipe
2025-10-10T14:08:40.498747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594791131461051:5520], now have 1 active actors on pipe
2025-10-10T14:08:40.498761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594791131460990:2442], now have 1 active actors on pipe
2025-10-10T14:08:40.504276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 774, pipe: [1:7559594791131461053:9722]
2025-10-10T14:08:40.504378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 774
2025-10-10T14:08:40.504449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 774
2025-10-10T14:08:40.505541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:40.505588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:40.505687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:40.505723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:40.505741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:40.505751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:40.505790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:40.505835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:40.505884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:40.506513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:40.506533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:40.506576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:40.506927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 775 partition: 0 MaxSeqNo: 36 sessionId: src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0
2025-10-10T14:08:40.508327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa5fbe39-5f77b2b4-6480e456-5828284c_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:40.558861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0] Write session: try to update token
2025-10-10T14:08:40.558925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:40.562828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:40.562864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:40.562904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.563042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:40.563207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:40.564849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:40.575332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:40.576675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:40.669479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:40.673648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:40.674328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:40.674341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:40.674352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:40.674483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:40.714606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:40.714647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:40.714661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:40.714671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:40.714682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:40.714725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.714750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.714773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.714795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594789553538255:9270]
2025-10-10T14:08:40.714941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:40.714970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:40.714981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:40.716016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:40.717381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:40.717427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:40.717453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:40.717479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:40.842722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId: src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:40.881013Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:40.887206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:40.912819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594791131461053:9722]
2025-10-10T14:08:40.912931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:40.912943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:40.915006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:40.923021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 775 reason: error at write: Disconnected sessionId: src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0
2025-10-10T14:08:40.923378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 775 sessionId: src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0 is DEAD
2025-10-10T14:08:40.925701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:40.925732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0] Write session will restart in 0.008605s
2025-10-10T14:08:40.925823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0] Write session: Do CDS request
2025-10-10T14:08:40.925854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:40.940914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:40.941471Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:40.941496Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 776
2025-10-10T14:08:40.941881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:40.941962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:40.941972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:40.941979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:40.943069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 776 sessionId:  describe result for acl check
2025-10-10T14:08:40.943157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:40.943163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:40.943168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:40.943181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594791131461104:5516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:40.945139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594791131461104:5516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:40.958798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594791131461104:5516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:40.972100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594791131461104:5516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:40.972151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594791131461104:5516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:40.972165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594791131461104:5516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:40.972203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:41.016425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:41.017984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594795426428485:9722]
2025-10-10T14:08:41.037249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:41.037959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:41.037977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:41.038021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:41.038266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:41.038444Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594793848505694:9282]
2025-10-10T14:08:41.042396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:41.043905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:41.044154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:41.045441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:41.045787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:41.045795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:41.045801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:41.045809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:41.045816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:41.045824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:41.045830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:41.045836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:41.045845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.045852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.045858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.045865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.045910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:41.046012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:41.046060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:41.046105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:41.046147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:41.046190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:41.046233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:41.046273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:41.046315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.046357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.046399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.046439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.046477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:41.046549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:41.046607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:41.046657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:41.046702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:41.046752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:41.046791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:41.046842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:41.046887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:41.046938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:41.046981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:41.047062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:41.047113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:41.047163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:41.047203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:41.047252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:41.047294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.047340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.047382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.047428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.047470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.047518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.047558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.047605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.047985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:41.105995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:41.121256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:41.121314Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:41.121329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:41.121347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:41.121369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 775 [2:7559594793848505694:9282]
2025-10-10T14:08:41.121423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:41.122247Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:41.122272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:41.122284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:41.122296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:41.122351Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:41.122373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:41.122395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:41.124687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.124721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.124734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.124747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.124759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:41.125028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:41.125054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.125198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.125358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.125569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.125672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:41.125758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594791131461136:5516], now have 1 active actors on pipe
2025-10-10T14:08:41.125781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594795426428485:9722], now have 1 active actors on pipe
2025-10-10T14:08:41.125801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594791131461094:2442], now have 1 active actors on pipe
2025-10-10T14:08:41.125825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594793848505688:9282]
2025-10-10T14:08:41.125840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594793848505688:9282]
2025-10-10T14:08:41.125852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594793848505688:9282]
2025-10-10T14:08:41.125863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594793848505688:9282]
2025-10-10T14:08:41.125907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:41.126002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:41.126165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 775
2025-10-10T14:08:41.126238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 775, pipe: [1:7559594795426428485:9722]
2025-10-10T14:08:41.126308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 775
2025-10-10T14:08:41.126171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:41.126199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:41.126327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594793848505688:9282]
2025-10-10T14:08:41.126349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:41.126523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:41.126534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:41.126546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:41.126557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:41.126578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:41.128729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:41.128770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:41.128866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97b58b3c-e430c421-94b529d2-9853859e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:41.128901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:41.128918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:41.128928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:41.128967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:41.129014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:41.129063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:41.130040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:41.130070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:41.130133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:41.130441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 776 partition: 0 MaxSeqNo: 36 sessionId: src_id|97b58b3c-e430c421-94b529d2-9853859e_0
2025-10-10T14:08:41.131183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4465094-1ab46c30-d091d5e2-576d2d0e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|97b58b3c-e430c421-94b529d2-9853859e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:41.178919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97b58b3c-e430c421-94b529d2-9853859e_0] Write session: try to update token
2025-10-10T14:08:41.178978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97b58b3c-e430c421-94b529d2-9853859e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:41.246063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:41.246111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:41.246133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:41.246210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:41.246232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:41.246252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:41.246272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:41.246289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:41.246343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594793848505688:9282]
2025-10-10T14:08:41.246386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594793848505688:9282]
2025-10-10T14:08:41.246425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594793848505688:9282]
2025-10-10T14:08:41.246460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594793848505688:9282]
2025-10-10T14:08:41.246655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:41.246693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.246721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:41.246914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:41.246938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:41.246961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:41.246984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:41.249206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:41.320198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId: src_id|97b58b3c-e430c421-94b529d2-9853859e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:41.374038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:41.440242Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:41.454423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:41.454468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:41.458702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:41.458728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:41.461411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594795426428485:9722]
2025-10-10T14:08:41.461567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:41.462126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:41.469814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 776 reason: error at write: Disconnected sessionId: src_id|97b58b3c-e430c421-94b529d2-9853859e_0
2025-10-10T14:08:41.470148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 776 sessionId: src_id|97b58b3c-e430c421-94b529d2-9853859e_0 is DEAD
2025-10-10T14:08:41.476870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b58b3c-e430c421-94b529d2-9853859e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:41.476916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b58b3c-e430c421-94b529d2-9853859e_0] Write session will restart in 0.007910s
2025-10-10T14:08:41.477015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b58b3c-e430c421-94b529d2-9853859e_0] Write session: Do CDS request
2025-10-10T14:08:41.477043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b58b3c-e430c421-94b529d2-9853859e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:41.493992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:41.494026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 777
2025-10-10T14:08:41.497830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97b58b3c-e430c421-94b529d2-9853859e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:41.499988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:41.500157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:41.500175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:41.500186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:41.533021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 777 sessionId:  describe result for acl check
2025-10-10T14:08:41.533176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:41.533188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:41.533197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:41.533216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594795426428527:5500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:41.535806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594795426428527:5500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:41.545662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594795426428527:5500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:41.563875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594795426428569:9722]
2025-10-10T14:08:41.577961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594795426428527:5500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:41.578007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594795426428527:5500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:41.578023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594795426428527:5500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:41.578054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:41.616779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:41.617175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:41.618171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:41.618193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:41.618245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:41.618418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:41.618535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594793848505815:9289]
2025-10-10T14:08:41.620077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:41.620883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:41.621015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:41.621867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:41.622067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:41.622071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:41.622075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:41.622079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:41.622083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:41.622087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:41.622091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:41.622096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:41.622100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.622104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.622108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.622113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.622142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:41.622217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:41.622249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:41.622278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:41.622316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:41.622351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:41.622380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:41.622409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:41.622438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.622468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.622496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.622523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.622545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:41.622589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:41.622626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:41.622660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:41.622691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:41.622723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:41.622750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:41.622794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:41.622828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:41.622862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:41.622889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:41.622924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:41.622953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:41.622986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:41.623015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:41.623046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:41.623075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.623109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.623135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.623167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.623194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.623227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.623254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.623286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.623561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:41.666908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:41.687949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:41.687997Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:41.688012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:41.688030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:41.688052Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 776 [2:7559594793848505815:9289]
2025-10-10T14:08:41.688104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:41.688161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:41.688175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:41.688187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:41.688197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:41.688243Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:41.688265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:41.688286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:41.693820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.693867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.693880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.693892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.693904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:41.694185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:41.694213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.694343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:41.694530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:41.694746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:41.694851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:41.694924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:41.694941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:41.694953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:41.694964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:41.695006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:41.695088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:41.695222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:41.695237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:41.695249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:41.695258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:41.695262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:41.695276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:41.695421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:41.695443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:41.695522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:41.695821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594795426428604:5500], now have 1 active actors on pipe
2025-10-10T14:08:41.695844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594795426428569:9722], now have 1 active actors on pipe
2025-10-10T14:08:41.695862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594795426428511:2442], now have 1 active actors on pipe
2025-10-10T14:08:41.696381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 776
2025-10-10T14:08:41.696453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 776, pipe: [1:7559594795426428569:9722]
2025-10-10T14:08:41.696516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 776
2025-10-10T14:08:41.697176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:41.697208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:41.697287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:41.697310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:41.697322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:41.697329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:41.697354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:41.697387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:41.697418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:41.701861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:41.701899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:41.701966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:41.702466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 777 partition: 0 MaxSeqNo: 36 sessionId: src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0
2025-10-10T14:08:41.705752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97b58b3c-e430c421-94b529d2-9853859e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:41.746360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0] Write session: try to update token
2025-10-10T14:08:41.746417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:41.899405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:41.899443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:41.899454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:41.899507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:41.899522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:41.899537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:41.899549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:41.899560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:41.899595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:41.899623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:41.899650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:41.899675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:41.899892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:41.899933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:41.899945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:41.901007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:41.901298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:41.901347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:41.901376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:41.901403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:41.942983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId: src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:41.985360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:42.057017Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:42.087917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:42.087963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:42.088030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:42.088045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:42.088089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594793848505810:9289]
2025-10-10T14:08:42.088265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:42.089640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:42.089699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:42.089710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:42.089788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594795426428569:9722]
2025-10-10T14:08:42.088973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:42.097138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 777 reason: error at write: Disconnected sessionId: src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0
2025-10-10T14:08:42.097937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 777 sessionId: src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0 is DEAD
2025-10-10T14:08:42.101270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:42.101344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0] Write session will restart in 0.007141s
2025-10-10T14:08:42.101529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0] Write session: Do CDS request
2025-10-10T14:08:42.101573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:42.118525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:42.118940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:42.118972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 778
2025-10-10T14:08:42.127196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:42.127564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:42.127605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:42.127633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:42.132362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 778 sessionId:  describe result for acl check
2025-10-10T14:08:42.132496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:42.132508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:42.132519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:42.132537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594799721395977:5462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:42.135969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594799721395977:5462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:42.148985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594799721395977:5462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:42.157043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594799721395977:5462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:42.157076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594799721395977:5462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:42.157089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594799721395977:5462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:42.157110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:42.193650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594799721396058:9722]
2025-10-10T14:08:42.214124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:42.220150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:42.221094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:42.221114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:42.221179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:42.221467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:42.221677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594798143473236:9295]
2025-10-10T14:08:42.229411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:42.234655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:42.234942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:42.236561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:42.236931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:42.236940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:42.236947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:42.236955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:42.236961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:42.236968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:42.236977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:42.236985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:42.236993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.237000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.237008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.237017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.237069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:42.237219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:42.237283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:42.237353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:42.237407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:42.237463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:42.237535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:42.237593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:42.237649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.237706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.237765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.237815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.237864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:42.237941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:42.238011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:42.238076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:42.238134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:42.238199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:42.238249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:42.238309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:42.238368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:42.238430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:42.238486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:42.238546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:42.238605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:42.238669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:42.238725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:42.238787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:42.238842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.238903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.238955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.239021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.239077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.239135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.239274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.239339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.239855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:42.271070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:42.290544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:42.290596Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:42.290614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:42.290634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:42.290660Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 777 [2:7559594798143473236:9295]
2025-10-10T14:08:42.290719Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:42.290787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:42.290801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:42.290814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:42.290828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:42.290877Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:42.290901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:42.290923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:42.292284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.292301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.292318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.292335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.292347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:42.292622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:42.292643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.292801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.293005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.293276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.293405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:42.293483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594798143473231:9295]
2025-10-10T14:08:42.293515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594798143473231:9295]
2025-10-10T14:08:42.293530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594798143473231:9295]
2025-10-10T14:08:42.293543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594798143473231:9295]
2025-10-10T14:08:42.293680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:42.293692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:42.293705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:42.293717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:42.294877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 777, pipe: [1:7559594799721396058:9722]
2025-10-10T14:08:42.294995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 777
2025-10-10T14:08:42.295067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 777
2025-10-10T14:08:42.295462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:42.295648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:42.295868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:42.295887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:42.295937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594799721396006:5462], now have 1 active actors on pipe
2025-10-10T14:08:42.295963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594799721395963:2442], now have 1 active actors on pipe
2025-10-10T14:08:42.295986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594799721396058:9722], now have 1 active actors on pipe
2025-10-10T14:08:42.296035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:42.296057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:42.296209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594798143473231:9295]
2025-10-10T14:08:42.296249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:42.296323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:42.296354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:42.296372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:42.296384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:42.296418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:42.296459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:42.296607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:42.297069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:42.303087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:42.303136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:42.303219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:42.304724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc2386da-d6e7d7a2-4aa593e8-81da70cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:42.303829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 778 partition: 0 MaxSeqNo: 36 sessionId: src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0
2025-10-10T14:08:42.366666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0] Write session: try to update token
2025-10-10T14:08:42.366726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:42.392031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:42.392069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:42.392079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:42.522612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:42.522658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:42.522671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:42.522729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:42.522744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:42.522758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:42.522771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:42.522782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:42.522822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594798143473231:9295]
2025-10-10T14:08:42.522852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594798143473231:9295]
2025-10-10T14:08:42.522878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594798143473231:9295]
2025-10-10T14:08:42.522902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594798143473231:9295]
2025-10-10T14:08:42.523055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:42.523086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.523099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:42.524285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:42.527929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:42.527985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:42.528019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:42.528053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:42.562752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId: src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:42.585245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:42.700092Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:42.714178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:42.714231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:42.715586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:42.715830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594799721396058:9722]
2025-10-10T14:08:42.713059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:42.713106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:42.717850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:42.776625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 778 reason: error at write: Disconnected sessionId: src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0
2025-10-10T14:08:42.776940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 778 sessionId: src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0 is DEAD
2025-10-10T14:08:42.778383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:42.778425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0] Write session will restart in 0.006573s
2025-10-10T14:08:42.778526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0] Write session: Do CDS request
2025-10-10T14:08:42.778559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:42.798678Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:42.798713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 779
2025-10-10T14:08:42.802030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:42.802888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:42.803042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:42.803059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:42.803069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:42.805765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 779 sessionId:  describe result for acl check
2025-10-10T14:08:42.805851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:42.805858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:42.805865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:42.805876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594799721396117:5467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:42.807824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594799721396117:5467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:42.814575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594799721396117:5467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:42.815884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594799721396165:9722]
2025-10-10T14:08:42.831920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594799721396117:5467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:42.831959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594799721396117:5467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:42.831976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594799721396117:5467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:42.832005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:42.853710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:42.856426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:42.857276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:42.857308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:42.857349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:42.857622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:42.857828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594798143473368:9304]
2025-10-10T14:08:42.859982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:42.861088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:42.861311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:42.862534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:42.862826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:42.862834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:42.862842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:42.862849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:42.862855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:42.862862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:42.862870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:42.862877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:42.862883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.862890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.862898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.862905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.862951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:42.863058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:42.863107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:42.863168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:42.863215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:42.863262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:42.863308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:42.863354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:42.863402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.863450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.863496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.863541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.863584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:42.863647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:42.863705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:42.863757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:42.863805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:42.863860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:42.863902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:42.863955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:42.864003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:42.864054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:42.864098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:42.864148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:42.864195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:42.864248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:42.864294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:42.864346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:42.864395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.864449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.864493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.864546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.864590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.864642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.864689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.864739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.867078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:42.900043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:42.935921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:42.935970Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:42.935983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:42.936001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:42.936024Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 778 [2:7559594798143473368:9304]
2025-10-10T14:08:42.936073Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:42.936129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:42.936145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:42.936155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:42.936167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:42.936215Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:42.936237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:42.936256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:42.940076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 778, pipe: [1:7559594799721396165:9722]
2025-10-10T14:08:42.940183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 778
2025-10-10T14:08:42.940266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 778
2025-10-10T14:08:42.938642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.938668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.938680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.938693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.938705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:42.938970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:42.938985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:42.939112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:42.939275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:42.939474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:42.939575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:42.939651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594799721396165:9722], now have 1 active actors on pipe
2025-10-10T14:08:42.939673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594799721396091:2442], now have 1 active actors on pipe
2025-10-10T14:08:42.939693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594799721396187:5467], now have 1 active actors on pipe
2025-10-10T14:08:42.939717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:42.939730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:42.939741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:42.939752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:42.939797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:42.939869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:42.940029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:42.940045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:42.940165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:42.940185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:42.940323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:42.940342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:42.940355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:42.940366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:42.940395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:42.940998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:42.941023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:42.941101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:42.941155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:42.941174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:42.941185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:42.941231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:42.941272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:42.941320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:42.942223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:42.942270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:42.942336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:42.945637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21598e94-b977c2b4-fbc7cf9d-a51d16ad_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:42.942647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 779 partition: 0 MaxSeqNo: 36 sessionId: src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0
2025-10-10T14:08:43.019311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0] Write session: try to update token
2025-10-10T14:08:43.019365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:43.041962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:43.041997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:43.042007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:43.042060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:43.042072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:43.042106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:43.042210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:43.042293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:43.044294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:43.045765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:43.061873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:43.063226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:43.064741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:43.065249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:43.153290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId: src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:43.165377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:43.165419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:43.165434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:43.165445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:43.165458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:43.165513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:43.165544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:43.165571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:43.165597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594798143473363:9304]
2025-10-10T14:08:43.165772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:43.165797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:43.165809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:43.165856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:43.165882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:43.165894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:43.166944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:43.168206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:43.168242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:43.168272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:43.168309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:43.193815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:43.341152Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:43.343905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:43.343959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:43.344767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:43.346616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594799721396165:9722]
2025-10-10T14:08:43.346738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:43.346932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:43.361913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 779 reason: status is not ok: tablet will be restarted right now sessionId: src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0
2025-10-10T14:08:43.362260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 779 sessionId: src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0 is DEAD
2025-10-10T14:08:43.365343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:43.365382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0] Write session will restart in 0.005644s
2025-10-10T14:08:43.365491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0] Write session: Do CDS request
2025-10-10T14:08:43.365518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:43.398427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:43.403850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:43.403883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 780
2025-10-10T14:08:43.404339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:43.404463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:43.404477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:43.404487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:43.405831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 780 sessionId:  describe result for acl check
2025-10-10T14:08:43.405942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:43.405953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:43.405962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:43.405977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594804016363534:5453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:43.409096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594804016363534:5453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:43.437807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594804016363534:5453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:43.448900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594804016363613:9722]
2025-10-10T14:08:43.459286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594804016363534:5453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:43.459328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594804016363534:5453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:43.459346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594804016363534:5453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:43.459374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:43.479081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:43.485383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:43.486317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:43.486337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:43.486385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:43.486663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:43.486857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594802438440788:9312]
2025-10-10T14:08:43.491792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:43.497812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:43.498100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:43.499402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:43.499729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:43.499738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:43.499744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:43.499751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:43.499757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:43.499763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:43.499770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:43.499777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:43.499784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:43.499790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:43.499796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:43.499803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:43.499847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:43.499946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:43.499990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:43.500033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:43.500074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:43.500117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:43.500159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:43.500202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:43.500243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:43.500283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:43.500324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:43.500363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:43.500403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:43.500465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:43.500520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:43.500572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:43.500616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:43.500665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:43.500712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:43.500762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:43.500805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:43.500852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:43.500893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:43.500938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:43.500982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:43.501032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:43.501076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:43.502087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:43.502169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:43.502230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:43.502272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:43.502319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:43.502362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:43.502414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:43.502457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:43.502511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:43.502958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:43.554358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:43.590366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:43.590416Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:43.590435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:43.590456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:43.590479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 779 [2:7559594802438440788:9312]
2025-10-10T14:08:43.590535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:43.590606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:43.590622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:43.590633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:43.590644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:43.590691Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:43.590720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:43.590751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:43.594229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:43.594258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:43.594271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:43.594284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:43.594294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:43.594611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:43.594628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:43.594771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:43.594942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:43.595156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:43.595263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:43.595343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:43.595361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:43.595373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:43.595385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:43.595420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:43.595507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:43.595702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:43.595717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:43.595850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:43.595869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:43.600290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 779
2025-10-10T14:08:43.600406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 779, pipe: [1:7559594804016363613:9722]
2025-10-10T14:08:43.600481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 779
2025-10-10T14:08:43.597422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:43.597458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:43.597489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:43.597503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:43.597535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:43.600684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594804016363521:2442], now have 1 active actors on pipe
2025-10-10T14:08:43.600717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594804016363613:9722], now have 1 active actors on pipe
2025-10-10T14:08:43.600741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594804016363619:5453], now have 1 active actors on pipe
2025-10-10T14:08:43.600996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:43.601022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:43.601117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:43.601172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:43.601190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:43.601201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:43.601241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:43.601283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:43.601334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:43.603542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:43.603587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:43.603662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:43.604227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 780 partition: 0 MaxSeqNo: 36 sessionId: src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0
2025-10-10T14:08:43.606181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|744f84b8-b3083007-c4b4d8f2-a9a64ebd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:43.690315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:43.690356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:43.690371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:43.718741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0] Write session: try to update token
2025-10-10T14:08:43.718804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:43.826188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:43.826225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:43.826239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:43.826249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:43.826261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:43.826298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:43.826324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:43.826346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:43.826370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:43.826542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:43.826556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:43.826568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:43.829337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:43.829370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:43.829400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:43.829431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:43.862167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:43.862208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:43.862215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:43.863200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:43.913338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId: src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:43.937314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:44.058856Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:44.060781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:44.060794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:44.060824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594802438440783:9312]
2025-10-10T14:08:44.060946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:44.060946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:44.060962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:44.066190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:44.066306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594804016363613:9722]
2025-10-10T14:08:44.066361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:44.066369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:44.067249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:44.077323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:44.077363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0] Write session will restart in 0.009586s
2025-10-10T14:08:44.077453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0] Write session: Do CDS request
2025-10-10T14:08:44.077489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:44.075517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 780 reason: error at write: Disconnected sessionId: src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0
2025-10-10T14:08:44.075846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 780 sessionId: src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0 is DEAD
2025-10-10T14:08:44.106677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:44.107057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:44.107089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 781
2025-10-10T14:08:44.107497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:44.107601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:44.107616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:44.107624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:44.109010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 781 sessionId:  describe result for acl check
2025-10-10T14:08:44.109115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:44.109140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:44.109149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:44.109166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594808311330982:5445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:44.111770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594808311330982:5445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:44.137409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594808311330982:5445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:44.155235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594808311330982:5445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:44.155281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594808311330982:5445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:44.155296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594808311330982:5445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:44.155324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:44.165576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:44.169483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594808311331069:9722]
2025-10-10T14:08:44.174190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:44.174973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:44.175003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:44.175043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:44.175280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:44.175457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594806733408226:9320]
2025-10-10T14:08:44.177534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:44.180311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:44.180526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:44.181705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:44.182007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:44.182014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:44.182020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:44.182027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:44.182034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:44.182039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:44.182045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:44.182053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:44.182061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.182068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.182074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.182080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.182124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:44.182223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:44.182268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:44.182312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:44.182352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:44.182394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:44.182435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:44.182477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:44.182517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.182561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.182600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.182639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.182676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:44.182733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:44.182784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:44.182832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:44.182876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:44.182920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:44.182959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:44.183001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:44.183039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:44.183089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:44.183129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:44.183174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:44.183216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:44.183269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:44.183311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:44.183357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:44.183398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.183448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.183491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.183537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.183579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.183628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.183674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.183744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.184145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:44.245282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:44.264955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:44.265006Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:44.265021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:44.265041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:44.265062Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 780 [2:7559594806733408226:9320]
2025-10-10T14:08:44.265113Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:44.269329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:44.269365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:44.269377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:44.269388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:44.269441Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:44.269475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:44.269496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:44.271616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.271633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.271645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.271658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.271668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:44.271940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:44.271955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.272082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.272254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.272471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.272578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:44.272651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.272666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.272678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.272689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.272956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:44.272968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:44.272977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:44.272987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:44.274557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 780
2025-10-10T14:08:44.274599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 780
2025-10-10T14:08:44.274648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 780, pipe: [1:7559594808311331069:9722]
2025-10-10T14:08:44.277494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:44.277640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:44.277819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:44.277835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:44.277905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594808311330968:2442], now have 1 active actors on pipe
2025-10-10T14:08:44.277935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594808311331064:5445], now have 1 active actors on pipe
2025-10-10T14:08:44.277956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594808311331069:9722], now have 1 active actors on pipe
2025-10-10T14:08:44.278025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:44.278044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:44.278221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.278257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:44.278331Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2621899-96ca6859-acfcfd3b-905474cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:44.278364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:44.278381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:44.278391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:44.278428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:44.278470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:44.278596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:44.279256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:44.281658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:44.281690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:44.281753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:44.282101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 781 partition: 0 MaxSeqNo: 36 sessionId: src_id|e2621899-96ca6859-acfcfd3b-905474cd_0
2025-10-10T14:08:44.285346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1444354d-fb7e86fb-58a28aa9-4e468e02_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e2621899-96ca6859-acfcfd3b-905474cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:44.327598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2621899-96ca6859-acfcfd3b-905474cd_0] Write session: try to update token
2025-10-10T14:08:44.327657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2621899-96ca6859-acfcfd3b-905474cd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:44.442474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:44.442524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:44.442576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.442752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:44.442774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:44.442796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:44.442885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:44.443470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:44.450280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:44.451553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:44.453765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:44.454798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:44.456128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:44.456443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:44.493328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:44.493366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:44.493378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:44.493390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:44.493400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:44.493441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.493484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.493505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.493528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594806733408219:9320]
2025-10-10T14:08:44.493681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:44.493709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.493721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:44.494722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:44.494749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:44.494766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:44.494784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:44.495399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:44.517214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId: src_id|e2621899-96ca6859-acfcfd3b-905474cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:44.538559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:44.652926Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:44.657740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:44.657790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:44.659866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:44.660014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:44.660029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:44.664106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 781 reason: error at write: Disconnected sessionId: src_id|e2621899-96ca6859-acfcfd3b-905474cd_0
2025-10-10T14:08:44.665327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2621899-96ca6859-acfcfd3b-905474cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:44.664872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594808311331069:9722]
2025-10-10T14:08:44.665363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2621899-96ca6859-acfcfd3b-905474cd_0] Write session will restart in 0.007597s
2025-10-10T14:08:44.665476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2621899-96ca6859-acfcfd3b-905474cd_0] Write session: Do CDS request
2025-10-10T14:08:44.665507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2621899-96ca6859-acfcfd3b-905474cd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:44.665606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:44.672046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 781 sessionId: src_id|e2621899-96ca6859-acfcfd3b-905474cd_0 is DEAD
2025-10-10T14:08:44.680711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2621899-96ca6859-acfcfd3b-905474cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:44.684521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:44.684554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 782
2025-10-10T14:08:44.684983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:44.685094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:44.685110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:44.685121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:44.691589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 782 sessionId:  describe result for acl check
2025-10-10T14:08:44.691787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:44.691806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:44.691822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:44.691855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594808311331099:5428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:44.699502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594808311331099:5428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:44.712770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594808311331099:5428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:44.732038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594808311331099:5428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:44.732123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594808311331099:5428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:44.732153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594808311331099:5428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:44.732189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:44.770493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594808311331163:9722]
2025-10-10T14:08:44.820949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:44.842309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:44.843159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:44.843175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:44.843217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:44.843468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:44.843661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594806733408366:9331]
2025-10-10T14:08:44.845705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:44.846864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:44.847061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:44.848204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:44.848494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:44.848501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:44.848508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:44.848515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:44.848521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:44.848527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:44.848535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:44.848542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:44.848549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.848555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.848561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.848568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.848613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:44.848727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:44.848773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:44.848817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:44.848859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:44.848901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:44.848943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:44.848989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:44.849032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.849074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.849117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.849179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.849219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:44.849287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:44.849345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:44.849400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:44.849461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:44.849512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:44.849553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:44.849603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:44.849648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:44.849695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:44.849737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:44.849784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:44.849828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:44.849875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:44.849918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:44.849970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:44.850019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.850068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.850108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.857393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.857513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.857586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.857637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.857700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.858129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:44.915070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:44.947737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:44.947784Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:44.947800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:44.947819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:44.947842Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 781 [2:7559594806733408366:9331]
2025-10-10T14:08:44.947895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:44.947952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:44.947967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:44.947979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:44.947991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:44.948036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:44.948058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:44.948080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:44.995189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.995232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.995246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.995259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.995272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:44.995571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:44.995591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:44.995757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:44.995971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:44.996218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:44.996351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:44.996425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594806733408356:9331]
2025-10-10T14:08:44.996442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594806733408356:9331]
2025-10-10T14:08:44.996458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594806733408356:9331]
2025-10-10T14:08:44.996473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594806733408356:9331]
2025-10-10T14:08:44.996518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:44.996604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:44.996804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:44.996823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:44.996960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594806733408356:9331]
2025-10-10T14:08:44.996983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:44.997568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:44.997584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:44.997596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:44.997606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:44.997630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:45.000720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 781
2025-10-10T14:08:45.000877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 781
2025-10-10T14:08:45.000965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 781, pipe: [1:7559594808311331163:9722]
2025-10-10T14:08:45.003109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 782 partition: 0 MaxSeqNo: 36 sessionId: src_id|d45afcad-4e678336-4c76cefb-59057a81_0
2025-10-10T14:08:45.004055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2621899-96ca6859-acfcfd3b-905474cd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d45afcad-4e678336-4c76cefb-59057a81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:44.998843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594808311331091:2442], now have 1 active actors on pipe
2025-10-10T14:08:44.998893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594808311331134:5428], now have 1 active actors on pipe
2025-10-10T14:08:44.998919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594808311331163:9722], now have 1 active actors on pipe
2025-10-10T14:08:45.001872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:45.001901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:45.001991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d45afcad-4e678336-4c76cefb-59057a81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:45.002025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:45.002046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:45.002060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:45.002097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:45.002143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:45.002193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:45.002730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:45.002752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:45.002814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:45.025753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45afcad-4e678336-4c76cefb-59057a81_0] Write session: try to update token
2025-10-10T14:08:45.025810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45afcad-4e678336-4c76cefb-59057a81_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:45.049356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:45.049396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:45.049411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:45.149668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:45.149715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:45.149729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:45.201892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:45.201931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:45.201945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:45.201956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:45.201969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:45.202004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594806733408356:9331]
2025-10-10T14:08:45.202032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594806733408356:9331]
2025-10-10T14:08:45.202057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594806733408356:9331]
2025-10-10T14:08:45.202080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594806733408356:9331]
2025-10-10T14:08:45.202232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:45.202260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:45.202272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:45.202667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:45.202705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:45.202729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:45.202751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:45.212830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:45.286028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId: src_id|d45afcad-4e678336-4c76cefb-59057a81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:45.338340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:45.426322Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:45.429251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:45.429302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:45.433522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:45.433551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:45.448864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45afcad-4e678336-4c76cefb-59057a81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:45.448908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45afcad-4e678336-4c76cefb-59057a81_0] Write session will restart in 0.007843s
2025-10-10T14:08:45.449009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45afcad-4e678336-4c76cefb-59057a81_0] Write session: Do CDS request
2025-10-10T14:08:45.449049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45afcad-4e678336-4c76cefb-59057a81_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:45.445456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594808311331163:9722]
2025-10-10T14:08:45.445555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:45.447404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 782 reason: error at write: Disconnected sessionId: src_id|d45afcad-4e678336-4c76cefb-59057a81_0
2025-10-10T14:08:45.448172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 782 sessionId: src_id|d45afcad-4e678336-4c76cefb-59057a81_0 is DEAD
2025-10-10T14:08:45.463800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:45.481168Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:45.481218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 783
2025-10-10T14:08:45.482114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d45afcad-4e678336-4c76cefb-59057a81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:45.486342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:45.486492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:45.486508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:45.486519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:45.494946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 783 sessionId:  describe result for acl check
2025-10-10T14:08:45.495087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:45.495101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:45.495110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:45.495127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594812606298566:5388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:45.502287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594812606298566:5388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:45.521522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594812606298566:5388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:45.544745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594812606298566:5388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:45.544788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594812606298566:5388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:45.544807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594812606298566:5388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:45.544837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:45.544956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594812606298644:9722]
2025-10-10T14:08:45.564777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:45.572311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:45.573050Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:45.573063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:45.573093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:45.573370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:45.573576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594811028375782:9335]
2025-10-10T14:08:45.575168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:45.577033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:45.577356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:45.578743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:45.579062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:45.579071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:45.579079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:45.579087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:45.579095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:45.579103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:45.579111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:45.579119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:45.579126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:45.579134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:45.579141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:45.579148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:45.579198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:45.579310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:45.579360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:45.579411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:45.579457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:45.579508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:45.579554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:45.579603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:45.579651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:45.579700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:45.579747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:45.579796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:45.579834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:45.579924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:45.579988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:45.580051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:45.580107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:45.580166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:45.580212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:45.580271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:45.580325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:45.580384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:45.580436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:45.580499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:45.580552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:45.580612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:45.580662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:45.580718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:45.580774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:45.580831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:45.580879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:45.580936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:45.580988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:45.581064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:45.581119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:45.582449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:45.582991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:45.673414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:45.689340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:45.689396Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:45.689419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:45.689454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:45.689480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 782 [2:7559594811028375782:9335]
2025-10-10T14:08:45.689555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:45.689617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:45.689632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:45.689646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:45.689658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:45.689710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:45.689746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:45.689768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:45.691851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:45.691884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:45.691899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:45.691914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:45.691925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:45.692201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:45.692219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:45.692366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:45.692557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:45.692790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:45.692910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:45.692978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.692993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.693006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.693019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.693051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:45.693324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:45.693341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:45.693359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:45.693370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:45.693383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:45.693709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:45.694018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 782, pipe: [1:7559594812606298644:9722]
2025-10-10T14:08:45.693736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:45.694135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 782
2025-10-10T14:08:45.694222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 782
2025-10-10T14:08:45.693902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594812606298644:9722], now have 1 active actors on pipe
2025-10-10T14:08:45.693926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594812606298540:2442], now have 1 active actors on pipe
2025-10-10T14:08:45.693949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594812606298647:5388], now have 1 active actors on pipe
2025-10-10T14:08:45.693970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.694007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:45.694557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:45.696605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:45.696639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:45.696698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c491cf95-d1e5916-f95e7944-de456afd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:45.696722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:45.696734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:45.696743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:45.696770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:45.696810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:45.696846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:45.702918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:45.702969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:45.703062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:45.703444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 783 partition: 0 MaxSeqNo: 36 sessionId: src_id|c491cf95-d1e5916-f95e7944-de456afd_0
2025-10-10T14:08:45.713379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d45afcad-4e678336-4c76cefb-59057a81_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|c491cf95-d1e5916-f95e7944-de456afd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:45.763986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:45.764029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:45.764071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.764207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:45.765404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:45.784444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c491cf95-d1e5916-f95e7944-de456afd_0] Write session: try to update token
2025-10-10T14:08:45.784513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c491cf95-d1e5916-f95e7944-de456afd_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:45.801674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:45.820536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:45.822832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:45.824127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:45.826333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:45.831295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:45.831324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:45.831335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:45.831387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:45.887375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:45.887412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:45.887425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:45.887438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:45.887452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:45.887494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.887523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.887547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.887573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594811028375777:9335]
2025-10-10T14:08:45.887717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:45.887743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:45.887755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:45.888815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:45.889300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:45.889353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:45.889384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:45.889415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:45.953239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId: src_id|c491cf95-d1e5916-f95e7944-de456afd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:45.979566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:46.064462Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:46.082872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:46.082922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:46.083802Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:46.087067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594812606298644:9722]
2025-10-10T14:08:46.087183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:46.087324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:46.087336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:46.100709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 783 reason: error at write: Disconnected sessionId: src_id|c491cf95-d1e5916-f95e7944-de456afd_0
2025-10-10T14:08:46.101074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 783 sessionId: src_id|c491cf95-d1e5916-f95e7944-de456afd_0 is DEAD
2025-10-10T14:08:46.105377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491cf95-d1e5916-f95e7944-de456afd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:46.105436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491cf95-d1e5916-f95e7944-de456afd_0] Write session will restart in 0.008179s
2025-10-10T14:08:46.105542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491cf95-d1e5916-f95e7944-de456afd_0] Write session: Do CDS request
2025-10-10T14:08:46.105577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491cf95-d1e5916-f95e7944-de456afd_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:46.125881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c491cf95-d1e5916-f95e7944-de456afd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:46.125596Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:46.125644Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 784
2025-10-10T14:08:46.129408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:46.129580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:46.129606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:46.129617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:46.131653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 784 sessionId:  describe result for acl check
2025-10-10T14:08:46.131775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:46.131791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:46.131801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:46.131818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594816901265990:5360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:46.134421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594816901265990:5360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:46.154381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594816901265990:5360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:46.175799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594816901265990:5360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:46.175840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594816901265990:5360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:46.175858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594816901265990:5360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:46.175887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:46.187367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594816901266079:9722]
2025-10-10T14:08:46.199694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:46.208844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:46.209889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:46.209910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:46.209963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:46.210292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:46.210496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594815323343211:9347]
2025-10-10T14:08:46.212763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:46.213896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:46.214129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:46.215504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:46.215855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:46.215864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:46.215872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:46.215879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:46.215886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:46.215893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:46.215899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:46.215907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:46.215914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.215922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.215929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.215947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.216007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:46.216120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:46.216170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:46.216220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:46.216268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:46.216318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:46.216365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:46.216411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:46.216460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.216506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.216552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.216599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.216641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:46.216712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:46.216775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:46.216835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:46.216887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:46.216943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:46.216990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:46.217046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:46.217095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:46.217884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:46.217951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:46.218009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:46.218060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:46.218118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:46.218168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:46.218223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:46.218275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.218330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.218376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.218434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.218483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.218537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.218583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.218638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.219101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:46.270517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:46.306468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:46.306526Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:46.306544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:46.306565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:46.306592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 783 [2:7559594815323343211:9347]
2025-10-10T14:08:46.306653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:46.306727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:46.306745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:46.306759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:46.306772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:46.306829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:46.306855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:46.306879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:46.308452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.308470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.308483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.308497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.308508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:46.308820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:46.308840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.308986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.309439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.309669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.309789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:46.309861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.309875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.309887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.309899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.309929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:46.310021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:46.310073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:46.310084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:46.310093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:46.310103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:46.310189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:46.310208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:46.310253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594816901265978:2442], now have 1 active actors on pipe
2025-10-10T14:08:46.310276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594816901266061:5360], now have 1 active actors on pipe
2025-10-10T14:08:46.310409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594816901266079:9722], now have 1 active actors on pipe
2025-10-10T14:08:46.310426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.310454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:46.310918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:46.310982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 783
2025-10-10T14:08:46.311099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 783
2025-10-10T14:08:46.311166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 783, pipe: [1:7559594816901266079:9722]
2025-10-10T14:08:46.317320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:46.317374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:46.317482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:46.317524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:46.317544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:46.317555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:46.317600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:46.317650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:46.317703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:46.328915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:46.328974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:46.329073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:46.330593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c491cf95-d1e5916-f95e7944-de456afd_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:46.329733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 784 partition: 0 MaxSeqNo: 36 sessionId: src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0
2025-10-10T14:08:46.399320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0] Write session: try to update token
2025-10-10T14:08:46.399387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:46.460355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:46.460392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:46.460405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:46.460469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:46.460484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:46.460498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:46.460510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:46.460522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:46.460560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.460589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.460613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.460635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.460833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:46.460861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.460873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:46.460989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:46.461018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:46.461045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:46.461073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:46.465751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:46.554065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId: src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:46.579171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:46.641932Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:46.659542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:46.659755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:46.659823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:46.659837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:46.659878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594815323343206:9347]
2025-10-10T14:08:46.661367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:46.662297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:46.673072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:46.673105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:46.685181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 784 reason: error at write: Disconnected sessionId: src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0
2025-10-10T14:08:46.685605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 784 sessionId: src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0 is DEAD
2025-10-10T14:08:46.688722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:46.688792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0] Write session will restart in 0.009497s
2025-10-10T14:08:46.688966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0] Write session: Do CDS request
2025-10-10T14:08:46.689015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:46.722764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594816901266079:9722]
2025-10-10T14:08:46.722842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:46.725360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:46.732613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:46.732648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 785
2025-10-10T14:08:46.733086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:46.733209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:46.733225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:46.733236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:46.734606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 785 sessionId:  describe result for acl check
2025-10-10T14:08:46.734723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:46.734733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:46.734742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:46.734760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594816901266130:5333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:46.737351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594816901266130:5333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:46.755921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594816901266130:5333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:46.767539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594816901266130:5333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:46.767579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594816901266130:5333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:46.767595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594816901266130:5333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:46.767625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:46.772869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:46.779406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:46.780365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:46.780400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:46.780446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:46.780698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:46.780884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594815323343339:9354]
2025-10-10T14:08:46.783328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:46.784555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:46.784766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:46.786077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:46.786415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:46.786432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:46.786440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:46.786447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:46.786454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:46.786460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:46.786466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:46.786474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:46.786480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.786486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.786492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.786498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.786538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:46.786635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:46.786679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:46.786719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:46.786761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:46.786810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:46.786853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:46.786901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:46.786945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.786988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.787028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.787070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.787109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:46.787166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:46.787220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:46.787269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:46.787313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:46.787361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:46.787403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:46.787454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:46.787496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:46.787546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:46.787586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:46.787652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:46.787698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:46.787746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:46.787785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:46.787833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:46.787879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.787930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.787970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.788019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.788062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.788135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.788177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.788226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.788627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:46.823699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594816901266226:9722]
2025-10-10T14:08:46.850546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:46.883043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:46.883092Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:46.883109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:46.883129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:46.883149Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 784 [2:7559594815323343339:9354]
2025-10-10T14:08:46.883203Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:46.883258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:46.883272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:46.883284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:46.883295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:46.883343Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:46.883365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:46.883388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:46.885788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.885804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.885819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.885834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.885846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:46.886125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:46.886156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:46.886295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:46.886479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:46.886706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:46.886822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:46.886895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:46.886909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:46.886922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:46.886936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:46.886980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:46.887084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:46.887268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:46.887285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:46.887412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:46.887432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:46.889336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:46.889354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:46.889368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:46.889382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:46.889409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:46.890334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594816901266216:5333], now have 1 active actors on pipe
2025-10-10T14:08:46.890383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594816901266119:2442], now have 1 active actors on pipe
2025-10-10T14:08:46.890407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594816901266226:9722], now have 1 active actors on pipe
2025-10-10T14:08:46.892042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 784
2025-10-10T14:08:46.892128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 784, pipe: [1:7559594816901266226:9722]
2025-10-10T14:08:46.892202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 784
2025-10-10T14:08:46.897731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:46.897784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:46.897868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:46.897904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:46.897924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:46.897936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:46.897973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:46.898018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:46.898067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:46.909249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:46.909300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:46.909385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:46.916140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a63251d3-c0c43256-b8890512-5e3d4c4e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:46.913592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 785 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0
2025-10-10T14:08:46.970690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0] Write session: try to update token
2025-10-10T14:08:46.970736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:47.023190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:47.023224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:47.023235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:47.023288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:47.023302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:47.023313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:47.023323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:47.023334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:47.023367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:47.023393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:47.023415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:47.023435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:47.023558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:47.023598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:47.023631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:47.023640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:47.023664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:47.023665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:47.023676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:47.024837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:47.115716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId: src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:47.138405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:47.184883Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:47.211552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:47.211605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:47.211665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:47.211677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:47.211717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594815323343334:9354]
2025-10-10T14:08:47.212090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:47.213280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:47.213312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:47.217248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:47.217387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594816901266226:9722]
2025-10-10T14:08:47.214896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:47.224678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 785 reason: error at write: Disconnected sessionId: src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0
2025-10-10T14:08:47.229556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 785 sessionId: src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0 is DEAD
2025-10-10T14:08:47.233865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:47.233900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0] Write session will restart in 0.006374s
2025-10-10T14:08:47.234010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0] Write session: Do CDS request
2025-10-10T14:08:47.234041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:47.266077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:47.265426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:47.265462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 786
2025-10-10T14:08:47.267106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:47.267261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:47.267279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:47.267290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:47.269145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 786 sessionId:  describe result for acl check
2025-10-10T14:08:47.269275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:47.269295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:47.269309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:47.269329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594821196233571:5327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:47.272366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594821196233571:5327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:47.296534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594821196233571:5327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:47.319196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594821196233630:9722]
2025-10-10T14:08:47.320449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594821196233571:5327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:47.320478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594821196233571:5327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:47.320498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594821196233571:5327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:47.320532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:47.376141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:47.377817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:47.378750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:47.378770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:47.378815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:47.379093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:47.379279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594819618310782:9360]
2025-10-10T14:08:47.381520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:47.382829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:47.383060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:47.384414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:47.384736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:47.384743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:47.384751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:47.384758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:47.384765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:47.384771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:47.384780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:47.384785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:47.384792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:47.384799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:47.384806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:47.384813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:47.384858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:47.384964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:47.385012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:47.385058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:47.385101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:47.385188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:47.385232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:47.385276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:47.385322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:47.385367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:47.385429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:47.385473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:47.385513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:47.385578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:47.385634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:47.385694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:47.385745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:47.385797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:47.385844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:47.385901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:47.385948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:47.386003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:47.386046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:47.386101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:47.386165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:47.386223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:47.386268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:47.386321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:47.386368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:47.386420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:47.386464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:47.386515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:47.386557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:47.386610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:47.386652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:47.386722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:47.387173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:47.421845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:47.463537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:47.463581Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:47.463595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:47.463623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:47.463644Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 785 [2:7559594819618310782:9360]
2025-10-10T14:08:47.463694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:47.463750Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:47.463764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:47.463775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:47.463785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:47.463830Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:47.463851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:47.463872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:47.466115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:47.466131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:47.466143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:47.466154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:47.466165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:47.466413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:47.466428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:47.466548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:47.466705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:47.468629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 785
2025-10-10T14:08:47.468701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 785, pipe: [1:7559594821196233630:9722]
2025-10-10T14:08:47.468767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 785
2025-10-10T14:08:47.468076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:47.468214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:47.468296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594821196233633:5327], now have 1 active actors on pipe
2025-10-10T14:08:47.468315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594821196233630:9722], now have 1 active actors on pipe
2025-10-10T14:08:47.468334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594821196233559:2442], now have 1 active actors on pipe
2025-10-10T14:08:47.468358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.468387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.468398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.468409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.468442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:47.468516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:47.468681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:47.468696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:47.468790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:47.468804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:47.468814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:47.468825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:47.468827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.468849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:47.468851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:47.471599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:47.471626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:47.471717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f04f3d1b-dc090956-694235e8-3f71946_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:47.471748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:47.471765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:47.471775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:47.471813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:47.471856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:47.471899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:47.472841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:47.472886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:47.472969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:47.477334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac1bbf17-a7f3b8f6-ef6c2da9-2e10133_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f04f3d1b-dc090956-694235e8-3f71946_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:47.474468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 786 partition: 0 MaxSeqNo: 36 sessionId: src_id|f04f3d1b-dc090956-694235e8-3f71946_0
2025-10-10T14:08:47.552834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:47.552879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:47.552918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.553029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:47.553047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:47.555398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04f3d1b-dc090956-694235e8-3f71946_0] Write session: try to update token
2025-10-10T14:08:47.555457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04f3d1b-dc090956-694235e8-3f71946_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:47.559220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:47.560900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:47.562271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:47.563669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:47.589349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:47.636128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:47.636167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:47.636179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:47.636235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:47.751596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:47.751633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:47.751647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:47.751661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:47.751673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:47.751715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.751740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.751761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.751781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594819618310777:9360]
2025-10-10T14:08:47.751883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:47.751909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:47.751942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:47.751947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:47.751954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:47.751964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:47.751970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:47.752006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:47.752029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:47.752040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:47.755102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:47.761257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId: src_id|f04f3d1b-dc090956-694235e8-3f71946_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:47.811848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:47.919073Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:47.920844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:47.920889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:47.922424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:47.922449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:47.926629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 786 reason: error at write: Disconnected sessionId: src_id|f04f3d1b-dc090956-694235e8-3f71946_0
2025-10-10T14:08:47.927212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594821196233630:9722]
2025-10-10T14:08:47.927281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:47.927688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04f3d1b-dc090956-694235e8-3f71946_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:47.927716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04f3d1b-dc090956-694235e8-3f71946_0] Write session will restart in 0.005931s
2025-10-10T14:08:47.927814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04f3d1b-dc090956-694235e8-3f71946_0] Write session: Do CDS request
2025-10-10T14:08:47.927843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04f3d1b-dc090956-694235e8-3f71946_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:47.932319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 786 sessionId: src_id|f04f3d1b-dc090956-694235e8-3f71946_0 is DEAD
2025-10-10T14:08:47.928965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:47.945856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f04f3d1b-dc090956-694235e8-3f71946_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:47.945850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:47.945892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 787
2025-10-10T14:08:47.946543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:47.946693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:47.946710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:47.946721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:47.950706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 787 sessionId:  describe result for acl check
2025-10-10T14:08:47.950836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:47.950847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:47.950856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:47.950873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594821196233709:5319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:47.953815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594821196233709:5319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:47.973808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594821196233709:5319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:47.986962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594821196233709:5319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:47.987002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594821196233709:5319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:47.987020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594821196233709:5319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:47.987051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:48.012003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:48.020664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:48.021374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:48.021410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:48.021453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:48.021641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:48.021783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594823913278222:9375]
2025-10-10T14:08:48.023557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:48.024587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:48.024824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:48.025829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:48.026117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:48.026133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:48.026139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:48.026144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:48.026153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:48.026161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:48.026167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:48.026173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:48.026179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.026185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.026192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.026197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.026240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:48.026344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:48.026390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:48.026434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:48.026485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:48.026529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:48.026571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:48.026614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:48.026656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.026704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.026748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.026791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.026830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:48.026891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:48.026940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:48.026975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:48.027007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:48.027045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:48.027084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:48.027118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:48.027149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:48.027184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:48.027213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:48.027253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:48.027299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:48.027347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:48.027379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:48.027413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:48.027443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.027476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.027505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.027540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.027581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.027618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.027645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.027680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.028001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:48.028877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594825491201106:9722]
2025-10-10T14:08:48.050330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:48.091201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:48.091241Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:48.091253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:48.091272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:48.091294Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 786 [2:7559594823913278222:9375]
2025-10-10T14:08:48.091355Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:48.091407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:48.091421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:48.091432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:48.091443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:48.091490Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:48.091512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:48.091533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:48.093635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.093652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.093664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.093678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.093688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:48.093950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:48.093965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.094087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.094247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.094451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.094554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:48.094623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.094637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.094650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.094662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.094797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:48.094807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:48.094818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:48.094828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:48.095898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:48.096016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:48.096187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:48.096206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:48.096248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594821196233698:2442], now have 1 active actors on pipe
2025-10-10T14:08:48.096271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594825491201106:9722], now have 1 active actors on pipe
2025-10-10T14:08:48.096291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594821196233744:5319], now have 1 active actors on pipe
2025-10-10T14:08:48.096407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.096436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:48.098612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 786
2025-10-10T14:08:48.098693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 786, pipe: [1:7559594825491201106:9722]
2025-10-10T14:08:48.098755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 786
2025-10-10T14:08:48.096798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:48.111606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:48.111657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:48.111745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:48.111781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:48.111798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:48.111809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:48.111860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:48.111905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:48.111950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:48.115689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:48.115736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:48.115812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:48.116302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 787 partition: 0 MaxSeqNo: 36 sessionId: src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0
2025-10-10T14:08:48.117523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f04f3d1b-dc090956-694235e8-3f71946_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:48.162115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0] Write session: try to update token
2025-10-10T14:08:48.162172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:48.274269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:48.274309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:48.274323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:48.274334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:48.274344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:48.274384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.274411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.274436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.274457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.274618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:48.274631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:48.274644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:48.274749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:48.274773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.274784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:48.275908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:48.277340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:48.277372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:48.277428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:48.277458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:48.393181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId: src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:48.431951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:48.459034Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:48.506909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:48.506961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:48.507015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:48.507027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:48.507070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594823913278217:9375]
2025-10-10T14:08:48.507387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:48.507641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:48.509269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:48.509441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594825491201106:9722]
2025-10-10T14:08:48.509520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:48.544165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 787 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0
2025-10-10T14:08:48.544542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 787 sessionId: src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0 is DEAD
2025-10-10T14:08:48.547316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:48.547389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0] Write session will restart in 0.005572s
2025-10-10T14:08:48.547564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0] Write session: Do CDS request
2025-10-10T14:08:48.547613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:48.562995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:48.563033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 788
2025-10-10T14:08:48.563465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:48.567050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:48.567210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:48.567225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:48.567236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:48.570443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 788 sessionId:  describe result for acl check
2025-10-10T14:08:48.570561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:48.570570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:48.570579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:48.570597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594825491201149:5302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:48.576235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594825491201149:5302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:48.588864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594825491201149:5302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:48.613182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594825491201209:9722]
2025-10-10T14:08:48.620019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594825491201149:5302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:48.620061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594825491201149:5302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:48.620077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594825491201149:5302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:48.620106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:48.661274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:48.662728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:48.663550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:48.663569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:48.663618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:48.663874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:48.664051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594823913278337:9377]
2025-10-10T14:08:48.670788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:48.672582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:48.672862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:48.674146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:48.674474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:48.674483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:48.674490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:48.674496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:48.674503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:48.674509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:48.674515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:48.674522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:48.674529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.674535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.674541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.674549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.674595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:48.674698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:48.674747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:48.674794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:48.674852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:48.674906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:48.674957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:48.675001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:48.675044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.675089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.675134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.675180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.675220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:48.675287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:48.675350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:48.675402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:48.675454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:48.675508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:48.675553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:48.675607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:48.675655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:48.675707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:48.675751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:48.675804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:48.675850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:48.675903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:48.675951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:48.676000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:48.676050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.676102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.676149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.676199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.676246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.676299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.676343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.676398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.676815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:48.719639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:48.733202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:48.733254Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:48.733270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:48.733291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:48.733315Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 787 [2:7559594823913278337:9377]
2025-10-10T14:08:48.733370Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:48.733445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:48.733462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:48.733474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:48.733486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:48.733543Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:48.733570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:48.733593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:48.750654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.750689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.750700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.750710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.750721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:48.751006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:48.751024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:48.751158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:48.751320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:48.751527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:48.751636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:48.751710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:48.751726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:48.751738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:48.751752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:48.751796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:48.751874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:48.752047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:48.752063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:48.752194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:48.752221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:48.752720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:48.752735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:48.752746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:48.752757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:48.752782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:48.753952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594825491201224:5302], now have 1 active actors on pipe
2025-10-10T14:08:48.753987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594825491201135:2442], now have 1 active actors on pipe
2025-10-10T14:08:48.754009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594825491201209:9722], now have 1 active actors on pipe
2025-10-10T14:08:48.754283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 787
2025-10-10T14:08:48.754375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 787
2025-10-10T14:08:48.754440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 787, pipe: [1:7559594825491201209:9722]
2025-10-10T14:08:48.758007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:48.758052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:48.758150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|891171cb-f7acd953-33701eb-9e74edf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:48.758185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:48.758202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:48.758213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:48.758250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:48.758294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:48.758341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:48.759293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:48.759316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:48.759363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:48.759858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 788 partition: 0 MaxSeqNo: 36 sessionId: src_id|891171cb-f7acd953-33701eb-9e74edf6_0
2025-10-10T14:08:48.760754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513dd7-665fa76e-5e0e1a88-c2318f3e_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|891171cb-f7acd953-33701eb-9e74edf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:48.822181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891171cb-f7acd953-33701eb-9e74edf6_0] Write session: try to update token
2025-10-10T14:08:48.822243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891171cb-f7acd953-33701eb-9e74edf6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:48.835039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:48.835078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:48.835115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:48.835235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:48.835247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:48.835258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:48.835323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:48.835612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:48.870472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:48.871735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:48.872879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:48.882076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:48.883749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:48.884075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:48.937454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:48.937507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:48.937527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:49.020141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:49.020199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:49.020224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:49.020245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:49.020262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:49.020320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:49.020364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:49.020420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:49.020472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594823913278332:9377]
2025-10-10T14:08:49.020645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:49.020672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:49.020682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:49.020687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:49.020731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:49.020769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:49.020809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:49.037810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:49.069248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId: src_id|891171cb-f7acd953-33701eb-9e74edf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:49.103532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:49.216784Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:49.220095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:49.220998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:49.222560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:49.226299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:49.226631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594825491201209:9722]
2025-10-10T14:08:49.226786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:49.243871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 788 reason: status is not ok: tablet will be restarted right now sessionId: src_id|891171cb-f7acd953-33701eb-9e74edf6_0
2025-10-10T14:08:49.244220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 788 sessionId: src_id|891171cb-f7acd953-33701eb-9e74edf6_0 is DEAD
2025-10-10T14:08:49.245543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891171cb-f7acd953-33701eb-9e74edf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:49.245584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891171cb-f7acd953-33701eb-9e74edf6_0] Write session will restart in 0.008385s
2025-10-10T14:08:49.245675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891171cb-f7acd953-33701eb-9e74edf6_0] Write session: Do CDS request
2025-10-10T14:08:49.245700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891171cb-f7acd953-33701eb-9e74edf6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:49.262560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891171cb-f7acd953-33701eb-9e74edf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:49.263651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:49.263697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 789
2025-10-10T14:08:49.264014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:49.264117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:49.264132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:49.264144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:49.265483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 789 sessionId:  describe result for acl check
2025-10-10T14:08:49.265591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:49.265600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:49.265609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:49.265626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594829786168594:5278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:49.268168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594829786168594:5278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:49.307078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594829786168594:5278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:49.318647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594829786168594:5278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:49.318693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594829786168594:5278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:49.318709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594829786168594:5278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:49.318738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:49.327053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594829786168631:9722]
2025-10-10T14:08:49.400008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:49.406586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:49.407428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:49.407455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:49.407499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:49.407741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:49.407931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594828208245800:9389]
2025-10-10T14:08:49.410120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:49.414152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:49.414377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:49.415625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:49.415915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:49.415921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:49.415928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:49.415935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:49.415940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:49.415946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:49.415954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:49.415960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:49.415966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:49.415973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:49.415979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:49.415985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:49.416028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:49.416130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:49.416174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:49.416215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:49.416257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:49.416297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:49.416338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:49.416378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:49.416418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:49.416458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:49.416498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:49.416538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:49.416578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:49.416642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:49.416695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:49.416744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:49.416789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:49.416838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:49.416879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:49.416927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:49.416969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:49.417015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:49.417055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:49.418189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:49.418257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:49.418312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:49.418353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:49.418402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:49.418444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:49.418495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:49.418536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:49.418586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:49.418646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:49.418698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:49.418744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:49.418790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:49.419229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:49.452794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:49.538717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:49.538772Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:49.538789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:49.538808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:49.538831Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 788 [2:7559594828208245800:9389]
2025-10-10T14:08:49.538883Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:49.538950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:49.538966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:49.538978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:49.538991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:49.539038Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:49.539061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:49.539084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:49.540353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:49.540369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:49.540381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:49.540393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:49.540404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:49.540685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:49.540703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:49.540842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:49.541010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:49.542359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 788
2025-10-10T14:08:49.542446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 788, pipe: [1:7559594829786168631:9722]
2025-10-10T14:08:49.542516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 788
2025-10-10T14:08:49.542990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:49.543113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:49.543210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594829786168587:2442], now have 1 active actors on pipe
2025-10-10T14:08:49.543233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594829786168631:9722], now have 1 active actors on pipe
2025-10-10T14:08:49.543252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594829786168628:5278], now have 1 active actors on pipe
2025-10-10T14:08:49.543309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:49.543330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:49.543367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594828208245795:9389]
2025-10-10T14:08:49.543382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594828208245795:9389]
2025-10-10T14:08:49.543394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594828208245795:9389]
2025-10-10T14:08:49.543406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594828208245795:9389]
2025-10-10T14:08:49.543446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:49.543528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:49.543702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:49.543720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:49.543798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:49.543832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:49.543851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:49.543860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:49.543899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:49.543945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:49.544082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594828208245795:9389]
2025-10-10T14:08:49.544103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:49.544146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:49.544343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:49.544355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:49.544365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:49.544377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:49.544400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:49.546908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:49.546948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:49.547020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:49.547426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 789 partition: 0 MaxSeqNo: 36 sessionId: src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0
2025-10-10T14:08:49.548314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891171cb-f7acd953-33701eb-9e74edf6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:49.620056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0] Write session: try to update token
2025-10-10T14:08:49.620115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:49.637437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:49.637484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:49.637496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:49.772551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:49.772587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:49.772599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:49.772664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:49.772689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:49.772704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:49.772715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:49.772726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:49.772766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594828208245795:9389]
2025-10-10T14:08:49.772792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594828208245795:9389]
2025-10-10T14:08:49.772815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594828208245795:9389]
2025-10-10T14:08:49.772836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594828208245795:9389]
2025-10-10T14:08:49.772974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:49.773000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:49.773010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:49.774121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:49.777462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:49.777492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:49.777520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:49.777544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:49.841814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId: src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:49.867493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:49.996451Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:49.999136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:49.999181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:50.002598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:50.008137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:50.016239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 789 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0
2025-10-10T14:08:50.016606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 789 sessionId: src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0 is DEAD
2025-10-10T14:08:50.021346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:50.021401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0] Write session will restart in 0.008671s
2025-10-10T14:08:50.021493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0] Write session: Do CDS request
2025-10-10T14:08:50.021522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:50.038514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:50.044402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:50.053189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 790
2025-10-10T14:08:50.053552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:50.053675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594829786168631:9722]
2025-10-10T14:08:50.054047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:50.054156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:50.054170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:50.054180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:50.062313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 790 sessionId:  describe result for acl check
2025-10-10T14:08:50.062433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:50.062442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:50.062452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:50.062469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594834081136055:5260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:50.064810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594834081136055:5260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:50.096843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594834081136055:5260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:50.125303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594834081136055:5260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:50.125350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594834081136055:5260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:50.125379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594834081136055:5260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:50.125412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:50.148022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:50.155617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594834081136163:9722]
2025-10-10T14:08:50.153518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:50.154379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:50.154397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:50.154439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:50.154686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:50.154870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594832503213226:9398]
2025-10-10T14:08:50.156787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:50.169601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:50.169875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:50.171056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:50.171349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:50.171357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:50.171363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:50.171369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:50.171375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:50.171381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:50.171387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:50.171395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:50.171401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:50.171407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:50.171413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:50.171420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:50.171463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:50.171568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:50.171611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:50.171652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:50.171694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:50.171734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:50.171774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:50.171813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:50.171854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:50.171897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:50.171938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:50.171976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:50.172013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:50.172073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:50.172126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:50.172177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:50.172219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:50.172267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:50.172307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:50.172355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:50.172398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:50.172447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:50.172489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:50.172538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:50.172581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:50.172630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:50.172671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:50.172718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:50.172761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:50.172808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:50.172847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:50.172893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:50.172933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:50.172981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:50.173021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:50.173068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:50.180428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:50.234566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:50.255342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:50.255404Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:50.255423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:50.255445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:50.255471Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 789 [2:7559594832503213226:9398]
2025-10-10T14:08:50.255536Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:50.255601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:50.255616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:50.255628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:50.255640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:50.255693Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:50.255717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:50.255740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:50.287365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:50.287401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:50.287417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:50.287431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:50.287444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:50.287755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:50.287776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:50.287940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:50.288153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:50.288412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:50.288543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:50.288631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594834081136163:9722], now have 1 active actors on pipe
2025-10-10T14:08:50.288657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594834081136158:5260], now have 1 active actors on pipe
2025-10-10T14:08:50.288683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594834081136050:2442], now have 1 active actors on pipe
2025-10-10T14:08:50.288710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594832503213221:9398]
2025-10-10T14:08:50.289265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 789, pipe: [1:7559594834081136163:9722]
2025-10-10T14:08:50.289385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 789
2025-10-10T14:08:50.289452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 789
2025-10-10T14:08:50.288730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594832503213221:9398]
2025-10-10T14:08:50.288744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594832503213221:9398]
2025-10-10T14:08:50.288758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594832503213221:9398]
2025-10-10T14:08:50.288804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:50.288890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:50.289085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:50.289103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:50.289644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:50.289658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:50.289671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:50.289685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:50.290268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594832503213221:9398]
2025-10-10T14:08:50.290315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:50.290387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:50.290411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:50.290587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:50.290622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:50.290640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:50.290652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:50.290690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:50.290737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:50.290812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:50.291147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:50.292037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:50.292065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:50.292135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:50.292515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 790 partition: 0 MaxSeqNo: 36 sessionId: src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0
2025-10-10T14:08:50.293712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9328dc6c-8e62fbc7-6f90d79-433e9d3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:50.355975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0] Write session: try to update token
2025-10-10T14:08:50.356034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:50.355621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:50.355657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:50.355669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
E1010 14:08:50.370889867  106882 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:08:50.456065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:50.456104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:50.456118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:50.456128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:50.456137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:50.456171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594832503213221:9398]
2025-10-10T14:08:50.456197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594832503213221:9398]
2025-10-10T14:08:50.456219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594832503213221:9398]
2025-10-10T14:08:50.456237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594832503213221:9398]
2025-10-10T14:08:50.456386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:50.456396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:50.456406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:50.456450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:50.456474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:50.456484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:50.457535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:50.458061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:50.458083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:50.458103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:50.458121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:50.585147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId: src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:50.630129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:50.741888Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:50.771553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:50.771608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:50.774669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594834081136163:9722]
2025-10-10T14:08:50.774765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:50.774777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:50.782121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:50.784384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:50.798258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:50.798364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0] Write session will restart in 0.008374s
2025-10-10T14:08:50.798610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0] Write session: Do CDS request
2025-10-10T14:08:50.798690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:50.796591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 790 reason: error at write: Disconnected sessionId: src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0
2025-10-10T14:08:50.796938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 790 sessionId: src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0 is DEAD
2025-10-10T14:08:50.816708Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:50.816744Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 791
2025-10-10T14:08:50.817750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:50.818363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:50.818482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:50.818497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:50.818509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:50.822585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 791 sessionId:  describe result for acl check
2025-10-10T14:08:50.822716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:50.822726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:50.822736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:50.822754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594834081136209:5243] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:50.825454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594834081136209:5243] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:50.837256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594834081136209:5243] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:50.856705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594834081136209:5243] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:50.856749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594834081136209:5243] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:50.856767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594834081136209:5243] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:50.856802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:50.874968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594834081136247:9722]
2025-10-10T14:08:50.952671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:50.970291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:51.024031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:51.024078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:51.024166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:51.024575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:51.024766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594836798180663:9408]
2025-10-10T14:08:51.033199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:51.041859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:51.042122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:51.043297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:51.043602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:51.043609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:51.043616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:51.043623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:51.043629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:51.043636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:51.043642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:51.043648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:51.043655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.043661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.043667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.043673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.043715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:51.043814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:51.043857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:51.043903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:51.043943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:51.043988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:51.044030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:51.044070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:51.044114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.044159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.044201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.044242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.044281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:51.044340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:51.044394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:51.044443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:51.044490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:51.044540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:51.044581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:51.044630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:51.044675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:51.044727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:51.044767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:51.044819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:51.044864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:51.044914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:51.044957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:51.045006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:51.045055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.045105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.046046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.046123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.046174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.046226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.046271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.046324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.046744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:51.094294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:51.112955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:51.121515Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:51.121567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:51.121589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:51.121616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 790 [2:7559594836798180663:9408]
2025-10-10T14:08:51.121683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:51.121753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:51.121772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:51.121784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:51.121795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:51.121850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:51.121874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:51.121897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:51.207123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 790, pipe: [1:7559594834081136247:9722]
2025-10-10T14:08:51.207228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 790
2025-10-10T14:08:51.207293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 790
2025-10-10T14:08:51.205488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.205526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.205541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.205557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.205569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:51.205864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:51.205883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.206028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.206202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.206422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.206537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:51.206628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594834081136247:9722], now have 1 active actors on pipe
2025-10-10T14:08:51.206654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594834081136244:5243], now have 1 active actors on pipe
2025-10-10T14:08:51.206675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594834081136200:2442], now have 1 active actors on pipe
2025-10-10T14:08:51.206702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594832503213361:9408]
2025-10-10T14:08:51.206717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594832503213361:9408]
2025-10-10T14:08:51.206731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594832503213361:9408]
2025-10-10T14:08:51.206742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594832503213361:9408]
2025-10-10T14:08:51.206785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:51.206867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:51.207043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:51.207061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:51.207196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594832503213361:9408]
2025-10-10T14:08:51.207216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:51.208360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:51.208374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:51.208386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:51.208397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:51.208423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:51.211317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:51.211363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:51.211463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:51.211498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:51.211518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:51.211530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:51.211568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:51.211615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:51.211668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:51.212840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 791 partition: 0 MaxSeqNo: 36 sessionId: src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0
2025-10-10T14:08:51.212440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:51.212467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:51.212531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:51.218888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eab30b7-4b684343-4cf9df81-b5c44c06_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:51.222478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:51.222512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:51.222525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:51.257870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0] Write session: try to update token
2025-10-10T14:08:51.257932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:51.318630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:51.318669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:51.318682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:51.318693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:51.318704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:51.318747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594832503213361:9408]
2025-10-10T14:08:51.318774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594832503213361:9408]
2025-10-10T14:08:51.318797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594832503213361:9408]
2025-10-10T14:08:51.318820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594832503213361:9408]
2025-10-10T14:08:51.318964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:51.318993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.319004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:51.319677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:51.319717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:51.319746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:51.319773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:51.320062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
E1010 14:08:51.371341461  295612 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:08:51.385839Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:6178 } ]
2025-10-10T14:08:51.474282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId: src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:51.496206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:51.536850Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:51.539263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:51.539307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:51.542818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:51.542369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594834081136247:9722]
2025-10-10T14:08:51.542445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:51.542457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:51.610536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 791 reason: error at write: Disconnected sessionId: src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0
2025-10-10T14:08:51.611058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 791 sessionId: src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0 is DEAD
2025-10-10T14:08:51.617440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:51.617506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0] Write session will restart in 0.008874s
2025-10-10T14:08:51.617663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0] Write session: Do CDS request
2025-10-10T14:08:51.617713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:51.628502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:51.641447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:51.641481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 792
2025-10-10T14:08:51.642022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:51.645411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594838376103732:9722]
2025-10-10T14:08:51.645547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:51.645660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:51.645674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:51.645686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:51.647814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 792 sessionId:  describe result for acl check
2025-10-10T14:08:51.647933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:51.647942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:51.647953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:51.647968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594838376103735:5212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:51.650461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594838376103735:5212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:51.655860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:51.674654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594838376103735:5212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:51.680347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:51.681395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:51.681423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:51.681484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:51.681790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:51.681983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594836798180810:9417]
2025-10-10T14:08:51.686356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:51.690621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:51.690890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:51.692119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:51.692430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:51.692438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:51.692443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:51.692449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:51.692455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:51.692462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:51.692469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:51.692475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:51.692481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.692488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.692494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.692501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.692547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:51.692644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:51.692691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:51.692735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:51.692776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:51.692818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:51.692859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:51.692902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:51.692945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.692992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.693039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.693083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.693148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:51.693206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:51.693265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:51.693317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:51.693382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:51.700569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:51.700655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:51.700697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:51.700734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:51.700771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:51.700811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:51.700864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:51.700912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:51.700954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:51.700986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:51.701022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:51.701058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.701096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.701144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.701197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.701247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.701297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.701351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.701399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.701822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:51.706464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594838376103735:5212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:51.706511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594838376103735:5212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:51.706528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594838376103735:5212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:51.706561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:51.740640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:51.775399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:51.775449Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:51.775465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:51.775483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:51.775503Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 791 [2:7559594836798180810:9417]
2025-10-10T14:08:51.775557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:51.775622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:51.775636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:51.775648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:51.775658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:51.775706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:51.775728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:51.775763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:51.779235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.779252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.779265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.779277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.779288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:51.779567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:51.779583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:51.779719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:51.779889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:51.780104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:51.780210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:51.780280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:51.780296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:51.780308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:51.780321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:51.780363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:51.780454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:51.780616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:51.780633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:51.780762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:51.780781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:51.781274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:51.781288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:51.781298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:51.781308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:51.781331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:51.782398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594838376103694:2442], now have 1 active actors on pipe
2025-10-10T14:08:51.782425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594838376103770:5212], now have 1 active actors on pipe
2025-10-10T14:08:51.782447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594838376103732:9722], now have 1 active actors on pipe
2025-10-10T14:08:51.795521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:51.795568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:51.795659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:51.795692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:51.795710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:51.795721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:51.795758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:51.795807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:51.795854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:51.794280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 791
2025-10-10T14:08:51.794388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 791
2025-10-10T14:08:51.794445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 791, pipe: [1:7559594838376103732:9722]
2025-10-10T14:08:51.799918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:51.799960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:51.800033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:51.800486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 792 partition: 0 MaxSeqNo: 36 sessionId: src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0
2025-10-10T14:08:51.802639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1835b8b-75f4ad9-b6d8a7c7-4ae6b762_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:51.873831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:51.873867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:51.873881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:51.879706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0] Write session: try to update token
2025-10-10T14:08:51.879770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:52.049000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:52.052960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:52.052990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:52.053112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:52.053145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:52.053157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:52.053167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:52.053178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:52.053212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:52.053235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:52.053256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:52.053278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:52.053401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:52.053441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:52.053467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:52.053492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:52.098630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:52.098676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:52.098688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:52.099740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:52.145224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId: src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:52.193192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:52.270163Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:52.273052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:52.273067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:52.273111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594836798180805:9417]
2025-10-10T14:08:52.273472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:52.273507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:52.273705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:52.274748Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:52.279616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:52.279839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:52.284403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594838376103732:9722]
2025-10-10T14:08:52.287813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 792 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0
2025-10-10T14:08:52.288161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 792 sessionId: src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0 is DEAD
2025-10-10T14:08:52.291274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:52.291314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0] Write session will restart in 0.007499s
2025-10-10T14:08:52.291407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0] Write session: Do CDS request
2025-10-10T14:08:52.291435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:52.305600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:52.304066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:52.304100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 793
2025-10-10T14:08:52.306381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:52.306517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:52.306534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:52.306543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:52.307970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 793 sessionId:  describe result for acl check
2025-10-10T14:08:52.308069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:52.308078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:52.308087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:52.308103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594842671071122:5201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:52.311402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594842671071122:5201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:52.337472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594842671071122:5201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:52.365137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594842671071122:5201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:52.365184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594842671071122:5201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:52.365202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594842671071122:5201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:52.365233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:52.388351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594842671071222:9722]
2025-10-10T14:08:52.406578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:52.412833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:52.413741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:52.413770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:52.413815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:52.414070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:52.414262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594841093148260:9429]
2025-10-10T14:08:52.416590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:52.417763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:52.417985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:52.419253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:52.419563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:52.419571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:52.419578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:52.419584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:52.419590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:52.419596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:52.419603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:52.419610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:52.419616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:52.419622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:52.419629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:52.419636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:52.419679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:52.419777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:52.419823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:52.419868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:52.419912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:52.419957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:52.420000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:52.420046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:52.420086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:52.420130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:52.420171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:52.420215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:52.420255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:52.420315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:52.420370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:52.420424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:52.420474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:52.420524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:52.420568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:52.420618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:52.420663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:52.420716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:52.420759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:52.420810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:52.420851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:52.420902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:52.420967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:52.421018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:52.421062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:52.421113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:52.422108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:52.422181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:52.422230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:52.422280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:52.422323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:52.422370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:52.422781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:52.450680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:52.467086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:52.467133Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:52.467148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:52.467165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:52.467188Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 792 [2:7559594841093148260:9429]
2025-10-10T14:08:52.467235Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:52.467290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:52.467305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:52.467317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:52.467327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:52.467374Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:52.467395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:52.467417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:52.495615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:52.495649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:52.495661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:52.495672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:52.495681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:52.495942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:52.495957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:52.496074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:52.496226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:52.496415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:52.496510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:52.497475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 792
2025-10-10T14:08:52.497557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 792
2025-10-10T14:08:52.497619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 792, pipe: [1:7559594842671071222:9722]
2025-10-10T14:08:52.498122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.498150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.498162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.498173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.498209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:52.498307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594842671071175:5201], now have 1 active actors on pipe
2025-10-10T14:08:52.498329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594842671071113:2442], now have 1 active actors on pipe
2025-10-10T14:08:52.498348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594842671071222:9722], now have 1 active actors on pipe
2025-10-10T14:08:52.498390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:52.498411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:52.498463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:52.498632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:52.498649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:52.498813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6082225a-d0113428-50c08aa7-aa027627_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:52.498846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:52.498864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:52.498874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:52.498910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:52.498951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:52.498989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.499009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:52.499100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:52.499648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:52.499669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:52.499679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:52.499690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:52.499712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:52.504403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:52.504443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:52.504519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:52.504918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 793 partition: 0 MaxSeqNo: 36 sessionId: src_id|6082225a-d0113428-50c08aa7-aa027627_0
2025-10-10T14:08:52.505841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ccde24-18029d75-e0126f90-a4bf3395_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6082225a-d0113428-50c08aa7-aa027627_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:52.548655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6082225a-d0113428-50c08aa7-aa027627_0] Write session: try to update token
2025-10-10T14:08:52.548716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6082225a-d0113428-50c08aa7-aa027627_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:52.558763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:52.558805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:52.558843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.558983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:52.561415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:52.562169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:52.563473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:52.564984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:52.566294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:52.569330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:52.570693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:52.570706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:52.570717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:52.570774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:52.723268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:52.723304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:52.723316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:52.723374Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:52.723389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:52.723402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:52.723414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:52.723424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:52.723467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.723493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.723516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.723538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594841093148255:9429]
2025-10-10T14:08:52.723681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:52.723705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:52.723716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:52.723978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:52.724010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:52.724039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:52.724065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:52.727012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:52.772203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId: src_id|6082225a-d0113428-50c08aa7-aa027627_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:52.814334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:52.966564Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:52.968676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:52.968713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:52.974956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:52.978284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:52.978328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:52.978824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:52.979045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594842671071222:9722]
2025-10-10T14:08:52.984942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 793 reason: error at write: Disconnected sessionId: src_id|6082225a-d0113428-50c08aa7-aa027627_0
2025-10-10T14:08:52.985534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 793 sessionId: src_id|6082225a-d0113428-50c08aa7-aa027627_0 is DEAD
2025-10-10T14:08:52.993842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6082225a-d0113428-50c08aa7-aa027627_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:52.993895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6082225a-d0113428-50c08aa7-aa027627_0] Write session will restart in 0.005180s
2025-10-10T14:08:52.994010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6082225a-d0113428-50c08aa7-aa027627_0] Write session: Do CDS request
2025-10-10T14:08:52.994045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6082225a-d0113428-50c08aa7-aa027627_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:53.004172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:53.004221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 794
2025-10-10T14:08:53.005246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6082225a-d0113428-50c08aa7-aa027627_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:53.006060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:53.006202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:53.006218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:53.006227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:53.007812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 794 sessionId:  describe result for acl check
2025-10-10T14:08:53.007930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:53.007939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:53.007949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:53.007966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594846966038556:5194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:53.010977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594846966038556:5194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:53.037549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594846966038556:5194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:53.051642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594846966038556:5194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:53.051686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594846966038556:5194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:53.051704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594846966038556:5194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:53.051736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:53.079348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594846966038628:9722]
2025-10-10T14:08:53.109713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:53.122408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:53.123369Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:53.123390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:53.123439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:53.123718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:53.123914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594845388115708:9437]
2025-10-10T14:08:53.130258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:53.134133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:53.134413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:53.135660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:53.135993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:53.136002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:53.136009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:53.136017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:53.136024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:53.136029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:53.136036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:53.136042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:53.136049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.136057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.136063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.136069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.136116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:53.136220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:53.136271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:53.136316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:53.136357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:53.136419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:53.136461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:53.136502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:53.136543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.136586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.136625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.136669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.136712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:53.136775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:53.136831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:53.136884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:53.136931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:53.136983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:53.137027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:53.137075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:53.138064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:53.138153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:53.138206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:53.138258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:53.138304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:53.138355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:53.138399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:53.138447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:53.138494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.138544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.138590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.138639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.138685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.138738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.138781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.138832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.139247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:53.188759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:53.202562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:53.202618Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:53.202638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:53.202659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:53.202687Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 793 [2:7559594845388115708:9437]
2025-10-10T14:08:53.202743Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:53.202808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:53.202828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:53.202841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:53.202851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:53.202902Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:53.202925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:53.202948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:53.231465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.231502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.231513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.231527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.231538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:53.231826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:53.231841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.231971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.232138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.232343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.232454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:53.232530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.232544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.232558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.232571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.232618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:53.232699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:53.232865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:53.232881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:53.233015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.233034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:53.235360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:53.235386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:53.235397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:53.235409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:53.235434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:53.235881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594846966038590:5194], now have 1 active actors on pipe
2025-10-10T14:08:53.235912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594842671071251:2442], now have 1 active actors on pipe
2025-10-10T14:08:53.235930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594846966038628:9722], now have 1 active actors on pipe
2025-10-10T14:08:53.236482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 793
2025-10-10T14:08:53.236574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 793, pipe: [1:7559594846966038628:9722]
2025-10-10T14:08:53.236652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 793
2025-10-10T14:08:53.237012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:53.237044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:53.237147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:53.237184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:53.237201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:53.237212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:53.237248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:53.237293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:53.237352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:53.238777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:53.238806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:53.238876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:53.239304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 794 partition: 0 MaxSeqNo: 36 sessionId: src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0
2025-10-10T14:08:53.241826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6082225a-d0113428-50c08aa7-aa027627_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:53.290128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0] Write session: try to update token
2025-10-10T14:08:53.290185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:53.305475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:53.305525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:53.305537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:53.455733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:53.455771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:53.455784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:53.455795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:53.455805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:53.455840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.455866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.455889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.455910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.456126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:53.456138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:53.456150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:53.456195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:53.456202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:53.456220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.456230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:53.456230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:53.456258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:53.456297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:53.465389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:53.478294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId: src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:53.514944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:53.626609Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:53.646821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:53.646874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:53.646942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:53.646954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:53.646992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594845388115703:9437]
2025-10-10T14:08:53.647300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:53.648988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:53.649016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:53.654038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:53.667322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:08:53.667376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-10T14:08:53.667426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:53.667468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-10-10T14:08:53.667579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594846966038628:9722]
2025-10-10T14:08:53.667655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 794 reason: error at write: Disconnected sessionId: src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0
2025-10-10T14:08:53.667995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 794 sessionId: src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0 is DEAD
2025-10-10T14:08:53.673357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:53.673394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0] Write session will restart in 0.009376s
2025-10-10T14:08:53.673497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0] Write session: Do CDS request
2025-10-10T14:08:53.673526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:53.689278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:53.704335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:53.709197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 795
2025-10-10T14:08:53.715460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:53.715621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:53.715638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:53.715649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:53.717057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 795 sessionId:  describe result for acl check
2025-10-10T14:08:53.717201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:53.717212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:53.717222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:53.717241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594846966038744:5174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:53.719230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594846966038744:5174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:53.726658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594846966038744:5174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:53.739052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594846966038744:5174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:53.739092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594846966038744:5174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:53.739110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594846966038744:5174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:53.739141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:53.767979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594846966038829:9722]
2025-10-10T14:08:53.806227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:53.833463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:53.834297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:53.834315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:53.834360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:53.834602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:53.834778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594845388115849:9440]
2025-10-10T14:08:53.836813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:53.838153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:53.838356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:53.839665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:53.839966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:53.839973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:53.839979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:53.839985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:53.839993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:53.839999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:53.840004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:53.840011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:53.840016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.840023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.840029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.840035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.840076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:53.840174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:53.840216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:53.840257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:53.840295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:53.840335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:53.840375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:53.840415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:53.840454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.840496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.840533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.840574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.840609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:53.840668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:53.840717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:53.840765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:53.840808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:53.840855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:53.840896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:53.840943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:53.840985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:53.841035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:53.841773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:53.841842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:53.841889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:53.841939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:53.841976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:53.842023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:53.842069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.842116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:53.842156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.842203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:53.842246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.842292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:53.842332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.842377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:53.842761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:53.920069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:53.954943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:53.954982Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:53.954996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:53.955016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:53.955037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 794 [2:7559594845388115849:9440]
2025-10-10T14:08:53.955086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:53.955139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:53.955150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:53.955161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:53.955185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:53.955227Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:53.955248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:53.955267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:54.012838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:54.012885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:54.012899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:54.012913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:54.012925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:54.013288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:54.013329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:54.013464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:54.013633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:54.013854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:54.013960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:54.014048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594846966038733:2442], now have 1 active actors on pipe
2025-10-10T14:08:54.014071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594846966038781:5174], now have 1 active actors on pipe
2025-10-10T14:08:54.014091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594846966038829:9722], now have 1 active actors on pipe
2025-10-10T14:08:54.014119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.014132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.014145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.014157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.014188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:54.014218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:54.014231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:54.014241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:54.014253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:54.014272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:54.014435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:54.014451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:54.014579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.014608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:54.015307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:54.017968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 794, pipe: [1:7559594846966038829:9722]
2025-10-10T14:08:54.018125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 794
2025-10-10T14:08:54.018218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 794
2025-10-10T14:08:54.020423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:54.020466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:54.020593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46a1271-1f634e91-3be7c34c-fa142d35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:54.020625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:54.020643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:54.020654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:54.020693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:54.020739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:54.020888Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 71283424 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:08:54.020973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:54.021908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 19 DataSize: 71283424 UsedReserveSize: 0
2025-10-10T14:08:54.022047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:08:54.023184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:54.023219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:54.023284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:54.023651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 795 partition: 0 MaxSeqNo: 36 sessionId: src_id|46a1271-1f634e91-3be7c34c-fa142d35_0
2025-10-10T14:08:54.032246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e419be99-d1fb39e4-be07ff36-b9eef74_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|46a1271-1f634e91-3be7c34c-fa142d35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:54.057217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:54.057247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:54.057255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:54.085740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a1271-1f634e91-3be7c34c-fa142d35_0] Write session: try to update token
2025-10-10T14:08:54.085796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a1271-1f634e91-3be7c34c-fa142d35_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:54.188249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:54.188290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:54.188306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:54.188316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:54.188327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:54.188365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.188394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.188419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.188442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.188619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:54.188648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:54.188659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:54.192458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:54.192524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:54.192560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:54.192591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:54.244286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:54.244406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:54.244425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:54.245611Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:54.356326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId: src_id|46a1271-1f634e91-3be7c34c-fa142d35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:54.434578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:54.734247Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:54.736077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:54.736108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:54.736158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594845388115837:9440]
2025-10-10T14:08:54.736311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:54.737160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:54.736337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:54.736488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:54.737334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:54.737373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:54.737346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:54.738836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594846966038829:9722]
2025-10-10T14:08:54.791176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 795 reason: error at write: Disconnected sessionId: src_id|46a1271-1f634e91-3be7c34c-fa142d35_0
2025-10-10T14:08:54.792099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a1271-1f634e91-3be7c34c-fa142d35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:54.792131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a1271-1f634e91-3be7c34c-fa142d35_0] Write session will restart in 0.006211s
2025-10-10T14:08:54.792229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a1271-1f634e91-3be7c34c-fa142d35_0] Write session: Do CDS request
2025-10-10T14:08:54.792274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a1271-1f634e91-3be7c34c-fa142d35_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:54.793059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 795 sessionId: src_id|46a1271-1f634e91-3be7c34c-fa142d35_0 is DEAD
2025-10-10T14:08:54.804058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46a1271-1f634e91-3be7c34c-fa142d35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:54.804580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:54.804612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 796
2025-10-10T14:08:54.805046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:54.805190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:54.805206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:54.805217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:54.806851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 796 sessionId:  describe result for acl check
2025-10-10T14:08:54.806966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:54.806978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:54.806988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:54.807005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594851261006225:5155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:54.815326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594851261006225:5155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:54.842536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594851261006298:9722]
2025-10-10T14:08:54.849629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594851261006225:5155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:54.879920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:54.896644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594851261006225:5155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:54.896690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594851261006225:5155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:54.896706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594851261006225:5155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:54.896738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:54.897988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:54.905597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:54.905641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:54.905711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:54.906111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:54.906315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594849683083299:9458]
2025-10-10T14:08:54.908299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:54.913419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:54.913701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:54.914933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:54.915233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:54.915241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:54.915248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:54.915254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:54.915260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:54.915265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:54.915271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:54.915277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:54.915283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:54.915290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:54.915296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:54.915302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:54.915342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:54.915438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:54.915479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:54.915520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:54.915558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:54.915597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:54.915634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:54.915669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:54.915705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:54.915742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:54.915780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:54.915817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:54.915855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:54.915921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:54.915974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:54.916019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:54.916060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:54.916107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:54.916143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:54.916187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:54.916227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:54.916271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:54.916309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:54.916352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:54.916389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:54.916434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:54.916472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:54.916517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:54.916555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:54.916598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:54.916636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:54.916682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:54.916722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:54.916768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:54.916805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:54.916849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:54.918226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:54.966695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:55.002463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:55.002510Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:55.002524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:55.002543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:55.002568Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 795 [2:7559594849683083299:9458]
2025-10-10T14:08:55.002621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:55.002681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:55.002695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:55.002707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:55.002717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:55.002762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:55.002786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:55.002808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:55.031627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.031655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:55.031663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:55.031672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:55.031681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:55.031949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:55.031962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.032077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:55.032216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:55.032402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:55.032494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:55.032569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.032583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.032595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.032608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.032649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:55.032725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:55.032876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:55.032893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:55.033015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.033033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:55.033310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:55.033322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:55.033332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:55.033341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:55.033364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:55.035726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594851261006199:2442], now have 1 active actors on pipe
2025-10-10T14:08:55.035764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594851261006329:5155], now have 1 active actors on pipe
2025-10-10T14:08:55.035784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594851261006298:9722], now have 1 active actors on pipe
2025-10-10T14:08:55.035841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:55.035861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:55.035936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f11123e-fa92af1a-109186a-46a03af7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:55.035971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:55.035989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:55.035999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:55.036034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:55.036080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:55.036123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:55.037242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:55.037276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:55.037354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:55.038451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46a1271-1f634e91-3be7c34c-fa142d35_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|3f11123e-fa92af1a-109186a-46a03af7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:55.035222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 795
2025-10-10T14:08:55.035316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 795
2025-10-10T14:08:55.035371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 795, pipe: [1:7559594851261006298:9722]
2025-10-10T14:08:55.037665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 796 partition: 0 MaxSeqNo: 36 sessionId: src_id|3f11123e-fa92af1a-109186a-46a03af7_0
2025-10-10T14:08:55.091130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f11123e-fa92af1a-109186a-46a03af7_0] Write session: try to update token
2025-10-10T14:08:55.091190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f11123e-fa92af1a-109186a-46a03af7_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:55.104436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:55.104474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:55.104485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:55.227342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:55.227383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:55.227394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:55.227404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:55.227414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:55.227446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.227473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.227497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.227517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.227756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:55.227768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:55.227784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:55.227835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:55.227864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.227880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:55.228277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:55.228307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:55.228336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:55.228362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:55.228893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:55.276016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId: src_id|3f11123e-fa92af1a-109186a-46a03af7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:55.307557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:55.376332Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:55.388969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:55.389022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:55.389100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:55.389116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:55.389179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594849683083293:9458]
2025-10-10T14:08:55.389445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:55.389852Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:55.393886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:55.394053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:55.396966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594851261006298:9722]
2025-10-10T14:08:55.403482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 796 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3f11123e-fa92af1a-109186a-46a03af7_0
2025-10-10T14:08:55.403839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 796 sessionId: src_id|3f11123e-fa92af1a-109186a-46a03af7_0 is DEAD
2025-10-10T14:08:55.409367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f11123e-fa92af1a-109186a-46a03af7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:55.409430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f11123e-fa92af1a-109186a-46a03af7_0] Write session will restart in 0.008447s
2025-10-10T14:08:55.409538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f11123e-fa92af1a-109186a-46a03af7_0] Write session: Do CDS request
2025-10-10T14:08:55.409581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f11123e-fa92af1a-109186a-46a03af7_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:55.425756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f11123e-fa92af1a-109186a-46a03af7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:55.429337Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:55.429375Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 797
2025-10-10T14:08:55.431915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:55.432073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:55.432090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:55.432103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:55.435722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 797 sessionId:  describe result for acl check
2025-10-10T14:08:55.435848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:55.435859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:55.435869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:55.435884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594855555973670:5132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:55.438732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594855555973670:5132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:55.458124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594855555973670:5132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:55.484015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594855555973670:5132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:55.484062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594855555973670:5132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:55.484080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594855555973670:5132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:55.484114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:55.494511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594855555973775:9722]
2025-10-10T14:08:55.510648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:55.516329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:55.517835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:55.517871Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:55.517924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:55.518301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:55.518519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594853978050729:9463]
2025-10-10T14:08:55.521003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:55.522278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:55.522526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:55.523898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:55.524244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:55.524254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:55.524262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:55.524270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:55.524277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:55.524285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:55.524294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:55.524302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:55.524310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.524319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:55.524327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:55.524336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:55.524776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:55.524909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:55.524968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:55.525023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:55.525074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:55.525143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:55.525202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:55.525254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:55.525320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.525372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:55.525424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:55.525475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:55.525526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:55.525604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:55.525674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:55.525734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:55.525788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:55.525849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:55.525900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:55.525961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:55.526018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:55.526078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:55.526129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:55.526189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:55.526244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:55.526304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:55.526357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:55.526418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:55.526472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.526529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.526581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:55.526642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:55.526696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:55.526754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:55.526801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:55.526863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:55.527355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:55.570190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:55.604286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:55.604343Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:55.604363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:55.604386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:55.604411Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 796 [2:7559594853978050729:9463]
2025-10-10T14:08:55.604477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:55.604544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:55.604579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:55.604591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:55.604603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:55.604653Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:55.604677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:55.604699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:55.606346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.606379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:55.606396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:55.606411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:55.606423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:55.606750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:55.606779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.606937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:55.607124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:55.607327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:55.607417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:55.607482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594855555973660:2442], now have 1 active actors on pipe
2025-10-10T14:08:55.607500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594855555973775:9722], now have 1 active actors on pipe
2025-10-10T14:08:55.607517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594855555973750:5132], now have 1 active actors on pipe
2025-10-10T14:08:55.607537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.607547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.607558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.607567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.607598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:55.607648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:55.607657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:55.607664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:55.607687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:55.607700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:55.607809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:55.607823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:55.607922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.607941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:55.607983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:55.610439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 796
2025-10-10T14:08:55.610524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 796, pipe: [1:7559594855555973775:9722]
2025-10-10T14:08:55.610603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 796
2025-10-10T14:08:55.611045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:55.611088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:55.611172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0728c16-e0485c22-13111f85-fecef965_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:55.611207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:55.611228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:55.611240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:55.611281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:55.611326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:55.611379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:55.613116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:55.613180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:55.613265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:55.617546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 797 partition: 0 MaxSeqNo: 36 sessionId: src_id|b0728c16-e0485c22-13111f85-fecef965_0
2025-10-10T14:08:55.621943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f11123e-fa92af1a-109186a-46a03af7_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|b0728c16-e0485c22-13111f85-fecef965_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:55.665542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0728c16-e0485c22-13111f85-fecef965_0] Write session: try to update token
2025-10-10T14:08:55.665605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0728c16-e0485c22-13111f85-fecef965_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:55.708395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:55.708440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:55.708478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.708653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:55.716614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:55.716665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:55.716677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:55.716774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:08:55.726970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:08:55.728224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:55.737531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:55.738689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:08:55.740195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:08:55.740560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:08:55.861262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId: src_id|b0728c16-e0485c22-13111f85-fecef965_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:55.892225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:55.910200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:55.910241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:55.910254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:55.910315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:55.910329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:55.910343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:55.910354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:55.910364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:55.910409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.910437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.910460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.910485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594853978050724:9463]
2025-10-10T14:08:55.910689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:55.910717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:55.910753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:55.910781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:55.910792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:55.911866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:55.913371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:55.913405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:55.913434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:55.913462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:56.072869Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:56.109366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594855555973775:9722]
2025-10-10T14:08:56.109446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:56.109679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:56.109692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:56.117957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:56.140040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 797 reason: error at write: Disconnected sessionId: src_id|b0728c16-e0485c22-13111f85-fecef965_0
2025-10-10T14:08:56.140769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 797 sessionId: src_id|b0728c16-e0485c22-13111f85-fecef965_0 is DEAD
2025-10-10T14:08:56.146846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0728c16-e0485c22-13111f85-fecef965_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:56.146882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0728c16-e0485c22-13111f85-fecef965_0] Write session will restart in 0.008172s
2025-10-10T14:08:56.146989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0728c16-e0485c22-13111f85-fecef965_0] Write session: Do CDS request
2025-10-10T14:08:56.147018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0728c16-e0485c22-13111f85-fecef965_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:56.165488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0728c16-e0485c22-13111f85-fecef965_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:56.165520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:56.165552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 798
2025-10-10T14:08:56.169494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:56.169633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:56.169650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:56.169660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:56.174418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 798 sessionId:  describe result for acl check
2025-10-10T14:08:56.174553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:56.174565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:56.174575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:56.174592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594859850941126:5115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:56.177444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594859850941126:5115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:56.206536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594859850941126:5115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:56.210594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594859850941184:9722]
2025-10-10T14:08:56.228373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594859850941126:5115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:56.228416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594859850941126:5115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:56.228436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594859850941126:5115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:56.228465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:56.271852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:56.274722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:56.275701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:56.275722Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:56.275772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:56.276074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:56.276282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594858273018176:9473]
2025-10-10T14:08:56.281804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:56.289787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:56.290071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:56.291511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:56.291904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:56.291913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:56.291923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:56.291932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:56.291940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:56.291948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:56.291957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:56.291965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:56.291972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:56.291980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:56.291986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:56.291994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:56.292047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:56.292175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:56.292229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:56.292282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:56.292336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:56.292390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:56.292443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:56.292496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:56.292548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:56.292603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:56.292655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:56.292710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:56.292757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:56.292836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:56.292906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:56.292969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:56.293026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:56.293087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:56.293422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:56.293497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:56.293561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:56.293624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:56.293679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:56.293740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:56.293793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:56.293855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:56.293908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:56.293968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:56.294023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:56.294083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:56.294139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:56.294201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:56.294276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:56.294353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:56.294433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:56.294497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:56.295022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:56.333314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:56.366964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:56.367018Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:56.367039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:56.367059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:56.367083Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 797 [2:7559594858273018176:9473]
2025-10-10T14:08:56.367134Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:56.367183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:56.367193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:56.367202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:56.367211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:56.367248Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:56.367264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:56.367280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:56.368346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:56.368358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:56.368367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:56.368376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:56.368384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:56.368655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:56.368667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:56.368771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:56.368904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:56.370091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 797
2025-10-10T14:08:56.370184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 797
2025-10-10T14:08:56.370251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 797, pipe: [1:7559594859850941184:9722]
2025-10-10T14:08:56.369100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:56.369212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:56.369293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594859850941218:5115], now have 1 active actors on pipe
2025-10-10T14:08:56.369320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594859850941108:2442], now have 1 active actors on pipe
2025-10-10T14:08:56.369345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594859850941184:9722], now have 1 active actors on pipe
2025-10-10T14:08:56.369369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:56.369384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:56.369398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:56.369412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:56.369451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:56.369536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:56.369687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:56.369699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:56.369793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:56.369805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:56.370348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:56.370363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:56.370375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:56.370386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:56.370411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:56.372854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:56.372888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:56.373011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:56.373323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:56.373353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:56.373368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:56.373421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:56.373478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:56.373550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:56.381576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:56.381631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:56.381721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:56.382206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 798 partition: 0 MaxSeqNo: 36 sessionId: src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0
2025-10-10T14:08:56.385728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0728c16-e0485c22-13111f85-fecef965_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:56.428955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0] Write session: try to update token
2025-10-10T14:08:56.429014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:56.622031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:56.622067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:56.622081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:56.622143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:56.622158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:56.622171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:56.622182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:56.622193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:56.622229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:56.622257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:56.633829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:56.633926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:56.634172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:56.634200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:56.634211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:56.634468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:56.634505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:56.634533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:56.634559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:56.654144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:56.720466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId: src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:56.768534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:57.007324Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:57.097080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:57.097150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:57.097218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:57.097230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:57.097281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594858273018171:9473]
2025-10-10T14:08:57.101761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:57.101998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:57.103012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:57.103256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594859850941184:9722]
2025-10-10T14:08:57.103397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:57.103414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:57.125694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:57.125741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0] Write session will restart in 0.007879s
2025-10-10T14:08:57.122011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 798 reason: error at write: Disconnected sessionId: src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0
2025-10-10T14:08:57.122378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 798 sessionId: src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0 is DEAD
2025-10-10T14:08:57.125839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0] Write session: Do CDS request
2025-10-10T14:08:57.125870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:57.174565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:57.206534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594864145908595:9722]
2025-10-10T14:08:57.206580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:57.206593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 799
2025-10-10T14:08:57.212262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:57.212398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:57.212415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:57.212424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:57.214397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 799 sessionId:  describe result for acl check
2025-10-10T14:08:57.214501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:57.214511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:57.214519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:57.214533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594864145908604:5090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:57.216865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594864145908604:5090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:57.238185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594864145908604:5090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:57.270442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594864145908604:5090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:57.270490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594864145908604:5090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:57.270508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594864145908604:5090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:57.270539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:57.287729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:57.294506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:57.295673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:57.295695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:57.295747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:57.296061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:57.296294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594862567985636:9481]
2025-10-10T14:08:57.298715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:57.300331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:57.300613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:57.302313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:57.302746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:57.302770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:57.302779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:57.302788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:57.302795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:57.302805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:57.302814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:57.302821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:57.302829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:57.302837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:57.302844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:57.302852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:57.302909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:57.303035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:57.303099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:57.303161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:57.303219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:57.303273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:57.303329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:57.303391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:57.303446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:57.303508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:57.303562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:57.303611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:57.303657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:57.303733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:57.303798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:57.303861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:57.303916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:57.303977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:57.304032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:57.304092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:57.304145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:57.304213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:57.304267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:57.304339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:57.304395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:57.304454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:57.304509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:57.304568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:57.304622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:57.304680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:57.304731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:57.304792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:57.304844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:57.304901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:57.304954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:57.305011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:57.306819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:57.390178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:57.414465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:57.414521Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:57.414542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:57.414564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:57.414589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 798 [2:7559594862567985636:9481]
2025-10-10T14:08:57.414655Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:57.414720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:57.414737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:57.414751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:57.414763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:57.414814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:57.414838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:57.414862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:57.416241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:57.416261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:57.416278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:57.416294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:57.416307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:57.416600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:57.416621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:57.416787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:57.417006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:57.417919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:57.418085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:57.418184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594864145908595:9722], now have 1 active actors on pipe
2025-10-10T14:08:57.418211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594864145908582:2442], now have 1 active actors on pipe
2025-10-10T14:08:57.418239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594864145908709:5090], now have 1 active actors on pipe
2025-10-10T14:08:57.418272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:57.418291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:57.418306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:57.418322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:57.418369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:57.418459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:57.418662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:57.418680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:57.418813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:57.418833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:57.418974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:57.419003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:57.419016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:57.419029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:57.419068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:57.423229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 798, pipe: [1:7559594864145908595:9722]
2025-10-10T14:08:57.423349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 798
2025-10-10T14:08:57.423459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 798
2025-10-10T14:08:57.424022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:57.424081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:57.424200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7442490-eb1102d9-13d6ca23-c42af30a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:57.424237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:57.424257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:57.424271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:57.424312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:57.424361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:57.424419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:57.425516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:57.425559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:57.425636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:57.426042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 799 partition: 0 MaxSeqNo: 36 sessionId: src_id|7442490-eb1102d9-13d6ca23-c42af30a_0
2025-10-10T14:08:57.432883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f91765e8-bddb5f3c-f4a2018d-dfbc48c3_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7442490-eb1102d9-13d6ca23-c42af30a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:57.487602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7442490-eb1102d9-13d6ca23-c42af30a_0] Write session: try to update token
2025-10-10T14:08:57.487668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7442490-eb1102d9-13d6ca23-c42af30a_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:57.664005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:57.664048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:57.664060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:57.664122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:57.664138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:57.664151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:57.664161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:57.664173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:57.664209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:57.664235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:57.664262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:57.664285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:57.664483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:57.664510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:57.664522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:57.665682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:57.665723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:57.665753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:57.665793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:57.669930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:57.698500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId: src_id|7442490-eb1102d9-13d6ca23-c42af30a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:57.748026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:58.011067Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:58.097612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:58.097667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:58.097740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:58.097755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:58.097800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594862567985631:9481]
2025-10-10T14:08:58.098242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:58.102080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:58.102368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594864145908595:9722]
2025-10-10T14:08:58.102439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:58.102550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:58.102560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:58.201277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594868440876061:9722]
2025-10-10T14:08:58.266870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 799 reason: error at write: Disconnected sessionId: src_id|7442490-eb1102d9-13d6ca23-c42af30a_0
2025-10-10T14:08:58.267225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 799 sessionId: src_id|7442490-eb1102d9-13d6ca23-c42af30a_0 is DEAD
2025-10-10T14:08:58.269722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442490-eb1102d9-13d6ca23-c42af30a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:58.269756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442490-eb1102d9-13d6ca23-c42af30a_0] Write session will restart in 0.008483s
2025-10-10T14:08:58.269847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442490-eb1102d9-13d6ca23-c42af30a_0] Write session: Do CDS request
2025-10-10T14:08:58.269874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442490-eb1102d9-13d6ca23-c42af30a_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:58.294380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7442490-eb1102d9-13d6ca23-c42af30a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:58.303667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:58.303707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 800
2025-10-10T14:08:58.309324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:58.309482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:58.309499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:58.309511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:58.314378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 800 sessionId:  describe result for acl check
2025-10-10T14:08:58.314501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:58.314511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:58.314521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:58.314538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594868440876143:5070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:58.316558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:58.316998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594868440876143:5070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:58.322059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:58.323165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:58.323193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:58.323237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:58.323507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:58.323713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594866862953086:9493]
2025-10-10T14:08:58.325903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:58.340766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:58.341053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:58.342457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:58.342780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:58.342787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:58.342794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:58.342801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:58.342808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:58.342815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:58.342823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:58.342829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:58.342836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:58.342843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:58.342849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:58.342855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:58.342902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:58.349469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:58.349541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:58.349585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:58.349629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:58.349673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:58.349717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:58.349762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:58.349805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:58.349853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:58.349895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:58.349935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:58.349981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:58.350045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:58.350100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:58.350150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:58.350196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:58.350246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:58.350289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:58.350339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:58.350402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:58.350452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:58.350494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:58.350545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:58.350591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:58.350642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:58.350684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:58.350732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:58.350778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:58.350829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:58.350873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:58.350923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:58.350966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:58.351015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:58.351056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:58.351106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:58.351501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:58.354175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594868440876143:5070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:58.398955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594868440876143:5070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:58.398995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594868440876143:5070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:58.399014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594868440876143:5070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:58.399051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:58.408423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:58.483694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:58.484057Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:58.489362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:58.489405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:58.489442Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 799 [2:7559594866862953086:9493]
2025-10-10T14:08:58.489497Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:58.489556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:58.489570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:58.489584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:58.489594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:58.489646Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:58.489669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:58.489691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:58.490952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:58.490967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:58.490982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:58.490995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:58.491007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:58.491283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:58.491300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:58.491433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:58.491610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:58.491827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:58.491936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:58.492008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594866862953081:9493]
2025-10-10T14:08:58.492023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594866862953081:9493]
2025-10-10T14:08:58.492036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594866862953081:9493]
2025-10-10T14:08:58.492048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594866862953081:9493]
2025-10-10T14:08:58.492092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:58.492171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:58.492341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:58.492357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:58.492486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594866862953081:9493]
2025-10-10T14:08:58.492505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:58.495666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 799
2025-10-10T14:08:58.495751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 799
2025-10-10T14:08:58.495814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 799, pipe: [1:7559594868440876061:9722]
2025-10-10T14:08:58.493405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:58.493434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:58.493445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:58.493457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:58.493480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:58.498256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594868440876186:5070], now have 1 active actors on pipe
2025-10-10T14:08:58.498301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594868440876047:2442], now have 1 active actors on pipe
2025-10-10T14:08:58.498325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594868440876061:9722], now have 1 active actors on pipe
2025-10-10T14:08:58.498388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:58.498412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:58.498510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18a17d4d-330d9577-9d08d019-a9927775_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:58.498545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:58.498566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:58.498576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:58.498615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:58.498675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:58.498727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:58.506447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 800 partition: 0 MaxSeqNo: 36 sessionId: src_id|18a17d4d-330d9577-9d08d019-a9927775_0
2025-10-10T14:08:58.505927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:58.505977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:58.506072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:58.509756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7442490-eb1102d9-13d6ca23-c42af30a_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|18a17d4d-330d9577-9d08d019-a9927775_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:58.582621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18a17d4d-330d9577-9d08d019-a9927775_0] Write session: try to update token
2025-10-10T14:08:58.582678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18a17d4d-330d9577-9d08d019-a9927775_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:58.589159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:58.589209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:58.589244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:58.686193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:58.686236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:58.686251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:58.686265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:58.686278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:58.686318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594866862953081:9493]
2025-10-10T14:08:58.686347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594866862953081:9493]
2025-10-10T14:08:58.686376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594866862953081:9493]
2025-10-10T14:08:58.686401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594866862953081:9493]
2025-10-10T14:08:58.686531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:58.686554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:58.686591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:58.686593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:58.686606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:58.686625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:58.686657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:58.691134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:58.777890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId: src_id|18a17d4d-330d9577-9d08d019-a9927775_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:58.799285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:58.863295Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:58.866286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:58.866333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:58.874304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:08:58.874332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:08:58.877819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:58.944636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:58.944789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594868440876061:9722]
2025-10-10T14:08:58.944858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 800 reason: error at write: Disconnected sessionId: src_id|18a17d4d-330d9577-9d08d019-a9927775_0
2025-10-10T14:08:58.945437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 800 sessionId: src_id|18a17d4d-330d9577-9d08d019-a9927775_0 is DEAD
2025-10-10T14:08:58.947345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a17d4d-330d9577-9d08d019-a9927775_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:08:58.947430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a17d4d-330d9577-9d08d019-a9927775_0] Write session will restart in 0.005234s
2025-10-10T14:08:58.947565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a17d4d-330d9577-9d08d019-a9927775_0] Write session: Do CDS request
2025-10-10T14:08:58.947617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a17d4d-330d9577-9d08d019-a9927775_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:58.964050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18a17d4d-330d9577-9d08d019-a9927775_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:58.970219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:58.970251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 801
2025-10-10T14:08:58.970643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:58.970751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:58.970766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:58.970776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:58.976724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 801 sessionId:  describe result for acl check
2025-10-10T14:08:58.976854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:58.976865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:58.976873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:58.976891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594868440876254:5059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:58.979999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594868440876254:5059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:58.989419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594868440876254:5059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:59.002597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594868440876254:5059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:59.002649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594868440876254:5059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:59.002665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594868440876254:5059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:59.002694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:59.006053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:59.015044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:59.015912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:59.015930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:59.015974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:59.016209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:59.016373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594871157920534:9501]
2025-10-10T14:08:59.026280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:59.027377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:59.027567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:59.028814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:59.029143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:59.029151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:59.029158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:59.029163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:59.029170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:59.029178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:59.029183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:59.029189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:59.029194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.029200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.029206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.029212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.029272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:59.029368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:59.029412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:59.029456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:59.029497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:59.029538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:59.029580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:59.029623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:59.029663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.029706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.029748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.029787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.029822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:59.029878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:59.029935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:59.029987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:59.030033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:59.030078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:59.030120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:59.030170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:59.030213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:59.030260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:59.030301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:59.030351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:59.030394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:59.030441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:59.030486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:59.030533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:59.030576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.030627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.030665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.030714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.030757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.030807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.030847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.030899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.031302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:59.043931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594872735843647:9722]
2025-10-10T14:08:59.093637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:59.134688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:59.134749Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:59.134769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:59.134793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:59.134817Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 800 [2:7559594871157920534:9501]
2025-10-10T14:08:59.134883Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:59.134950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:59.134967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:59.134980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:59.134992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:59.135045Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:59.135068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:59.135092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:59.136535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.136553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.136570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.136585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.136597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:59.136885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:59.136904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.137061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.137835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.138103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.138237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:59.138328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594868440876216:2442], now have 1 active actors on pipe
2025-10-10T14:08:59.138355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594872735843647:9722], now have 1 active actors on pipe
2025-10-10T14:08:59.138378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594872735843628:5059], now have 1 active actors on pipe
2025-10-10T14:08:59.138404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.138419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.138434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.138449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.138491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:59.138581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:59.138778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:59.138794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:59.138932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.138956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:59.139495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:59.139520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:59.139535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:59.139549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:59.139572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:59.142626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 800
2025-10-10T14:08:59.142746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 800, pipe: [1:7559594872735843647:9722]
2025-10-10T14:08:59.142831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 800
2025-10-10T14:08:59.153508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:59.153567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:59.153655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:59.153691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:59.153711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:59.153723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:59.153761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:59.153809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:59.153863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:59.156247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:59.156288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:59.156367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:59.161409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 801 partition: 0 MaxSeqNo: 36 sessionId: src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0
2025-10-10T14:08:59.162537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a17d4d-330d9577-9d08d019-a9927775_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:59.199121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0] Write session: try to update token
2025-10-10T14:08:59.199187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:59.300652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:08:59.300686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:59.300699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:08:59.300708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:08:59.300716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:08:59.300750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.300771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.300792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.300810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.300976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:59.300990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:59.301004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:59.301114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:08:59.301155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.301165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:08:59.301927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:08:59.301961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:08:59.301986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:08:59.302008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:08:59.302597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:08:59.326052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId: src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:08:59.366704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:08:59.455302Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:08:59.472968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:59.473031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:59.473110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:08:59.473122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:08:59.473178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594871157920527:9501]
2025-10-10T14:08:59.473459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:08:59.474654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:08:59.477936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:08:59.478269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594872735843647:9722]
2025-10-10T14:08:59.478449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:08:59.478524Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 closed with error: reason# too much attempts to restart pipe
2025-10-10T14:08:59.479099Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 8 consumer shared/user session shared/user_1_8_1343463284912049680_v1 is DEAD
2025-10-10T14:08:59.481507Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559594602152885765:9719] disconnected; active server actors: 1
2025-10-10T14:08:59.481574Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559594602152885765:9719] client user disconnected session shared/user_1_8_1343463284912049680_v1
2025-10-10T14:08:59.483087Z :ERROR: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-10T14:08:59.483806Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:08:59.483865Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:08:59.483931Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Reconnecting session to cluster  in 0.005126s
2025-10-10T14:08:59.488025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 801 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0
2025-10-10T14:08:59.488349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 801 sessionId: src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0 is DEAD
2025-10-10T14:08:59.493317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:08:59.493355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0] Write session will restart in 0.009318s
2025-10-10T14:08:59.493451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0] Write session: Do CDS request
2025-10-10T14:08:59.493478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:08:59.497621Z :DEBUG: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Successfully connected. Initializing session
2025-10-10T14:08:59.514769Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:08:59.514794Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 9
2025-10-10T14:08:59.520509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:59.521556Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 9 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:08:59.521834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:08:59.521853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 802
2025-10-10T14:08:59.521854Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 read init: from# ipv6:[::1]:40068, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:08:59.522156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:08:59.522239Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 auth for : user
2025-10-10T14:08:59.522260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:08:59.522274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:08:59.522283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:08:59.527349Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 Handle describe topics response
2025-10-10T14:08:59.527500Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 auth is DEAD
2025-10-10T14:08:59.527572Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:08:59.529708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 802 sessionId:  describe result for acl check
2025-10-10T14:08:59.529902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:08:59.529927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:08:59.529956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:08:59.529991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594872735843682:5041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:08:59.541991Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:08:59.542407Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559594872735843683:5043] connected; active server actors: 1
2025-10-10T14:08:59.542512Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7559594872735843683:5043] session shared/user_1_9_10373462377834257282_v1
2025-10-10T14:08:59.542551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:08:59.542604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:08:59.542646Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_9_10373462377834257282_v1" (Sender=[1:7559594872735843676:5043], Pipe=[1:7559594872735843683:5043], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:08:59.542673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:08:59.542725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:08:59.542775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_9_10373462377834257282_v1" (Sender=[1:7559594872735843676:5043], Pipe=[1:7559594872735843683:5043], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:08:59.542834Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_9_10373462377834257282_v1" sender [1:7559594872735843676:5043] lock partition 0 for ReadingSession "shared/user_1_9_10373462377834257282_v1" (Sender=[1:7559594872735843676:5043], Pipe=[1:7559594872735843683:5043], Partitions=[], ActiveFamilyCount=1) generation 1 step 9
2025-10-10T14:08:59.542880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:08:59.542908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000160s
2025-10-10T14:08:59.543753Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 9 Session: "shared/user_1_9_10373462377834257282_v1" ClientId: "user" PipeClient { RawX1: 7559594872735843683 RawX2: 4503603922342835 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:08:59.543840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:08:59.545435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594872735843682:5041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:08:59.549272Z :INFO: [/Root] [/Root] [2cbafd20-1be055a9-ca1e98d7-27fb42] [] Got InitResponse. ReadSessionId: shared/user_1_9_10373462377834257282_v1
2025-10-10T14:08:59.558227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594872735843682:5041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:08:59.575146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594872735843682:5041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:08:59.575190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594872735843682:5041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:08:59.575209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594872735843682:5041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:08:59.575263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:08:59.621451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:08:59.623956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:08:59.624886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:08:59.624924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:08:59.624969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:08:59.625295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:08:59.625493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594871157920690:9507]
2025-10-10T14:08:59.627831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:08:59.630729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:08:59.631008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:08:59.632087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:08:59.632347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:59.632360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:59.632365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:59.632371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:59.632376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:59.632381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:59.632386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:59.632390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:59.632395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.632400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.632404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.632409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.632446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:59.632539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:59.632580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:59.632616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:59.632656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:59.632695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:59.632731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:59.632767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:59.632804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.632838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.632875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.632909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.632935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:59.632986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:08:59.633029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:59.633072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:08:59.633107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:59.633187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:08:59.633237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:59.633277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:08:59.633310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:59.633349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:08:59.633380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:59.633418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:08:59.633449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:59.633488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:08:59.633519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:59.633555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:08:59.633587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.633624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.633662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.633717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.633765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.633819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.633865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.633935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.634442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:08:59.691016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:08:59.707822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:08:59.707877Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:08:59.707895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:08:59.707915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:08:59.707939Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 801 [2:7559594871157920690:9507]
2025-10-10T14:08:59.707996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:08:59.708055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:08:59.708069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:59.708082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:59.708093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:59.708142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:08:59.708164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:08:59.708186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:08:59.719355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.719398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.719414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.719428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.719439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:08:59.719733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:08:59.719751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:08:59.719901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:08:59.720087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:08:59.720324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:08:59.720442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:08:59.720513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594871157920685:9507]
2025-10-10T14:08:59.720530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594871157920685:9507]
2025-10-10T14:08:59.720545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594871157920685:9507]
2025-10-10T14:08:59.720559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594871157920685:9507]
2025-10-10T14:08:59.720604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:08:59.720690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:08:59.720871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:08:59.720889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:08:59.721016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594871157920685:9507]
2025-10-10T14:08:59.721036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:08:59.721844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:08:59.721871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:08:59.721884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:08:59.721898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:08:59.721921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:08:59.724070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 801
2025-10-10T14:08:59.724194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 801
2025-10-10T14:08:59.724324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 801, pipe: [1:7559594872735843686:5037]
2025-10-10T14:08:59.725047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594872735843686:5037], now have 1 active actors on pipe
2025-10-10T14:08:59.725085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594872735843660:2442], now have 1 active actors on pipe
2025-10-10T14:08:59.725110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594872735843759:5041], now have 1 active actors on pipe
2025-10-10T14:08:59.725242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:59.725268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:59.725333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:59.725347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:59.725380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_9_10373462377834257282_v1 on pipe: [1:7559594872735843686:5037]
2025-10-10T14:08:59.725461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ffd2068-132194df-6c4f1272-d0256a45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:08:59.725492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:59.725511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:59.725523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:59.725561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:59.725606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:08:59.725651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:59.725673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:59.725682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:08:59.725745Z node 2 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_9_10373462377834257282_v1
2025-10-10T14:08:59.725757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:59.725883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:59.725942Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:08:59.726411Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_9_10373462377834257282_v1:1 with generation 801
2025-10-10T14:08:59.729254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:08:59.729294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:08:59.729371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:08:59.729771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 802 partition: 0 MaxSeqNo: 36 sessionId: src_id|7ffd2068-132194df-6c4f1272-d0256a45_0
2025-10-10T14:08:59.733260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f8dee85-1fe6658-3796a757-3a71fe75_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|7ffd2068-132194df-6c4f1272-d0256a45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:08:59.742473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:08:59.742556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:08:59.742581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:59.742593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:59.742605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:59.742638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-10T14:08:59.742676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:08:59.745400Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 36 WriteTimestampMS: 1760104766000 SizeLag: 18742722 WriteTimestampEstimateMS: 1760105339725 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:08:59.745463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 36 readOffset 0 committedOffset 0
2025-10-10T14:08:59.745567Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 sending to client partition status
2025-10-10T14:08:59.806113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffd2068-132194df-6c4f1272-d0256a45_0] Write session: try to update token
2025-10-10T14:08:59.806176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffd2068-132194df-6c4f1272-d0256a45_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:08:59.809384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:59.809424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:59.809435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:08:59.917301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:08:59.917347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:08:59.917359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:00.007379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId: src_id|7ffd2068-132194df-6c4f1272-d0256a45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:09:00.071080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:00.071122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:00.071132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:00.071240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:00.071253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:00.071263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:00.071274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:00.071284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:00.071317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594871157920685:9507]
2025-10-10T14:09:00.071340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594871157920685:9507]
2025-10-10T14:09:00.071363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594871157920685:9507]
2025-10-10T14:09:00.071384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594871157920685:9507]
2025-10-10T14:09:00.072433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:00.072478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:00.072504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:00.072527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:00.088837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:00.088894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:00.088906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:00.091691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:09:00.094459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:00.255657Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:00.278723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:09:00.278763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:00.281069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594871157920685:9507]
2025-10-10T14:09:00.281294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:00.281293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:09:00.281320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:00.285730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_9_10373462377834257282_v1
2025-10-10T14:09:00.285778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:09:00.286385Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_9_10373462377834257282_v1
2025-10-10T14:09:00.286567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:09:00.286707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:09:00.286718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:09:00.310357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 802 reason: error at write: Disconnected sessionId: src_id|7ffd2068-132194df-6c4f1272-d0256a45_0
2025-10-10T14:09:00.310735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 802 sessionId: src_id|7ffd2068-132194df-6c4f1272-d0256a45_0 is DEAD
2025-10-10T14:09:00.319382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffd2068-132194df-6c4f1272-d0256a45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:09:00.319425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffd2068-132194df-6c4f1272-d0256a45_0] Write session will restart in 0.008262s
2025-10-10T14:09:00.319519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffd2068-132194df-6c4f1272-d0256a45_0] Write session: Do CDS request
2025-10-10T14:09:00.319547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffd2068-132194df-6c4f1272-d0256a45_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:09:00.332645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594872735843686:5037]
2025-10-10T14:09:00.335903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffd2068-132194df-6c4f1272-d0256a45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:00.336615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:09:00.336646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 803
2025-10-10T14:09:00.338341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:00.338468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:09:00.338483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:09:00.338493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:09:00.340303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 803 sessionId:  describe result for acl check
2025-10-10T14:09:00.340431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:09:00.340443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:09:00.340453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:09:00.340471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594877030811149:5014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:09:00.343114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594877030811149:5014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:09:00.377779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594877030811149:5014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:09:00.399452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594877030811149:5014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:09:00.399493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594877030811149:5014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:09:00.399511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594877030811149:5014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:09:00.399542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:09:00.413748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:09:00.423126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:09:00.430812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594877030811260:5037]
2025-10-10T14:09:00.446948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:09:00.446996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:09:00.447109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:09:00.447538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:09:00.447742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594875452888151:9522]
2025-10-10T14:09:00.450295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:09:00.451583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:09:00.451822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:09:00.452972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:09:00.453316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:00.453324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:00.453331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:00.453338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:00.453344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:00.453350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:00.453357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:00.453363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:00.453370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:00.453376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:00.453383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:00.453391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:00.453436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:00.453533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:00.453576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:00.453619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:00.453665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:00.453708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:00.453748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:00.453788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:00.453829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:00.453873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:00.453914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:00.453955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:00.453995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:00.454055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:00.454108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:00.454158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:00.454201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:00.454251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:00.454298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:00.454348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:00.454393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:00.454443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:00.454487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:00.454537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:00.454583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:00.454634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:00.454676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:00.454727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:00.454772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:00.454818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:00.454860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:00.454911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:00.454956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:00.455010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:00.455054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:00.455105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:00.455519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:09:00.488063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:09:00.501645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:09:00.501698Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:09:00.501715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:09:00.501733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:09:00.501755Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 802 [2:7559594875452888151:9522]
2025-10-10T14:09:00.501807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:09:00.501869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:09:00.501885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:00.501898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:00.501910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:00.501960Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:09:00.501983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:09:00.502016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:09:00.504057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:00.504074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:00.504087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:00.504100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:00.504113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:09:00.506131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:09:00.506167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:00.506294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:00.506459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:00.506662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:00.506772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:09:00.506818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594877030811139:2442], now have 1 active actors on pipe
2025-10-10T14:09:00.506839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594877030811260:5037], now have 1 active actors on pipe
2025-10-10T14:09:00.506858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594877030811254:5014], now have 1 active actors on pipe
2025-10-10T14:09:00.506938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:00.506957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:00.507035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594875452888145:9522]
2025-10-10T14:09:00.507051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594875452888145:9522]
2025-10-10T14:09:00.507065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594875452888145:9522]
2025-10-10T14:09:00.507075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594875452888145:9522]
2025-10-10T14:09:00.507113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:09:00.507218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:09:00.507252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:00.507271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:00.507281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:09:00.507318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:00.507363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:09:00.507414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:09:00.507581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:09:00.507597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:09:00.507737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:00.507791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594875452888145:9522]
2025-10-10T14:09:00.507814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:09:00.505310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 802
2025-10-10T14:09:00.505422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 802, pipe: [1:7559594877030811260:5037]
2025-10-10T14:09:00.505496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 802
2025-10-10T14:09:00.509709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:09:00.509738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:09:00.509749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:09:00.509759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:09:00.509787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:09:00.517273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:00.517322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:00.517406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:00.518534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 803 partition: 0 MaxSeqNo: 36 sessionId: src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0
2025-10-10T14:09:00.522182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ffd2068-132194df-6c4f1272-d0256a45_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:09:00.580835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0] Write session: try to update token
2025-10-10T14:09:00.580895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:09:00.686557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:00.686603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:00.686616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:00.686683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:00.686698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:00.686713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:00.686724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:00.686735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:00.686776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594875452888145:9522]
2025-10-10T14:09:00.686804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594875452888145:9522]
2025-10-10T14:09:00.686829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594875452888145:9522]
2025-10-10T14:09:00.686851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594875452888145:9522]
2025-10-10T14:09:00.687000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:00.687030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:00.687042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:00.687565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:00.687597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:00.687639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:00.687671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:00.710194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:00.837631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId: src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:09:00.898850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:09:00.964501Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:00.966432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:00.966476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:00.973069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:09:00.973257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594877030811260:5037]
2025-10-10T14:09:00.973341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:09:00.973353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:09:00.976913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 803 reason: error at write: Disconnected sessionId: src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0
2025-10-10T14:09:01.000889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 803 sessionId: src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0 is DEAD
2025-10-10T14:09:01.008753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:09:01.008798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0] Write session will restart in 0.008766s
2025-10-10T14:09:01.008902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0] Write session: Do CDS request
2025-10-10T14:09:01.008934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:09:01.026522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:01.028148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:09:01.028178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 804
2025-10-10T14:09:01.029347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:01.029471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:09:01.029487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:09:01.029498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:09:01.030698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 804 sessionId:  describe result for acl check
2025-10-10T14:09:01.030809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:09:01.030818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:09:01.030827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:09:01.030843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594881325778613:5002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:09:01.032987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594881325778613:5002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:09:01.066949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594881325778613:5002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:09:01.076331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594881325778670:5037]
2025-10-10T14:09:01.103311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594881325778613:5002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:09:01.103358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594881325778613:5002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:09:01.103377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594881325778613:5002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:09:01.103410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:09:01.146510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:09:01.166059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:09:01.166570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:09:01.167295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:09:01.167314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:09:01.167360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:09:01.167591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:09:01.167795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594879747855584:9526]
2025-10-10T14:09:01.174484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:09:01.175935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:09:01.176153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:09:01.177383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:09:01.177729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:01.177737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:01.177744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:01.177752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:01.177759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:01.177767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:01.177775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:01.177782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:01.177788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.177795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.177803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.177809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.177854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:01.177960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:01.178008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:01.178054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:01.178099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:01.178147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:01.178191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:01.178240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:01.178285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.178332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.178377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.178422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.178464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:01.178528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:01.178582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:01.178635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:01.178684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:01.178737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:01.178781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:01.178835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:01.178882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:01.178934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:01.178980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:01.179035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:01.179083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:01.179137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:01.179181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:01.179236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:01.179283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.179334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.179378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.179430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.179474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.179526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.179573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.179626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.180063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:09:01.216525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:09:01.251455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:09:01.251508Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:09:01.251524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:09:01.251544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:09:01.251567Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 803 [2:7559594879747855584:9526]
2025-10-10T14:09:01.251617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:09:01.251680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:09:01.251695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:01.251707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:01.251717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:01.251764Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:09:01.251786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:09:01.251809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:09:01.254030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.254069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.254082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.254093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.254105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:09:01.254393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:09:01.254417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.254539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.254706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.254909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.255006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:09:01.255076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.255090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.255101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.255112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.255152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:09:01.255224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:09:01.255378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:09:01.255395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:09:01.255524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.255541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:09:01.257394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:09:01.257425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:09:01.257437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:09:01.257447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:09:01.257477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:09:01.259500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594881325778670:5037], now have 1 active actors on pipe
2025-10-10T14:09:01.259530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594877030811302:2442], now have 1 active actors on pipe
2025-10-10T14:09:01.259551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594881325778692:5002], now have 1 active actors on pipe
2025-10-10T14:09:01.259707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 803, pipe: [1:7559594881325778670:5037]
2025-10-10T14:09:01.259809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 803
2025-10-10T14:09:01.259886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 803
2025-10-10T14:09:01.264035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:01.264078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:01.264163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:09:01.264199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:01.264220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:01.264230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:09:01.264284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:01.264334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:09:01.264379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:01.265107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:01.265163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:01.265255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:01.265712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 804 partition: 0 MaxSeqNo: 36 sessionId: src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0
2025-10-10T14:09:01.277397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6940c8e-4de79fc4-a5d342ab-66b34674_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:09:01.351437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0] Write session: try to update token
2025-10-10T14:09:01.351499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:09:01.353183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:01.353238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:01.353250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:01.492779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:01.492815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:01.492828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:01.492838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:01.492849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:01.492884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.492910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.492936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.492959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.493499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:01.493577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:01.493634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:01.493686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:01.494233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:01.494271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:01.494296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:01.494379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:01.494426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.494449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:01.526570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:01.592933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId: src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:09:01.667256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:09:01.796698Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:01.810595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:01.810655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:01.810755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:09:01.810770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:01.810812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594879747855579:9526]
2025-10-10T14:09:01.819328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:09:01.820772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:09:01.825464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:09:01.825694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:09:01.902536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594881325778670:5037]
2025-10-10T14:09:01.902636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 804 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0
2025-10-10T14:09:01.903478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:09:01.903508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0] Write session will restart in 0.009718s
2025-10-10T14:09:01.903607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0] Write session: Do CDS request
2025-10-10T14:09:01.903637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:09:01.909719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 804 sessionId: src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0 is DEAD
2025-10-10T14:09:01.925943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:01.972197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:09:01.972226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 805
2025-10-10T14:09:01.979302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:09:01.980418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:09:01.981164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:09:01.981197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:09:01.981242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:09:01.981473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:09:01.981646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594879747855758:9536]
2025-10-10T14:09:01.983649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:09:01.984794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:09:01.985004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:09:01.986241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:09:01.986541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:01.986550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:01.986556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:01.986562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:01.986570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:01.986577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:01.986582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:01.986588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:01.986595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.986601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.986608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.986614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.986661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:01.986764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:01.986810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:01.986856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:01.986898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:01.986946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:01.986988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:01.987030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:01.987072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.987117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.987161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.987207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.987247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:01.987308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:01.987365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:01.987416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:01.987462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:01.987510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:01.987550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:01.987597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:01.987640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:01.987688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:01.987729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:01.987776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:01.987820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:01.987867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:01.987906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:01.987955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:01.988001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.988050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:01.988095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.988144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:01.988204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.988258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:01.988301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.988349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:01.989293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:01.989435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:09:01.989451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:09:01.989462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:09:01.989959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:09:01.994220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 805 sessionId:  describe result for acl check
2025-10-10T14:09:01.994346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:09:01.994356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:09:01.994365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:09:01.994382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594881325778874:4972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:09:01.996906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594881325778874:4972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:09:02.006688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594885620746173:5037]
2025-10-10T14:09:02.033318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:09:02.042016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594881325778874:4972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:09:02.067461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594881325778874:4972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:09:02.067511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594881325778874:4972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:09:02.067532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594881325778874:4972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:09:02.067568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:09:02.070117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:09:02.070163Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:09:02.070178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:09:02.070197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:09:02.070219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 804 [2:7559594879747855758:9536]
2025-10-10T14:09:02.070269Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:09:02.070320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:09:02.070334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:02.070344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:02.070354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:02.070400Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:09:02.070419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:09:02.070440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:09:02.072949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:02.072967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:02.072980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:02.072994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:02.073006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:09:02.075201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:09:02.075235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:02.075373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:02.075547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:02.075766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:02.075872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:09:02.075913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594885620746173:5037], now have 1 active actors on pipe
2025-10-10T14:09:02.075936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594881325778771:2442], now have 1 active actors on pipe
2025-10-10T14:09:02.075958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594885620746199:4972], now have 1 active actors on pipe
2025-10-10T14:09:02.076022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.076035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.076047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.076059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.076099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:09:02.076176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:09:02.076338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:09:02.076354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:09:02.076483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.076500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:09:02.077196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:09:02.077220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:09:02.077252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:09:02.077263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:09:02.077289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:09:02.081510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 804, pipe: [1:7559594885620746173:5037]
2025-10-10T14:09:02.081623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 804
2025-10-10T14:09:02.081702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 804
2025-10-10T14:09:02.084311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:02.084364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:02.084452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:09:02.084487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:02.084504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:02.084513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:09:02.084552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:02.084598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:09:02.084643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:02.087585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 805 partition: 0 MaxSeqNo: 36 sessionId: src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0
2025-10-10T14:09:02.088449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b2013ad-10c0d3ea-665696dc-fa045bc6_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:09:02.087180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:02.087226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:02.087305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:02.145212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0] Write session: try to update token
2025-10-10T14:09:02.145271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:09:02.167887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:02.167930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:02.167942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:02.447509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:02.447550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:02.447563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:02.447572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:02.447583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:02.447622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.447647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.447670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.447689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.449231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId: src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:09:02.447846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:02.447858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:02.447868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:02.447972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:02.447998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:02.448009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:02.448951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:02.454889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:02.454923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:02.454950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:02.454978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:02.503692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:09:02.621763Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:02.643883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:02.643968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:02.644078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:09:02.644097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:02.644152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594879747855753:9536]
2025-10-10T14:09:02.644434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:09:02.644812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:09:02.648602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594885620746173:5037]
2025-10-10T14:09:02.648745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:09:02.648967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:09:02.715011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 805 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0
2025-10-10T14:09:02.715320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 805 sessionId: src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0 is DEAD
2025-10-10T14:09:02.721628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:09:02.721726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0] Write session will restart in 0.008700s
2025-10-10T14:09:02.721968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0] Write session: Do CDS request
2025-10-10T14:09:02.722034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:09:02.743337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:02.744882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:09:02.744914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 806
2025-10-10T14:09:02.747041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:02.747197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:09:02.747215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:09:02.747223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:09:02.750128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 806 sessionId:  describe result for acl check
2025-10-10T14:09:02.750178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594885620746275:5037]
2025-10-10T14:09:02.750253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:09:02.750265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:09:02.750276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:09:02.750293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594885620746277:4964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:09:02.752908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594885620746277:4964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:09:02.769860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594885620746277:4964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:09:02.783177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594885620746277:4964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:09:02.783219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594885620746277:4964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:09:02.783237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594885620746277:4964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:09:02.783269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:09:02.796447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:09:02.809346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:09:02.810389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:09:02.810436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:09:02.810487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:09:02.810818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:09:02.811275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594884042823210:9547]
2025-10-10T14:09:02.813914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:09:02.815156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:09:02.815402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:09:02.816738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:09:02.817079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:02.817088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:02.817097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:02.817104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:02.817112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:02.817121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:02.817151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:02.817159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:02.817180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:02.817188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:02.817196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:02.817203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:02.817258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:02.817377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:02.817431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:02.817486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:02.817537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:02.817586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:02.818103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:02.818166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:02.818216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:02.818271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:02.818319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:02.818369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:02.818418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:02.818660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:02.818731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:02.818795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:02.818852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:02.818911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:02.818962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:02.819018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:02.819073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:02.819132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:02.819179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:02.819238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:02.819291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:02.819350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:02.819400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:02.819455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:02.819506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:02.819562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:02.819612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:02.819671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:02.819723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:02.819782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:02.819831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:02.819892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:02.820369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:09:02.858781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:09:02.874015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:09:02.874068Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:09:02.874084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:09:02.874103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:09:02.874125Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 805 [2:7559594884042823210:9547]
2025-10-10T14:09:02.874181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:09:02.874235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:09:02.874248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:02.874261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:02.874274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:02.874321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:09:02.874342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:09:02.874364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:09:02.904782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:02.904822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:02.904833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:02.904844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:02.904854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:09:02.905846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 805
2025-10-10T14:09:02.905942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 805
2025-10-10T14:09:02.906025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 805, pipe: [1:7559594885620746275:5037]
2025-10-10T14:09:02.905411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:09:02.905441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:02.905569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:02.905740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:02.905954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:02.906063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:09:02.906145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594885620746275:5037], now have 1 active actors on pipe
2025-10-10T14:09:02.906169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594885620746366:4964], now have 1 active actors on pipe
2025-10-10T14:09:02.906191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594885620746245:2442], now have 1 active actors on pipe
2025-10-10T14:09:02.906216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:02.906229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:02.906243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:02.906258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:02.906303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:09:02.906332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:09:02.906344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:09:02.906351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:09:02.906359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:09:02.906384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:09:02.906561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:09:02.906590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:09:02.906663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:02.906691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:02.906822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:02.906865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:09:02.906891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:09:02.906935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|730a597a-b8f97689-5d7267da-e864842b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:09:02.906966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:02.906982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:02.906993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:09:02.907028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:02.907067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:09:02.907193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:02.908179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:02.908208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:02.908301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:02.908745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 806 partition: 0 MaxSeqNo: 36 sessionId: src_id|730a597a-b8f97689-5d7267da-e864842b_0
2025-10-10T14:09:02.909525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8c783-f89fdafa-5af9b6ea-5cce39a0_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|730a597a-b8f97689-5d7267da-e864842b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:09:02.952337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|730a597a-b8f97689-5d7267da-e864842b_0] Write session: try to update token
2025-10-10T14:09:02.952401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|730a597a-b8f97689-5d7267da-e864842b_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:09:03.033437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:03.033469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:03.033476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:03.033516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:03.033531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:03.033540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:03.033549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:03.033558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:03.033591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:03.033616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:03.033638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:03.033659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:03.033778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:03.033813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:03.033853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:03.033865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:03.033883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:03.033890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.033902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:03.040540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:03.096762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId: src_id|730a597a-b8f97689-5d7267da-e864842b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:09:03.126310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:09:03.190377Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:03.227516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:03.227565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:03.227634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:09:03.227649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:03.227689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594884042823205:9547]
2025-10-10T14:09:03.228012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:09:03.228975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:09:03.229350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594885620746275:5037]
2025-10-10T14:09:03.229442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:09:03.229561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:09:03.243591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 806 reason: status is not ok: tablet will be restarted right now sessionId: src_id|730a597a-b8f97689-5d7267da-e864842b_0
2025-10-10T14:09:03.243912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 806 sessionId: src_id|730a597a-b8f97689-5d7267da-e864842b_0 is DEAD
2025-10-10T14:09:03.244328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730a597a-b8f97689-5d7267da-e864842b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:09:03.244367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730a597a-b8f97689-5d7267da-e864842b_0] Write session will restart in 0.009527s
2025-10-10T14:09:03.244478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730a597a-b8f97689-5d7267da-e864842b_0] Write session: Do CDS request
2025-10-10T14:09:03.244510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730a597a-b8f97689-5d7267da-e864842b_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:09:03.263354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|730a597a-b8f97689-5d7267da-e864842b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:03.265443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:09:03.265481Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 807
2025-10-10T14:09:03.265786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:03.265916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:09:03.265939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:09:03.265949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:09:03.268394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 807 sessionId:  describe result for acl check
2025-10-10T14:09:03.268529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:09:03.268548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:09:03.268559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:09:03.268575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594889915713709:4946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:09:03.271505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594889915713709:4946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:09:03.293541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594889915713709:4946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:09:03.321421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594889915713709:4946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:09:03.321465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594889915713709:4946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:09:03.321483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594889915713709:4946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:09:03.321514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:09:03.330859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594889915713805:5037]
2025-10-10T14:09:03.362852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:09:03.365376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:09:03.366263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:09:03.366283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:09:03.366326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:09:03.366611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:09:03.366817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594888337790666:9556]
2025-10-10T14:09:03.369615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:09:03.371808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:09:03.372045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:09:03.373551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:09:03.373933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:03.373942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:03.373950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:03.373958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:03.373966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:03.373975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:03.373984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:03.373991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:03.373999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.374006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.374013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.374022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.374074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:03.374199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:03.374255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:03.374311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:03.374364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:03.374420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:03.374475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:03.374525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:03.374579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.374634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.374686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.374736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.374781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:03.374855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:03.374923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:03.374985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:03.375039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:03.375097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:03.375150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:03.375213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:03.375286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:03.375346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:03.375398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:03.375456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:03.375512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:03.375574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:03.375626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:03.375688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:03.375744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.375805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.375856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.375920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.375970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.376031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.376081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.376143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.376653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:09:03.409208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:09:03.432261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:09:03.432322Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:09:03.432342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:09:03.432366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:09:03.432390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 806 [2:7559594888337790666:9556]
2025-10-10T14:09:03.432451Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:09:03.432515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:09:03.432542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:03.432556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:03.432570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:03.432620Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:09:03.432652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:09:03.432679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:09:03.436420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 806
2025-10-10T14:09:03.436529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 806
2025-10-10T14:09:03.436601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 806, pipe: [1:7559594889915713805:5037]
2025-10-10T14:09:03.434750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.434786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.434803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.434819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.434831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:09:03.435143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:09:03.435164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.435323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.435546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.435814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.435944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:09:03.436031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594889915713770:4946], now have 1 active actors on pipe
2025-10-10T14:09:03.436058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594889915713683:2442], now have 1 active actors on pipe
2025-10-10T14:09:03.436082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594889915713805:5037], now have 1 active actors on pipe
2025-10-10T14:09:03.436108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.436126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.436139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.436154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.436197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:09:03.436255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:09:03.436271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:09:03.436284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:09:03.436284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:09:03.436297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:09:03.436487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:09:03.436504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:09:03.436636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.436671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:09:03.436698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:09:03.437349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:03.437378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:03.437465Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:09:03.437496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:03.437515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:03.437525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:09:03.437557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:03.437600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:09:03.437650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:03.438378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:03.438400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:03.438482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:03.440702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 807 partition: 0 MaxSeqNo: 36 sessionId: src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0
2025-10-10T14:09:03.441772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|730a597a-b8f97689-5d7267da-e864842b_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:09:03.485453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0] Write session: try to update token
2025-10-10T14:09:03.485517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:09:03.587309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:03.587353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:03.587366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:03.587423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:03.587439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:03.587453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:03.587466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:03.587479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:03.587517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.587546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.587574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.587600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.587789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:03.587814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.587828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:03.588886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:03.589620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:03.589670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:03.589703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:03.589736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:03.650084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId: src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:09:03.705309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:09:03.744248Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:03.758516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:03.758565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:03.758626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:09:03.758641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:03.758683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594888337790661:9556]
2025-10-10T14:09:03.759212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:09:03.760143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:09:03.765361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594889915713805:5037]
2025-10-10T14:09:03.765456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:09:03.790948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:09:03.791109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 807 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0
2025-10-10T14:09:03.791421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 807 sessionId: src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0 is DEAD
2025-10-10T14:09:03.793637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:09:03.793679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0] Write session will restart in 0.007699s
2025-10-10T14:09:03.793780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0] Write session: Do CDS request
2025-10-10T14:09:03.793810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:09:03.813967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:03.853658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:09:03.853697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 808
2025-10-10T14:09:03.858719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:03.858873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:09:03.858891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:09:03.858903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:09:03.862975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 808 sessionId:  describe result for acl check
2025-10-10T14:09:03.863135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:09:03.863147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:09:03.863158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:09:03.863174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594889915713898:4941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:09:03.868236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594889915713901:5037]
2025-10-10T14:09:03.868308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594889915713898:4941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:09:03.894233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594889915713898:4941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:09:03.919733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594889915713898:4941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:09:03.919778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594889915713898:4941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:09:03.919796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594889915713898:4941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:09:03.919825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:09:03.940602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:09:03.941186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:09:03.942049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:09:03.942068Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:09:03.942119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:09:03.942389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:09:03.942601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594888337790818:9564]
2025-10-10T14:09:03.945609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:09:03.946746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:09:03.947002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:09:03.948313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:09:03.948663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:03.948670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:03.948678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:03.948686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:03.948695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:03.948701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:03.948708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:03.948715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:03.948722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.948731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.948738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.948745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.948794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:03.948909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:03.948959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:03.949007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:03.949053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:03.949102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:03.949189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:03.949237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:03.949282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.949329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.949376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.949426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.949470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:03.949541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:03.949606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:03.949663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:03.949714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:03.952007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:03.952091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:03.952154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:03.952222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:03.952280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:03.952329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:03.952389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:03.952439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:03.952495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:03.952543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:03.952602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:03.952653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.952714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:03.952764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.952836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:03.952883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.952942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:03.952989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.953045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:03.953539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:09:04.021474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:09:04.036732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:09:04.037003Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:09:04.037027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:09:04.037048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:09:04.037071Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 807 [2:7559594888337790818:9564]
2025-10-10T14:09:04.037171Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:09:04.037227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:09:04.037241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:04.037253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:04.037266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:04.037316Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:09:04.037341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:09:04.037364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:09:04.039778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:04.039795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:04.039809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:04.039822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:04.039833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:09:04.041659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:09:04.041191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 807
2025-10-10T14:09:04.041266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 807, pipe: [1:7559594889915713901:5037]
2025-10-10T14:09:04.041337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 807
2025-10-10T14:09:04.046575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:04.046749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:04.046958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:04.047220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:04.047355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:09:04.047408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594889915713979:4941], now have 1 active actors on pipe
2025-10-10T14:09:04.047440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594889915713901:5037], now have 1 active actors on pipe
2025-10-10T14:09:04.047463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594889915713859:2442], now have 1 active actors on pipe
2025-10-10T14:09:04.047556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:04.047581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:04.047639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.047655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.047670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.047685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.047730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:09:04.047821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:09:04.048021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:09:04.048039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:09:04.048106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e41befe5-eb2de653-e9effc64-62faf760_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:09:04.048140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:04.048137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:09:04.048154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:09:04.048158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:04.048166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:09:04.048169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:09:04.048179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:09:04.048204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:04.048247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:09:04.048394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.048426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:09:04.048478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:04.048489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:09:04.055321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 808 partition: 0 MaxSeqNo: 36 sessionId: src_id|e41befe5-eb2de653-e9effc64-62faf760_0
2025-10-10T14:09:04.056408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9502962a-1c6ccad8-2a7d9b2c-cc1c4cbe_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|e41befe5-eb2de653-e9effc64-62faf760_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:09:04.054783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:04.054837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:04.054927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:04.099596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e41befe5-eb2de653-e9effc64-62faf760_0] Write session: try to update token
2025-10-10T14:09:04.099657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e41befe5-eb2de653-e9effc64-62faf760_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:09:04.222761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:04.222798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:04.222810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:04.222862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:04.222876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:04.222890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:04.222900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:04.222912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:04.222948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.222976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.223000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.223025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.223219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:04.223245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:04.223257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:04.223595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:04.223636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:04.223668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:04.223698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:04.224343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:04.270752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId: src_id|e41befe5-eb2de653-e9effc64-62faf760_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:09:04.296517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:09:04.573790Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:04.587059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:04.587120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:04.587181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:09:04.587197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:04.587240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594888337790813:9564]
2025-10-10T14:09:04.589459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:09:04.598116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:09:04.596182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:09:04.596217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:09:04.599888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594889915713901:5037]
2025-10-10T14:09:04.599969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:09:04.673923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 808 reason: error at write: Disconnected sessionId: src_id|e41befe5-eb2de653-e9effc64-62faf760_0
2025-10-10T14:09:04.674267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 808 sessionId: src_id|e41befe5-eb2de653-e9effc64-62faf760_0 is DEAD
2025-10-10T14:09:04.677623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41befe5-eb2de653-e9effc64-62faf760_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:09:04.677657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41befe5-eb2de653-e9effc64-62faf760_0] Write session will restart in 0.005191s
2025-10-10T14:09:04.677759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41befe5-eb2de653-e9effc64-62faf760_0] Write session: Do CDS request
2025-10-10T14:09:04.677788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41befe5-eb2de653-e9effc64-62faf760_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:09:04.693581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e41befe5-eb2de653-e9effc64-62faf760_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:04.697279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594894210681355:5037]
2025-10-10T14:09:04.697320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:09:04.697334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 809
2025-10-10T14:09:04.697611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:04.697711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:09:04.697727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:09:04.697736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:09:04.701050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 809 sessionId:  describe result for acl check
2025-10-10T14:09:04.701194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:09:04.701205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:09:04.701214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:09:04.701231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594894210681367:4920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:09:04.704049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594894210681367:4920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:09:04.831919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594894210681367:4920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:09:04.851539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594894210681367:4920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:09:04.851584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594894210681367:4920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:09:04.851602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594894210681367:4920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:09:04.851635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:09:04.952775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:09:04.961976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:09:04.962837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:09:04.962857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:09:04.962904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:09:04.963164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:09:04.963353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594892632758283:9576]
2025-10-10T14:09:04.965831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:09:04.974093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:09:04.974374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:09:04.975812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:09:04.976169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:04.976178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:04.976187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:04.976195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:04.976203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:04.976211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:04.976218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:04.976226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:04.976234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:04.976243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:04.976252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:04.976258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:04.976308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:04.976425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:04.976479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:04.976528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:04.976579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:04.976632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:04.976683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:04.976737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:04.976788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:04.976844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:04.976894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:04.976944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:04.976987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:04.977060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:04.977159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:04.977225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:04.977289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:04.977347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:04.977397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:04.977457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:04.977512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:04.977569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:04.977621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:04.977677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:04.977766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:04.977833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:04.977881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:04.977940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:04.977993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:04.978052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:04.978103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:04.978159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:04.978231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:04.978292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:04.978341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:04.978399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:04.978898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:09:05.297506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:09:05.313428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:09:05.313474Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:09:05.313490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:09:05.313508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:09:05.313528Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 808 [2:7559594892632758283:9576]
2025-10-10T14:09:05.313577Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:09:05.313624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:09:05.313638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:05.313649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:05.313660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:05.313701Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:09:05.313722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:09:05.313739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:09:05.353325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:05.353361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:05.353374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:05.353387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:05.353398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:09:05.353706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:09:05.353739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:05.353870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:05.354052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:05.354274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:05.354394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:09:05.354474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594894210681449:4920], now have 1 active actors on pipe
2025-10-10T14:09:05.354504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594894210681355:5037], now have 1 active actors on pipe
2025-10-10T14:09:05.354534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594894210681325:2442], now have 1 active actors on pipe
2025-10-10T14:09:05.354564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.354583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.354596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.354609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.354642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:09:05.354675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:09:05.354698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:09:05.354709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:09:05.354719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:09:05.354719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:09:05.354887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:09:05.354909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:09:05.355023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.355053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:09:05.355067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:09:05.357515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 808
2025-10-10T14:09:05.357622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 808, pipe: [1:7559594894210681355:5037]
2025-10-10T14:09:05.357707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 808
2025-10-10T14:09:05.360227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 809 partition: 0 MaxSeqNo: 36 sessionId: src_id|15a0754d-330f4563-9449b0e9-853eac08_0
2025-10-10T14:09:05.361338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e41befe5-eb2de653-e9effc64-62faf760_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|15a0754d-330f4563-9449b0e9-853eac08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:09:05.358437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:05.358484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:05.358569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15a0754d-330f4563-9449b0e9-853eac08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:09:05.358599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:05.358616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:05.358640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:09:05.358674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:05.358713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:09:05.358765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:05.359846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:05.359865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:05.359922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:05.392651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15a0754d-330f4563-9449b0e9-853eac08_0] Write session: try to update token
2025-10-10T14:09:05.392709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15a0754d-330f4563-9449b0e9-853eac08_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:09:05.460545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:05.472128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:05.472184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:05.472403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:05.472428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:05.472451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:05.472472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:05.472495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:05.472543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.472575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.472604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.472634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.477291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:05.477355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:05.477393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:05.477428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:05.612688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:05.612752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:05.612768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:05.623180Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:05.855357Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:05.867002Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:09:05.867051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:05.867104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594892632758278:9576]
2025-10-10T14:09:05.869728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:09:05.874636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:09:05.874672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:09:05.874730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 809 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|15a0754d-330f4563-9449b0e9-853eac08_0
2025-10-10T14:09:05.875085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 809 sessionId: src_id|15a0754d-330f4563-9449b0e9-853eac08_0 is DEAD
2025-10-10T14:09:05.875483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594894210681355:5037]
2025-10-10T14:09:05.875548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:09:05.878219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15a0754d-330f4563-9449b0e9-853eac08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-10T14:09:05.878258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15a0754d-330f4563-9449b0e9-853eac08_0] Write session will restart in 0.007050s
2025-10-10T14:09:05.878364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15a0754d-330f4563-9449b0e9-853eac08_0] Write session: Do CDS request
2025-10-10T14:09:05.878394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15a0754d-330f4563-9449b0e9-853eac08_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:09:05.902453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15a0754d-330f4563-9449b0e9-853eac08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:05.905468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:09:05.905508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 810
2025-10-10T14:09:05.905981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:05.906126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:09:05.906142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:09:05.906154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:09:05.907772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 810 sessionId:  describe result for acl check
2025-10-10T14:09:05.907892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:09:05.907903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:09:05.907914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:09:05.907930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594898505648819:4905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:09:05.911000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594898505648819:4905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:09:05.965027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594898505648819:4905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:09:05.993938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594898505648856:5037]
2025-10-10T14:09:06.007609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594898505648819:4905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:09:06.007659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594898505648819:4905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:09:06.007677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594898505648819:4905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:09:06.007710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:09:06.065858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:09:06.068150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:09:06.068962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:09:06.068997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:09:06.069040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:09:06.069333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:09:06.069530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594901222693045:9585]
2025-10-10T14:09:06.071893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:09:06.073052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:09:06.073332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:09:06.074569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:09:06.074884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:06.074904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:06.074910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:06.074916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:06.074923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:06.074929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:06.074934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:06.074941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:06.074948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.074954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.074961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.074967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.075012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:06.075114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:06.075157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:06.075201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:06.075264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:06.075313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:06.075359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:06.075406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:06.075453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.075501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.075551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.075595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.075639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:06.075702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:06.075760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:06.075819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:06.075864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:06.075913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:06.075953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:06.076002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:06.076046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:06.076097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:06.076139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:06.076191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:06.076236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:06.076300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:06.076343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:06.076391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:06.076435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.076485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.076529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.076576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.076617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.076666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.076705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.076754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.077202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:09:06.100931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
E1010 14:09:06.110942412  107741 chttp2_transport.cc:1143]             ipv4:127.0.0.1:6178: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-10T14:09:06.115301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:09:06.115349Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:09:06.115366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:09:06.115384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:09:06.115407Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 809 [2:7559594901222693045:9585]
2025-10-10T14:09:06.115458Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:09:06.115513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:09:06.115526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:06.115538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:06.115548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:06.115596Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:09:06.115618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:09:06.115640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:09:06.150470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.150509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.150518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.150527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.150535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:09:06.150801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:09:06.150825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.150939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.151079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.151262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.151367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:09:06.151446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594902800616168:4905], now have 1 active actors on pipe
2025-10-10T14:09:06.151468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594898505648856:5037], now have 1 active actors on pipe
2025-10-10T14:09:06.151489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594898505648810:2442], now have 1 active actors on pipe
2025-10-10T14:09:06.151513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.151528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.151541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.151553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.151585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:09:06.151622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:09:06.151636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:09:06.151649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:09:06.151657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:09:06.151662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:09:06.151818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:09:06.151203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 809
2025-10-10T14:09:06.151834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:09:06.151892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:06.151286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 809, pipe: [1:7559594898505648856:5037]
2025-10-10T14:09:06.151910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:06.151354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 809
2025-10-10T14:09:06.152050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.152084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:09:06.152153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56c6580f-da0a48ec-94085001-30952cef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:09:06.152184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:06.152201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:06.152211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:09:06.152248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:06.152289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:09:06.152409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:09:06.152417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:06.153554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:06.153585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:06.153645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:06.154033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 810 partition: 0 MaxSeqNo: 36 sessionId: src_id|56c6580f-da0a48ec-94085001-30952cef_0
2025-10-10T14:09:06.160015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15a0754d-330f4563-9449b0e9-853eac08_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|56c6580f-da0a48ec-94085001-30952cef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:09:06.195370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c6580f-da0a48ec-94085001-30952cef_0] Write session: try to update token
2025-10-10T14:09:06.195434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c6580f-da0a48ec-94085001-30952cef_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:09:06.228869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:06.228906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:06.228919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:06.228978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:09:06.228994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:06.229032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.229513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:09:06.229799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:09:06.231573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-10T14:09:06.232704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:09:06.238571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:09:06.244297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-10T14:09:06.246286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-10T14:09:06.246802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104765608 queuesize 0 startOffset 0
2025-10-10T14:09:06.329338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:06.329383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:06.329396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:06.420042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:06.420080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:06.420094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:06.420103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:06.420113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:06.420151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.420177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.420199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.420219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594901222693040:9585]
2025-10-10T14:09:06.420366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:06.420366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:06.420390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.420399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:06.420401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:06.420425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:06.420458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:06.423367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:06.476505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId: src_id|56c6580f-da0a48ec-94085001-30952cef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:09:06.562163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:09:06.668313Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:06.670505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:06.670557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:06.672510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-10T14:09:06.672539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-10T14:09:06.673442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7559594898505648856:5037]
2025-10-10T14:09:06.673614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-10T14:09:06.679565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:09:06.714135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 810 reason: error at write: Disconnected sessionId: src_id|56c6580f-da0a48ec-94085001-30952cef_0
2025-10-10T14:09:06.714489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 810 sessionId: src_id|56c6580f-da0a48ec-94085001-30952cef_0 is DEAD
2025-10-10T14:09:06.717845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c6580f-da0a48ec-94085001-30952cef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-10T14:09:06.717879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c6580f-da0a48ec-94085001-30952cef_0] Write session will restart in 0.005514s
2025-10-10T14:09:06.717989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c6580f-da0a48ec-94085001-30952cef_0] Write session: Do CDS request
2025-10-10T14:09:06.718023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c6580f-da0a48ec-94085001-30952cef_0] Start write session. Will connect to endpoint: localhost:62043
2025-10-10T14:09:06.728408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:09:06.728449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 811
2025-10-10T14:09:06.734275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c6580f-da0a48ec-94085001-30952cef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:06.734957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:09:06.735106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:40068
2025-10-10T14:09:06.735123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40068 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:09:06.735135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:09:06.742654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 811 sessionId:  describe result for acl check
2025-10-10T14:09:06.742807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:09:06.742818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:09:06.742829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:09:06.742848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559594902800616291:4889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:09:06.750724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559594902800616291:4889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:09:06.770236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559594902800616291:4889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:09:06.777742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 36 InitDone 1 WaitForData 0, pipe: [1:7559594902800616320:5037]
2025-10-10T14:09:06.798739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559594902800616291:4889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:09:06.798786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559594902800616291:4889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:09:06.798805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559594902800616291:4889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:09:06.798841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:09:06.912170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:09:06.931457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:09:06.932482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:09:06.932501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-10T14:09:06.932545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:09:06.932820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:09:06.933017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559594901222693211:9591]
2025-10-10T14:09:06.935190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-10T14:09:06.949495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-10T14:09:06.949792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-10T14:09:06.951115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-10T14:09:06.951448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:06.951458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:06.951465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:06.951472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:06.951480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:06.951487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:06.951493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:06.951501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:06.951509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.951516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.951522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.951529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.951579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:06.951686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:06.951733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:06.951778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:06.951825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:06.951873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:06.951920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:06.951963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:06.952006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.952051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.952096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.952140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.952183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:06.952248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-10T14:09:06.952305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:06.952359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-10T14:09:06.952406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:06.952457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-10T14:09:06.952503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:06.952554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-10T14:09:06.952601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:06.952658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-10T14:09:06.952701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:06.952756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-10T14:09:06.952802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:06.952855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-10T14:09:06.952900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:06.952956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 6247585 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00011|
2025-10-10T14:09:06.953001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.953054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2970333 so 0 eo 30 d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:06.957163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.957325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 2 size 4506418 so 0 eo 32 d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:06.957393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.957448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 3 size 8295638 so 0 eo 35 d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:06.957503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.957558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 717135 so 0 eo 36 d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:06.958035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-10T14:09:07.023846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:914: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 25 endOffset 36 key 25,3 valuesize 6247585 expected 6247585
2025-10-10T14:09:07.123507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-10T14:09:07.123563Z node 2 :PERSQUEUE INFO: partition_init.cpp:963: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-10T14:09:07.123579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:09:07.123599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:09:07.123623Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 810 [2:7559594901222693211:9591]
2025-10-10T14:09:07.123676Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 36 Head Offset 36 PartNo 0 PackedSize 0 count 0 nextOffset 36 batches 0
SYNC INIT sourceId  src_id seqNo 36 offset 35
SYNC INIT DATA KEY: d0000000000_00000000000000000028_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00003_0000000001_00001? size 717135
2025-10-10T14:09:07.123738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-10T14:09:07.123754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:07.123765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:07.123775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:07.123823Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 36 offset: 35 MaxOffset: 36
2025-10-10T14:09:07.123847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:09:07.123870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:09:07.125680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:07.125710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:07.125726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:07.125738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:197: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:07.125753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:202: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489524 bytes
2025-10-10T14:09:07.126042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:213: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-10T14:09:07.126060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:07.126200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-10T14:09:07.126380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-10T14:09:07.126611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000001_00001?
2025-10-10T14:09:07.126721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:250: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-10T14:09:07.126794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 28 partno 3 count 2 parts_count 5 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.126810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 0 count 2 parts_count 8 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.126822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 32 partno 0 count 3 parts_count 15 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.126834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 3 count 1 parts_count 1 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.126880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-10T14:09:07.126966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 36 max time lag 0ms effective offset 0
2025-10-10T14:09:07.127143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 36
2025-10-10T14:09:07.127162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:09:07.127300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.127321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-10T14:09:07.129194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_10373462377834257282_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 810, pipe: [1:7559594902800616320:5037]
2025-10-10T14:09:07.129305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 810
2025-10-10T14:09:07.129372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 810
2025-10-10T14:09:07.128031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 28 partno 3 count 2 parts_count 5
2025-10-10T14:09:07.128054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 0 count 2 parts_count 8
2025-10-10T14:09:07.128066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 32 partno 0 count 3 parts_count 15
2025-10-10T14:09:07.128078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 3 count 1 parts_count 1
2025-10-10T14:09:07.128099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-10T14:09:07.133991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594902800616320:5037], now have 1 active actors on pipe
2025-10-10T14:09:07.134045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594902800616326:4889], now have 1 active actors on pipe
2025-10-10T14:09:07.134069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559594902800616282:2442], now have 1 active actors on pipe
2025-10-10T14:09:07.134139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:07.134164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:07.134291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:09:07.134339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:07.134360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:07.134372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:09:07.134415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:07.134466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:09:07.134516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:07.141628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 811 partition: 0 MaxSeqNo: 36 sessionId: src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0
2025-10-10T14:09:07.141002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:07.141064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:07.141187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:09:07.145679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c6580f-da0a48ec-94085001-30952cef_0] Write session established. Init response: last_sequence_number: 36 session_id: "src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:09:07.187422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0] Write session: try to update token
2025-10-10T14:09:07.187481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0] Send 10 message(s) (0 left), first sequence number is 37
2025-10-10T14:09:07.225728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:07.225766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:07.225777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:07.506394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:09:07.506430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:09:07.506440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:09:07.506545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-10T14:09:07.506558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:07.506569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-10T14:09:07.506581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-10T14:09:07.506599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-10T14:09:07.506631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 28 count 2 size 2970333 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.506653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.506671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.506688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 717135 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.508187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 28 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-10T14:09:07.508214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-10T14:09:07.508237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-10T14:09:07.508258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-10T14:09:07.507876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId: src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:09:07.600224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-10T14:09:07.617248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:426: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000028_00003_0000000002_00005?
2025-10-10T14:09:07.617292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:427: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-10T14:09:07.626543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:09:07.628096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-10T14:09:07.881426Z node 2 :PERSQUEUE CRIT: actor.h:44: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=28;Head.PackedSize=6247585;NewHead.Offset=28;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1A8C264D)
__cxa_throw+221 (0x1A8C246D)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+1117 (0x1CC1B72D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+3658 (0x3DA62EBA)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+416 (0x3DA4C8D0)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+1134 (0x3DD1C03E)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+12246 (0x3DD208C6)
NKikimr::NPQ::TPartition::Handle(TAutoPtr<NActors::TEventHandle<NKikimr::TEvPQ::TEvBlobResponse>, TDelete>&, NActors::TActorContext const&)+647 (0x3D9A5057)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+13141 (0x3D94C965)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+732 (0x1CB3B65C)
2025-10-10T14:09:07.884994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-10T14:09:07.885024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-10T14:09:07.885081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7559594901222693202:9591]
2025-10-10T14:09:07.885253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:09:07.885280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:09:07.885657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-10T14:09:07.886876Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-10T14:09:07.909317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:09:07.917800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 811 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0
2025-10-10T14:09:07.918147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 811 sessionId: src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0 is DEAD
2025-10-10T14:09:07.921328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-10T14:09:07.921369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0] Write session will restart in 0.006430s
2025-10-10T14:09:07.921464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0] Write session: Do CDS request
2025-10-10T14:09:07.921494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b9823c-1f8ba6d5-71ab6099-6dfd4a9f_0] Start write session. Will connect to endpoint: localhost:62043

Traceback (most recent call last):
  File "library/python/testing/yatest_common/yatest/common/process.py", line 384, in wait
    wait_for(
  File "library/python/testing/yatest_common/yatest/common/process.py", line 765, in wait_for
    raise TimeoutError(truncate(message, MAX_MESSAGE_LEN))
yatest.common.process.TimeoutError: 600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9750504073/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/bx9e/002eb1/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "devtools/ya/test/programs/test_tool/run_test/run_test.py", line 1770, in main
    res.wait(check_exit_code=False, timeout=current_run_test_timeout, on_timeout=timeout_callback)
  File "library/python/testing/yatest_common/yatest/common/process.py", line 398, in wait
    raise ExecutionTimeoutError(self, str(e))
yatest.common.process.ExecutionTimeoutError: (("600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9750504073/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/bx9e/002eb1/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout",), {})
2025-10-10T14:56:29.156697Z :RetryDiscoveryWithCancel INFO: Random seed for debugging is 1760108189156607
2025-10-10T14:56:29.654276Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559607111440631140:2087];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:29.669716Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:56:29.713402Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-10T14:56:29.731059Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:56:29.757422Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559607110331829148:2258];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:29.757654Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:56:29.765608Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-10T14:56:29.766102Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e87/r3tmp/tmp9qBGu5/pdisk_1.dat
2025-10-10T14:56:30.068724Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:30.099568Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:30.153023Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:56:30.180941Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:30.181091Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:30.182570Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:30.182686Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:30.191927Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:56:30.193735Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:56:30.195037Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 17777, node 1
2025-10-10T14:56:30.283547Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e87/r3tmp/yandexRQgD6b.tmp
2025-10-10T14:56:30.283605Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e87/r3tmp/yandexRQgD6b.tmp
2025-10-10T14:56:30.283801Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e87/r3tmp/yandexRQgD6b.tmp
2025-10-10T14:56:30.283946Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:56:30.306204Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:56:30.312812Z INFO: TTestServer started on Port 4104 GrpcPort 17777
2025-10-10T14:56:30.396199Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:4104
PQClient connected to localhost:17777
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:56:30.643696Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:56:30.661328Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
waiting...
2025-10-10T14:56:30.748904Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
2025-10-10T14:56:33.851001Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:33.853224Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7559607127511698429:2292], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:33.853536Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=Y2E4ZjY1ZmMtN2U0NDk5NTItMzI4YzMyMC05YWNlOGExOQ==, ActorId: [2:7559607127511698427:2291], ActorState: ExecuteState, TraceId: 01k779z9j75hw80h5akat6yyjn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:33.855514Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:33.854474Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7559607128620501292:2321], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:33.854686Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=MmQ1M2VlZjUtNmFjMTAxYzgtMjBiMTY1YWMtOTBlNzFhNmE=, ActorId: [1:7559607128620501289:2319], ActorState: ExecuteState, TraceId: 01k779z9qm6pv90xwa99zm66x8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:33.855561Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:34.032218Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:34.198457Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:17777", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:56:34.507569Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k779zagb5ar7xffa6bhjcghv, Database: , SessionId: ydb://session/3?node_id=1&id=OTE3YTNlOTQtNzAyMGNmZmMtODA1NGJjZmEtZDJjYmM4ZjI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559607132915468969:2904] 
2025-10-10T14:56:34.653954Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559607111440631140:2087];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:34.654034Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:56:34.753512Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559607110331829148:2258];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:34.753588Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:56:40.656292Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:17777
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:40.809987Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:17777
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:56:40.850977Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559607158685273323:3239] connected; active server actors: 1
2025-10-10T14:56:40.851224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:56:40.851782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:56:40.852981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:56:40.877616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:56:40.883495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:56:40.881008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:56:40.881326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:56:40.881372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:40.881410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:56:40.882005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607158685273322:3238], now have 1 active actors on pipe
2025-10-10T14:56:40.882040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607158685273350:2451], now have 1 active actors on pipe
2025-10-10T14:56:40.882950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.888482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:40.899061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607158685273390:3290], now have 1 active actors on pipe
2025-10-10T14:56:40.899740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.906458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:40.909272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:40.909383Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:40.909685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:40.909974Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559607157576470101:2395]
2025-10-10T14:56:40.911938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:40.911955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:56:40.911969Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559607157576470101:2395]
2025-10-10T14:56:40.912014Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:40.913071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:56:40.913105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.913621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.913642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:40.913676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:40.913691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.913702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.913713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:40.913768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:40.914146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.914327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:40.928279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:40.928477Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108200942, TxId 281474976710679
2025-10-10T14:56:40.928499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.928509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.928678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.928956Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:40.932829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:40.933218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:40.933260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.933276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.933287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.933317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:40.933708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:56:40.933843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:40.934119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.944396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:40.944532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.951756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:41.013965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.013994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.014005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.022319Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710680. Ctx: { TraceId: 01k779zgwy08w19rd37jbyc979, Database: , SessionId: ydb://session/3?node_id=1&id=NjU3OGRiNi00YjI5ZGIyYS1lN2E3ODBiMC1kMzBiMTk5Mg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1760108200942
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1760108200942
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:17777
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:41.052436Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:41.117353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.117398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.117407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.217835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.217863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.217885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.318097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.318119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.318129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.419103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.419130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.419139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.521030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.521057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.521067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:17777
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:41.557615Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-10T14:56:41.622461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.622486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.622496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.722562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.722590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.722599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.822920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.822948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.822961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.924015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.924050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.924059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.024182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.024219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.024229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:17777
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:42.064180Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:56:42.085730Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:56:42.086266Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:56:42.086301Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:17777
2025-10-10T14:56:42.097600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:56:42.097642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:56:42.128614Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:42.125362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.125388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.125397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.129241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:42.129364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:49972
2025-10-10T14:56:42.129378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49972 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:56:42.129390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:56:42.130836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:56:42.130998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:56:42.131009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:56:42.131017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:56:42.131032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559607167275208151:2488] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:56:42.132926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559607167275208151:2488] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:56:42.225889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.225917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.225925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.271264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559607167275208151:2488] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:56:42.271859Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607167275208188:2488] connected; active server actors: 1
2025-10-10T14:56:42.272017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559607167275208151:2488] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:56:42.272034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559607167275208151:2488] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:56:42.273594Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607167275208188:2488] disconnected; active server actors: 1
2025-10-10T14:56:42.273624Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607167275208188:2488] disconnected no session
2025-10-10T14:56:42.326200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.326229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.326238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.374827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607167275208210:2488], now have 1 active actors on pipe
2025-10-10T14:56:42.375126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:42.375160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:42.375247Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|53de8816-aaf15049-e8a78ef3-bcd44473_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:56:42.375291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.375313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.375328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:42.375394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.375443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:56:42.375491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:42.376015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:42.376038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:42.376111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:42.374036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559607167275208151:2488] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:56:42.374083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559607167275208151:2488] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:56:42.377284Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760108202377 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:42.374102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559607167275208151:2488] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:56:42.374129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:56:42.374923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:56:42.376342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|53de8816-aaf15049-e8a78ef3-bcd44473_0
2025-10-10T14:56:42.377422Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|53de8816-aaf15049-e8a78ef3-bcd44473_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:56:42.377721Z :INFO: [] MessageGroupId [src] SessionId [src|53de8816-aaf15049-e8a78ef3-bcd44473_0] Write session: close. Timeout = 0 ms
2025-10-10T14:56:42.377751Z :INFO: [] MessageGroupId [src] SessionId [src|53de8816-aaf15049-e8a78ef3-bcd44473_0] Write session will now close
2025-10-10T14:56:42.377817Z :DEBUG: [] MessageGroupId [src] SessionId [src|53de8816-aaf15049-e8a78ef3-bcd44473_0] Write session: aborting
2025-10-10T14:56:42.378156Z :INFO: [] MessageGroupId [src] SessionId [src|53de8816-aaf15049-e8a78ef3-bcd44473_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:56:42.378185Z :DEBUG: [] MessageGroupId [src] SessionId [src|53de8816-aaf15049-e8a78ef3-bcd44473_0] Write session: destroy
2025-10-10T14:56:42.379447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607167275208210:2488] destroyed
2025-10-10T14:56:42.379485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:56:42.379514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.379528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.379540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.378811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|53de8816-aaf15049-e8a78ef3-bcd44473_0 grpc read done: success: 0 data: 
2025-10-10T14:56:42.378827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|53de8816-aaf15049-e8a78ef3-bcd44473_0 grpc read failed
2025-10-10T14:56:42.378866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|53de8816-aaf15049-e8a78ef3-bcd44473_0
2025-10-10T14:56:42.378876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|53de8816-aaf15049-e8a78ef3-bcd44473_0 is DEAD
2025-10-10T14:56:42.379138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:56:42.429240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.429270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.429279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-10T14:56:42.450888Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:29224 } ]
2025-10-10T14:56:42.529506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.529538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.529558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.631813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.631835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.631843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.731726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.731754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.731764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.832142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.832179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.832199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.932425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.932453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.932462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.032799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.032827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.032835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.137227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.137258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.137267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.237670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.237701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.237712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.338016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.338039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.338051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.441429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.441453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.441462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.542667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.542708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.542718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.643581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.643606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.643616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.743915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.743941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.743952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.844303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.844330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.844341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.944671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.944703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.944715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.045199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.045226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.045237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.146121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.146151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.146160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.246207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.246235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.246246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.346553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.346582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.346591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.446966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.446994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.447002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.549234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.549264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.549280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.649481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.649510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.649520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.750193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.750233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.750243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.850418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.850450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.850462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.951801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.951829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.951839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.053287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.053319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.053331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.094097Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:56:45.094127Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:56:45.153502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.153531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.153544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.253887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.253918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.253928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.354325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.354355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.354366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.455081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.455110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.455133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.555401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.555429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.555441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.655734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.655761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.655771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.757274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.757302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.757313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.856957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.856985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.856995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.915129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:45.961238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.961267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.961277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.061534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.061565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.061575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.161635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.161661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.161670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.261986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.262013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.262023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.365646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.365678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.365688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.465546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.465572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.465582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.566004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.566033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.566043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.666616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.666639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.666646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.767215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.767240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.767249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.869622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.869654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.869664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.973221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.973249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.973258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.077235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.077267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.077278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.175937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.175958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.175981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.276239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.276285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.276293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.376798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.376832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.376861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.476958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.476989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.476998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.577268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.577299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.577308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.679647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.679672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.679681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.780017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.780047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.780056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.880402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.880429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.880438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.981618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.981647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.981657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.084614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.084647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.084658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.185103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.185151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.185162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.285373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.285400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.285409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.386492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.386520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.386530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.489310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.489343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.489353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.589545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.589575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.589584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.690021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.690049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.690059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.790195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.790223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.790234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.891491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.891522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.891533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.991981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.992021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.992033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.093436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.093467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.093478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.193213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.193245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.193258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.294322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.294353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.294366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.397258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.397292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.397303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.498467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.498494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.498506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.598913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.598940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.598951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.701574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.701599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.701609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.801938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.801969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.801979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.905309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.905339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.905348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.007008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.007038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.007048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.107128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.107176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.107188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.207664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.207692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.207702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.309249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.309278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.309313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.409195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.409227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.409238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.509586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.509612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.509622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.609953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.609981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.609990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:56:50.713330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.713365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.713375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.818467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.818495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.818503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.917713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:50.925234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.925264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.925273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.025610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.025648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.025658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.126919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.126946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.126957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.229236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.229266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.229276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.329390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.329425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.329436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.430692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.430722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.430732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.537261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.537300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.537310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.641243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.641277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.641287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.741718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.741745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.741762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.842275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.842302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.842313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.942589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.942618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.942639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.042992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.043021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.043031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.143403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.143435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.143446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.243663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.243687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.243698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.345143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.345176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.345188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.449220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.449247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.449257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.553447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.553475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.553485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.654735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.654762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.654773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.754927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.754955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.754967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.855528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.855553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.855574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.957666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.957692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.957705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.057762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.057804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.057823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.159126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.159156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.159166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.263347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.263377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.263387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.362766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.362796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.362807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.465340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.465371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.465381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.564130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.564164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.564175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.664512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.664546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.664556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.764824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.764862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.764871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.865191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.865217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.865229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.965490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.965513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.965519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.069343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.069376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.069386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.173236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.173270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.173282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.273276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.273307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.273317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.373568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.373596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.373606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.476933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.476963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.476974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.578131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.578161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.578171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.681250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.681283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.681294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.781619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.781647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.781657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.884667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.884700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.884711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.984920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.984952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.984966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.087151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.087182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.087195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.189794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.189840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.189853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.290065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.290101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.290123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.392409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.392444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.392456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.497468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.497498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.497511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.601531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.601566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.601576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.702049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.702079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.702088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.802116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.802157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.802168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.902882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.902914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.902925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.917717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:56.003663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.003693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.003700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.105450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.105480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.105491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.211063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.211098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.211109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.311739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.311769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.311780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.411872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.411914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.411928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.512214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.512245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.512255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.613348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.613378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.613399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.715154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.715183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.715193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.817437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.817467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.817477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.919037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.919074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.919084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.020738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.020766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.020777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.121301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.121335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.121346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.222486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.222518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.222526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.322827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.322866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.322878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.425574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.425602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.425611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.526963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.526993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.527003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.627369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.627397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.627406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.728910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.728950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.728960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.829050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.829078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.829088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.933272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.933309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.933319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.032878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.032908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.032921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.133238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.133270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.133282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.237652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.237682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.237694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.343017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.343038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.343049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.445287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.445316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.445327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.549407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.549435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.549447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.653241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.653271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.653282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.753246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.753271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.753283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.857604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.857633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.857644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.961114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.961180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.961189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.062881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.062920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.062930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.163055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.163094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.163106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.263200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.263228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.263239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.366270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.366301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.366312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.466484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.466514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.466529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.569310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.569339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.569350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.673233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.673267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.673276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.777304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.777338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.777349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.876546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.876572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.876581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.977320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.977357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.977368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.081252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.081286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.081296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.181727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.181768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.181778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.282181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.282209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.282221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.382426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.382455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.382467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.483124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.483152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.483164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.583159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.583187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.583194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.685246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.685280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.685292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.787263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.787293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.787304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.887288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.887330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.887343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.921427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:00.987587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.987640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.987651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.090132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.090160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.090170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.193248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.193281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.193291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.297240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.297273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.297284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.397224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.397251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.397262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.497575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.497606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.497617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.600353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.600390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.600401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.701258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.701293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.701305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.801886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.801912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.801926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.902083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.902109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.902121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.003189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.003221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.003232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.104058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.104100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.104113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.205325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.205367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.205379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.305494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.305526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.305538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.406502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.406548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.406559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.509278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.509312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.509323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.611507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.611542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.611554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.713115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.713166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.713177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.813369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.813410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.813420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.914601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.914629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.914636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.017842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.017870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.017882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.118204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.118226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.118236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.218421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.218449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.218462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.320177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.320206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.320217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.421339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.421374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.421387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.525286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.525328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.525341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.629498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.629534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.629545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.729433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.729462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.729471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.833277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.833310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.833322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.936383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.936415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.936426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.036576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.036615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.036625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.137547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.137578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.137589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.238052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.238074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.238085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.339989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.340021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.340034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.441396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.441433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.441446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.541447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.541474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.541485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.644800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.644833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.644843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.744101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.744139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.744152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.845571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.845603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.845614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.946518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.946548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.946562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.049717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.049758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.049771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.153165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.153196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.153209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.256812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.256841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.256853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.357346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.357374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.357386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.459968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.459994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.460006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.562822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.562850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.562862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.665335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.665363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.665374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.765898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.765923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.765935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.869241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.869273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.869285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.922198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:05.969426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.969454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.969465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.073513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.073549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.073560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.173619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.173650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.173660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.276463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.276507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.276518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.377471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.377502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.377513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.478015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.478048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.478058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.585259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.585296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.585306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.685243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.685278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.685291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.785820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.785848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.785859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.886156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.886186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.886198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.015884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.016078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.016091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.116310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.116335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.116345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.217359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.217385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.217397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.317424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.317450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.317463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.417864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.417891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.417903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.518209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.518237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.518249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.622092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.622121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.622132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.723555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.723585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.723596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.825810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.825840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.825851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.926979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.927025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.927034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.029449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.029479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.029491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.129488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.129513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.129524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.233254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.233286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.233297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.337367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.337397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.337406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.436200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.436231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.436241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.541258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.541291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.541302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.641635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.641660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.641670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.743966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.743995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.744006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.845287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.845316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.845326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.945255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.945282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.945292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.048004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.048039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.048048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.148544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.148575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.148586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.248698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.248743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.248754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.349260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.349294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.349306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.449484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.449511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.449522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.549898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.549928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.549939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.650278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.650298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.650304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.750987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.751011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.751022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.853270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.853304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.853314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.953226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.953269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.953281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.055249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.055281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.055293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.157165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.157195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.157207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.256841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.256872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.256883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.357934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.357967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.357980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.458725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.458760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.458773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.560145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.560176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.560188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.663001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.663030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.663040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.766202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.766236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.766248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.856464Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:57:10.855545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:57:10.855658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T14:57:10.857464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:57:10.858074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:57:10.859662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-10T14:57:10.864639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.864669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.864679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.922668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:10.968128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.968156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.968166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.068403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.068433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.068445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.169211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.169241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.169252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.270140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.270182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.270193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.372626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.372656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.372666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.475957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.475990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.476000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.578979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.579006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.579017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.681299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.681328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.681338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.781578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.781604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.781620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.882419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.882449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.882459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.982869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.982898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.982908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.083547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.083581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.083591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.189272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.189306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.189318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.297312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.297346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.297359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.401879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.401913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.401925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.504871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.504915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.504926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.609247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.609285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.609297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.717264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.717312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.717327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.817488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.817514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.817525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.921238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.921274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.921285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.025819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.025849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.025860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.129264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.129298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.129308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.226469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.226500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.226522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.328888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.328933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.328944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.430222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.430255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.430266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.532884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.532918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.532931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.633523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.633563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.633574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.737348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.737387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.737400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.837829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.837856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.837868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.939825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.939855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.939866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.040024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.040054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.040065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.140474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.140509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.140522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.242585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.242614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.242624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.342101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.342124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.342131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.443609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.443641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.443652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.545455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.545484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.545493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.647735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.647762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.647771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.749344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.749371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.749383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.857246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.857278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.857289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.957394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.957424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.957436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.055760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.055791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.055803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.155755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.155784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.155795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.257251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.257284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.257297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.361816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.361851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.361863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.462481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.462524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.462536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.568450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.568489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.568502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.669254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.669292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.669305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.769060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.769102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.769113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.869400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.869440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.869452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.925428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:15.969747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.969795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.969819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.070657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.070688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.070701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.174192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.174228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.174243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.275006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.275036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.275047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.376875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.376911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.376921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.476975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.477009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.477020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.577435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.577470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.577481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.679385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.679420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.679439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.782848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.782878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.782888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.883544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.883574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.883584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.984116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.984151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.984160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.084439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.084474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.084501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.184727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.184757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.184770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.285087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.285120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.285148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.385378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.385404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.385416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.486003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.486029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.486039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.587357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.587387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.587398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.689360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.689389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.689400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.793236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.793269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.793280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.897239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.897272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.897283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.997340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:17.997366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:17.997384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.100313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.100346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.100359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.201965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.201997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.202008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.305329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.305359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.305380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.405930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.405962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.405973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.506864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.506897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.506908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.607529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.607566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.607578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.708428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.708471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.708483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.809022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.809057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.809068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:18.913266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:18.913298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:18.913308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.017257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.017291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.017300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.121245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.121277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.121288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.218871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.218892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.218900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.319289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.319329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.319341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.422770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.422805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.422817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.523044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.523077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.523089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.624433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.624465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.624478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.724774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.724803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.724816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.825239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.825271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.825283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:19.925411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:19.925442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:19.925453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.027834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.027864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.027875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.128205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.128236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.128246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.228532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.228564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.228576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.328875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.328897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.328905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.431184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.431212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.431223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.532898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.532930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.532942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.633039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.633068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.633081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-10T14:57:20.717356Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:29224 } ]
2025-10-10T14:57:20.733487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.733522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.733534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.837252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.837288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.837300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:20.925940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:20.937175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:20.937210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:20.937223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.037543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.037574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.037600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.142354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.142387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.142398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.245353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.245381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.245393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.349256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.349289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.349300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.453259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.453289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.453302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.557148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.557175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.557184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.661242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.661274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.661284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.765456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.765489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.765500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.865924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.865948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.865955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:21.966280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:21.966311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:21.966324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.069245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.069280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.069293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.168031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.168059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.168070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.269232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.269265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.269277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.369276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.369307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.369317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.470358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.470389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.470402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.570192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.570219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.570230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.673298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.673333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.673344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.779473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.779505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.779516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.879832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.879874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.879885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:22.983574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:22.983610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:22.983622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.083981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.084009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.084020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.185379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.185409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.185428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.286064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.286096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.286107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.388278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.388303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.388311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.488713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.488750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.488760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.588830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.588863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.588873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.689165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.689196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.689209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.789483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.789509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.789520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.890119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.890153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.890166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:23.990454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:23.990484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:23.990495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.092919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.092947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.092959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.193253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.193285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.193297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.296006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.296036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.296047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.396508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.396537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.396547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.498973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.499005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.499015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.601312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.601345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.601355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.705248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.705279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.705290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.803531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.803572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.803583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:24.903557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:24.903579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:24.903589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.005242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.005274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.005300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.108109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.108142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.108153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.209236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.209266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.209277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.313237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.313267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.313278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.413977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.414002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.414013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.513934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.513961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.513973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.614622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.614659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.614674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.718390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.718419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.718431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.819855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.819883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.819894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.920073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:25.920100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:25.920113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:25.929521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:26.020306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.020347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.020358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.120846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.120873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.120886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.225347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.225379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.225391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.325482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.325525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.325537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.425953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.425984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.425997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.528369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.528400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.528411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.629824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.629855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.629867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.729897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.729923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.729934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.830288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.830317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.830329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:26.933288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:26.933322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:26.933333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.033286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.033328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.033341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.133420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.133455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.133465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.233893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.233923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.233933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.334103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.334128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.334138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.434463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.434495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.434505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.535871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.535905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.535916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.637370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.637403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.637414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.742300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.742326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.742336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.840950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.840978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.840989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:27.941307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:27.941338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:27.941348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.045256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.045292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.045302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.142050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.142083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.142094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.245518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.245553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.245565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.346527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.346560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.346583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.449360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.449393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.449405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.554695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.554725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.554736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.655099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.655130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.655141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.757244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.757277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.757287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.857369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.857396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.857409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:28.958424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:28.958455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:28.958466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.061375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.061402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.061413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.162385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.162413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.162424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.268215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.268245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.268257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.369401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.369438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.369451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.477251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.477286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.477300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.576111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.576141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.576153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.677247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.677278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.677290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.780380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.780420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.780432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.881450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.881473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.881485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:29.983193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:29.983222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:29.983233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:57:30.087583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.087610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.087619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.188115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.188145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.188156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.288375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.288417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.288428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.388701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.388741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.388753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.489042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.489070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.489093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.589407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.589441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.589452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.693697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.693727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.693739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.797304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.797339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.797351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.897631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.897662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.897675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.929531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:30.999975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.000006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.000017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.103630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.103665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.103676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.203822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.203850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.203869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.309317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.309347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.309358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.410352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.410383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.410393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.510463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.510492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.510503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.610926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.610960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.610973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.713270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.713318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.713332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.813609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.813640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.813654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.917474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.917505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.917517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.021246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.021277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.021290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.125235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.125269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.125280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.225316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.225355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.225366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.329253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.329284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.329296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.429303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.429334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.429346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.529967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.529999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.530010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.630641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.630678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.630690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.731278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.731313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.731324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.831477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.831506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.831517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.933261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.933293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.933304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.033197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.033236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.033249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.133613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.133657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.133670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.234283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.234311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.234323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.337241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.337271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.337284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.436212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.436241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.436252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.537657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.537685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.537698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.641222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.641251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.641262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.741716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.741748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.741773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.842233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.842265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.842278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.942478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.942509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.942532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.042836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.042872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.042883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.143190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.143221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.143235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.243561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.243597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.243609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.343912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.343942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.343954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.444207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.444238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.444250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.544611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.544646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.544659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.645244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.645278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.645290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.745288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.745318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.745329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.845616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.845648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.845659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.946007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:34.946047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:34.946060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.046337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.046373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.046386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.146718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.146742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.146751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.247051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.247073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.247082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.347389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.347417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.347440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.447768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.447803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.447814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.548122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.548153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.548165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.649536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.649562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.649574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.749869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.749890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.749898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.852114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.852142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.852158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:35.929812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:35.952215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:35.952246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:35.952257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.053048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.053078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.053092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.153270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.153305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.153316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.257379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.257412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.257424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.357610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.357639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.357649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.457940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.457981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.457991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.561361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.561391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.561403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.661413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.661442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.661453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.761529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.761559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.761570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.861930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.861958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.861968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:36.962237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:36.962268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:36.962278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.063332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.063374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.063385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.163522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.163564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.163577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.263820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.263862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.263874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.364209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.364236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.364249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.466555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.466582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.466595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.566980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.567014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.567026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.667291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.667337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.667349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.767653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.767685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.767698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.868060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.868088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.868100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:37.969261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:37.969296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:37.969310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.069450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.069495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.069508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.169705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.169738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.169753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.272324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.272356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.272369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.371298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.371334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.371346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.471670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.471701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.471713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.573357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.573392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.573405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.673392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.673434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.673447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.774754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.774781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.774794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.876955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.876985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.876998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:38.977328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:38.977361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:38.977372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.078451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.078489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.078503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.181277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.181308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.181331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.282231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.282266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.282278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.382003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.382039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.382050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.482405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.482438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.482451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.582723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.582770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.582782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.683018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.683047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.683060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.785338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.785368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.785381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.889030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.889069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.889080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:39.989202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:39.989236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:39.989246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.089552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:40.089584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:40.089596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.193488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:40.193529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:40.193541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.297231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:40.297268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:40.297279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.397246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:40.397281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:40.397291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.497629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:40.497682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:40.497694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.598164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:40.598188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:40.598196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.698344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:40.698372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:40.698382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.801255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:40.801294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:40.801304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.856015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:57:40.856094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-10T14:57:40.856798Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:57:40.857503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:57:40.857752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:57:40.901617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:40.901656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:40.901667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:40.929937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:41.003952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.003991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.004002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:41.104605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.104639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.104656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:41.205434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.205472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.205482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:41.308583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.308618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.308630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:41.408980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.409015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.409026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:41.512356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.512388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.512399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:41.617269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.617307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.617318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:41.717238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.717283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.717295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:41.817781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.817810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.817820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:41.917965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:41.917996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:41.918008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.018282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.018315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.018330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.118634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.118667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.118678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.221416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.221455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.221468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.322356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.322389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.322402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.425333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.425367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.425380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.525688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.525714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.525728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.627296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.627331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.627344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.727568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.727595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.727602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.827678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.827706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.827725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:42.929375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:42.929408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:42.929421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.029470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.029501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.029514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.129904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.129939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.129953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.233252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.233289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.233299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.333083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.333115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.333136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.436690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.436724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.436736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.536358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.536392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.536410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.636973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.637003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.637015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.738067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.738105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.738118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.839805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.839838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.839850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:43.940332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:43.940364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:43.940375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.040706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.040752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.040763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.141021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.141059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.141072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.241355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.241397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.241407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.341767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.341795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.341813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.442162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.442194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.442207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.547867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.547913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.547925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.647899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.647938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.647949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.748557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.748597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.748609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.850990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.851014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.851022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:44.951593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:44.951622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:44.951630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.053569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.053606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.053617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.157002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.157031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.157044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.257903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.257934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.257947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.358045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.358084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.358095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.459047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.459090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.459100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.561241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.561281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.561295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.661313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.661345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.661364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.761521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.761561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.761572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.861857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.861889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.861901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:45.930246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:45.965426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:45.965454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:45.965466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.069269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.069303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.069315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.173302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.173336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.173348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.277410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.277441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.277453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.377500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.377548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.377561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.477803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.477832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.477845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.578170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.578202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.578215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.678473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.678505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.678518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.781349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.781388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.781400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.881772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.881809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.881821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:46.982156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:46.982182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:46.982193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:47.082455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:47.082483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:47.082496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:47.182990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:47.183011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:47.183022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:47.286235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:47.286267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:47.286282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:47.388797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:47.388829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:47.388843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:47.488973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:47.489008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:47.489020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:47.589368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:47.589409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:47.589420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:47.689712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:47.689761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:47.689773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:47.793765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:47.793795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:47.793805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:47.897417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:47.897464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:47.897475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.000299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.000330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.000344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.101027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.101069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.101082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.201216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.201250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.201265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.301535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.301565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.301576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.401911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.401944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.401956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.502220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.502268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.502279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.602588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.602629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.602642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.702900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.702950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.702963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.803304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.803344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.803356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:48.905275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:48.905310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:48.905321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.006553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.006595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.006606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.106877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.106909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.106922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.207762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.207793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.207805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.308238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.308276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.308289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.408876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.408911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.408924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.508870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.508900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.508913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.609405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.609433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.609451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.709732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.709771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.709781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.813238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.813273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.813285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:49.914152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:49.914190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:49.914213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.017291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.017324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.017336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.115641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.115666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.115677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.216090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.216125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.216136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.316280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.316307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.316313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.417415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.417454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.417465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.517459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.517488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.517498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.621301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.621335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.621352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.725004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.725035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.725048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.825222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.825256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.825269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.925514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:50.925549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:50.925562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:50.931329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:51.025949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.025977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.025990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:51.126404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.126435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.126456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:51.227499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.227539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.227551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:51.327936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.327961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.327974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:51.428344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.428373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.428384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:51.531694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.531724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.531736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:51.634294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.634332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.634343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:51.734484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.734520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.734532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:51.834835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.834863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.834884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:51.935519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:51.935557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:51.935577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.038307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.038340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.038352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.138480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.138510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.138530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.238848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.238879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.238892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.340337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.340381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.340396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.440106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.440138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.440149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.540398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.540431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.540442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.640715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.640745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.640755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.741333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.741361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.741369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.841970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.842009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.842021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:52.941976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:52.942004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:52.942016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.045255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.045294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.045306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.149232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.149266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.149278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.248983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.249011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.249035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.349390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.349441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.349452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.449729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.449782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.449795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.550570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.550604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.550616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.650849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.650886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.650894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.751255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.751289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.751301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.851587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.851619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.851640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:53.952597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:53.952631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:53.952655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.053432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.053467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.053477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.155003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.155037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.155048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.255568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.255600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.255625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.355954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.355996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.356006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.456250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.456285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.456296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.556596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.556623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.556635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.657299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.657330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.657340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.761246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.761282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.761294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.861285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.861323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.861334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:54.961673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:54.961704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:54.961715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.061964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.062000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.062012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.165343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.165376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.165390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.265791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.265828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.265848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.366120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.366158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.366171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.469345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.469379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.469390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.568381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.568422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.568434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.668922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.668960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.668970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.769234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.769273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.769284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.869361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.869384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.869407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:55.931048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:55.969748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:55.969792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:55.969803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.070114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.070147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.070158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.171614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.171650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.171663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.272407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.272433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.272447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.372245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.372280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.372293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.472753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.472790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.472803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.572944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.572987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.572999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.674561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.674600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.674613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.774654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.774696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.774707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.874975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.875007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.875017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:56.977272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:56.977313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:56.977326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.081627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.081656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.081667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.183479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.183518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.183527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.285948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.285975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.285986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.386438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.386470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.386480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.486787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.486811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.486818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.587184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.587217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.587228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.688780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.688815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.688827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.789264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.789298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.789310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.889674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.889705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.889717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:57.990135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:57.990171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:57.990194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.090580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.090622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.090635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.191679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.191713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.191724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.292208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.292243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.292256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.392538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.392563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.392572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.492871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.492906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.492918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.597255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.597290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.597304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.697207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.697243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.697255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.797510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.797541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.797552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.898080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.898111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.898122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:58.998247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:58.998276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:58.998288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:59.098603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:59.098638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:59.098649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:59.198917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:59.198936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:59.198951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:59.299744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:59.299769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:59.299778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:59.400177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:59.400209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:59.400220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:59.500793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:59.500824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:59.500835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:59.600874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:59.600903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:59.600915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:59.701247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:59.701282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:59.701293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:59.802156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:59.802185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:59.802198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:59.902458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:59.902493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:59.902504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.002828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.002866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.002879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-10T14:58:00.043378Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:29224 } ]
2025-10-10T14:58:00.103142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.103172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.103194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.203438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.203467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.203477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.303878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.303909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.303922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.404145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.404174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.404184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.504531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.504565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.504576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.605347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.605384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.605396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.705724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.705768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.705780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.806471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.806504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.806516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.906995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:00.907031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:00.907045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:00.931246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:58:01.009267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.009300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.009314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:01.109239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.109273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.109285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:01.209563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.209598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.209611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:01.309904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.309936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.309956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:01.410225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.410254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.410266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:01.510640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.510672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.510684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:01.614338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.614373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.614389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:01.714348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.714380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.714392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:01.814762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.814799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.814811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:01.915122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:01.915166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:01.915178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.015451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.015495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.015507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.120580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.120613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.120626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.220757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.220787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.220808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.321151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.321190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.321202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.421476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.421513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.421526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.521820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.521853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.521865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.622139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.622166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.622177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.722524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.722563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.722576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.822899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.822944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.822956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:02.924804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:02.924846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:02.924858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.025264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.025298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.025310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.125494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.125524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.125533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.225903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.225934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.225946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.326198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.326231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.326242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.426525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.426579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.426589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.526900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.526934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.526949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.627197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.627231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.627242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.727610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.727641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.727651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.830489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.830522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.830533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:03.930865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:03.930900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:03.930910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.031220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.031262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.031276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.131538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.131573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.131585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.231908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.231942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.231964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.332253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.332293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.332305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.433246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.433281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.433301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.533491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.533521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.533533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.636612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.636648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.636660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.736701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.736728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.736739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.837113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.837174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.837191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:04.937453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:04.937502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:04.937516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.037815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.037850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.037862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.138300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.138337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.138348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.238509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.238540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.238550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.340274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.340306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.340317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.440749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.440783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.440796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.541088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.541142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.541155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.641471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.641501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.641514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.741823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.741864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.741876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.842214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.842268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.842286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:05.931328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:58:05.942472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:05.942505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:05.942517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:06.042835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:06.042869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:06.042878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:06.144407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:06.144440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:06.144451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:06.244586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:06.244618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:06.244638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:06.345039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:06.345076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:06.345087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:06.445418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:06.445453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:06.445466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:06.545683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:06.545734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:06.545745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:06.645989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:06.646018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:06.646032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:58:06.746346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:06.746378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:06.746390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:06.846704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:06.846748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:06.846761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:07.540437Z node 1 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [1:7559607532347432813:3276] TxId: 281474976710829. Ctx: { TraceId: 01k77a2544c4hbdnb6j7m6edcc, Database: /Root, SessionId: ydb://session/3?node_id=1&id=Y2E5ZTExOGEtZmEyYmU0YzAtODlkN2Y0YjEtODNkNjJhZDU=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 2
2025-10-10T14:58:07.541621Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559607532347432823:3284], TxId: 281474976710829, task: 4. Ctx: { TraceId : 01k77a2544c4hbdnb6j7m6edcc.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=1&id=Y2E5ZTExOGEtZmEyYmU0YzAtODlkN2Y0YjEtODNkNjJhZDU=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7559607532347432813:3276], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T14:58:07.544426Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559607532347432822:3283], TxId: 281474976710829, task: 2. Ctx: { TraceId : 01k77a2544c4hbdnb6j7m6edcc.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=1&id=Y2E5ZTExOGEtZmEyYmU0YzAtODlkN2Y0YjEtODNkNjJhZDU=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7559607532347432813:3276], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T14:58:08.521640Z :RecreateObserver INFO: Random seed for debugging is 1760108288521618
2025-10-10T14:58:08.879968Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559607535734417602:2078];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:58:08.884985Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:58:08.927996Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559607536922270644:2079];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:58:08.928882Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e87/r3tmp/tmpH63UcR/pdisk_1.dat
2025-10-10T14:58:08.997363Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:58:09.008166Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:58:09.008446Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-10T14:58:09.025503Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:58:09.063555Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:58:09.184540Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:58:09.218413Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:58:09.218502Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:58:09.226172Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:58:09.227119Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:58:09.237330Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:58:09.237412Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:58:09.242631Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 61996, node 3
2025-10-10T14:58:09.270299Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:58:09.316457Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:58:09.351590Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e87/r3tmp/yandex3lpDN9.tmp
2025-10-10T14:58:09.351621Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e87/r3tmp/yandex3lpDN9.tmp
2025-10-10T14:58:09.351756Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e87/r3tmp/yandex3lpDN9.tmp
2025-10-10T14:58:09.351942Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:58:09.401733Z INFO: TTestServer started on Port 4244 GrpcPort 61996
TClient is connected to server localhost:4244
PQClient connected to localhost:61996
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:58:09.678953Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T14:58:09.953294Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:58:09.981166Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:58:13.063216Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7559607557209255067:2322], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:58:13.065955Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=NzllNDFmZWQtZWMwZjAxODctYzQ1OTAyN2MtNzA5ZWQ2ZjI=, ActorId: [3:7559607557209255064:2320], ActorState: ExecuteState, TraceId: 01k77a2axc7mb9e0dfbtj4fata, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:58:13.066639Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:58:13.095883Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:58:13.159174Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7559607558397107415:2293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:58:13.163326Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=N2VjNjE0YzMtNWQ0Y2VkYTgtY2Y0NTM5MzUtODg2ODJiMjM=, ActorId: [4:7559607558397107413:2292], ActorState: ExecuteState, TraceId: 01k77a2azv4d0adkqbh0ejf61r, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:58:13.163776Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:58:13.255029Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:58:13.435244Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:61996", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:58:13.846449Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k77a2bfb5xpr34z24acpns57, Database: , SessionId: ydb://session/3?node_id=3&id=ZjA2NDNkYTYtNjU2YzY0ZWYtOWUyY2U3NjItMWYzZGE3YWY=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T14:58:13.880519Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559607535734417602:2078];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:58:13.880633Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559607557209255505:2946] 
2025-10-10T14:58:13.924591Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559607536922270644:2079];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:58:13.924684Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:58:20.284364Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:61996
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:58:20.384779Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:61996
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:58:20.427462Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:58:20.431203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:58:20.431521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:58:20.431564Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:58:20.431620Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:58:20.431916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607587274027205:3302], now have 1 active actors on pipe
2025-10-10T14:58:20.432823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:58:20.438791Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:58:20.467687Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559607587274027206:3303] connected; active server actors: 1
2025-10-10T14:58:20.468175Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:58:20.468842Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:58:20.470195Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7559607588461878959:2387], now have 1 active actors on pipe
2025-10-10T14:58:20.470328Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-10T14:58:20.471316Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:58:20.477063Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607587274027283:3360], now have 1 active actors on pipe
2025-10-10T14:58:20.477390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:58:20.481704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:58:20.482574Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:58:20.482618Z node 3 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:58:20.482850Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:58:20.483031Z node 3 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7559607587274027299:2458]
2025-10-10T14:58:20.486240Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:58:20.486268Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:58:20.486287Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7559607587274027299:2458]
2025-10-10T14:58:20.486310Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:58:20.487583Z node 3 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:58:20.487617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:20.487700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.487711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:58:20.487729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:58:20.487740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.487749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.487759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:58:20.487792Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:58:20.488106Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:58:20.488241Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:58:20.491795Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:58:20.491923Z node 3 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108300524, TxId 281474976710679
2025-10-10T14:58:20.491942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.491953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.492089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:20.492273Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:58:20.494403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:58:20.494685Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:58:20.494709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:20.494720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.494731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:20.494757Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:58:20.495103Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:58:20.495185Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:58:20.495449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:58:20.499955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:58:20.500039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:58:20.503984Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:58:20.587758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:20.587800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.587811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:20.628786Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710680. Ctx: { TraceId: 01k77a2j5173mgvvfwph6798v7, Database: , SessionId: ydb://session/3?node_id=3&id=N2ZkNzBlZi1mM2Q3ZmViMi02YzNlYzUwNy1kOTBkMDY3Yw==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1760108300524
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1760108300524
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:61996
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:58:20.659798Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:58:20.688231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:20.688261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.688273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:20.788418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:20.788450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.788461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:20.889335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:20.889365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.889381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:20.993295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:20.993326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:20.993338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.093673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.093702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.093713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:61996
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:58:21.165259Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:58:21.176269Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:58:21.176961Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:58:21.177161Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:61996
2025-10-10T14:58:21.188877Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:58:21.189952Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:58:21.189991Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:58:21.190773Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:58:21.190882Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:48424
2025-10-10T14:58:21.190901Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48424 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:58:21.190911Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:58:21.192483Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:58:21.192604Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:58:21.192614Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:58:21.192621Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:58:21.192636Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559607591568994744:2485] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:58:21.195684Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559607591568994744:2485] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:58:21.195927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.195949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.195960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.309831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.309856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.309866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.357092Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559607591568994744:2485] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:58:21.358097Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607591568994796:2485] connected; active server actors: 1
2025-10-10T14:58:21.358968Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607591568994796:2485] disconnected; active server actors: 1
2025-10-10T14:58:21.358995Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607591568994796:2485] disconnected no session
2025-10-10T14:58:21.358580Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559607591568994744:2485] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:58:21.358607Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559607591568994744:2485] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:58:21.487019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.487054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.487066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.501972Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559607591568994744:2485] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:58:21.502009Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559607591568994744:2485] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:58:21.502027Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559607591568994744:2485] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:58:21.502058Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:58:21.503403Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-10T14:58:21.503450Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607591568994812:2485], now have 1 active actors on pipe
2025-10-10T14:58:21.503544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:58:21.503570Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:58:21.503643Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:58:21.503685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.503707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.503717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:58:21.503753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.503793Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:58:21.503839Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:58:21.503937Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:58:21.503957Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:58:21.504007Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:58:21.504116Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0
2025-10-10T14:58:21.504886Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760108301504 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:58:21.505029Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:58:21.509242Z :INFO: [] MessageGroupId [src] SessionId [src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0] Write session: close. Timeout = 0 ms
2025-10-10T14:58:21.509303Z :INFO: [] MessageGroupId [src] SessionId [src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0] Write session will now close
2025-10-10T14:58:21.509354Z :DEBUG: [] MessageGroupId [src] SessionId [src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0] Write session: aborting
2025-10-10T14:58:21.510826Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0 grpc read done: success: 0 data: 
2025-10-10T14:58:21.510857Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0 grpc read failed
2025-10-10T14:58:21.510900Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0 grpc closed
2025-10-10T14:58:21.510921Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0 is DEAD
2025-10-10T14:58:21.511730Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:58:21.511866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559607591568994812:2485] destroyed
2025-10-10T14:58:21.511906Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:58:21.511932Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.511944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.511982Z :INFO: [] MessageGroupId [src] SessionId [src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:58:21.511954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.513077Z :DEBUG: [] MessageGroupId [src] SessionId [src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0] Write session is aborting and will not restart
2025-10-10T14:58:21.517207Z :DEBUG: [] MessageGroupId [src] SessionId [src|ecc48cb2-383b0e06-2a97c3c9-1fce267e_0] Write session: destroy
Session was created
2025-10-10T14:58:21.587178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.587207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.587217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.687511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.687537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.687549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.787881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.787921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.787933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.891360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.891391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.891402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:21.996754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:21.996783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:21.996794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:22.097181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:22.097223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:22.097238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:22.197485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:22.197527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:22.197542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:22.297837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:22.297866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:22.297879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:22.398178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:22.398208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:22.398222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:22.498533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:22.498575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:22.498590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-10-10T14:58:22.548411Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:8444 } ]
2025-10-10T14:58:22.548576Z :ERROR: [/Root] [] [25d3e9be-f019c24-5c36e427-b2221ff7] Federated state update failed. FederationState: { Status: TRANSPORT_UNAVAILABLE SelfLocation: "" Issues: { [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:8444 } ] } }
>>> Got event: SessionClosed { Status: TRANSPORT_UNAVAILABLE Issues: "<main>: Error: GRpc error: (14): mock 'unavailable' <main>: Error: Grpc error response on endpoint localhost:8444 " }
Session2 was created
2025-10-10T14:58:22.598894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:22.598928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:22.598944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:22.700656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:22.700693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:22.700709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:22.801147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:22.801178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:22.801190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:22.901461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:22.901488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:22.901500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.001784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.001807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.001816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.103857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.103907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.103920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.204200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.204230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.204240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.304400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.304430Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.304443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.404850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.404884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.404907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.505112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.505157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.505170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:58:23.557398Z :INFO: [/Root] [] [d4988f1e-55bcaa48-754e0667-650ba5cd] Open read subsessions to databases: { name: dc1, endpoint: localhost:61996, path: /Root }, { name: dc2, endpoint: localhost:61996, path: /Root }, { name: dc3, endpoint: localhost:61996, path: /Root }
2025-10-10T14:58:23.568365Z :INFO: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] Starting read session
2025-10-10T14:58:23.568422Z :DEBUG: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] Starting single session
2025-10-10T14:58:23.568914Z :DEBUG: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:58:23.568961Z :DEBUG: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:58:23.569011Z :DEBUG: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:58:23.574587Z :INFO: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] Starting read session
2025-10-10T14:58:23.574638Z :DEBUG: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] Starting single session
2025-10-10T14:58:23.574745Z :DEBUG: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:58:23.574779Z :DEBUG: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:58:23.574806Z :DEBUG: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:58:23.576697Z :INFO: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] Starting read session
2025-10-10T14:58:23.576732Z :DEBUG: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] Starting single session
2025-10-10T14:58:23.576833Z :DEBUG: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:58:23.576858Z :DEBUG: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:58:23.576884Z :DEBUG: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:58:23.584703Z :DEBUG: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] [] Successfully connected. Initializing session
2025-10-10T14:58:23.585284Z :DEBUG: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] [] Successfully connected. Initializing session
2025-10-10T14:58:23.587736Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:58:23.587776Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T14:58:23.589313Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:58:23.589324Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-10T14:58:23.595299Z :DEBUG: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] [] Successfully connected. Initializing session
2025-10-10T14:58:23.605006Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:58:23.605353Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 read init: from# ipv6:[::1]:48448, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:58:23.605897Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:58:23.605917Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-10T14:58:23.606004Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 auth for : user
2025-10-10T14:58:23.606060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.606073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.606084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.606815Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:58:23.607052Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:58:23.607077Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 read init: from# ipv6:[::1]:48448, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:58:23.607162Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 read init: from# ipv6:[::1]:48448, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:58:23.607362Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 auth for : user
2025-10-10T14:58:23.607380Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 auth for : user
2025-10-10T14:58:23.607557Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 Handle describe topics response
2025-10-10T14:58:23.607691Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 auth is DEAD
2025-10-10T14:58:23.607822Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:58:23.609065Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:58:23.610155Z :INFO: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] [] Got InitResponse. ReadSessionId: shared/user_3_1_1911113861642898257_v1
2025-10-10T14:58:23.610212Z :DEBUG: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:58:23.610483Z :DEBUG: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:58:23.612764Z :INFO: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] [] Got InitResponse. ReadSessionId: shared/user_3_2_1143946551272184665_v1
2025-10-10T14:58:23.612821Z :DEBUG: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:58:23.613021Z :DEBUG: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:58:23.611030Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:58:23.611191Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 got read request: guid# ed6e43bd-47d8c145-5436bac2-47738629
2025-10-10T14:58:23.613212Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607600158929573:2533] connected; active server actors: 1
2025-10-10T14:58:23.611424Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 Handle describe topics response
2025-10-10T14:58:23.611507Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 auth is DEAD
2025-10-10T14:58:23.613327Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559607600158929573:2533] session shared/user_3_1_1911113861642898257_v1
2025-10-10T14:58:23.611701Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:58:23.612493Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:58:23.613392Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:58:23.612554Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 Handle describe topics response
2025-10-10T14:58:23.613454Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:58:23.612620Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 auth is DEAD
2025-10-10T14:58:23.612665Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:58:23.613504Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_1911113861642898257_v1" (Sender=[3:7559607600158929566:2533], Pipe=[3:7559607600158929573:2533], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:58:23.613542Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:58:23.613612Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:58:23.613686Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_1911113861642898257_v1" (Sender=[3:7559607600158929566:2533], Pipe=[3:7559607600158929573:2533], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:58:23.613954Z :INFO: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] [] Got InitResponse. ReadSessionId: shared/user_3_3_7235884730977489209_v1
2025-10-10T14:58:23.613781Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_1911113861642898257_v1" sender [3:7559607600158929566:2533] lock partition 0 for ReadingSession "shared/user_3_1_1911113861642898257_v1" (Sender=[3:7559607600158929566:2533], Pipe=[3:7559607600158929573:2533], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T14:58:23.613990Z :DEBUG: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:58:23.613851Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:58:23.613888Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000238s
2025-10-10T14:58:23.614195Z :DEBUG: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:58:23.614252Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607600158929576:2534] connected; active server actors: 1
2025-10-10T14:58:23.616198Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559607600158929576:2534] session shared/user_3_2_1143946551272184665_v1
2025-10-10T14:58:23.616244Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_1143946551272184665_v1" (Sender=[3:7559607600158929567:2534], Pipe=[3:7559607600158929576:2534], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:58:23.616261Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:58:23.616291Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607600158929577:2536] connected; active server actors: 1
2025-10-10T14:58:23.616317Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:58:23.616338Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:58:23.616396Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_1911113861642898257_v1" sender [3:7559607600158929566:2533]  release partitions [0]. Target status Free
2025-10-10T14:58:23.616432Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000099s
2025-10-10T14:58:23.616892Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559607600158929577:2536] session shared/user_3_3_7235884730977489209_v1
2025-10-10T14:58:23.616929Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_7235884730977489209_v1" (Sender=[3:7559607600158929569:2536], Pipe=[3:7559607600158929577:2536], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:58:23.616949Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:58:23.613534Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:58:23.616979Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:58:23.616999Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:58:23.613697Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:58:23.617015Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000021s
2025-10-10T14:58:23.613740Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 got read request: guid# 86f9e7f6-28d52596-125f0bcc-86f63d2
2025-10-10T14:58:23.614510Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:58:23.614582Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 got read request: guid# 533a580e-a6af6929-2ce576b-d8d27454
2025-10-10T14:58:23.615571Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_1_1911113861642898257_v1" ClientId: "user" PipeClient { RawX1: 7559607600158929573 RawX2: 4503612512274917 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:58:23.615748Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:58:23.616338Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7559607600158929579:2542]
2025-10-10T14:58:23.616378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607600158929579:2542], now have 1 active actors on pipe
2025-10-10T14:58:23.616478Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:58:23.616498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:58:23.616530Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_1_1911113861642898257_v1 on pipe: [3:7559607600158929579:2542]
2025-10-10T14:58:23.616590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.616617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.616657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:58:23.616734Z node 3 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_1_1911113861642898257_v1
2025-10-10T14:58:23.616756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.616903Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:58:23.616942Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_1_1911113861642898257_v1:1 with generation 1
2025-10-10T14:58:23.618680Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 gone release: partition# 0
2025-10-10T14:58:23.618720Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:58:23.618749Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:58:23.618788Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:58:23.619393Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [3:7559607600158929573:2533] session shared/user_3_1_1911113861642898257_v1 partition 0
2025-10-10T14:58:23.619455Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:58:23.619502Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:58:23.619543Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_2_1143946551272184665_v1" (Sender=[3:7559607600158929567:2534], Pipe=[3:7559607600158929576:2534], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:58:23.619586Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_2_1143946551272184665_v1" sender [3:7559607600158929567:2534] lock partition 0 for ReadingSession "shared/user_3_2_1143946551272184665_v1" (Sender=[3:7559607600158929567:2534], Pipe=[3:7559607600158929576:2534], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-10T14:58:23.619629Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:58:23.619646Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000128s
2025-10-10T14:58:23.619833Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_1_1911113861642898257_v1
2025-10-10T14:58:23.619878Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559607600158929579:2542] destroyed
2025-10-10T14:58:23.620076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:58:23.620149Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:58:23.620179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.620199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.620215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.620243Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:58:23.620280Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:58:23.621046Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_3_2_1143946551272184665_v1" ClientId: "user" PipeClient { RawX1: 7559607600158929576 RawX2: 4503612512274918 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:58:23.621103Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_1_1911113861642898257_v1
2025-10-10T14:58:23.621172Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:58:23.621721Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7559607600158929586:2543]
2025-10-10T14:58:23.621773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607600158929586:2543], now have 1 active actors on pipe
2025-10-10T14:58:23.621907Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:58:23.621929Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:58:23.621955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_2_1143946551272184665_v1 on pipe: [3:7559607600158929586:2543]
2025-10-10T14:58:23.621997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.622014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.622023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:58:23.622075Z node 3 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_2_1143946551272184665_v1
2025-10-10T14:58:23.622085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.622182Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:58:23.622213Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_2_1143946551272184665_v1:1 with generation 1
2025-10-10T14:58:23.626113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:58:23.626195Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:58:23.626223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.626233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.626245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.626272Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:58:23.626316Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:58:23.626502Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760108303620 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:58:23.626539Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:58:23.626614Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 sending to client partition status
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-10T14:58:23.633395Z :INFO: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] Closing read session. Close timeout: 0.000000s
2025-10-10T14:58:23.633477Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:58:23.633533Z :INFO: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] Counters: { Errors: 0 CurrentSessionLifetimeMs: 65 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:58:23.633658Z :NOTICE: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-10T14:58:23.633711Z :DEBUG: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] [] Abort session to cluster
2025-10-10T14:58:23.641253Z :INFO: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] Closing read session. Close timeout: 0.000000s
2025-10-10T14:58:23.641322Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:58:23.640111Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:58:23.641367Z :INFO: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] Counters: { Errors: 0 CurrentSessionLifetimeMs: 66 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:58:23.640144Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 grpc read failed
2025-10-10T14:58:23.640184Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 grpc closed
2025-10-10T14:58:23.640230Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_1143946551272184665_v1 is DEAD
2025-10-10T14:58:23.642531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_2_1143946551272184665_v1
2025-10-10T14:58:23.642594Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559607600158929586:2543] destroyed
2025-10-10T14:58:23.642674Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_2_1143946551272184665_v1
2025-10-10T14:58:23.645175Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607600158929576:2534] disconnected; active server actors: 1
2025-10-10T14:58:23.645216Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607600158929576:2534] client user disconnected session shared/user_3_2_1143946551272184665_v1
2025-10-10T14:58:23.645294Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:58:23.645350Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:58:23.645398Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_1911113861642898257_v1" (Sender=[3:7559607600158929566:2533], Pipe=[3:7559607600158929573:2533], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:58:23.645468Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_1911113861642898257_v1" sender [3:7559607600158929566:2533] lock partition 0 for ReadingSession "shared/user_3_1_1911113861642898257_v1" (Sender=[3:7559607600158929566:2533], Pipe=[3:7559607600158929573:2533], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-10-10T14:58:23.645516Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:58:23.645536Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000172s
2025-10-10T14:58:23.646821Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_3_1_1911113861642898257_v1" ClientId: "user" PipeClient { RawX1: 7559607600158929573 RawX2: 4503612512274917 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:58:23.646902Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2)
2025-10-10T14:58:23.647219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607600158929593:2544], now have 1 active actors on pipe
2025-10-10T14:58:23.647241Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7559607600158929593:2544]
2025-10-10T14:58:23.647433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:58:23.647459Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:58:23.647488Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_1_1911113861642898257_v1 on pipe: [3:7559607600158929593:2544]
2025-10-10T14:58:23.647540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.647560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.647570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:58:23.647659Z node 3 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_1_1911113861642898257_v1
2025-10-10T14:58:23.647701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.647898Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:58:23.648397Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_1_1911113861642898257_v1:2 with generation 1
2025-10-10T14:58:23.651335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:58:23.651423Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:58:23.651459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.651471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.651483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.651512Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:58:23.651546Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:58:23.651682Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760108303625 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:58:23.651712Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:58:23.651768Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 sending to client partition status
2025-10-10T14:58:23.706790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.706818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.706830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.745678Z :NOTICE: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-10T14:58:23.745787Z :DEBUG: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] [] Abort session to cluster
2025-10-10T14:58:23.746210Z :INFO: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] Closing read session. Close timeout: 0.000000s
2025-10-10T14:58:23.746259Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:58:23.746297Z :INFO: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 169 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:58:23.746352Z :NOTICE: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-10T14:58:23.746378Z :DEBUG: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] [] Abort session to cluster
2025-10-10T14:58:23.746629Z :INFO: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] Closing read session. Close timeout: 0.000000s
2025-10-10T14:58:23.746670Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:58:23.746722Z :INFO: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 170 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:58:23.746807Z :NOTICE: [/Root] [/Root] [c59ee7fb-60ac606f-3bf41502-b324b8b7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:58:23.746939Z :INFO: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] Closing read session. Close timeout: 0.000000s
2025-10-10T14:58:23.746979Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:58:23.747010Z :INFO: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] Counters: { Errors: 0 CurrentSessionLifetimeMs: 172 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:58:23.747052Z :NOTICE: [/Root] [/Root] [3fa60e4-43fd0e89-be18e597-85cb7052] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:58:23.747113Z :INFO: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] Closing read session. Close timeout: 0.000000s
2025-10-10T14:58:23.747145Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-10T14:58:23.747175Z :INFO: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] Counters: { Errors: 0 CurrentSessionLifetimeMs: 178 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:58:23.747216Z :NOTICE: [/Root] [/Root] [356f2467-193cdd33-3bbb037c-4a74ada5] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:58:23.750619Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:58:23.750633Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:58:23.750644Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 grpc read failed
2025-10-10T14:58:23.750648Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 grpc read failed
2025-10-10T14:58:23.750672Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 grpc closed
2025-10-10T14:58:23.750673Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 grpc closed
2025-10-10T14:58:23.750691Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_7235884730977489209_v1 is DEAD
2025-10-10T14:58:23.750702Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_1911113861642898257_v1 is DEAD
2025-10-10T14:58:23.751301Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_1_1911113861642898257_v1
2025-10-10T14:58:23.751339Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559607600158929593:2544] destroyed
2025-10-10T14:58:23.751377Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_1_1911113861642898257_v1
2025-10-10T14:58:23.751596Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607600158929577:2536] disconnected; active server actors: 1
2025-10-10T14:58:23.751623Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607600158929577:2536] client user disconnected session shared/user_3_3_7235884730977489209_v1
2025-10-10T14:58:23.751645Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:58:23.751672Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607600158929573:2533] disconnected; active server actors: 1
2025-10-10T14:58:23.751680Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607600158929573:2533] client user disconnected session shared/user_3_1_1911113861642898257_v1
2025-10-10T14:58:23.808009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.808042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.808056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:23.909290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:23.909321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:23.909334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:24.009269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:24.009299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:24.009310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:24.109737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:24.109787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:24.109801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:24.155187Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:58:24.155215Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:58:24.209704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:24.209727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:24.209739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:24.311831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:24.311903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:24.311933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:24.411986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:24.412020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:24.412035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:58:24.512366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:58:24.512401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:58:24.512416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:28.223740Z :WaitEventBlocksBeforeDiscovery INFO: Random seed for debugging is 1760108188223633
2025-10-10T14:56:28.746242Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559607105333767228:2186];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:28.746327Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:56:28.780505Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-10T14:56:28.793747Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e8e/r3tmp/tmpv1hPTu/pdisk_1.dat
2025-10-10T14:56:28.894484Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559607106190502751:2239];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:28.895122Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T14:56:28.946186Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:56:29.127653Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:29.160788Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:29.246572Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:56:29.282285Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:29.282386Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:29.286672Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:56:29.286758Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:56:29.291917Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:56:29.292881Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T14:56:29.293048Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:56:29.294720Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:56:29.367078Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 9234, node 1
2025-10-10T14:56:29.486181Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e8e/r3tmp/yandexC2yjbX.tmp
2025-10-10T14:56:29.486212Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e8e/r3tmp/yandexC2yjbX.tmp
2025-10-10T14:56:29.486471Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e8e/r3tmp/yandexC2yjbX.tmp
2025-10-10T14:56:29.486675Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:56:29.527495Z INFO: TTestServer started on Port 29925 GrpcPort 9234
2025-10-10T14:56:29.753393Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:29925
PQClient connected to localhost:9234
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-10-10T14:56:29.810295Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:56:29.892842Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-10T14:56:29.898021Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
2025-10-10T14:56:29.922007Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715657, at schemeshard: 72057594046644480
waiting...
waiting...
waiting...
2025-10-10T14:56:33.148136Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:33.157720Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7559607122513637277:2321], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:33.158512Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=N2Q4OWFlMzQtNzViZDJkOWYtMjk5ZDA0YTAtNGJmYmIwZTA=, ActorId: [1:7559607122513637274:2319], ActorState: ExecuteState, TraceId: 01k779z8xd9sm1rejwb3rdy1zp, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:33.160685Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:33.163675Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7559607123370372052:2292], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:56:33.165373Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=ZjVmOTUyOTktMmUyYWVlNGYtMWUxMDlkZTMtZmUwNjZjYWM=, ActorId: [2:7559607123370372050:2291], ActorState: ExecuteState, TraceId: 01k779z90w6e9wbe42zj0nvvgn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:56:33.165754Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:56:33.352314Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:56:33.516061Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:9234", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:56:33.746633Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559607105333767228:2186];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:33.746702Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:56:33.865228Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559607106190502751:2239];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:56:33.865305Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T14:56:33.872646Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k779z9w433fc7c96wr1cgf1s, Database: , SessionId: ydb://session/3?node_id=1&id=MWM5ZjRkOGEtZmIyZmYyMjEtZTZiZGIwM2MtYmY5OWFkODI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559607126808604968:2905] 
=== CheckClustersList. Ok
2025-10-10T14:56:39.851715Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:9234
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:39.988903Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:9234
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:56:40.029871Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559607156873376612:3232] connected; active server actors: 1
2025-10-10T14:56:40.030114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:56:40.031981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:56:40.033465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:56:40.056465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:56:40.059724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:56:40.060014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:56:40.060055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:40.060100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:56:40.060846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T14:56:40.061228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607156873376611:3231], now have 1 active actors on pipe
2025-10-10T14:56:40.061254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607156873376629:2451], now have 1 active actors on pipe
2025-10-10T14:56:40.062062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.066827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:40.074865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607156873376666:3276], now have 1 active actors on pipe
2025-10-10T14:56:40.077318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.081300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:40.082334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:56:40.082403Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:56:40.082694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:56:40.083480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559607157730111018:2395]
2025-10-10T14:56:40.086165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:56:40.086193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:56:40.086211Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559607157730111018:2395]
2025-10-10T14:56:40.086241Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:56:40.087616Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:56:40.087664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.087777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.087793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:40.087826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:40.087838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.087854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.087867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:56:40.087901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:56:40.088439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.088585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:40.093863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:40.094006Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108200116, TxId 281474976715679
2025-10-10T14:56:40.094033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.094047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.094187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.094428Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:56:40.096817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:56:40.097112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:56:40.097168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.097180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.097191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.097223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:40.097625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:56:40.097786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:56:40.098088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.102078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:40.102217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:56:40.104090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:56:40.184602Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k779zg3cf15jp963rc6z1ptr, Database: , SessionId: ydb://session/3?node_id=1&id=ZjU5NjBhMDMtZDYyNDc1MTktNmM4YTMwN2QtMzg2NGE1MDk=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T14:56:40.188030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.188058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.188076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760108200116
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760108200116
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:9234
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:40.215844Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:40.288976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.289003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.289012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.389263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.389289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.389300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.489909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.489932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.489943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.591721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.591749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.591760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.692177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.692210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.692220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:9234
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:40.720738Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:56:40.793309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.793337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.793348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.893611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.893648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.893658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:40.993971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:40.993996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:40.994006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.094353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.094393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.094411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.195974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.196014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.196023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:9234
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:56:41.228716Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:56:41.241949Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:56:41.243479Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:56:41.243515Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:9234
2025-10-10T14:56:41.251918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:56:41.251961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:56:41.296008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.296035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.296045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.305398Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:41.306252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:56:41.306456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:35454
2025-10-10T14:56:41.306472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:35454 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:56:41.306481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:56:41.308487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:56:41.308660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:56:41.308688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:56:41.308697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:56:41.308713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559607161168344137:2488] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:56:41.311090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559607161168344137:2488] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:56:41.396436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.396466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.396476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.469903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559607161168344137:2488] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:56:41.470152Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607161168344176:2488] connected; active server actors: 1
2025-10-10T14:56:41.470213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559607161168344137:2488] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:56:41.470230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559607161168344137:2488] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:56:41.470524Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607161168344176:2488] disconnected; active server actors: 1
2025-10-10T14:56:41.470550Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559607161168344176:2488] disconnected no session
2025-10-10T14:56:41.496724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.496757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.496768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.582570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559607161168344137:2488] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:56:41.582610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559607161168344137:2488] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:56:41.583448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559607161168344195:2488], now have 1 active actors on pipe
2025-10-10T14:56:41.582628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559607161168344137:2488] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:56:41.583788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:41.582657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:56:41.583823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:41.583638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T14:56:41.583926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|64b9b7fa-e504c8db-c420fcf7-97d96035_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:56:41.585065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|64b9b7fa-e504c8db-c420fcf7-97d96035_0
2025-10-10T14:56:41.583965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.583992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.584004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:56:41.584045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.584119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:56:41.584184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:41.584675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:56:41.584691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:56:41.584766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:56:41.585792Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760108201585 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:56:41.585959Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|64b9b7fa-e504c8db-c420fcf7-97d96035_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:56:41.589240Z :INFO: [] MessageGroupId [src] SessionId [src|64b9b7fa-e504c8db-c420fcf7-97d96035_0] Write session: close. Timeout = 0 ms
2025-10-10T14:56:41.589305Z :INFO: [] MessageGroupId [src] SessionId [src|64b9b7fa-e504c8db-c420fcf7-97d96035_0] Write session will now close
2025-10-10T14:56:41.589349Z :DEBUG: [] MessageGroupId [src] SessionId [src|64b9b7fa-e504c8db-c420fcf7-97d96035_0] Write session: aborting
2025-10-10T14:56:41.590593Z :INFO: [] MessageGroupId [src] SessionId [src|64b9b7fa-e504c8db-c420fcf7-97d96035_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:56:41.590667Z :DEBUG: [] MessageGroupId [src] SessionId [src|64b9b7fa-e504c8db-c420fcf7-97d96035_0] Write session is aborting and will not restart
2025-10-10T14:56:41.590601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|64b9b7fa-e504c8db-c420fcf7-97d96035_0 grpc read done: success: 0 data: 
2025-10-10T14:56:41.590760Z :DEBUG: [] MessageGroupId [src] SessionId [src|64b9b7fa-e504c8db-c420fcf7-97d96035_0] Write session: destroy
2025-10-10T14:56:41.590631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|64b9b7fa-e504c8db-c420fcf7-97d96035_0 grpc read failed
2025-10-10T14:56:41.590676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|64b9b7fa-e504c8db-c420fcf7-97d96035_0 grpc closed
2025-10-10T14:56:41.590694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|64b9b7fa-e504c8db-c420fcf7-97d96035_0 is DEAD
2025-10-10T14:56:41.591845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:56:41.592208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559607161168344195:2488] destroyed
2025-10-10T14:56:41.592270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:56:41.592297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.592311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.592341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.597168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.597195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.597205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Before ReadSession was created
Session was created
Returned from WaitEvent
2025-10-10T14:56:41.701234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.701262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.701272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.801463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.801494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.801506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:41.904821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:41.904854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:41.904865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.005164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.005190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.005201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.106106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.106138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.106148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.206410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.206448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.206458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.313241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.313271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.313281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.411175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.411199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.411206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.511506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.511538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.511549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.611855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.611888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.611897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session blocked successfully
Session closed gracefully
2025-10-10T14:56:42.713245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.713278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.713289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.813663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.813728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.813745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:42.913962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:42.913994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:42.914005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.015231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.015260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.015271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.115677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.115716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.115726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.217236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.217267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.217278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.320053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.320084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.320095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.420368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.420408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.420419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.521218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.521244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.521252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.621511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.621537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.621555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.722652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.722687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.722696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.822882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.822911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.822922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:43.923122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:43.923157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:43.923168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.025416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.025444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.025456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.133300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.133329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.133339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.152490Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:56:44.152528Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:56:44.233422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.233453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.233465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.333744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.333773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.333785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.434104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.434140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.434151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.534454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.534482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.534493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.635373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.635399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.635409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.735691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.735711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.735723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.836764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.836799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.836808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:44.936882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:44.936904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:44.936919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.037252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.037275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.037286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.089718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:45.137601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.137622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.137630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.238337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.238367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.238376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.341245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.341273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.341282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.441222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.441251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.441261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.544985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.545011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.545020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.649225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.649255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.649265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.749445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.749473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.749486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.849848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.849892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.849902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:45.950135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:45.950165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:45.950175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.053621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.053656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.053668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.153955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.153986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.153999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.257234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.257263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.257274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.359923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.359965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.359974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.461358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.461386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.461397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.561709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.561741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.561749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.662942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.662970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.662981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.766991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.767016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.767023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.868533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.868562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.868571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:46.968671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:46.968703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:46.968714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.070464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.070495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.070507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.173260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.173291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.173303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.273665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.273697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.273710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.374220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.374259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.374271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.477251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.477286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.477298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.577285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.577312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.577324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.678342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.678376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.678386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.778475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.778503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.778515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.878846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.878874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.878885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:47.979413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:47.979446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:47.979457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.081247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.081282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.081293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.181688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.181714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.181726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.285241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.285277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.285286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.385224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.385253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.385263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.493253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.493284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.493295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.593081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.593116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.593144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.693479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.693507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.693519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.796932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.796961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.796972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:48.897229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:48.897267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:48.897276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.001231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.001259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.001267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.101276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.101294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.101300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.203545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.203598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.203608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.305504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.305526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.305535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.409279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.409307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.409318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.511321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.511348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.511357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.611378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.611401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.611408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.711751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.711780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.711791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.812216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.812243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.812252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:49.912847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:49.912875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:49.912884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.013280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.013307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.013317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.092127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:50.113705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.113732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.113743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.216540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.216566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.216575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.316818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.316846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.316857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.421553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.421586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.421596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.525292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.525320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.525334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.633238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.633270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.633280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.737356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.737394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.737408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.839038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.839068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.839079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:50.939127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:50.939167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:50.939179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.039462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.039491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.039502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.145252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.145284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.145294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.249256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.249280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.249291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.349168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.349194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.349204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.453399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.453443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.453455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.553253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.553289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.553301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.654946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.654975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.654986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.757531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.757557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.757567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:51.910266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:51.910291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:51.910300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.011602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.011624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.011632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.113309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.113332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.113341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.213417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.213444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.213454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.314264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.314289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.314301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.414668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.414693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.414703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.517408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.517440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.517450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.621239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.621273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.621284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.721349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.721380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.721392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.825230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.825265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.825276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:52.925780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:52.925821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:52.925835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.026369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.026396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.026407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.133303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.133332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.133343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.236184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.236213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.236225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.337285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.337311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.337322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.441943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.441969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.441979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.544458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.544485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.544497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.643743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.643777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.643788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.749271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.749304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.749316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.849228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.849256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.849270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:53.949243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:53.949272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:53.949293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.049467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.049506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.049517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.153271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.153309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.153320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.253730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.253754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.253766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.354099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.354140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.354150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.457251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.457288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.457301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.562266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.562303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.562315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.665900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.665929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.665940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.769246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.769278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.769288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:54.930350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:54.930381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:54.930390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.033312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.033344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.033355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.092858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:56:55.133979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.134004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.134015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.236036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.236065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.236075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.337037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.337079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.337090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.439188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.439217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.439230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.541245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.541275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.541287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.640243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.640281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.640292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.741310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.741339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.741349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.841450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.841488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.841499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:55.945322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:55.945350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:55.945360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.046022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.046050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.046061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.148481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.148515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.148525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.257235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.257265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.257275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.352435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.352464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.352476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.452805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.452847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.452859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.553226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.553256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.553268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.658006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.658038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.658051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.757947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.757971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.757981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.858335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.858360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.858371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:56.958914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:56.958934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:56.958940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.062186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.062209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.062217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.165270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.165308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.165320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.265390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.265408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.265415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.368259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.368287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.368301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.469758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.469802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.469816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.573099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.573146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.573157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.677241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.677272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.677283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.777335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.777369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.777380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.880520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.880554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.880565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:57.978517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:57.978553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:57.978565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.079668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.079697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.079707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.185257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.185286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.185296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.282999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.283037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.283049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.389243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.389275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.389286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.490488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.490517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.490529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.593634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.593658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.593669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.697235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.697264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.697276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.798429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.798464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.798476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:58.916031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:58.916051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:58.916058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.016382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.016414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.016423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.116727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.116770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.116783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.217180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.217208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.217218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.317981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.318006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.318016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.417749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.417769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.417780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.518155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.518186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.518199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.618487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.618515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.618532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.721328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.721358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.721370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.825245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.825280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.825293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:56:59.929253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:56:59.929287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:56:59.929301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.032736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.032766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.032779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.094026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:00.133256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.133290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.133301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.237565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.237600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.237610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.341276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.341310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.341321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.444849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.444881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.444891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.549444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.549469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.549478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.649942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.649974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.649985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.750510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.750533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.750543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.850966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.850994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.851005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:00.952322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:00.952361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:00.952371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.052590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.052629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.052642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.152964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.152993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.153000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.257238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.257270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.257282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.356146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.356172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.356183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.457306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.457330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.457340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.558662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.558695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.558706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.657803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.657832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.657843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.761246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.761280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.761291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.860323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.860349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.860360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:01.961286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:01.961315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:01.961325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.061295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.061327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.061339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.165251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.165279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.165290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.266777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.266807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.266817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.369575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.369611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.369623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.472583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.472613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.472623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.572776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.572799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.572809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.673008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.673034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.673045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.774180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.774206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.774218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.876272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.876300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.876311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:02.977449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:02.977486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:02.977498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.077895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.077926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.077949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.178889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.178921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.178933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.279265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.279285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.279292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.381272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.381301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.381311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.481397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.481428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.481440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.581854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.581885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.581898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.685379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.685407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.685418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.790959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.790990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.791002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.891250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.891281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.891294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:03.993360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:03.993405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:03.993416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.101292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.101323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.101336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.208052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.208083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.208094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.309191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.309225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.309237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.409573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.409598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.409607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.510319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.510348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.510360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.610671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.610702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.610716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.710816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.710848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.710860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.813343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.813371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.813384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:04.914470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:04.914511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:04.914521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.019318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.019344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.019351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.097752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:05.119517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.119546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.119556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.221651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.221686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.221697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.322206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.322235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.322246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.425448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.425478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.425489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.525940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.525964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.525974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.629649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.629678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.629689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.733566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.733593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.733603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.833821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.833850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.833862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:05.935495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:05.935527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:05.935537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.037908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.037941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.037954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.145678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.145725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.145738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.245911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.245945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.245957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.347490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.347522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.347533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.449355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.449387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.449399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.550007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.550040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.550051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.653369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.653396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.653407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.753834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.753866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.753877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.857306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.857342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.857355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:06.957285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:06.957317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:06.957329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.057331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.057359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.057370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.161236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.161267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.161279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.265817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.265849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.265858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.369798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.369833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.369847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.474288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.474323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.474334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.578248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.578285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.578298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.678971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.679012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.679027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.779803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.779834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.779845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.880653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.880684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.880694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:07.985991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:07.986027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:07.986038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.089260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.089302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.089314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.189813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.189844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.189854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.290203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.290231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.290241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.391424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.391451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.391462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.493456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.493481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.493491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.594885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.594909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.594920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.697241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.697268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.697279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.797139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.797171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.797182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.897793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.897824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.897839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:08.999933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:08.999962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:08.999972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.101446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.101487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.101500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.203225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.203270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.203284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.308060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.308094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.308106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.406906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.406937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.406950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.507239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.507269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.507280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.608610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.608644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.608653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.709368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.709409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.709421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.811015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.811050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.811062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:09.911257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:09.911284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:09.911304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.013284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.013316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.013329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.035880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:57:10.035978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T14:57:10.036766Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:57:10.037826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:57:10.038419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:57:10.040038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-10T14:57:10.097381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:10.117265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.117307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.117321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.217252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.217289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.217301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.317767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.317819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.317830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.419685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.419717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.419729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.520190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.520216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.520225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.625005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.625037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.625049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.724761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.724791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.724804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.825357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.825385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.825397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:10.927975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:10.928015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:10.928027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.030768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.030798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.030810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.137238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.137271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.137282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.237587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.237610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.237619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.340883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.340906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.340917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.441086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.441113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.441139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.541425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.541460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.541471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.645590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.645615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.645626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.750221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.750248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.750259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.857386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.857417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.857431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:11.959363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:11.959389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:11.959399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.059554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.059580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.059593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.161225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.161247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.161255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.269377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.269406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.269417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.369602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.369634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.369646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.470326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.470358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.470374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.575416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.575447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.575458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.680433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.680473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.680485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.781238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.781272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.781283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.881403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.881430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.881442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:12.982296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:12.982321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:12.982331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.082982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.083009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.083020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.186094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.186121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.186135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.285338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.285366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.285387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.385892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.385920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.385931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.490268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.490296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.490307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.593410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.593436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.593448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.698880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.698904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.698911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.799404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.799428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.799439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:13.901079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:13.901107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:13.901137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.037353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.037374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.037384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.141114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.141150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.141160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.241605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.241638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.241649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.342899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.342924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.342935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.443686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.443726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.443739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.543848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.543892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.543906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.646437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.646473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.646486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.746594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.746627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.746639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.847659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.847694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.847706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:14.948881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:14.948932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:14.948944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.048942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.048971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.048985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.097429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:15.149659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.149688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.149701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.250056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.250097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.250111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.353242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.353275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.353287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.454829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.454859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.454869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.554952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.554984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.554993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.657244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.657268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.657276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.757479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.757510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.757522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.857639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.857668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.857680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:15.957941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:15.957966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:15.957978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.061383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.061411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.061422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.162661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.162688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.162698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.265518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.265547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.265559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.366362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.366390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.366401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.470387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.470413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.470424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.570777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.570801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.570812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.677177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.677209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.677220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:16.776396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:16.776435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:16.776447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:17.178538Z node 1 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [1:7559607315787168640:2821] TxId: 281474976715746. Ctx: { TraceId: 01k77a0kymbrvds766j7yfn3je, Database: /Root, SessionId: ydb://session/3?node_id=1&id=MWU0MTQxNzItNjkxZDMxOTAtNzFlYjNkMWYtMWE1MTQwM2M=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 2
2025-10-10T14:57:17.179261Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559607315787168650:2830], TxId: 281474976715746, task: 4. Ctx: { TraceId : 01k77a0kymbrvds766j7yfn3je.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=1&id=MWU0MTQxNzItNjkxZDMxOTAtNzFlYjNkMWYtMWE1MTQwM2M=.  CurrentExecutionId : .  DatabaseId : /Root.  Database : /Root. }. Handle abort execution event from: [1:7559607315787168640:2821], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T14:57:17.179268Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559607315787168649:2829], TxId: 281474976715746, task: 2. Ctx: { TraceId : 01k77a0kymbrvds766j7yfn3je.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=1&id=MWU0MTQxNzItNjkxZDMxOTAtNzFlYjNkMWYtMWE1MTQwM2M=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7559607315787168640:2821], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T14:57:18.440084Z :SimpleHandlers INFO: Random seed for debugging is 1760108238440066
2025-10-10T14:57:18.838749Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559607320310366104:2079];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:57:18.858369Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e8e/r3tmp/tmpoiSEJJ/pdisk_1.dat
2025-10-10T14:57:18.957620Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:57:18.958523Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-10T14:57:18.958574Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:57:18.961729Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T14:57:18.969527Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:57:19.110265Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T14:57:19.146991Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T14:57:19.157431Z node 4 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [4:7559607321003276569:2073] 1760108238861799 != 1760108238861796
2025-10-10T14:57:19.220451Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:57:19.220528Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:57:19.222498Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T14:57:19.222575Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T14:57:19.234626Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T14:57:19.234795Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T14:57:19.235374Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 61715, node 3
2025-10-10T14:57:19.310208Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T14:57:19.301589Z node 4 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.013701s
2025-10-10T14:57:19.360507Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e8e/r3tmp/yandex970xag.tmp
2025-10-10T14:57:19.360533Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e8e/r3tmp/yandex970xag.tmp
2025-10-10T14:57:19.360676Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e8e/r3tmp/yandex970xag.tmp
2025-10-10T14:57:19.360838Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T14:57:19.401626Z INFO: TTestServer started on Port 64088 GrpcPort 61715
TClient is connected to server localhost:64088
PQClient connected to localhost:61715
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T14:57:19.630630Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
2025-10-10T14:57:19.697379Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
2025-10-10T14:57:19.937285Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:57:19.939941Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T14:57:22.734150Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7559607337490236262:2321], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:57:22.737571Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=ODFiY2M2NjktYmJhNWJiOTMtMWM5ZGQ4NmUtOTUwM2E5ODI=, ActorId: [3:7559607337490236259:2319], ActorState: ExecuteState, TraceId: 01k77a0sr10rcxn3a6w7y64324, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:57:22.738032Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:57:22.793594Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:57:23.025545Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T14:57:23.112550Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7559607342478113461:2297], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T14:57:23.113437Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=YmQxOTQ3NzgtODlkYWE3MGUtYWQyYzc0ZjgtYTlhZTdjNjk=, ActorId: [4:7559607342478113459:2296], ActorState: ExecuteState, TraceId: 01k77a0t3xbvgh9704ck2kp3yq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T14:57:23.113887Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T14:57:23.243123Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:61715", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T14:57:23.694386Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k77a0tg35qqa6j7q8eypg7k0, Database: , SessionId: ydb://session/3?node_id=3&id=M2I3N2YxZDgtMzMyN2QzNTEtMWFhZGMzZjgtZDAwYjRiNjI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559607341785203955:2910] 
2025-10-10T14:57:23.839336Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559607320310366104:2079];send_to=[0:7307199536658146131:7762515];
2025-10-10T14:57:23.839412Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-10T14:57:30.144324Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:61715
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:57:30.291250Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:61715
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T14:57:30.370078Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559607371849975604:3247] connected; active server actors: 1
2025-10-10T14:57:30.370391Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T14:57:30.373316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T14:57:30.373931Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T14:57:30.375843Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T14:57:30.378297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T14:57:30.378566Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T14:57:30.378611Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:57:30.378649Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T14:57:30.379106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607371849975603:3246], now have 1 active actors on pipe
2025-10-10T14:57:30.379143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607371849975656:2452], now have 1 active actors on pipe
2025-10-10T14:57:30.380369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:57:30.382856Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-10T14:57:30.392203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:57:30.406154Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607371849975692:3308], now have 1 active actors on pipe
2025-10-10T14:57:30.408896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:57:30.414119Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:57:30.414914Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T14:57:30.414977Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T14:57:30.415326Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T14:57:30.415507Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7559607372542885064:2385]
2025-10-10T14:57:30.418255Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T14:57:30.418281Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T14:57:30.418295Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7559607372542885064:2385]
2025-10-10T14:57:30.418312Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T14:57:30.419463Z node 4 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T14:57:30.419504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.419569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.419577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:57:30.419590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:57:30.419597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.419605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.419610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T14:57:30.419636Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:57:30.419862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:57:30.419994Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:30.426298Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:57:30.426398Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760108250446, TxId 281474976715679
2025-10-10T14:57:30.426418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.426428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.426522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.426674Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:30.429350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:30.429596Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:30.429624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.429640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.429662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.429690Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:30.430048Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T14:57:30.430140Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T14:57:30.430410Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:57:30.441822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:57:30.441910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T14:57:30.449411Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T14:57:30.516599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.516642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.516655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.545382Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k77a1175enzs5j2m9waa3a80, Database: , SessionId: ydb://session/3?node_id=3&id=NDg3NjFkN2QtYmZkYzQwMDEtZTQ1MjJmYi05NmQyMGJlNw==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760108250446
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760108250446
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:61715
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:57:30.617273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.617306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.617319Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.622251Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T14:57:30.717352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.717381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.717394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.817893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.817919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.817933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:30.920317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:30.920344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:30.920356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.021338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.021382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.021395Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.125339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.125369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.125383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:61715
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T14:57:31.136947Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T14:57:31.150885Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T14:57:31.151639Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T14:57:31.151691Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:61715
2025-10-10T14:57:31.176458Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:57:31.182366Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:57:31.182401Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T14:57:31.182779Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T14:57:31.182885Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:33430
2025-10-10T14:57:31.182902Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33430 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:57:31.182910Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:57:31.184521Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T14:57:31.184656Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:57:31.184666Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:57:31.184674Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:57:31.184690Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559607376144943136:2485] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:57:31.189266Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559607376144943136:2485] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:57:31.229301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.229330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.229344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.330770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.330799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.330813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.431050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.431080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.431092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.479107Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559607376144943136:2485] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:57:31.479946Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943177:2485] connected; active server actors: 1
2025-10-10T14:57:31.480059Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559607376144943136:2485] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T14:57:31.480076Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559607376144943136:2485] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T14:57:31.503404Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943177:2485] disconnected; active server actors: 1
2025-10-10T14:57:31.503437Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943177:2485] disconnected no session
2025-10-10T14:57:31.532636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.532684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.532695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.630345Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559607376144943136:2485] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:57:31.630384Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559607376144943136:2485] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:57:31.630402Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559607376144943136:2485] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T14:57:31.630435Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:57:31.632883Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607376144943194:2485], now have 1 active actors on pipe
2025-10-10T14:57:31.632967Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T14:57:31.633306Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:31.633337Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:31.633388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.633402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.633412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.633494Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|52a1962b-4e187624-4edffa63-599f6dd2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T14:57:31.633531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.633549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.633557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:57:31.633592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.633619Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:57:31.633660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:57:31.634467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:31.634489Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:31.634551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:57:31.635211Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|52a1962b-4e187624-4edffa63-599f6dd2_0
2025-10-10T14:57:31.637774Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760108251637 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:31.637899Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|52a1962b-4e187624-4edffa63-599f6dd2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:57:31.638081Z :INFO: [] MessageGroupId [src] SessionId [src|52a1962b-4e187624-4edffa63-599f6dd2_0] Write session: close. Timeout = 0 ms
2025-10-10T14:57:31.638124Z :INFO: [] MessageGroupId [src] SessionId [src|52a1962b-4e187624-4edffa63-599f6dd2_0] Write session will now close
2025-10-10T14:57:31.638165Z :DEBUG: [] MessageGroupId [src] SessionId [src|52a1962b-4e187624-4edffa63-599f6dd2_0] Write session: aborting
2025-10-10T14:57:31.638613Z :INFO: [] MessageGroupId [src] SessionId [src|52a1962b-4e187624-4edffa63-599f6dd2_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:57:31.638657Z :DEBUG: [] MessageGroupId [src] SessionId [src|52a1962b-4e187624-4edffa63-599f6dd2_0] Write session: destroy
2025-10-10T14:57:31.643465Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|52a1962b-4e187624-4edffa63-599f6dd2_0 grpc read done: success: 0 data: 
2025-10-10T14:57:31.643494Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|52a1962b-4e187624-4edffa63-599f6dd2_0 grpc read failed
2025-10-10T14:57:31.645241Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559607376144943194:2485] destroyed
2025-10-10T14:57:31.645287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:57:31.645327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.645339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.645351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.643528Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|52a1962b-4e187624-4edffa63-599f6dd2_0 grpc closed
2025-10-10T14:57:31.643543Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|52a1962b-4e187624-4edffa63-599f6dd2_0 is DEAD
2025-10-10T14:57:31.644383Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
>>> Session was created
2025-10-10T14:57:31.733730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.733768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.733782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:57:31.778832Z :INFO: [/Root] [] [d5ccde48-48dff046-b250edf9-6c9464d3] Open read subsessions to databases: { name: dc1, endpoint: localhost:61715, path: /Root }, { name: dc2, endpoint: localhost:61715, path: /Root }, { name: dc3, endpoint: localhost:61715, path: /Root }
2025-10-10T14:57:31.795342Z :INFO: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Starting read session
2025-10-10T14:57:31.795431Z :DEBUG: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Starting single session
2025-10-10T14:57:31.809649Z :DEBUG: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:57:31.817326Z :DEBUG: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:57:31.817400Z :DEBUG: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:57:31.818213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-10T14:57:31.828818Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Starting read session
2025-10-10T14:57:31.828868Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Starting single session
2025-10-10T14:57:31.828979Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:57:31.829011Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:57:31.829037Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:57:31.831619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-10T14:57:31.831724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:61715
2025-10-10T14:57:31.838723Z :INFO: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Starting read session
2025-10-10T14:57:31.838773Z :DEBUG: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Starting single session
2025-10-10T14:57:31.838841Z :DEBUG: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] [] Successfully connected. Initializing session
2025-10-10T14:57:31.838876Z :DEBUG: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:57:31.838918Z :DEBUG: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:57:31.838947Z :DEBUG: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] [] Reconnecting session to cluster  in 0.000000s
2025-10-10T14:57:31.835799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.835831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.835845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.843439Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:57:31.843466Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-10T14:57:31.865591Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Successfully connected. Initializing session
2025-10-10T14:57:31.875704Z :DEBUG: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] [] Successfully connected. Initializing session
2025-10-10T14:57:31.881725Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:57:31.881749Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-10T14:57:31.881863Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-10T14:57:31.881872Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-10T14:57:31.901223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:57:31.937244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:31.937278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:31.937290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:31.961730Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:57:31.962417Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:57:31.962777Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read init: from# ipv6:[::1]:33456, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:57:31.974765Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 read init: from# ipv6:[::1]:33456, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:57:31.975376Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 auth for : user
2025-10-10T14:57:31.975443Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 auth for : user
2025-10-10T14:57:31.975506Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:57:31.975643Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 read init: from# ipv6:[::1]:33456, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-10T14:57:31.975880Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 auth for : user
2025-10-10T14:57:31.976036Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:57:31.976049Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T14:57:31.977203Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-10T14:57:31.977338Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:33456
2025-10-10T14:57:31.977352Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33456 proto=v1  topic=test-topic durationSec=0
2025-10-10T14:57:31.977360Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:57:31.987683Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got InitResponse. ReadSessionId: shared/user_3_2_17876818278139598348_v1
2025-10-10T14:57:31.987743Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:57:31.987989Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:31.981116Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Handle describe topics response
2025-10-10T14:57:32.005591Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607376144943265:2519], now have 1 active actors on pipe
2025-10-10T14:57:31.981418Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 auth is DEAD
2025-10-10T14:57:31.981505Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:57:31.983214Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:57:31.983731Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 Handle describe topics response
2025-10-10T14:57:31.983850Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 auth is DEAD
2025-10-10T14:57:31.985706Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 Handle describe topics response
2025-10-10T14:57:31.985851Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 auth is DEAD
2025-10-10T14:57:31.985928Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:57:31.986954Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:57:31.987119Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943255:2508] connected; active server actors: 1
2025-10-10T14:57:31.987155Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559607376144943255:2508] session shared/user_3_2_17876818278139598348_v1
2025-10-10T14:57:31.987234Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-10T14:57:31.987306Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-10T14:57:31.987358Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_17876818278139598348_v1" (Sender=[3:7559607376144943242:2508], Pipe=[3:7559607376144943255:2508], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:57:31.987391Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:57:31.987454Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-10T14:57:31.987527Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_2_17876818278139598348_v1" (Sender=[3:7559607376144943242:2508], Pipe=[3:7559607376144943255:2508], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:57:31.987615Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_2_17876818278139598348_v1" sender [3:7559607376144943242:2508] lock partition 0 for ReadingSession "shared/user_3_2_17876818278139598348_v1" (Sender=[3:7559607376144943242:2508], Pipe=[3:7559607376144943255:2508], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-10T14:57:31.987688Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-10T14:57:31.987732Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000240s
2025-10-10T14:57:31.988922Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_2_17876818278139598348_v1" ClientId: "user" PipeClient { RawX1: 7559607376144943255 RawX2: 4503612512274892 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-10T14:57:31.990319Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T14:57:31.990445Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:57:31.990455Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:57:31.990462Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:57:31.990478Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:57:31.990629Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-10T14:57:31.990718Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943261:2509] connected; active server actors: 1
2025-10-10T14:57:31.990741Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559607376144943261:2509] session shared/user_3_3_7166244897988296849_v1
2025-10-10T14:57:31.990777Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_7166244897988296849_v1" (Sender=[3:7559607376144943243:2509], Pipe=[3:7559607376144943261:2509], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:57:31.990797Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:57:31.990834Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:57:31.990856Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:57:31.990880Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000029s
2025-10-10T14:57:31.991319Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 auth ok: topics# 1, initDone# 0
2025-10-10T14:57:31.992187Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 register session: topic# rt3.dc1--test-topic
2025-10-10T14:57:31.995056Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:57:31.999340Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943266:2504] connected; active server actors: 1
2025-10-10T14:57:31.999433Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7559607376144943266:2504] session shared/user_3_1_12749517791752966456_v1
2025-10-10T14:57:31.999487Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_12749517791752966456_v1" (Sender=[3:7559607376144943235:2504], Pipe=[3:7559607376144943266:2504], Partitions=[], ActiveFamilyCount=0)
2025-10-10T14:57:31.999517Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:57:31.999555Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-10T14:57:31.999594Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-10-10T14:57:31.999620Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000045s
2025-10-10T14:57:32.003705Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:57:32.003820Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# d7e995c0-3ae7e1b-89d246ef-522d73e8
2025-10-10T14:57:32.008977Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7559607376144943265:2519]
2025-10-10T14:57:32.016594Z :INFO: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] [] Got InitResponse. ReadSessionId: shared/user_3_3_7166244897988296849_v1
2025-10-10T14:57:32.016655Z :DEBUG: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:57:32.016978Z :DEBUG: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.017100Z :INFO: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] [] Got InitResponse. ReadSessionId: shared/user_3_1_12749517791752966456_v1
2025-10-10T14:57:32.017154Z :DEBUG: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-10T14:57:32.017360Z :DEBUG: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.016260Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T14:57:32.011112Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.011148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.016001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_2_17876818278139598348_v1 on pipe: [3:7559607376144943265:2519]
2025-10-10T14:57:32.016099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.018086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.018104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:57:32.018196Z node 4 :PERSQUEUE DEBUG: partition.cpp:3747: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_2_17876818278139598348_v1
2025-10-10T14:57:32.018217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.018379Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.018908Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_2_17876818278139598348_v1:1 with generation 1
2025-10-10T14:57:32.027098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.027192Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.027219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.027230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.027240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.027272Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.027318Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-10T14:57:32.017880Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607380439910579:2514] connected; active server actors: 1
2025-10-10T14:57:32.017983Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T14:57:32.018000Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:57:32.018293Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:57:32.018425Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 got read request: guid# f789794c-a335bade-e05c3453-a01967ef
2025-10-10T14:57:32.019182Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607380439910579:2514] disconnected; active server actors: 1
2025-10-10T14:57:32.019201Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607380439910579:2514] disconnected no session
2025-10-10T14:57:32.020644Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-10T14:57:32.020763Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 got read request: guid# 59a5c59a-9b4fd8b9-b0f5b31c-d5e5db8a
2025-10-10T14:57:32.028089Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760108251937 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-10T14:57:32.028140Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-10T14:57:32.028232Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 sending to client partition status
2025-10-10T14:57:32.031167Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-10T14:57:32.031144Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:57:32.031190Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T14:57:32.031210Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:57:32.031243Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:57:32.036191Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-10T14:57:32.036375Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-10T14:57:32.036424Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-10T14:57:32.036471Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-10T14:57:32.037292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.037321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.037333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.038063Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T14:57:32.038365Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559607380439910594:2514], now have 1 active actors on pipe
2025-10-10T14:57:32.038448Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.038474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.038549Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:57:32.038583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.038600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.038610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:57:32.038653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.038688Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:57:32.038734Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:57:32.046798Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.046834Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.046914Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:57:32.053337Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0
2025-10-10T14:57:32.057692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760108252057 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:32.057856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T14:57:32.058949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 1 to 1
2025-10-10T14:57:32.059116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.059161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-10T14:57:32.059472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 2 to 2
2025-10-10T14:57:32.059520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.059545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-10T14:57:32.059590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 3 to 3
2025-10-10T14:57:32.059623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.059645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-10T14:57:32.059694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 4 to 4
2025-10-10T14:57:32.059735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.059754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-10T14:57:32.059788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 5 to 5
2025-10-10T14:57:32.059825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.059844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-10T14:57:32.059878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 6 to 6
2025-10-10T14:57:32.059916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.059936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-10T14:57:32.059967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 7 to 7
2025-10-10T14:57:32.060005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-10T14:57:32.060059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 8 to 8
2025-10-10T14:57:32.060102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-10T14:57:32.060157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 9 to 9
2025-10-10T14:57:32.060196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-10T14:57:32.060252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 10 to 10
2025-10-10T14:57:32.060291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-10T14:57:32.060353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 11 to 11
2025-10-10T14:57:32.060388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-10T14:57:32.060448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 12 to 12
2025-10-10T14:57:32.060486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-10T14:57:32.060536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 13 to 13
2025-10-10T14:57:32.060601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-10T14:57:32.060684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 14 to 14
2025-10-10T14:57:32.060726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-10T14:57:32.060779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 15 to 15
2025-10-10T14:57:32.060818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-10T14:57:32.060886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 16 to 16
2025-10-10T14:57:32.060927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.060952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-10T14:57:32.060988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 17 to 17
2025-10-10T14:57:32.061018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-10T14:57:32.061069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 18 to 18
2025-10-10T14:57:32.061099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-10T14:57:32.061176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 19 to 19
2025-10-10T14:57:32.061209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-10T14:57:32.061263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 20 to 20
2025-10-10T14:57:32.061294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-10T14:57:32.061347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 21 to 21
2025-10-10T14:57:32.061386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-10T14:57:32.061429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 22 to 22
2025-10-10T14:57:32.061458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-10T14:57:32.061507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 23 to 23
2025-10-10T14:57:32.061534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-10T14:57:32.061578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 24 to 24
2025-10-10T14:57:32.061610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-10T14:57:32.061657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 25 to 25
2025-10-10T14:57:32.061687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-10T14:57:32.061734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 26 to 26
2025-10-10T14:57:32.061780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-10T14:57:32.061835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 27 to 27
2025-10-10T14:57:32.061869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-10T14:57:32.061920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 28 to 28
2025-10-10T14:57:32.061957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.061982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-10T14:57:32.062015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 29 to 29
2025-10-10T14:57:32.062051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-10T14:57:32.062100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 30 to 30
2025-10-10T14:57:32.062134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-10T14:57:32.062220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 31 to 31
2025-10-10T14:57:32.062260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-10T14:57:32.062317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 32 to 32
2025-10-10T14:57:32.062362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-10T14:57:32.062422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 33 to 33
2025-10-10T14:57:32.062455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-10T14:57:32.061908Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.062507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 34 to 34
2025-10-10T14:57:32.062264Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.062565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-10T14:57:32.062623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 35 to 35
2025-10-10T14:57:32.062676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-10T14:57:32.062735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 36 to 36
2025-10-10T14:57:32.062789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-10T14:57:32.062846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 37 to 37
2025-10-10T14:57:32.062879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-10T14:57:32.062935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 38 to 38
2025-10-10T14:57:32.062971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-10T14:57:32.063026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 39 to 39
2025-10-10T14:57:32.063059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-10T14:57:32.063114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 40 to 40
2025-10-10T14:57:32.063148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-10T14:57:32.063200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 41 to 41
2025-10-10T14:57:32.063229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-10T14:57:32.063280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 42 to 42
2025-10-10T14:57:32.063317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-10T14:57:32.063367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 43 to 43
2025-10-10T14:57:32.063397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-10T14:57:32.063450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 44 to 44
2025-10-10T14:57:32.063483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-10T14:57:32.063538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 45 to 45
2025-10-10T14:57:32.063575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-10T14:57:32.063633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 46 to 46
2025-10-10T14:57:32.063701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-10T14:57:32.063767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 47 to 47
2025-10-10T14:57:32.063811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-10T14:57:32.063869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 48 to 48
2025-10-10T14:57:32.063914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.063936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-10T14:57:32.063972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 49 to 49
2025-10-10T14:57:32.064013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-10T14:57:32.064075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 50 to 50
2025-10-10T14:57:32.064111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-10T14:57:32.064165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 51 to 51
2025-10-10T14:57:32.064205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-10T14:57:32.064255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 52 to 52
2025-10-10T14:57:32.064293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-10T14:57:32.064347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 53 to 53
2025-10-10T14:57:32.064383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-10T14:57:32.064436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 54 to 54
2025-10-10T14:57:32.064476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 54
2025-10-10T14:57:32.064535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 55 to 55
2025-10-10T14:57:32.064574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 55
2025-10-10T14:57:32.064629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 56 to 56
2025-10-10T14:57:32.064663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 56
2025-10-10T14:57:32.064710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 57 to 57
2025-10-10T14:57:32.064745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 57
2025-10-10T14:57:32.064795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 58 to 58
2025-10-10T14:57:32.064831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.064850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 58
2025-10-10T14:57:32.064883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 59 to 59
2025-10-10T14:57:32.064912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.062839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.062888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.062984Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:57:32.068904Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.069427Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.069640Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.070000Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.070044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.070211Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.070365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.070462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 82 offset: -1
2025-10-10T14:57:32.070546Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.070559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.070592Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.070647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.070685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.070700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:57:32.073202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 59
2025-10-10T14:57:32.073295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 60 to 60
2025-10-10T14:57:32.073380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.073407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 60
2025-10-10T14:57:32.070920Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.071065Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.070830Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T14:57:32.075455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 61 to 61
2025-10-10T14:57:32.075518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.075547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 61
2025-10-10T14:57:32.075585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 62 to 62
2025-10-10T14:57:32.075624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.075648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 62
2025-10-10T14:57:32.075711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 63 to 63
2025-10-10T14:57:32.075756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.075778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 63
2025-10-10T14:57:32.075846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 64 to 64
2025-10-10T14:57:32.075899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.075934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 64
2025-10-10T14:57:32.075993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 65 to 65
2025-10-10T14:57:32.076038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.076057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 65
2025-10-10T14:57:32.076094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 66 to 66
2025-10-10T14:57:32.076122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.076143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 66
2025-10-10T14:57:32.076223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 67 to 67
2025-10-10T14:57:32.076261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.076280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 67
2025-10-10T14:57:32.076326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 68 to 68
2025-10-10T14:57:32.076369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.076388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 68
2025-10-10T14:57:32.076439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 69 to 69
2025-10-10T14:57:32.076485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.076506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 69
2025-10-10T14:57:32.076559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 70 to 70
2025-10-10T14:57:32.076603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.076626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 70
2025-10-10T14:57:32.076680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 71 to 71
2025-10-10T14:57:32.076727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.076748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 71
2025-10-10T14:57:32.076800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 72 to 72
2025-10-10T14:57:32.076840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.076860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 72
2025-10-10T14:57:32.076909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 73 to 73
2025-10-10T14:57:32.076951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.076972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 73
2025-10-10T14:57:32.077025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 74 to 74
2025-10-10T14:57:32.077096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.077119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 74
2025-10-10T14:57:32.077217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 75 to 75
2025-10-10T14:57:32.077287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.077312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 75
2025-10-10T14:57:32.078145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 76 to 76
2025-10-10T14:57:32.078235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.078265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 76
2025-10-10T14:57:32.078661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 77 to 77
2025-10-10T14:57:32.078745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.078773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 77
2025-10-10T14:57:32.077680Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.077978Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.079043Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.079238Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.079706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 78 to 78
2025-10-10T14:57:32.079802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.079832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 78
2025-10-10T14:57:32.079630Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.079875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 79 to 79
2025-10-10T14:57:32.079951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.079978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 79
2025-10-10T14:57:32.080021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 80 to 80
2025-10-10T14:57:32.080098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.080126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 80
2025-10-10T14:57:32.080165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 81 to 81
2025-10-10T14:57:32.080213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.080235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 81
2025-10-10T14:57:32.080271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 82 to 82
2025-10-10T14:57:32.080336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.080358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 82
2025-10-10T14:57:32.080403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 83 to 83
2025-10-10T14:57:32.080470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.080492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 83
2025-10-10T14:57:32.080527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 84 to 84
2025-10-10T14:57:32.080591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.079924Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.080613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 84
2025-10-10T14:57:32.079984Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.080649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 85 to 85
2025-10-10T14:57:32.080148Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.080178Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.080689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.080354Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.080709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 85
2025-10-10T14:57:32.080392Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.080758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 86 to 86
2025-10-10T14:57:32.080806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.080824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 86
2025-10-10T14:57:32.080863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 87 to 87
2025-10-10T14:57:32.080916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.080936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 87
2025-10-10T14:57:32.080974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 88 to 88
2025-10-10T14:57:32.081047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.081067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 88
2025-10-10T14:57:32.081103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 89 to 89
2025-10-10T14:57:32.080829Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.081181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.081204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 89
2025-10-10T14:57:32.080973Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.081241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 90 to 90
2025-10-10T14:57:32.081300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.081326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 90
2025-10-10T14:57:32.081363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 91 to 91
2025-10-10T14:57:32.081429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.081451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 91
2025-10-10T14:57:32.081511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 92 to 92
2025-10-10T14:57:32.081579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.081599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 92
2025-10-10T14:57:32.081393Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.081659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 93 to 93
2025-10-10T14:57:32.081723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.081750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 93
2025-10-10T14:57:32.081852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 94 to 94
2025-10-10T14:57:32.081919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.081940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 94
2025-10-10T14:57:32.082001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 95 to 95
2025-10-10T14:57:32.082065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.082086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 95
2025-10-10T14:57:32.082147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 96 to 96
2025-10-10T14:57:32.081680Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.082215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.081853Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.082234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 96
2025-10-10T14:57:32.081909Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.082038Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.082293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 97 to 97
2025-10-10T14:57:32.082084Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.082359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.082378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 97
2025-10-10T14:57:32.082433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 98 to 98
2025-10-10T14:57:32.082493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.082513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 98
2025-10-10T14:57:32.082566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 99 to 99
2025-10-10T14:57:32.082409Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.082676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.082703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 99
2025-10-10T14:57:32.076450Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 156 count 1 nextOffset 1 batches 1
2025-10-10T14:57:32.076516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.082779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 100 to 100
2025-10-10T14:57:32.077344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 142 WTime 1760108252077
2025-10-10T14:57:32.082673Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.077632Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.082839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.082862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 100
2025-10-10T14:57:32.077658Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.077703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.086644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 101 to 101
2025-10-10T14:57:32.086742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.086769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 101
2025-10-10T14:57:32.077716Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.077738Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.077907Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 142
2025-10-10T14:57:32.077948Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-10T14:57:32.078159Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 3
2025-10-10T14:57:32.087008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 102 to 102
2025-10-10T14:57:32.087076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.087097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 102
2025-10-10T14:57:32.087150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 103 to 103
2025-10-10T14:57:32.087208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.078186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 4
2025-10-10T14:57:32.087230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 103
2025-10-10T14:57:32.080334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.087301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 104 to 104
2025-10-10T14:57:32.080366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.080416Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.080433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.087359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.087379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 104
2025-10-10T14:57:32.080523Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 5
2025-10-10T14:57:32.080551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 6
2025-10-10T14:57:32.087430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 105 to 105
2025-10-10T14:57:32.081987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.082029Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.082098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 7 size 192 offset: -1
2025-10-10T14:57:32.087492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.087514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 105
2025-10-10T14:57:32.082143Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.082211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.087564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 106 to 106
2025-10-10T14:57:32.082932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.082961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.087621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.083000Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 8 size 303 offset: -1
2025-10-10T14:57:32.087654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 106
2025-10-10T14:57:32.083043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.083055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.087712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 107 to 107
2025-10-10T14:57:32.083074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 9 size 413 offset: -1
2025-10-10T14:57:32.087773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.087792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 107
2025-10-10T14:57:32.083116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.083128Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.087846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 108 to 108
2025-10-10T14:57:32.083162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.083172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.087918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.083199Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.087939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 108
2025-10-10T14:57:32.083209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.083256Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 142 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.087993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 109 to 109
2025-10-10T14:57:32.083304Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.088046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.083339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.088066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 109
2025-10-10T14:57:32.083357Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.083390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.088123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 110 to 110
2025-10-10T14:57:32.083441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.083493Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 89 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.088192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.083526Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.088212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 110
2025-10-10T14:57:32.083565Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T14:57:32.086637Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 142
2025-10-10T14:57:32.088270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 111 to 111
2025-10-10T14:57:32.088329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.088355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 111
2025-10-10T14:57:32.082910Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.083100Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.092113Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-10T14:57:32.092169Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-10T14:57:32.092239Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 142
2025-10-10T14:57:32.092272Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.092333Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 5e899e85-f73df7ba-c6c99325-b740e928, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 170, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.092431Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 170 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 5e899e85-f73df7ba-c6c99325-b740e928
2025-10-10T14:57:32.092801Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.093178Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.093404Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.093592Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.093743Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.093931Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.094080Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.094228Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.094374Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.094563Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.094724Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.094869Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.095017Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.095213Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.095355Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.095503Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.090306Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T14:57:32.090372Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T14:57:32.090398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.090442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.090456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:57:32.090591Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T14:57:32.097862Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 266 count 1 nextOffset 2 batches 1
2025-10-10T14:57:32.097959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T14:57:32.098006Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 611 count 2 nextOffset 3 batches 1
2025-10-10T14:57:32.098030Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-10T14:57:32.098089Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1066 count 3 nextOffset 4 batches 1
2025-10-10T14:57:32.098117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.098828Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,3 HeadOffset 1 endOffset 1 curOffset 4 d0000000000_00000000000000000001_00000_0000000003_00000? size 1029 WTime 1760108252097
2025-10-10T14:57:32.099013Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.099088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 7
2025-10-10T14:57:32.099133Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 8
2025-10-10T14:57:32.099149Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 9
2025-10-10T14:57:32.099177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:57:32.099250Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.101597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 112 to 112
2025-10-10T14:57:32.099270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.099320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 13 size 523 offset: -1
2025-10-10T14:57:32.099375Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.099387Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.099407Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 14 size 633 offset: -1
2025-10-10T14:57:32.101725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.099440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.099450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.101769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 112
2025-10-10T14:57:32.099482Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.099492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.099604Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.099622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.099681Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.099781Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 3 size 1029
2025-10-10T14:57:32.099830Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.099876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.101960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 113 to 113
2025-10-10T14:57:32.099890Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.099901Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.100246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 10
2025-10-10T14:57:32.100268Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 11
2025-10-10T14:57:32.102041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.100307Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T14:57:32.102067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 113
2025-10-10T14:57:32.100557Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-10T14:57:32.100574Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T14:57:32.100694Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.100728Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T14:57:32.100764Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 170 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T14:57:32.100896Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-10-10T14:57:32.100908Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-10T14:57:32.100943Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.101100Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-10T14:57:32.102247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 114 to 114
2025-10-10T14:57:32.102321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.102346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 114
2025-10-10T14:57:32.102503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 115 to 115
2025-10-10T14:57:32.102589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.102614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 115
2025-10-10T14:57:32.102296Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.102793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 116 to 116
2025-10-10T14:57:32.102887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.102916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 116
2025-10-10T14:57:32.102801Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.103103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 117 to 117
2025-10-10T14:57:32.103183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.103206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 117
2025-10-10T14:57:32.103082Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.103368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 118 to 118
2025-10-10T14:57:32.103486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.103344Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.103509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 118
2025-10-10T14:57:32.103557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 119 to 119
2025-10-10T14:57:32.103606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.103625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 119
2025-10-10T14:57:32.103662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 120 to 120
2025-10-10T14:57:32.103734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.103592Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.103753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 120
2025-10-10T14:57:32.103791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 121 to 121
2025-10-10T14:57:32.103835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.103855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 121
2025-10-10T14:57:32.103889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 122 to 122
2025-10-10T14:57:32.103952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.103974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 122
2025-10-10T14:57:32.103836Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.104010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 123 to 123
2025-10-10T14:57:32.104052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.104068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 123
2025-10-10T14:57:32.104101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 124 to 124
2025-10-10T14:57:32.104166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.104187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 124
2025-10-10T14:57:32.104053Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.104223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 125 to 125
2025-10-10T14:57:32.104267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.104284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 125
2025-10-10T14:57:32.104338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 126 to 126
2025-10-10T14:57:32.104267Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.104407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.104427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 126
2025-10-10T14:57:32.104463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 127 to 127
2025-10-10T14:57:32.104503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.104519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 127
2025-10-10T14:57:32.104553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 128 to 128
2025-10-10T14:57:32.104478Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.104621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.104644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 128
2025-10-10T14:57:32.104684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 129 to 129
2025-10-10T14:57:32.104765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.104788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 129
2025-10-10T14:57:32.104823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 130 to 130
2025-10-10T14:57:32.104685Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.104884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.104908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 130
2025-10-10T14:57:32.104946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 131 to 131
2025-10-10T14:57:32.105007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.105029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 131
2025-10-10T14:57:32.104901Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.105063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 132 to 132
2025-10-10T14:57:32.105097Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.105334Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.105557Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.105621Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-10T14:57:32.105679Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760108252070 queuesize 0 startOffset 0
2025-10-10T14:57:32.105749Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.105855Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:57:32.105878Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-10-10T14:57:32.105893Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:57:32.105960Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:57:32.106435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.106468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 132
2025-10-10T14:57:32.106580Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 82 bytes ..." SourceId: "\000src_id" SeqNo: 1 WriteTimestampMS: 1760108252070 CreateTimestampMS: 1760108252058 UncompressedSize: 11 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-10T14:57:32.106657Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.106707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.106738Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-10T14:57:32.106760Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.106787Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.106787Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 5e899e85-f73df7ba-c6c99325-b740e928 has messages 1
2025-10-10T14:57:32.106855Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.106908Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.106919Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 5e899e85-f73df7ba-c6c99325-b740e928, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 169
2025-10-10T14:57:32.106933Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.106950Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 5e899e85-f73df7ba-c6c99325-b740e928
2025-10-10T14:57:32.107158Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.107349Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.107411Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.107444Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.107703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.107766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.108353Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.108927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 133 to 133
2025-10-10T14:57:32.109032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.109056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 133
2025-10-10T14:57:32.109101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 134 to 134
2025-10-10T14:57:32.109197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.109219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 134
2025-10-10T14:57:32.109326Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 169, now ReadSizeBudget = 0, ReadSizeServerDelta = 524119
2025-10-10T14:57:32.109484Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 524119
2025-10-10T14:57:32.109343Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.109674Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.109720Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-10T14:57:32.109783Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 169 to budget
2025-10-10T14:57:32.109845Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 169, ReadSizeServerDelta = 524119
2025-10-10T14:57:32.109941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 135 to 135
2025-10-10T14:57:32.109991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.110014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 135
2025-10-10T14:57:32.110063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 136 to 136
2025-10-10T14:57:32.110104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.110133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 136
2025-10-10T14:57:32.110140Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.110172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 137 to 137
2025-10-10T14:57:32.110207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.110226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 137
2025-10-10T14:57:32.110228Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-10T14:57:32.110262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 138 to 138
2025-10-10T14:57:32.110358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.110386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 138
>>> event from dataHandler: 2025-10-10T14:57:32.110429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 139 to 139
2025-10-10T14:57:32.110498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..11 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-10T14:57:32.058000Z WriteTime: 2025-10-10T14:57:32.070000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.110531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 139
2025-10-10T14:57:32.110572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 140 to 140
2025-10-10T14:57:32.110558Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 1, size 11 bytes
2025-10-10T14:57:32.110622Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.110640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.110664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 140
2025-10-10T14:57:32.110706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 141 to 141
2025-10-10T14:57:32.110774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.110799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 141
2025-10-10T14:57:32.110836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 142 to 142
2025-10-10T14:57:32.110894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.110914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 142
2025-10-10T14:57:32.110949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 143 to 143
2025-10-10T14:57:32.111020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.111045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 143
2025-10-10T14:57:32.111083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 144 to 144
2025-10-10T14:57:32.111181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.111205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 144
2025-10-10T14:57:32.111244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 145 to 145
2025-10-10T14:57:32.111312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.111335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 145
2025-10-10T14:57:32.111375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 146 to 146
2025-10-10T14:57:32.111437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.111460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 146
2025-10-10T14:57:32.111503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 147 to 147
2025-10-10T14:57:32.111567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.111588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 147
2025-10-10T14:57:32.111625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 148 to 148
2025-10-10T14:57:32.111736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.111757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 148
2025-10-10T14:57:32.111827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 149 to 149
2025-10-10T14:57:32.111894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.111919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 149
2025-10-10T14:57:32.111957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 150 to 150
2025-10-10T14:57:32.112021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.112043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 150
2025-10-10T14:57:32.112080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 151 to 151
2025-10-10T14:57:32.112147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.112164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 151
2025-10-10T14:57:32.112202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 152 to 152
2025-10-10T14:57:32.112271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.112295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 152
2025-10-10T14:57:32.112334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 153 to 153
2025-10-10T14:57:32.112403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.112426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 153
2025-10-10T14:57:32.112463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 154 to 154
2025-10-10T14:57:32.112531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.112554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 154
2025-10-10T14:57:32.112592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 155 to 155
2025-10-10T14:57:32.112675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.112699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 155
2025-10-10T14:57:32.112758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 156 to 156
2025-10-10T14:57:32.112833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.112858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 156
2025-10-10T14:57:32.112898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 157 to 157
2025-10-10T14:57:32.112973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.113002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 157
2025-10-10T14:57:32.113046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 158 to 158
2025-10-10T14:57:32.108587Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.108618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.108666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 17 size 743 offset: -1
2025-10-10T14:57:32.108723Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.108737Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.108786Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 18 size 853 offset: -1
2025-10-10T14:57:32.108832Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.108842Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.108864Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 19 size 963 offset: -1
2025-10-10T14:57:32.108895Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.108904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.108927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 20 size 1073 offset: -1
2025-10-10T14:57:32.108957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.108968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.108987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size 1183 offset: -1
2025-10-10T14:57:32.109927Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.109999Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.109032Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.110028Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.109045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.110094Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.109079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.109089Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.110150Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.109113Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.110456Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.109151Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.110535Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.109198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.109213Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.110576Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.109243Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.110617Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.110659Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.113612Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.109255Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.109295Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.109338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.109349Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.109365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.109373Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.109385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.109393Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.109406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.109414Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.109425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.109541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-10T14:57:32.109576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 13
2025-10-10T14:57:32.109589Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 14
2025-10-10T14:57:32.109603Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 15
2025-10-10T14:57:32.109615Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 16
2025-10-10T14:57:32.113273Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.113307Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.113353Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 27 size 1293 offset: -1
2025-10-10T14:57:32.113405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.113426Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.113447Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 28 size 1403 offset: -1
2025-10-10T14:57:32.113484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.113494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.113511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 29 size 1513 offset: -1
2025-10-10T14:57:32.113543Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.113554Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.113576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 30 size 1623 offset: -1
2025-10-10T14:57:32.113610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.113621Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.113638Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size 1733 offset: -1
2025-10-10T14:57:32.113668Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.113676Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.113733Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.113775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.113822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.114002Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 169 } }
2025-10-10T14:57:32.114165Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 838448ad-ee887a94-48b7df27-100984e1
2025-10-10T14:57:32.114829Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.114876Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.114963Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.115036Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.115118Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.115150Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.115639Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.115735Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.115778Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.115811Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.115861Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.117475Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.117920Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.113116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.113839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.118336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 158
2025-10-10T14:57:32.113867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.113876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.113899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.113907Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.113927Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.113975Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.118517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 159 to 159
2025-10-10T14:57:32.118596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.118619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 159
2025-10-10T14:57:32.118660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 160 to 160
2025-10-10T14:57:32.118705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.118727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 160
2025-10-10T14:57:32.118765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 161 to 161
2025-10-10T14:57:32.118805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.118827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 161
2025-10-10T14:57:32.118864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 162 to 162
2025-10-10T14:57:32.118971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.118995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 162
2025-10-10T14:57:32.119036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 163 to 163
2025-10-10T14:57:32.119120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.119145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 163
2025-10-10T14:57:32.119190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 164 to 164
2025-10-10T14:57:32.119275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.119299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 164
2025-10-10T14:57:32.119337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 165 to 165
2025-10-10T14:57:32.119396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.119418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 165
2025-10-10T14:57:32.119459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 166 to 166
2025-10-10T14:57:32.119521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.119543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 166
2025-10-10T14:57:32.119579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 167 to 167
2025-10-10T14:57:32.119639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.119661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 167
2025-10-10T14:57:32.119699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 168 to 168
2025-10-10T14:57:32.119738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.119757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 168
2025-10-10T14:57:32.119790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 169 to 169
2025-10-10T14:57:32.119824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.119842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 169
2025-10-10T14:57:32.119878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 170 to 170
2025-10-10T14:57:32.119910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.119929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 170
2025-10-10T14:57:32.119961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 171 to 171
2025-10-10T14:57:32.119998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.120018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 171
2025-10-10T14:57:32.120051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 172 to 172
2025-10-10T14:57:32.120088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.120109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 172
2025-10-10T14:57:32.120165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 173 to 173
2025-10-10T14:57:32.120211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.120231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 173
2025-10-10T14:57:32.120279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 174 to 174
2025-10-10T14:57:32.120339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.120359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 174
2025-10-10T14:57:32.120394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 175 to 175
2025-10-10T14:57:32.120455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.120477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 175
2025-10-10T14:57:32.120516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 176 to 176
2025-10-10T14:57:32.120578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.120600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 176
2025-10-10T14:57:32.120638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 177 to 177
2025-10-10T14:57:32.120703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.120727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 177
2025-10-10T14:57:32.120766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 178 to 178
2025-10-10T14:57:32.120830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.120852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 178
2025-10-10T14:57:32.120891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 179 to 179
2025-10-10T14:57:32.120955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.120975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 179
2025-10-10T14:57:32.121012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 180 to 180
2025-10-10T14:57:32.121370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.121402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 180
2025-10-10T14:57:32.121447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 181 to 181
2025-10-10T14:57:32.121545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.121565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 181
2025-10-10T14:57:32.121611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 182 to 182
2025-10-10T14:57:32.121685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.121707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 182
2025-10-10T14:57:32.121746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 183 to 183
2025-10-10T14:57:32.121829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.121854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 183
2025-10-10T14:57:32.121894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 184 to 184
2025-10-10T14:57:32.121947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.121968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 184
2025-10-10T14:57:32.122038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 185 to 185
2025-10-10T14:57:32.122079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.122097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 185
2025-10-10T14:57:32.122166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 186 to 186
2025-10-10T14:57:32.122212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.122232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 186
2025-10-10T14:57:32.122307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 187 to 187
2025-10-10T14:57:32.122349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.122369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 187
2025-10-10T14:57:32.122450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 188 to 188
2025-10-10T14:57:32.122505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.122525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 188
2025-10-10T14:57:32.122612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 189 to 189
2025-10-10T14:57:32.122684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.122705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 189
2025-10-10T14:57:32.122777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 190 to 190
2025-10-10T14:57:32.122832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.122849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 190
2025-10-10T14:57:32.122919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 191 to 191
2025-10-10T14:57:32.122964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.122983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 191
2025-10-10T14:57:32.123088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 192 to 192
2025-10-10T14:57:32.123151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.123172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 192
2025-10-10T14:57:32.123242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 193 to 193
2025-10-10T14:57:32.123298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.123319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 193
2025-10-10T14:57:32.123400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 194 to 194
2025-10-10T14:57:32.123463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.123485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 194
2025-10-10T14:57:32.123559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 195 to 195
2025-10-10T14:57:32.123604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.123620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 195
2025-10-10T14:57:32.123717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 196 to 196
2025-10-10T14:57:32.123776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.123800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 196
2025-10-10T14:57:32.123872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 197 to 197
2025-10-10T14:57:32.123914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.123935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 197
2025-10-10T14:57:32.120785Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.121273Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.121565Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.121905Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.122151Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.122436Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.122681Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.122938Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.123178Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.123417Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.123460Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.123533Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.123671Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.123719Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.123776Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.124127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.124185Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.124226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.124259Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.124291Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.124322Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.113987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.113998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.114007Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.114048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.114072Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.114093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.114104Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.114114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.114175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-10T14:57:32.114218Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 18
2025-10-10T14:57:32.114232Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 19
2025-10-10T14:57:32.114245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 20
2025-10-10T14:57:32.114289Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 21
2025-10-10T14:57:32.121369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.121422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.121491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 37 size 1843 offset: -1
2025-10-10T14:57:32.121571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.121586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.121609Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 38 size 1953 offset: -1
2025-10-10T14:57:32.121656Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.121681Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.121705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 39 size 2063 offset: -1
2025-10-10T14:57:32.121751Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.121773Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.121821Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 40 size 2173 offset: -1
2025-10-10T14:57:32.121868Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.121879Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.121899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size 2283 offset: -1
2025-10-10T14:57:32.121940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.121950Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.121979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.121987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.122025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.122037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.122063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.122070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.122101Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.122110Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.122194Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.122249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.122275Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.122298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.122310Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.122321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.122330Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.122346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.122355Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.122368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.122934Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-10T14:57:32.122979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 23
2025-10-10T14:57:32.122995Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 24
2025-10-10T14:57:32.123011Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 25
2025-10-10T14:57:32.123026Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 26
2025-10-10T14:57:32.124399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.124421Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.124463Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 47 size 2393 offset: -1
2025-10-10T14:57:32.124543Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.124556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.124579Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 48 size 2503 offset: -1
2025-10-10T14:57:32.124651Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.124666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.124688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 49 size 2613 offset: -1
2025-10-10T14:57:32.124756Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.124770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.124792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 50 size 2723 offset: -1
2025-10-10T14:57:32.124836Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.124847Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.124865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size 2833 offset: -1
2025-10-10T14:57:32.124887Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.124929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.124939Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.124951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.124959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.124970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.124979Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.124990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.125018Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.125029Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.125057Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.125066Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.125079Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.125093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.125116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.125144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.125177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.125188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.125215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.125234Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.125307Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-10T14:57:32.125351Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 28
2025-10-10T14:57:32.125365Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 29
2025-10-10T14:57:32.125392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 30
2025-10-10T14:57:32.125408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 31
2025-10-10T14:57:32.127487Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.127549Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.127605Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.127629Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.127655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.127688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.128137Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.128182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.128264Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.128299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.128329Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.128891Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.129217Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.129496Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.129537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.129582Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 57 size 2943 offset: -1
2025-10-10T14:57:32.129638Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.129647Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.129666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 58 size 3053 offset: -1
2025-10-10T14:57:32.129700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.129711Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.129727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 59 size 3163 offset: -1
2025-10-10T14:57:32.129773Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.129785Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.129804Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 60 size 3273 offset: -1
2025-10-10T14:57:32.129839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.129850Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.129870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size 3383 offset: -1
2025-10-10T14:57:32.129901Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.129912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.129945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.129955Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.129981Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.129991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.130013Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.130023Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.130050Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.130059Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.130107Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 3 size 1029 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.130202Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.130162Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.130210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.130222Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.130235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.130238Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 3 parts 0 suffix '63' size 1029
2025-10-10T14:57:32.130244Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.130257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.130266Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.130281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.130291Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.130303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.130401Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.130453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 929 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.130489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.130519Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T14:57:32.130566Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.130591Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-10T14:57:32.130606Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.130624Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-10T14:57:32.130830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.130950Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.131046Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-10T14:57:32.131071Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 4
2025-10-10T14:57:32.131126Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 4, WTime# 1760108252070, sizeLag# 1029
2025-10-10T14:57:32.131140Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.131208Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 2f70388c-b1e8580d-fc3410e2-e86a2fad, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 1234, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.131266Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 1234 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 2f70388c-b1e8580d-fc3410e2-e86a2fad
2025-10-10T14:57:32.130918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.130936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (27)
2025-10-10T14:57:32.131030Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-10T14:57:32.131899Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 597 count 1 nextOffset 5 batches 1
2025-10-10T14:57:32.131962Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-10T14:57:32.131991Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1272 count 2 nextOffset 6 batches 1
2025-10-10T14:57:32.132009Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-10T14:57:32.132029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2057 count 3 nextOffset 7 batches 1
2025-10-10T14:57:32.132047Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-10T14:57:32.132064Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2952 count 4 nextOffset 8 batches 1
2025-10-10T14:57:32.132085Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-10T14:57:32.132105Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 3957 count 5 nextOffset 9 batches 1
2025-10-10T14:57:32.132122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-10T14:57:32.132143Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 5072 count 6 nextOffset 10 batches 1
2025-10-10T14:57:32.132162Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-10T14:57:32.132178Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6297 count 7 nextOffset 11 batches 1
2025-10-10T14:57:32.132201Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-10T14:57:32.132216Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 7632 count 8 nextOffset 12 batches 1
2025-10-10T14:57:32.132235Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-10T14:57:32.132251Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 9077 count 9 nextOffset 13 batches 1
2025-10-10T14:57:32.132269Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-10T14:57:32.132284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 10632 count 10 nextOffset 14 batches 1
2025-10-10T14:57:32.132302Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-10T14:57:32.132318Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 12297 count 11 nextOffset 15 batches 1
2025-10-10T14:57:32.132336Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-10T14:57:32.132352Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 14072 count 12 nextOffset 16 batches 1
2025-10-10T14:57:32.132367Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-10T14:57:32.132380Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 15957 count 13 nextOffset 17 batches 1
2025-10-10T14:57:32.132395Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-10T14:57:32.132410Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 17952 count 14 nextOffset 18 batches 1
2025-10-10T14:57:32.132425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-10T14:57:32.132440Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 20057 count 15 nextOffset 19 batches 1
2025-10-10T14:57:32.132456Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-10T14:57:32.132476Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 22272 count 16 nextOffset 20 batches 1
2025-10-10T14:57:32.132495Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-10T14:57:32.132551Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 24597 count 17 nextOffset 21 batches 1
2025-10-10T14:57:32.132573Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-10T14:57:32.132591Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 27032 count 18 nextOffset 22 batches 1
2025-10-10T14:57:32.132608Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-10T14:57:32.132624Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 29577 count 19 nextOffset 23 batches 1
2025-10-10T14:57:32.132639Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-10T14:57:32.132655Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 32232 count 20 nextOffset 24 batches 1
2025-10-10T14:57:32.132687Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-10T14:57:32.132708Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 34997 count 21 nextOffset 25 batches 1
2025-10-10T14:57:32.132727Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-10T14:57:32.132743Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 37872 count 22 nextOffset 26 batches 1
2025-10-10T14:57:32.132763Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-10T14:57:32.132776Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 40857 count 23 nextOffset 27 batches 1
2025-10-10T14:57:32.132793Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-10T14:57:32.132812Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 43952 count 24 nextOffset 28 batches 1
2025-10-10T14:57:32.132835Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-10T14:57:32.132852Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 47157 count 25 nextOffset 29 batches 1
2025-10-10T14:57:32.132868Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-10T14:57:32.132908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 50472 count 26 nextOffset 30 batches 1
2025-10-10T14:57:32.132931Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-10T14:57:32.132948Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 53897 count 27 nextOffset 31 batches 1
2025-10-10T14:57:32.132962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.133380Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.133687Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.133937Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.134211Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.134426Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.134681Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.135033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 198 to 198
2025-10-10T14:57:32.134915Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.135113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.135149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 198
2025-10-10T14:57:32.135267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 199 to 199
2025-10-10T14:57:32.135322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.135342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 199
2025-10-10T14:57:32.135201Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.135420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 200 to 200
2025-10-10T14:57:32.135475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.135497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 200
2025-10-10T14:57:32.135568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 201 to 201
2025-10-10T14:57:32.135614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.135633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 201
2025-10-10T14:57:32.135484Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.135729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 202 to 202
2025-10-10T14:57:32.135813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.135837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 202
2025-10-10T14:57:32.135734Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.135909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 203 to 203
2025-10-10T14:57:32.135983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.136004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 203
2025-10-10T14:57:32.136113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 204 to 204
2025-10-10T14:57:32.135993Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.136190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.136214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 204
2025-10-10T14:57:32.136284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 205 to 205
2025-10-10T14:57:32.136357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.136379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 205
2025-10-10T14:57:32.136268Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.136451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 206 to 206
2025-10-10T14:57:32.136525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.136548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 206
2025-10-10T14:57:32.136635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 207 to 207
2025-10-10T14:57:32.136705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.136542Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.136726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 207
2025-10-10T14:57:32.136803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 208 to 208
2025-10-10T14:57:32.136875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.136906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 208
2025-10-10T14:57:32.136985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 209 to 209
2025-10-10T14:57:32.136821Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.137062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.137087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 209
2025-10-10T14:57:32.137089Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.137380Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.137598Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.137834Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.137946Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,27 HeadOffset 4 endOffset 4 curOffset 31 d0000000000_00000000000000000004_00000_0000000027_00000? size 53095 WTime 1760108252137
2025-10-10T14:57:32.138092Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.138119Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.138183Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-10T14:57:32.138236Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 33
2025-10-10T14:57:32.138252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 34
2025-10-10T14:57:32.138273Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 35
2025-10-10T14:57:32.138300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 36
2025-10-10T14:57:32.138327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 2
2025-10-10T14:57:32.138356Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 3
2025-10-10T14:57:32.138379Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 4
2025-10-10T14:57:32.138484Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.138634Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.138689Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.138722Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.138747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.138810Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.138945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.138980Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.139011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.139200Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.139284Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.139317Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.139350Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.139379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.138492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.138519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.138564Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.138657Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 27 size 53095
2025-10-10T14:57:32.138938Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 3 size 1234 endOffset 4 max time lag 0ms effective offset 1
2025-10-10T14:57:32.139098Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 1029 count 3 last offset 1, current partition end offset: 4
2025-10-10T14:57:32.139111Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-10T14:57:32.139163Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 3 parts_count 0 source 1 size 1029 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.139194Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-10T14:57:32.139249Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.139731Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 3 count 3 size 1009 from pos 0 cbcount 3
2025-10-10T14:57:32.139840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:57:32.140255Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:57:32.140820Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.141272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 210 to 210
2025-10-10T14:57:32.141145Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.141389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.141424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 210
2025-10-10T14:57:32.141431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.141542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 211 to 211
2025-10-10T14:57:32.141466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.141527Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 67 size 3493 offset: -1
2025-10-10T14:57:32.141319Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 1 Data: "... 192 bytes ..." SourceId: "\000src_id" SeqNo: 2 WriteTimestampMS: 1760108252086 CreateTimestampMS: 1760108252059 UncompressedSize: 121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 303 bytes ..." SourceId: "\000src_id" SeqNo: 3 WriteTimestampMS: 1760108252097 CreateTimestampMS: 1760108252059 UncompressedSize: 231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 413 bytes ..." SourceId: "\000src_id" SeqNo: 4 WriteTimestampMS: 1760108252097 CreateTimestampMS: 1760108252059 UncompressedSize: 341 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551611 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 1 }
2025-10-10T14:57:32.141521Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 4
2025-10-10T14:57:32.141570Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid 2f70388c-b1e8580d-fc3410e2-e86a2fad has messages 1
2025-10-10T14:57:32.141662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.141628Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.141650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.141674Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 68 size 3603 offset: -1
2025-10-10T14:57:32.141722Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.141736Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.141776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 69 size 3713 offset: -1
2025-10-10T14:57:32.141813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.141826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.141845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 70 size 3823 offset: -1
2025-10-10T14:57:32.141685Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.141877Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.141979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.142007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size 3933 offset: -1
2025-10-10T14:57:32.142041Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.142052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.142140Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 2f70388c-b1e8580d-fc3410e2-e86a2fad, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 1039
2025-10-10T14:57:32.142175Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 2f70388c-b1e8580d-fc3410e2-e86a2fad
2025-10-10T14:57:32.142353Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.142087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.142104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.142129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.142139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.142163Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.142173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.142197Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.142206Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.142231Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.142274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.142287Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.142299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.142309Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.142324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.142336Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.142349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.142381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.142392Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.142405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.142481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-10T14:57:32.142541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 38
2025-10-10T14:57:32.142555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 39
2025-10-10T14:57:32.142570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 40
2025-10-10T14:57:32.142584Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 41
2025-10-10T14:57:32.142937Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.143415Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.143585Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.141686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 211
2025-10-10T14:57:32.144132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 212 to 212
2025-10-10T14:57:32.144252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.144280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 212
2025-10-10T14:57:32.144363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 213 to 213
2025-10-10T14:57:32.144435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.144457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 213
2025-10-10T14:57:32.144538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 214 to 214
2025-10-10T14:57:32.144607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.144640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 214
2025-10-10T14:57:32.144712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 215 to 215
2025-10-10T14:57:32.144787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.144808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 215
2025-10-10T14:57:32.144927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 216 to 216
2025-10-10T14:57:32.145018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.145040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 216
2025-10-10T14:57:32.145119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 217 to 217
2025-10-10T14:57:32.145213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.145235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 217
2025-10-10T14:57:32.145319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 218 to 218
2025-10-10T14:57:32.145396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.145418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 218
2025-10-10T14:57:32.145500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 219 to 219
2025-10-10T14:57:32.145515Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 1039, now ReadSizeBudget = 0, ReadSizeServerDelta = 523249
2025-10-10T14:57:32.145579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.145600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 219
2025-10-10T14:57:32.145683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 220 to 220
2025-10-10T14:57:32.145693Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 523249
2025-10-10T14:57:32.145785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.145806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 220
2025-10-10T14:57:32.145924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 221 to 221
2025-10-10T14:57:32.143841Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.143976Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.145968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.144077Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.145989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 221
2025-10-10T14:57:32.144202Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.144364Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.144516Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.146056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 222 to 222
2025-10-10T14:57:32.144657Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.144807Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.146095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.144965Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.146112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 222
2025-10-10T14:57:32.145185Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.145369Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.145539Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.145717Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.146218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 223 to 223
2025-10-10T14:57:32.146260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.146277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 223
2025-10-10T14:57:32.146346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 224 to 224
2025-10-10T14:57:32.146395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.146415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 224
2025-10-10T14:57:32.146489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 225 to 225
2025-10-10T14:57:32.146528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.146546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 225
2025-10-10T14:57:32.146622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 226 to 226
2025-10-10T14:57:32.146661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.146687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 226
2025-10-10T14:57:32.146442Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.146695Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-3)
2025-10-10T14:57:32.146745Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 1039 to budget
2025-10-10T14:57:32.146763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 227 to 227
2025-10-10T14:57:32.146823Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 1039, ReadSizeServerDelta = 523249
2025-10-10T14:57:32.146842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.146865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 227
2025-10-10T14:57:32.146956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 228 to 228
2025-10-10T14:57:32.147042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.147065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 228
2025-10-10T14:57:32.146926Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.147190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 229 to 229
2025-10-10T14:57:32.147096Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.147363Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-10T14:57:32.147226Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.147405Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (2-2)
2025-10-10T14:57:32.147675Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (3-3)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..121 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-10T14:57:32.059000Z WriteTime: 2025-10-10T14:57:32.086000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..231 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-10T14:57:32.059000Z WriteTime: 2025-10-10T14:57:32.097000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..341 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-10T14:57:32.059000Z WriteTime: 2025-10-10T14:57:32.097000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.147952Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 3, size 693 bytes
2025-10-10T14:57:32.147990Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.148180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.148208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 229
2025-10-10T14:57:32.147664Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.148291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 230 to 230
2025-10-10T14:57:32.148395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.148421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 230
2025-10-10T14:57:32.148491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 231 to 231
2025-10-10T14:57:32.148567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.148588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 231
2025-10-10T14:57:32.148656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 232 to 232
2025-10-10T14:57:32.148725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.148748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 232
2025-10-10T14:57:32.148818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 233 to 233
2025-10-10T14:57:32.148917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.148941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 233
2025-10-10T14:57:32.149015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 234 to 234
2025-10-10T14:57:32.149084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.149106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 234
2025-10-10T14:57:32.149230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 235 to 235
2025-10-10T14:57:32.149307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.149327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 235
2025-10-10T14:57:32.149396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 236 to 236
2025-10-10T14:57:32.149482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.149501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 236
2025-10-10T14:57:32.149571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 237 to 237
2025-10-10T14:57:32.149693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.149713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 237
2025-10-10T14:57:32.149806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 238 to 238
2025-10-10T14:57:32.149881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.149904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 238
2025-10-10T14:57:32.149978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 239 to 239
2025-10-10T14:57:32.150048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.150067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 239
2025-10-10T14:57:32.150139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 240 to 240
2025-10-10T14:57:32.150210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.150230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 240
2025-10-10T14:57:32.150320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 241 to 241
2025-10-10T14:57:32.150396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.150415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 241
2025-10-10T14:57:32.150530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 242 to 242
2025-10-10T14:57:32.150598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.150617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 242
2025-10-10T14:57:32.150690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 243 to 243
2025-10-10T14:57:32.150781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.150803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 243
2025-10-10T14:57:32.150867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 244 to 244
2025-10-10T14:57:32.150940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.150961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 244
2025-10-10T14:57:32.151046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 245 to 245
2025-10-10T14:57:32.151116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.151136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 245
2025-10-10T14:57:32.151200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 246 to 246
2025-10-10T14:57:32.151268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.151289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 246
2025-10-10T14:57:32.151353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 247 to 247
2025-10-10T14:57:32.147883Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 1039 } }
2025-10-10T14:57:32.147981Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# ff54e114-a870a386-458eba37-1f6becd4
2025-10-10T14:57:32.153348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.153383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 247
2025-10-10T14:57:32.148335Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.148701Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.148966Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.149211Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.149546Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.152171Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.152230Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.152293Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.152318Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.152351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.152373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.152773Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.152850Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.152884Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.152920Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.152948Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.153481Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.153889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 248 to 248
2025-10-10T14:57:32.153981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.154004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 248
2025-10-10T14:57:32.154080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 249 to 249
2025-10-10T14:57:32.154161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.154184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 249
2025-10-10T14:57:32.154252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 250 to 250
2025-10-10T14:57:32.154347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.154368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 250
2025-10-10T14:57:32.154435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 251 to 251
2025-10-10T14:57:32.154516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.154535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 251
2025-10-10T14:57:32.154599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 252 to 252
2025-10-10T14:57:32.154689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.154712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 252
2025-10-10T14:57:32.154781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 253 to 253
2025-10-10T14:57:32.154862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.154884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 253
2025-10-10T14:57:32.154956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 254 to 254
2025-10-10T14:57:32.155032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.155055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 254
2025-10-10T14:57:32.155197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 255 to 255
2025-10-10T14:57:32.155274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.155295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 255
2025-10-10T14:57:32.155367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 256 to 256
2025-10-10T14:57:32.155443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.155465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 256
2025-10-10T14:57:32.155542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 257 to 257
2025-10-10T14:57:32.155627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.155649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 257
2025-10-10T14:57:32.155212Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.155263Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.155316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 77 size 4043 offset: -1
2025-10-10T14:57:32.155397Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.155417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.155452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 78 size 4153 offset: -1
2025-10-10T14:57:32.155494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.155515Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.155539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 79 size 4263 offset: -1
2025-10-10T14:57:32.155612Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.155628Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.155650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 80 size 4373 offset: -1
2025-10-10T14:57:32.155775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.155787Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.155813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size 4483 offset: -1
2025-10-10T14:57:32.155844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.155855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.155886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.155896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.155920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.155930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.155959Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.155969Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.155994Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.156005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.156030Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.156257Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.156639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.156669Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.156686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.156697Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.156713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.156724Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.156737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.156747Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.156760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.156839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-10T14:57:32.156788Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.156890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 43
2025-10-10T14:57:32.156921Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 44
2025-10-10T14:57:32.156940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 45
2025-10-10T14:57:32.156956Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 46
2025-10-10T14:57:32.157029Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.157946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.157975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.158030Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 87 size 4593 offset: -1
2025-10-10T14:57:32.158087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.158104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.158129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 88 size 4703 offset: -1
2025-10-10T14:57:32.161240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 258 to 258
2025-10-10T14:57:32.161329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.161348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 258
2025-10-10T14:57:32.161422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 259 to 259
2025-10-10T14:57:32.161456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.161469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 259
2025-10-10T14:57:32.161529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 260 to 260
2025-10-10T14:57:32.161617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.161632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 260
2025-10-10T14:57:32.161709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 261 to 261
2025-10-10T14:57:32.161795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.161810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 261
2025-10-10T14:57:32.161865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 262 to 262
2025-10-10T14:57:32.161918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.161933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 262
2025-10-10T14:57:32.161986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 263 to 263
2025-10-10T14:57:32.162039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.162052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 263
2025-10-10T14:57:32.162106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 264 to 264
2025-10-10T14:57:32.162158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.162172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 264
2025-10-10T14:57:32.162225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 265 to 265
2025-10-10T14:57:32.162307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.162320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 265
2025-10-10T14:57:32.162374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 266 to 266
2025-10-10T14:57:32.162440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.162455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 266
2025-10-10T14:57:32.162529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 267 to 267
2025-10-10T14:57:32.162578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.162591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 267
2025-10-10T14:57:32.162642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 268 to 268
2025-10-10T14:57:32.162755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.162768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 268
2025-10-10T14:57:32.162829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 269 to 269
2025-10-10T14:57:32.162910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.162922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 269
2025-10-10T14:57:32.162973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 270 to 270
2025-10-10T14:57:32.163047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.163069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 270
2025-10-10T14:57:32.163139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 271 to 271
2025-10-10T14:57:32.163220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.163242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 271
2025-10-10T14:57:32.163499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 272 to 272
2025-10-10T14:57:32.163556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.163568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 272
2025-10-10T14:57:32.163619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 273 to 273
2025-10-10T14:57:32.163675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.163688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 273
2025-10-10T14:57:32.163763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 274 to 274
2025-10-10T14:57:32.163812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.163826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 274
2025-10-10T14:57:32.163875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 275 to 275
2025-10-10T14:57:32.163941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.163953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 275
2025-10-10T14:57:32.164004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 276 to 276
2025-10-10T14:57:32.164081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.164094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 276
2025-10-10T14:57:32.164147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 277 to 277
2025-10-10T14:57:32.164200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.164213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 277
2025-10-10T14:57:32.164264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 278 to 278
2025-10-10T14:57:32.164326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.164341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 278
2025-10-10T14:57:32.164421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 279 to 279
2025-10-10T14:57:32.164491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.164502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 279
2025-10-10T14:57:32.164577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 280 to 280
2025-10-10T14:57:32.164632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.164646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 280
2025-10-10T14:57:32.164699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 281 to 281
2025-10-10T14:57:32.164751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.164766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 281
2025-10-10T14:57:32.164821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 282 to 282
2025-10-10T14:57:32.164889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.164901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 282
2025-10-10T14:57:32.164953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 283 to 283
2025-10-10T14:57:32.165002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.165015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 283
2025-10-10T14:57:32.165069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 284 to 284
2025-10-10T14:57:32.157233Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.157284Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.157318Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.157348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.157374Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.157428Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.165308Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.165373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.165399Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.165422Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.165465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.165502Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.165898Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.166371Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.166509Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.166678Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.166815Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.166983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.167001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 284
2025-10-10T14:57:32.167070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 285 to 285
2025-10-10T14:57:32.167132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.167144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 285
2025-10-10T14:57:32.167194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 286 to 286
2025-10-10T14:57:32.167270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.167283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 286
2025-10-10T14:57:32.167370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 287 to 287
2025-10-10T14:57:32.167458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.167480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 287
2025-10-10T14:57:32.167571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 288 to 288
2025-10-10T14:57:32.165235Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.165287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.165347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 89 size 4813 offset: -1
2025-10-10T14:57:32.165398Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.165447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.165528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.165541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.165566Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 90 size 4923 offset: -1
2025-10-10T14:57:32.165650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.165684Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.165708Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size 5033 offset: -1
2025-10-10T14:57:32.165728Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.165748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.165782Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.165807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.165826Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.165849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.166022Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.166039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.166086Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 27 size 53095 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.166150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.166162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.166193Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.166204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.166202Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 27 parts 0 suffix '63' size 53095
2025-10-10T14:57:32.166219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.166262Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 52920 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.166288Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166320Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-10T14:57:32.166339Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166356Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-10T14:57:32.166367Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166384Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-10T14:57:32.166399Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166442Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-10T14:57:32.166459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166480Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-10T14:57:32.166494Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166510Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-10T14:57:32.166519Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166534Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-10T14:57:32.166545Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166570Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-10T14:57:32.166588Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166616Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-10T14:57:32.166630Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-10T14:57:32.166657Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166671Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-10T14:57:32.166681Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166695Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-10T14:57:32.166705Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166723Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-10T14:57:32.166733Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166765Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-10T14:57:32.167670Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.166780Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166807Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-10T14:57:32.166817Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166834Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-10T14:57:32.166845Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166862Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-10T14:57:32.166872Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166885Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-10T14:57:32.166893Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166907Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-10T14:57:32.166917Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166932Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-10T14:57:32.166945Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.166961Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-10T14:57:32.166970Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.167007Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-10T14:57:32.167018Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.167039Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-10T14:57:32.167054Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.167070Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-10T14:57:32.167080Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.167097Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-10T14:57:32.167923Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 31 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-10T14:57:32.167117Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.167141Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-10T14:57:32.173397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.167945Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 31
2025-10-10T14:57:32.167152Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.167174Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-10T14:57:32.167973Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.173437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 288
2025-10-10T14:57:32.167382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.168133Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.167448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.167458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:57:32.167550Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-10T14:57:32.168311Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 31, WTime# 1760108252097, sizeLag# 53095
2025-10-10T14:57:32.168326Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.173620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 289 to 289
2025-10-10T14:57:32.168372Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 6f112dd2-b318feb0-9275dbf5-661c52c6, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 32, size# 63714, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.168428Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 32 maxSize 63714 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 31 ClientCommitOffset 0 committedOffset 0 Guid 6f112dd2-b318feb0-9275dbf5-661c52c6
2025-10-10T14:57:32.168529Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.173718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.173739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 289
2025-10-10T14:57:32.173833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 290 to 290
2025-10-10T14:57:32.173910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.173930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 290
2025-10-10T14:57:32.174013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 291 to 291
2025-10-10T14:57:32.174102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.174122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 291
2025-10-10T14:57:32.174202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 292 to 292
2025-10-10T14:57:32.173948Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.181347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.181410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 292
2025-10-10T14:57:32.181600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 293 to 293
2025-10-10T14:57:32.181699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.181721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 293
2025-10-10T14:57:32.181836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 294 to 294
2025-10-10T14:57:32.181927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.181954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 294
2025-10-10T14:57:32.181575Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.182030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 295 to 295
2025-10-10T14:57:32.182140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.182162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 295
2025-10-10T14:57:32.182234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 296 to 296
2025-10-10T14:57:32.182370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.182393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 296
2025-10-10T14:57:32.182514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 297 to 297
2025-10-10T14:57:32.182279Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.182593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.182616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 297
2025-10-10T14:57:32.182699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 298 to 298
2025-10-10T14:57:32.182788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.182809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 298
2025-10-10T14:57:32.182871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 299 to 299
2025-10-10T14:57:32.182951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.182971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 299
2025-10-10T14:57:32.182766Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.183026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write 1 messages with Id from 300 to 300
2025-10-10T14:57:32.183102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: try to update token
2025-10-10T14:57:32.183121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Send 1 message(s) (0 left), first sequence number is 300
2025-10-10T14:57:32.183375Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.183901Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.184289Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.184682Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.185272Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.185715Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.186263Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.193331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 5 }
2025-10-10T14:57:32.193400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 1
2025-10-10T14:57:32.194078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 32 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.194113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 2
2025-10-10T14:57:32.213541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 32 queued_in_partition_duration_ms: 13 }
2025-10-10T14:57:32.213591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 3
2025-10-10T14:57:32.213751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 32 queued_in_partition_duration_ms: 13 }
2025-10-10T14:57:32.213791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 4
2025-10-10T14:57:32.304594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 3567 count 1 nextOffset 32 batches 1
2025-10-10T14:57:32.304677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-10T14:57:32.304715Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 7212 count 2 nextOffset 33 batches 1
2025-10-10T14:57:32.304735Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-10T14:57:32.304755Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 10967 count 3 nextOffset 34 batches 1
2025-10-10T14:57:32.304773Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-10T14:57:32.304791Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 14832 count 4 nextOffset 35 batches 1
2025-10-10T14:57:32.304808Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-10T14:57:32.304827Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 18807 count 5 nextOffset 36 batches 1
2025-10-10T14:57:32.304846Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-10T14:57:32.304863Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 22892 count 6 nextOffset 37 batches 1
2025-10-10T14:57:32.304880Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-10T14:57:32.304896Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 27087 count 7 nextOffset 38 batches 1
2025-10-10T14:57:32.304913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-10T14:57:32.304932Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 31392 count 8 nextOffset 39 batches 1
2025-10-10T14:57:32.304949Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-10T14:57:32.304969Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 35807 count 9 nextOffset 40 batches 1
2025-10-10T14:57:32.304987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T14:57:32.305003Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 40332 count 10 nextOffset 41 batches 1
2025-10-10T14:57:32.305021Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T14:57:32.305038Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 44967 count 11 nextOffset 42 batches 1
2025-10-10T14:57:32.305057Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T14:57:32.305077Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 49712 count 12 nextOffset 43 batches 1
2025-10-10T14:57:32.305096Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T14:57:32.305114Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 54567 count 13 nextOffset 44 batches 1
2025-10-10T14:57:32.305151Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T14:57:32.305171Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 59532 count 14 nextOffset 45 batches 1
2025-10-10T14:57:32.305189Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T14:57:32.305206Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 64607 count 15 nextOffset 46 batches 1
2025-10-10T14:57:32.305220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.305872Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 31,15 HeadOffset 31 endOffset 31 curOffset 46 d0000000000_00000000000000000031_00000_0000000015_00000? size 64190 WTime 1760108252305
2025-10-10T14:57:32.306015Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.306134Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.306155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.306194Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.306204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.306229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.306238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.306303Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 5
2025-10-10T14:57:32.306354Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 6
2025-10-10T14:57:32.306378Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 7
2025-10-10T14:57:32.306399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 8
2025-10-10T14:57:32.306422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 9
2025-10-10T14:57:32.306442Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 10
2025-10-10T14:57:32.306464Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-10T14:57:32.306486Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 12
2025-10-10T14:57:32.306508Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 13
2025-10-10T14:57:32.306528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 14
2025-10-10T14:57:32.306546Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 15
2025-10-10T14:57:32.306566Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-10T14:57:32.306590Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 17
2025-10-10T14:57:32.306612Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 18
2025-10-10T14:57:32.306634Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 19
2025-10-10T14:57:32.306654Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 20
2025-10-10T14:57:32.306675Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-10T14:57:32.309256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309374Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309402Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309428Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309523Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309552Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309599Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309627Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309657Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309679Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309733Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309793Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.309829Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.313331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 34 }
2025-10-10T14:57:32.313378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 5
2025-10-10T14:57:32.313596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 34 }
2025-10-10T14:57:32.313622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 6
2025-10-10T14:57:32.313752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.313790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 7
2025-10-10T14:57:32.313927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.313951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 8
2025-10-10T14:57:32.314060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.314085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 9
2025-10-10T14:57:32.314211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.314235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 10
2025-10-10T14:57:32.314367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.314389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 11
2025-10-10T14:57:32.314491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:32.314511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 12
2025-10-10T14:57:32.314686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:32.314707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 13
2025-10-10T14:57:32.314840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:32.314859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 14
2025-10-10T14:57:32.314959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:32.314981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 15
2025-10-10T14:57:32.315125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:32.315153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 16
2025-10-10T14:57:32.315286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.315307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 17
2025-10-10T14:57:32.315404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.315423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 18
2025-10-10T14:57:32.315526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.315547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 19
2025-10-10T14:57:32.315662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.315682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 20
2025-10-10T14:57:32.313300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 22
2025-10-10T14:57:32.313347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 23
2025-10-10T14:57:32.313374Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 24
2025-10-10T14:57:32.313403Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 25
2025-10-10T14:57:32.313431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-10T14:57:32.313458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 27
2025-10-10T14:57:32.313484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 28
2025-10-10T14:57:32.313512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 29
2025-10-10T14:57:32.313541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 30
2025-10-10T14:57:32.313566Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-10T14:57:32.313676Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.313698Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.313771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.313796Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.313915Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 31 partNo 0 count 15 size 64190
2025-10-10T14:57:32.314001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-10T14:57:32.314024Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 48
2025-10-10T14:57:32.314178Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 49
2025-10-10T14:57:32.314199Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 50
2025-10-10T14:57:32.314217Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 51
2025-10-10T14:57:32.314324Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 32 size 63714 endOffset 31 max time lag 0ms effective offset 4
2025-10-10T14:57:32.314495Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 53095 count 27 last offset 4, current partition end offset: 31
2025-10-10T14:57:32.314515Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-10T14:57:32.314570Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 27 parts_count 0 source 1 size 53095 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.314598Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-10T14:57:32.314647Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.315059Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 27 count 27 size 53073 from pos 0 cbcount 27
2025-10-10T14:57:32.315391Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-10T14:57:32.316705Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 27 parts 0 suffix '63'
2025-10-10T14:57:32.317204Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317296Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317324Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317382Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317406Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317435Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317463Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.318746Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.318775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.318825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 97 size 5143 offset: -1
2025-10-10T14:57:32.318874Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.318884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.318904Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 98 size 5253 offset: -1
2025-10-10T14:57:32.318945Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.318956Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.318974Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 99 size 5363 offset: -1
2025-10-10T14:57:32.319014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.319025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.319048Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 100 size 5473 offset: -1
2025-10-10T14:57:32.319089Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.319099Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.319121Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 101 size 5583 offset: -1
2025-10-10T14:57:32.319144Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.319183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.319196Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.319211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.319222Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.319250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.319262Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.319277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.319290Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.319303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.320193Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.320215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.320251Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.320261Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.320286Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.320296Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.320324Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.320334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.320358Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.320369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.320450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 52
2025-10-10T14:57:32.320480Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103  requestId: <none> cookie: 53
2025-10-10T14:57:32.320496Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 54
2025-10-10T14:57:32.320514Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105  requestId: <none> cookie: 55
2025-10-10T14:57:32.320532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 56
2025-10-10T14:57:32.317523Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317553Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317579Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317603Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317729Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.317818Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.318681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.318739Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.318773Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.318888Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.318922Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.319014Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 31 Result { Offset: 4 Data: "... 523 bytes ..." SourceId: "\000src_id" SeqNo: 5 WriteTimestampMS: 1760108252129 CreateTimestampMS: 1760108252059 UncompressedSize: 451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 633 bytes ..." SourceId: "\000src_id" SeqNo: 6 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252059 UncompressedSize: 561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 743 bytes ..." SourceId: "\000src_id" SeqNo: 7 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252059 UncompressedSize: 671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 853 bytes ..." SourceId: "\000src_id" SeqNo: 8 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 963 bytes ..." SourceId: "\000src_id" SeqNo: 9 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 1073 bytes ..." SourceId: "\000src_id" SeqNo: 10 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 1001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 1183 bytes ..." SourceId: "\000src_id" SeqNo: 11 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 1111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 1293 bytes ..." SourceId: "\000src_id" SeqNo: 12 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 1221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 1403 bytes ..." SourceId: "\000src_id" SeqNo: 13 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 1331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 1513 bytes ..." SourceId: "\000src_id" SeqNo: 14 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 1441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 1623 bytes ..." SourceId: "\000src_id" SeqNo: 15 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 1551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 1733 bytes ..." SourceId: "\000src_id" SeqNo: 16 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 1661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 1843 bytes ..." SourceId: "\000src_id" SeqNo: 17 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252060 UncompressedSize: 1771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 1953 bytes ..." SourceId: "\000src_id" SeqNo: 18 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 1881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 2063 bytes ..." SourceId: "\000src_id" SeqNo: 19 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 1991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 2173 bytes ..." SourceId: "\000src_id" SeqNo: 20 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 2101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 20 Data: "... 2283 bytes ..." SourceId: "\000src_id" SeqNo: 21 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 2211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 2393 bytes ..." SourceId: "\000src_id" SeqNo: 22 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 2321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 2503 bytes ..." SourceId: "\000src_id" SeqNo: 23 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 2431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 2613 bytes ..." SourceId: "\000src_id" SeqNo: 24 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 2541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 2723 bytes ..." SourceId: "\000src_id" SeqNo: 25 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 2651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 25 Data: "... 2833 bytes ..." SourceId: "\000src_id" SeqNo: 26 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 2761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 2943 bytes ..." SourceId: "\000src_id" SeqNo: 27 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 2871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 3053 bytes ..." SourceId: "\000src_id" SeqNo: 28 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252061 UncompressedSize: 2981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 28 Data: "... 3163 bytes ..." SourceId: "\000src_id" SeqNo: 29 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252062 UncompressedSize: 3091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 29 Data: "... 3273 bytes ..." SourceId: "\000src_id" SeqNo: 30 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252062 UncompressedSize: 3201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 30 Data: "... 3383 bytes ..." SourceId: "\000src_id" SeqNo: 31 WriteTimestampMS: 1760108252131 CreateTimestampMS: 1760108252062 UncompressedSize: 3311 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709550846 RealReadOffset: 30 WaitQuotaTimeMs: 0 EndOffset: 31 StartOffset: 0 } Cookie: 4 }
2025-10-10T14:57:32.319657Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 31
2025-10-10T14:57:32.319706Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 31 ReadOffset 31 ReadGuid 6f112dd2-b318feb0-9275dbf5-661c52c6 has messages 1
2025-10-10T14:57:32.319904Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.320152Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 6f112dd2-b318feb0-9275dbf5-661c52c6, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 51954
2025-10-10T14:57:32.320184Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 6f112dd2-b318feb0-9275dbf5-661c52c6
2025-10-10T14:57:32.320337Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.322246Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 51954, now ReadSizeBudget = 0, ReadSizeServerDelta = 472334
2025-10-10T14:57:32.322396Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 472334
2025-10-10T14:57:32.321649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.321706Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.321780Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.321806Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.321833Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.322118Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.322257Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.322296Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.322333Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.322750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.322366Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.322788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 21
2025-10-10T14:57:32.322960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.322983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 22
2025-10-10T14:57:32.323113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.323141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 23
2025-10-10T14:57:32.322938Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.323273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.323293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 24
2025-10-10T14:57:32.323390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.323410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 25
2025-10-10T14:57:32.323521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.323548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 26
2025-10-10T14:57:32.323452Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.323666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.323687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 27
2025-10-10T14:57:32.323786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.323805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 28
2025-10-10T14:57:32.323909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.323930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 29
2025-10-10T14:57:32.324033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.324053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 30
2025-10-10T14:57:32.324144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.324166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 31
2025-10-10T14:57:32.325040Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-30)
2025-10-10T14:57:32.325117Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 51954 to budget
2025-10-10T14:57:32.325167Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 51954, ReadSizeServerDelta = 472334
2025-10-10T14:57:32.325388Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.325468Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-10-10T14:57:32.325516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (5-5)
2025-10-10T14:57:32.325586Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (6-6)
2025-10-10T14:57:32.325701Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (7-7)
2025-10-10T14:57:32.325741Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (8-8)
2025-10-10T14:57:32.325793Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (9-9)
2025-10-10T14:57:32.325830Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (10-10)
2025-10-10T14:57:32.325867Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (11-11)
2025-10-10T14:57:32.325910Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (12-12)
2025-10-10T14:57:32.325942Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (13-13)
2025-10-10T14:57:32.325973Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (14-14)
2025-10-10T14:57:32.326011Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (15-15)
2025-10-10T14:57:32.326070Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (16-16)
2025-10-10T14:57:32.326102Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (17-17)
2025-10-10T14:57:32.326134Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (18-18)
2025-10-10T14:57:32.326172Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 14} (19-19)
2025-10-10T14:57:32.326259Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 15} (20-20)
2025-10-10T14:57:32.326294Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 16} (21-21)
2025-10-10T14:57:32.326320Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 17} (22-22)
2025-10-10T14:57:32.326360Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 18} (23-23)
2025-10-10T14:57:32.326395Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 19} (24-24)
2025-10-10T14:57:32.326418Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 20} (25-25)
2025-10-10T14:57:32.326444Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 21} (26-26)
2025-10-10T14:57:32.326474Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 22} (27-27)
2025-10-10T14:57:32.326500Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 23} (28-28)
2025-10-10T14:57:32.326530Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 24} (29-29)
2025-10-10T14:57:32.326556Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 25} (30-30)
2025-10-10T14:57:32.325330Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325362Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.325411Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 107 size 5693 offset: -1
2025-10-10T14:57:32.325461Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.325494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 108 size 5803 offset: -1
2025-10-10T14:57:32.325534Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.325575Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 109 size 5913 offset: -1
2025-10-10T14:57:32.325620Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325632Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.325652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 110 size 6023 offset: -1
2025-10-10T14:57:32.325692Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.325723Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 111 size 6133 offset: -1
2025-10-10T14:57:32.325751Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.325809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.325848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.325893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325903Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.325932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.325943Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.326367Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.326411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.326426Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.326441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.326451Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.326466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.327405Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.326478Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.326493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.327482Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.326503Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.326518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.326627Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 112  requestId: <none> cookie: 57
2025-10-10T14:57:32.326659Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 113  requestId: <none> cookie: 58
2025-10-10T14:57:32.326676Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 114  requestId: <none> cookie: 59
2025-10-10T14:57:32.326696Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 115  requestId: <none> cookie: 60
2025-10-10T14:57:32.326713Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 116  requestId: <none> cookie: 61
2025-10-10T14:57:32.327514Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.327543Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.327562Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.327768Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.327889Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.327916Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.327939Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.327963Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.329046Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.329476Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.329617Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 51954 } }
2025-10-10T14:57:32.329734Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 3cf9f6b9-cc096793-51ecf224-18996847
2025-10-10T14:57:32.329710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.329741Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.329810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 117 size 6243 offset: -1
2025-10-10T14:57:32.329873Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.329885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.329909Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 118 size 6353 offset: -1
2025-10-10T14:57:32.329965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.329978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.330002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 119 size 6463 offset: -1
2025-10-10T14:57:32.330048Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.330063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.330086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 120 size 6573 offset: -1
2025-10-10T14:57:32.330128Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.330140Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.330159Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 121 size 6683 offset: -1
2025-10-10T14:57:32.330189Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.330198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.330227Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.330240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> event from dataHandler: 2025-10-10T14:57:32.330298Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.330311Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.330339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.330351Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.330380Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.330392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.330573Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.330617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.330630Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.330648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.330658Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.330673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.330684Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.330700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.330710Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.330722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.330830Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 31 count 15 size 64190 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.331395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 122  requestId: <none> cookie: 62
2025-10-10T14:57:32.331423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 123  requestId: <none> cookie: 63
2025-10-10T14:57:32.331439Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 124  requestId: <none> cookie: 64
2025-10-10T14:57:32.331455Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 125  requestId: <none> cookie: 65
2025-10-10T14:57:32.331466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 126  requestId: <none> cookie: 66
2025-10-10T14:57:32.331480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.331513Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 64050 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.331534Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331554Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-10T14:57:32.331565Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331576Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-10T14:57:32.331583Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-10T14:57:32.331601Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331611Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-10T14:57:32.331617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331636Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-10T14:57:32.331643Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331653Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-10T14:57:32.331660Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331671Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-10T14:57:32.331679Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..451 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-10T14:57:32.059000Z WriteTime: 2025-10-10T14:57:32.129000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..561 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-10T14:57:32.059000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..671 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-10T14:57:32.059000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..781 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..891 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1001 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1111 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1221 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1331 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1441 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1551 bytes.. Information: { Offset: 14 ProducerId: "src_id" SeqNo: 15 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1661 bytes.. Information: { Offset: 15 ProducerId: "src_id" SeqNo: 16 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1771 bytes.. Information: { Offset: 16 ProducerId: "src_id" SeqNo: 17 CreateTime: 2025-10-10T14:57:32.060000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1881 bytes.. Information: { Offset: 17 ProducerId: "src_id" SeqNo: 18 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1991 bytes.. Information: { Offset: 18 ProducerId: "src_id" SeqNo: 19 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2101 bytes.. Information: { Offset: 19 ProducerId: "src_id" SeqNo: 20 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2211 bytes.. Information: { Offset: 20 ProducerId: "src_id" SeqNo: 21 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2321 bytes.. Information: { Offset: 21 ProducerId: "src_id" SeqNo: 22 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2431 bytes.. Information: { Offset: 22 ProducerId: "src_id" SeqNo: 23 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2541 bytes.. Information: { Offset: 23 ProducerId: "src_id" SeqNo: 24 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2651 bytes.. Information: { Offset: 24 ProducerId: "src_id" SeqNo: 25 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2761 bytes.. Information: { Offset: 25 ProducerId: "src_id" SeqNo: 26 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2871 bytes.. Information: { Offset: 26 ProducerId: "src_id" SeqNo: 27 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2981 bytes.. Information: { Offset: 27 ProducerId: "src_id" SeqNo: 28 CreateTime: 2025-10-10T14:57:32.061000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3091 bytes.. Information: { Offset: 28 ProducerId: "src_id" SeqNo: 29 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3201 bytes.. Information: { Offset: 29 ProducerId: "src_id" SeqNo: 30 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3311 bytes.. Information: { Offset: 30 ProducerId: "src_id" SeqNo: 31 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.131000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-10-10T14:57:32.331688Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-10T14:57:32.331694Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331708Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-10T14:57:32.331715Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331726Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-10T14:57:32.331732Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331759Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-10T14:57:32.331766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331777Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-10T14:57:32.331788Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.334588Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 27, size 50787 bytes
2025-10-10T14:57:32.331802Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-10T14:57:32.331812Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331832Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-10T14:57:32.331842Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.331858Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-10T14:57:32.334673Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.331999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.332039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.332064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:57:32.332130Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T14:57:32.332832Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 5217 count 1 nextOffset 47 batches 1
2025-10-10T14:57:32.332872Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T14:57:32.332892Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 10512 count 2 nextOffset 48 batches 1
2025-10-10T14:57:32.332905Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T14:57:32.332920Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 15917 count 3 nextOffset 49 batches 1
2025-10-10T14:57:32.332940Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T14:57:32.332954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 21432 count 4 nextOffset 50 batches 1
2025-10-10T14:57:32.332967Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-10T14:57:32.332981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 27057 count 5 nextOffset 51 batches 1
2025-10-10T14:57:32.332998Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-10T14:57:32.333024Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 32792 count 6 nextOffset 52 batches 1
2025-10-10T14:57:32.333049Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-10T14:57:32.333068Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 38637 count 7 nextOffset 53 batches 1
2025-10-10T14:57:32.333085Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-10T14:57:32.333630Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 15 parts 0 suffix '63' size 64190
2025-10-10T14:57:32.334123Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.334189Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.334219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.334249Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.334292Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.334579Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.334744Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.334777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.334872Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.334928Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.335100Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 31 EndOffset 31 newEndOffset 46 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-10T14:57:32.335117Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 31 endOffset 46
2025-10-10T14:57:32.335152Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 31, endOffset# 46, WTime# 1760108252131, sizeLag# 64190
2025-10-10T14:57:32.335165Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.335207Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 8aa343-cb9d6f59-b3758c70-85680741, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 77028, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.335257Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 77028 maxTimeLagMs 0 readTimestampMs 0 readOffset 31 EndOffset 46 ClientCommitOffset 0 committedOffset 0 Guid 8aa343-cb9d6f59-b3758c70-85680741
2025-10-10T14:57:32.337454Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.337890Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.336333Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 44592 count 8 nextOffset 54 batches 1
2025-10-10T14:57:32.336419Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-10T14:57:32.336463Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 50657 count 9 nextOffset 55 batches 1
2025-10-10T14:57:32.336485Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-10T14:57:32.336507Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 56832 count 10 nextOffset 56 batches 1
2025-10-10T14:57:32.336529Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-10T14:57:32.336546Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 63117 count 11 nextOffset 57 batches 1
2025-10-10T14:57:32.336565Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-10T14:57:32.336582Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 69512 count 12 nextOffset 58 batches 1
2025-10-10T14:57:32.336600Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-10T14:57:32.336620Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 76017 count 13 nextOffset 59 batches 1
2025-10-10T14:57:32.336641Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-10T14:57:32.336661Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 82632 count 14 nextOffset 60 batches 1
2025-10-10T14:57:32.336681Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-10T14:57:32.336697Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 89357 count 15 nextOffset 61 batches 1
2025-10-10T14:57:32.336709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.337504Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 46,15 HeadOffset 46 endOffset 46 curOffset 61 d0000000000_00000000000000000046_00000_0000000015_00000? size 88939 WTime 1760108252337
2025-10-10T14:57:32.337666Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.337723Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 32
2025-10-10T14:57:32.337789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 33
2025-10-10T14:57:32.337810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 34
2025-10-10T14:57:32.337829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 35
2025-10-10T14:57:32.337850Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-10T14:57:32.337872Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 37
2025-10-10T14:57:32.337893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 38
2025-10-10T14:57:32.337917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 39
2025-10-10T14:57:32.337937Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 40
2025-10-10T14:57:32.337958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-10T14:57:32.337979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 42
2025-10-10T14:57:32.337999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 43
2025-10-10T14:57:32.338063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 44
2025-10-10T14:57:32.338088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 45
2025-10-10T14:57:32.338110Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 46
2025-10-10T14:57:32.338219Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338299Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 127 size 6793 offset: -1
2025-10-10T14:57:32.338357Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338388Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 128 size 6903 offset: -1
2025-10-10T14:57:32.338450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338462Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338489Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 129 size 7013 offset: -1
2025-10-10T14:57:32.338574Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338594Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338619Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 130 size 7123 offset: -1
2025-10-10T14:57:32.338666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338677Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 131 size 7233 offset: -1
2025-10-10T14:57:32.338739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338785Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338858Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338882Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338892Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.338956Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.338997Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.339098Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 46 partNo 0 count 15 size 88939
2025-10-10T14:57:32.339135Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.339174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.339185Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.339202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.339211Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.339226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.339234Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.339246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.339257Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.339269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.339465Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 132  requestId: <none> cookie: 67
2025-10-10T14:57:32.339489Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 133  requestId: <none> cookie: 68
2025-10-10T14:57:32.339517Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 134  requestId: <none> cookie: 69
2025-10-10T14:57:32.339533Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 135  requestId: <none> cookie: 70
2025-10-10T14:57:32.339549Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 136  requestId: <none> cookie: 71
2025-10-10T14:57:32.339635Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 31 count 18 size 77028 endOffset 46 max time lag 0ms effective offset 31
2025-10-10T14:57:32.339813Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 64190 count 15 last offset 31, current partition end offset: 46
2025-10-10T14:57:32.339828Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-10T14:57:32.339905Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 31 partno 0 count 15 parts_count 0 source 1 size 64190 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.339927Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-10T14:57:32.339977Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.340838Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 15 parts 0 suffix '63'
2025-10-10T14:57:32.342339Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342392Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342413Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342438Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342494Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342516Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342537Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342566Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342589Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342608Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342648Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342667Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342689Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342731Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342749Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342778Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.342795Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.344208Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 31 totakecount 15 count 15 size 64168 from pos 0 cbcount 15
2025-10-10T14:57:32.345625Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.346449Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.346483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.346530Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 137 size 7343 offset: -1
2025-10-10T14:57:32.346586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.346596Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.346615Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 138 size 7453 offset: -1
2025-10-10T14:57:32.346676Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.346685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.346703Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 139 size 7563 offset: -1
2025-10-10T14:57:32.346740Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.346750Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.346794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 140 size 7673 offset: -1
2025-10-10T14:57:32.346846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.346859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.346880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 141 size 7783 offset: -1
2025-10-10T14:57:32.346994Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 31
2025-10-10T14:57:32.347058Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.347093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.347105Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.347120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.347129Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.347142Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.347152Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.347166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.347177Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.347189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.345797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.345846Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.345920Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.345956Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.351534Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.351573Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.351650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.351664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.351705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.351715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.351769Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.351790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.351865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.351886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.352000Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 142  requestId: <none> cookie: 72
2025-10-10T14:57:32.352055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 143  requestId: <none> cookie: 73
2025-10-10T14:57:32.352086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 144  requestId: <none> cookie: 74
2025-10-10T14:57:32.352108Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 145  requestId: <none> cookie: 75
2025-10-10T14:57:32.353515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 160 }
2025-10-10T14:57:32.353569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 32
2025-10-10T14:57:32.352129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 146  requestId: <none> cookie: 76
2025-10-10T14:57:32.351408Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.352699Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.352739Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.354162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 160 }
2025-10-10T14:57:32.354203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 33
2025-10-10T14:57:32.352736Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 46 Result { Offset: 31 Data: "... 3493 bytes ..." SourceId: "\000src_id" SeqNo: 32 WriteTimestampMS: 1760108252162 CreateTimestampMS: 1760108252062 UncompressedSize: 3421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 32 Data: "... 3603 bytes ..." SourceId: "\000src_id" SeqNo: 33 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252062 UncompressedSize: 3531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 33 Data: "... 3713 bytes ..." SourceId: "\000src_id" SeqNo: 34 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252062 UncompressedSize: 3641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 34 Data: "... 3823 bytes ..." SourceId: "\000src_id" SeqNo: 35 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252062 UncompressedSize: 3751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 35 Data: "... 3933 bytes ..." SourceId: "\000src_id" SeqNo: 36 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252062 UncompressedSize: 3861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 36 Data: "... 4043 bytes ..." SourceId: "\000src_id" SeqNo: 37 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252062 UncompressedSize: 3971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 37 Data: "... 4153 bytes ..." SourceId: "\000src_id" SeqNo: 38 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252062 UncompressedSize: 4081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 38 Data: "... 4263 bytes ..." SourceId: "\000src_id" SeqNo: 39 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252063 UncompressedSize: 4191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 39 Data: "... 4373 bytes ..." SourceId: "\000src_id" SeqNo: 40 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252063 UncompressedSize: 4301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 40 Data: "... 4483 bytes ..." SourceId: "\000src_id" SeqNo: 41 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252063 UncompressedSize: 4411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 41 Data: "... 4593 bytes ..." SourceId: "\000src_id" SeqNo: 42 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252063 UncompressedSize: 4521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 42 Data: "... 4703 bytes ..." SourceId: "\000src_id" SeqNo: 43 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252063 UncompressedSize: 4631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 43 Data: "... 4813 bytes ..." SourceId: "\000src_id" SeqNo: 44 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252063 UncompressedSize: 4741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 44 Data: "... 4923 bytes ..." SourceId: "\000src_id" SeqNo: 45 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252063 UncompressedSize: 4851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 45 Data: "... 5033 bytes ..." SourceId: "\000src_id" SeqNo: 46 WriteTimestampMS: 1760108252302 CreateTimestampMS: 1760108252063 UncompressedSize: 4961 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551231 RealReadOffset: 45 WaitQuotaTimeMs: 0 EndOffset: 46 StartOffset: 0 } Cookie: 31 }
2025-10-10T14:57:32.352762Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.352786Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.352846Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.353323Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 46
2025-10-10T14:57:32.353361Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 46 ReadOffset 46 ReadGuid 8aa343-cb9d6f59-b3758c70-85680741 has messages 1
2025-10-10T14:57:32.353536Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 8aa343-cb9d6f59-b3758c70-85680741, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 63625
2025-10-10T14:57:32.353564Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 8aa343-cb9d6f59-b3758c70-85680741
2025-10-10T14:57:32.353898Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.354420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 160 }
2025-10-10T14:57:32.354448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 34
2025-10-10T14:57:32.354571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 160 }
2025-10-10T14:57:32.354602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 35
2025-10-10T14:57:32.354774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 160 }
2025-10-10T14:57:32.354797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 36
2025-10-10T14:57:32.354958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 152 }
2025-10-10T14:57:32.354982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 37
2025-10-10T14:57:32.355103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 152 }
2025-10-10T14:57:32.355124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 38
2025-10-10T14:57:32.355271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 152 }
2025-10-10T14:57:32.355303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 39
2025-10-10T14:57:32.355434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 152 }
2025-10-10T14:57:32.355454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 40
2025-10-10T14:57:32.354954Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.355564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 152 }
2025-10-10T14:57:32.355015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.355585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 41
2025-10-10T14:57:32.355048Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.355081Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.355120Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.355154Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.355759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 140 }
2025-10-10T14:57:32.355784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 42
2025-10-10T14:57:32.355944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 140 }
2025-10-10T14:57:32.355980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 43
2025-10-10T14:57:32.356100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 140 }
2025-10-10T14:57:32.356140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 44
2025-10-10T14:57:32.356266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 140 }
2025-10-10T14:57:32.356288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 45
2025-10-10T14:57:32.356390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 140 }
2025-10-10T14:57:32.356413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 46
2025-10-10T14:57:32.354511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.354539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.354589Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 147 size 7893 offset: -1
2025-10-10T14:57:32.354681Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.354697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.354723Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 148 size 8003 offset: -1
2025-10-10T14:57:32.354764Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.354805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.354872Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.354887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.354921Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 149 size 8113 offset: -1
2025-10-10T14:57:32.354981Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.354993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.355017Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 150 size 8223 offset: -1
2025-10-10T14:57:32.355032Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.355050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.355079Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.355091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.355101Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.355114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.356133Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.356158Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.356191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 151 size 8333 offset: -1
2025-10-10T14:57:32.356235Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.356244Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.356278Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.356287Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.356311Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.356321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.356344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.356372Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.356405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.356418Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.356435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.356462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.356539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 152  requestId: <none> cookie: 77
2025-10-10T14:57:32.356573Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 153  requestId: <none> cookie: 78
2025-10-10T14:57:32.356588Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 154  requestId: <none> cookie: 79
2025-10-10T14:57:32.356602Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 155  requestId: <none> cookie: 80
2025-10-10T14:57:32.356616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 156  requestId: <none> cookie: 81
2025-10-10T14:57:32.357060Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.357134Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.357170Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.357193Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.357215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.357642Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.357687Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.358228Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 63625, now ReadSizeBudget = 0, ReadSizeServerDelta = 460663
2025-10-10T14:57:32.358404Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 460663
2025-10-10T14:57:32.358562Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (31-45)
2025-10-10T14:57:32.358598Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 63625 to budget
2025-10-10T14:57:32.358625Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 63625, ReadSizeServerDelta = 460663
2025-10-10T14:57:32.358834Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.357717Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.357752Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.357796Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.358911Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (31-31)
2025-10-10T14:57:32.359005Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (32-32)
2025-10-10T14:57:32.359088Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (33-33)
2025-10-10T14:57:32.359153Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (34-34)
2025-10-10T14:57:32.359325Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (35-35)
2025-10-10T14:57:32.359405Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (36-36)
2025-10-10T14:57:32.359438Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (37-37)
2025-10-10T14:57:32.359049Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 46 EndOffset 46 newEndOffset 61 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-10T14:57:32.359084Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 46 endOffset 61
2025-10-10T14:57:32.359493Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (38-38)
2025-10-10T14:57:32.359154Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 46, endOffset# 61, WTime# 1760108252302, sizeLag# 88939
2025-10-10T14:57:32.359167Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.359218Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# c409d64f-cb17f5c4-ae0d420f-ff82898d, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 106726, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.359298Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 106726 maxTimeLagMs 0 readTimestampMs 0 readOffset 46 EndOffset 61 ClientCommitOffset 0 committedOffset 0 Guid c409d64f-cb17f5c4-ae0d420f-ff82898d
2025-10-10T14:57:32.359647Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (39-39)
2025-10-10T14:57:32.359700Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (40-40)
2025-10-10T14:57:32.359730Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (41-41)
2025-10-10T14:57:32.359766Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (42-42)
2025-10-10T14:57:32.359821Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (43-43)
2025-10-10T14:57:32.359858Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (44-44)
2025-10-10T14:57:32.359928Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (45-45)
2025-10-10T14:57:32.357748Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 46 count 15 size 88939 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.357812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.357876Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 88800 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.357932Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.357970Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-10T14:57:32.357989Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-10T14:57:32.358028Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358044Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-10T14:57:32.358053Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358079Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-10T14:57:32.358095Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358110Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-10T14:57:32.358122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358149Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-10T14:57:32.358164Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358208Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-10T14:57:32.358221Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358257Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-10T14:57:32.358272Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358286Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-10T14:57:32.358296Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358312Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-10T14:57:32.358322Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358358Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-10T14:57:32.358376Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358398Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-10T14:57:32.358408Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358412Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 46 partno 0 count 15 parts 0 suffix '63' size 88939
2025-10-10T14:57:32.358422Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-10T14:57:32.358432Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358464Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-10T14:57:32.358482Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.358498Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-10T14:57:32.358667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.358733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.358743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:57:32.358820Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
>>> event from dataHandler: 2025-10-10T14:57:32.361415Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.361771Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 63625 } }
2025-10-10T14:57:32.361935Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# c592d02f-1165b7e2-749f2ba3-cb923acd
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..3421 bytes.. Information: { Offset: 31 ProducerId: "src_id" SeqNo: 32 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.162000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3531 bytes.. Information: { Offset: 32 ProducerId: "src_id" SeqNo: 33 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3641 bytes.. Information: { Offset: 33 ProducerId: "src_id" SeqNo: 34 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3751 bytes.. Information: { Offset: 34 ProducerId: "src_id" SeqNo: 35 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3861 bytes.. Information: { Offset: 35 ProducerId: "src_id" SeqNo: 36 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3971 bytes.. Information: { Offset: 36 ProducerId: "src_id" SeqNo: 37 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4081 bytes.. Information: { Offset: 37 ProducerId: "src_id" SeqNo: 38 CreateTime: 2025-10-10T14:57:32.062000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4191 bytes.. Information: { Offset: 38 ProducerId: "src_id" SeqNo: 39 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4301 bytes.. Information: { Offset: 39 ProducerId: "src_id" SeqNo: 40 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4411 bytes.. Information: { Offset: 40 ProducerId: "src_id" SeqNo: 41 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4521 bytes.. Information: { Offset: 41 ProducerId: "src_id" SeqNo: 42 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4631 bytes.. Information: { Offset: 42 ProducerId: "src_id" SeqNo: 43 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4741 bytes.. Information: { Offset: 43 ProducerId: "src_id" SeqNo: 44 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4851 bytes.. Information: { Offset: 44 ProducerId: "src_id" SeqNo: 45 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4961 bytes.. Information: { Offset: 45 ProducerId: "src_id" SeqNo: 46 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.302000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.362612Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 15, size 62865 bytes
2025-10-10T14:57:32.362672Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.362398Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.362708Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.364604Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.364810Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.411891Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 6867 count 1 nextOffset 62 batches 1
2025-10-10T14:57:32.411974Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-10T14:57:32.412008Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 13812 count 2 nextOffset 63 batches 1
2025-10-10T14:57:32.412027Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-10T14:57:32.412046Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 20867 count 3 nextOffset 64 batches 1
2025-10-10T14:57:32.412066Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-10T14:57:32.412083Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 28032 count 4 nextOffset 65 batches 1
2025-10-10T14:57:32.412101Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-10T14:57:32.412120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 35307 count 5 nextOffset 66 batches 1
2025-10-10T14:57:32.412139Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-10T14:57:32.412155Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 42692 count 6 nextOffset 67 batches 1
2025-10-10T14:57:32.412172Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-10T14:57:32.412188Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 50187 count 7 nextOffset 68 batches 1
2025-10-10T14:57:32.412207Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-10T14:57:32.412222Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 57792 count 8 nextOffset 69 batches 1
2025-10-10T14:57:32.412241Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-10T14:57:32.412260Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 65507 count 9 nextOffset 70 batches 1
2025-10-10T14:57:32.412278Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-10T14:57:32.412298Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 73332 count 10 nextOffset 71 batches 1
2025-10-10T14:57:32.412318Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-10T14:57:32.412337Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 81267 count 11 nextOffset 72 batches 1
2025-10-10T14:57:32.412357Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-10-10T14:57:32.412376Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 89312 count 12 nextOffset 73 batches 1
2025-10-10T14:57:32.412395Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-10T14:57:32.412414Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 97467 count 13 nextOffset 74 batches 1
2025-10-10T14:57:32.412434Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-10T14:57:32.412452Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 105732 count 14 nextOffset 75 batches 1
2025-10-10T14:57:32.412472Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-10T14:57:32.412490Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 61 PartNo 0 PackedSize 114107 count 15 nextOffset 76 batches 1
2025-10-10T14:57:32.412507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.413346Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 61,15 HeadOffset 61 endOffset 61 curOffset 76 d0000000000_00000000000000000061_00000_0000000015_00000? size 113689 WTime 1760108252413
2025-10-10T14:57:32.413508Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.413613Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 47
2025-10-10T14:57:32.413670Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 48
2025-10-10T14:57:32.413697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99  requestId: <none> cookie: 49
2025-10-10T14:57:32.413723Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 50
2025-10-10T14:57:32.413747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101  requestId: <none> cookie: 51
2025-10-10T14:57:32.413792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 107  requestId: <none> cookie: 52
2025-10-10T14:57:32.413817Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 108  requestId: <none> cookie: 53
2025-10-10T14:57:32.413840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 109  requestId: <none> cookie: 54
2025-10-10T14:57:32.413863Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 110  requestId: <none> cookie: 55
2025-10-10T14:57:32.413886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 111  requestId: <none> cookie: 56
2025-10-10T14:57:32.413912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 117  requestId: <none> cookie: 57
2025-10-10T14:57:32.413936Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 118  requestId: <none> cookie: 58
2025-10-10T14:57:32.413962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 119  requestId: <none> cookie: 59
2025-10-10T14:57:32.413984Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 120  requestId: <none> cookie: 60
2025-10-10T14:57:32.414008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 121  requestId: <none> cookie: 61
2025-10-10T14:57:32.414087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414111Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 157 size 8443 offset: -1
2025-10-10T14:57:32.414234Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 158 size 8553 offset: -1
2025-10-10T14:57:32.414315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 159 size 8663 offset: -1
2025-10-10T14:57:32.414390Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414402Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 160 size 8773 offset: -1
2025-10-10T14:57:32.414471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414482Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414503Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 161 size 8883 offset: -1
2025-10-10T14:57:32.414532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414613Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414623Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414650Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414686Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414760Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.414773Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.414823Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.414841Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.414952Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 61 partNo 0 count 15 size 113689
2025-10-10T14:57:32.415002Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.415035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.415058Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.415073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.415084Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.415099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.415109Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.415124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.415133Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.415146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.415349Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 162  requestId: <none> cookie: 82
2025-10-10T14:57:32.417469Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 163  requestId: <none> cookie: 83
2025-10-10T14:57:32.417507Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 164  requestId: <none> cookie: 84
2025-10-10T14:57:32.417525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 165  requestId: <none> cookie: 85
2025-10-10T14:57:32.417559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 166  requestId: <none> cookie: 86
2025-10-10T14:57:32.417664Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 46 count 18 size 106726 endOffset 61 max time lag 0ms effective offset 46
2025-10-10T14:57:32.417849Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 88939 count 15 last offset 46, current partition end offset: 61
2025-10-10T14:57:32.417870Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-10T14:57:32.417820Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.417915Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 46 partno 0 count 15 parts_count 0 source 1 size 88939 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.417936Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-10T14:57:32.417904Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.417940Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.417966Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.417991Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.417989Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.418023Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418050Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418081Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418118Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418153Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418180Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418213Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418255Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418287Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.418448Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 46 totakecount 15 count 15 size 88917 from pos 0 cbcount 15
2025-10-10T14:57:32.418634Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 46
2025-10-10T14:57:32.419315Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 46 partno 0 count 15 parts 0 suffix '63'
2025-10-10T14:57:32.420504Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.420573Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.420601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.420626Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.420660Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.421318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.421360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 47
2025-10-10T14:57:32.421598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 48 offsets: 47 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.421629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 48
2025-10-10T14:57:32.421777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 49 offsets: 48 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.421802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 49
2025-10-10T14:57:32.421923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 50 offsets: 49 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.421948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 50
2025-10-10T14:57:32.422066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 51 offsets: 50 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.422089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 51
2025-10-10T14:57:32.422199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 52 offsets: 51 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 6 }
2025-10-10T14:57:32.422221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 52
2025-10-10T14:57:32.422023Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.423077Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 88377, now ReadSizeBudget = 0, ReadSizeServerDelta = 435911
2025-10-10T14:57:32.422061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.421069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.422111Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 167 size 8993 offset: -1
2025-10-10T14:57:32.421254Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.422171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.421295Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.422181Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.421327Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.422204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 168 size 9103 offset: -1
2025-10-10T14:57:32.421383Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.422249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.422269Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.422290Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 169 size 9213 offset: -1
2025-10-10T14:57:32.421556Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 61 Result { Offset: 46 Data: "... 5143 bytes ..." SourceId: "\000src_id" SeqNo: 47 WriteTimestampMS: 1760108252332 CreateTimestampMS: 1760108252063 UncompressedSize: 5071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 47 Data: "... 5253 bytes ..." SourceId: "\000src_id" SeqNo: 48 WriteTimestampMS: 1760108252332 CreateTimestampMS: 1760108252063 UncompressedSize: 5181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 48 Data: "... 5363 bytes ..." SourceId: "\000src_id" SeqNo: 49 WriteTimestampMS: 1760108252332 CreateTimestampMS: 1760108252063 UncompressedSize: 5291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 49 Data: "... 5473 bytes ..." SourceId: "\000src_id" SeqNo: 50 WriteTimestampMS: 1760108252332 CreateTimestampMS: 1760108252064 UncompressedSize: 5401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 50 Data: "... 5583 bytes ..." SourceId: "\000src_id" SeqNo: 51 WriteTimestampMS: 1760108252332 CreateTimestampMS: 1760108252064 UncompressedSize: 5511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 51 Data: "... 5693 bytes ..." SourceId: "\000src_id" SeqNo: 52 WriteTimestampMS: 1760108252332 CreateTimestampMS: 1760108252064 UncompressedSize: 5621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 52 Data: "... 5803 bytes ..." SourceId: "\000src_id" SeqNo: 53 WriteTimestampMS: 1760108252332 CreateTimestampMS: 1760108252064 UncompressedSize: 5731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 53 Data: "... 5913 bytes ..." SourceId: "\000src_id" SeqNo: 54 WriteTimestampMS: 1760108252332 CreateTimestampMS: 1760108252064 UncompressedSize: 5841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 54 Data: "... 6023 bytes ..." SourceId: "\000src_id" SeqNo: 55 WriteTimestampMS: 1760108252336 CreateTimestampMS: 1760108252064 UncompressedSize: 5951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 55 Data: "... 6133 bytes ..." SourceId: "\000src_id" SeqNo: 56 WriteTimestampMS: 1760108252336 CreateTimestampMS: 1760108252064 UncompressedSize: 6061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 56 Data: "... 6243 bytes ..." SourceId: "\000src_id" SeqNo: 57 WriteTimestampMS: 1760108252336 CreateTimestampMS: 1760108252064 UncompressedSize: 6171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 57 Data: "... 6353 bytes ..." SourceId: "\000src_id" SeqNo: 58 WriteTimestampMS: 1760108252336 CreateTimestampMS: 1760108252064 UncompressedSize: 6281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 58 Data: "... 6463 bytes ..." SourceId: "\000src_id" SeqNo: 59 WriteTimestampMS: 1760108252336 CreateTimestampMS: 1760108252064 UncompressedSize: 6391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 59 Data: "... 6573 bytes ..." SourceId: "\000src_id" SeqNo: 60 WriteTimestampMS: 1760108252336 CreateTimestampMS: 1760108252073 UncompressedSize: 6501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 60 Data: "... 6683 bytes ..." SourceId: "\000src_id" SeqNo: 61 WriteTimestampMS: 1760108252336 CreateTimestampMS: 1760108252075 UncompressedSize: 6611 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551230 RealReadOffset: 60 WaitQuotaTimeMs: 0 EndOffset: 61 StartOffset: 0 } Cookie: 46 }
2025-10-10T14:57:32.423237Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 435911
2025-10-10T14:57:32.422336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.421842Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 61
2025-10-10T14:57:32.422347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.421869Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 61 ReadOffset 61 ReadGuid c409d64f-cb17f5c4-ae0d420f-ff82898d has messages 1
2025-10-10T14:57:32.422366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 170 size 9323 offset: -1
2025-10-10T14:57:32.421983Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# c409d64f-cb17f5c4-ae0d420f-ff82898d, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 88377
2025-10-10T14:57:32.422408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.422004Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# c409d64f-cb17f5c4-ae0d420f-ff82898d
2025-10-10T14:57:32.422419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.422228Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.422439Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 171 size 9433 offset: -1
2025-10-10T14:57:32.422466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.422475Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.422502Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.422511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.422541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.422550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.423428Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (46-60)
2025-10-10T14:57:32.422573Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.422582Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.422604Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.423469Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 88377 to budget
2025-10-10T14:57:32.422613Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.423506Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 88377, ReadSizeServerDelta = 435911
2025-10-10T14:57:32.422632Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.422677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.422691Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.422703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.422713Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.422727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.422737Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.423630Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.422748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.422761Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.422793Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.422900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 172  requestId: <none> cookie: 87
2025-10-10T14:57:32.422947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 173  requestId: <none> cookie: 88
2025-10-10T14:57:32.423693Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (46-46)
2025-10-10T14:57:32.422963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 174  requestId: <none> cookie: 89
2025-10-10T14:57:32.422978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 175  requestId: <none> cookie: 90
2025-10-10T14:57:32.423738Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (47-47)
2025-10-10T14:57:32.422993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 176  requestId: <none> cookie: 91
2025-10-10T14:57:32.423552Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.423775Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (48-48)
2025-10-10T14:57:32.423803Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (49-49)
2025-10-10T14:57:32.423855Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (50-50)
2025-10-10T14:57:32.423880Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (51-51)
2025-10-10T14:57:32.423918Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (52-52)
2025-10-10T14:57:32.423952Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (53-53)
2025-10-10T14:57:32.424127Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (54-54)
2025-10-10T14:57:32.424161Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (55-55)
2025-10-10T14:57:32.424191Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (56-56)
2025-10-10T14:57:32.424222Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (57-57)
2025-10-10T14:57:32.424257Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (58-58)
2025-10-10T14:57:32.424285Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (59-59)
2025-10-10T14:57:32.424313Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (60-60)
2025-10-10T14:57:32.423879Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.423916Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.423935Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.423954Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.423998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.424215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.424262Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.424286Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.424312Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.424335Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..5071 bytes.. Information: { Offset: 46 ProducerId: "src_id" SeqNo: 47 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5181 bytes.. Information: { Offset: 47 ProducerId: "src_id" SeqNo: 48 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5291 bytes.. Information: { Offset: 48 ProducerId: "src_id" SeqNo: 49 CreateTime: 2025-10-10T14:57:32.063000Z WriteTime: 2025-10-10T14:57:32.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5401 bytes.. Information: { Offset: 49 ProducerId: "src_id" SeqNo: 50 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5511 bytes.. Information: { Offset: 50 ProducerId: "src_id" SeqNo: 51 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5621 bytes.. Information: { Offset: 51 ProducerId: "src_id" SeqNo: 52 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5731 bytes.. Information: { Offset: 52 ProducerId: "src_id" SeqNo: 53 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5841 bytes.. Information: { Offset: 53 ProducerId: "src_id" SeqNo: 54 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.332000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5951 bytes.. Information: { Offset: 54 ProducerId: "src_id" SeqNo: 55 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.336000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6061 bytes.. Information: { Offset: 55 ProducerId: "src_id" SeqNo: 56 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.336000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6171 bytes.. Information: { Offset: 56 ProducerId: "src_id" SeqNo: 57 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.336000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6281 bytes.. Information: { Offset: 57 ProducerId: "src_id" SeqNo: 58 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.336000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6391 bytes.. Information: { Offset: 58 ProducerId: "src_id" SeqNo: 59 CreateTime: 2025-10-10T14:57:32.064000Z WriteTime: 2025-10-10T14:57:32.336000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6501 bytes.. Information: { Offset: 59 ProducerId: "src_id" SeqNo: 60 CreateTime: 2025-10-10T14:57:32.073000Z WriteTime: 2025-10-10T14:57:32.336000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6611 bytes.. Information: { Offset: 60 ProducerId: "src_id" SeqNo: 61 CreateTime: 2025-10-10T14:57:32.075000Z WriteTime: 2025-10-10T14:57:32.336000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.425719Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 15, size 87615 bytes
2025-10-10T14:57:32.425785Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.425461Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.426000Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.426279Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.425200Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425237Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425285Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 177 size 9543 offset: -1
2025-10-10T14:57:32.425342Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425370Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 178 size 9653 offset: -1
2025-10-10T14:57:32.425423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 179 size 9763 offset: -1
2025-10-10T14:57:32.425500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 180 size 9873 offset: -1
2025-10-10T14:57:32.425579Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425590Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425609Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 181 size 9983 offset: -1
2025-10-10T14:57:32.425642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425693Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425783Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425812Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.425825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.425846Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.425885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.425898Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.425916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.425928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.425940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.425951Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.425966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.425976Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.425989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.426057Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 182  requestId: <none> cookie: 92
2025-10-10T14:57:32.426099Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 183  requestId: <none> cookie: 93
2025-10-10T14:57:32.426117Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 184  requestId: <none> cookie: 94
2025-10-10T14:57:32.426133Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 185  requestId: <none> cookie: 95
2025-10-10T14:57:32.426149Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 186  requestId: <none> cookie: 96
2025-10-10T14:57:32.427315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 53 offsets: 52 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 6 }
2025-10-10T14:57:32.427362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 53
2025-10-10T14:57:32.427606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 54 offsets: 53 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.427634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 54
2025-10-10T14:57:32.427754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 55 offsets: 54 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.427775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 55
2025-10-10T14:57:32.427893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 56 offsets: 55 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.427919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 56
2025-10-10T14:57:32.428055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 57 offsets: 56 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 5 }
2025-10-10T14:57:32.428078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 57
2025-10-10T14:57:32.428181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 58 offsets: 57 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 5 }
2025-10-10T14:57:32.427224Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.428202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 58
2025-10-10T14:57:32.427282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.427314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.427341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.427409Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.427443Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.427867Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.427917Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.427952Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.428361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 59 offsets: 58 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 5 }
2025-10-10T14:57:32.427989Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.428386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 59
2025-10-10T14:57:32.428024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.428498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 60 offsets: 59 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 5 }
2025-10-10T14:57:32.428520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 60
2025-10-10T14:57:32.428627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 61 offsets: 60 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 5 }
2025-10-10T14:57:32.428652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 61
2025-10-10T14:57:32.429614Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.429647Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.429695Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 187 size 10093 offset: -1
2025-10-10T14:57:32.429771Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.429783Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.429806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 188 size 10203 offset: -1
2025-10-10T14:57:32.430086Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.430314Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 88377 } }
2025-10-10T14:57:32.430425Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# e9dcbebc-9d025860-a0841c6d-805a119d
2025-10-10T14:57:32.430108Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.430133Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.430165Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 189 size 10313 offset: -1
2025-10-10T14:57:32.430216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.430227Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.430249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 190 size 10423 offset: -1
2025-10-10T14:57:32.430295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.430306Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.430326Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 191 size 10533 offset: -1
2025-10-10T14:57:32.430354Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.430363Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.430392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.430401Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.430425Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.430434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.430460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.430470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.430493Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.430504Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.430525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.430569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.430583Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.430598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.430607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.430621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.430630Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.430642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.430658Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.430682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.430757Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 192  requestId: <none> cookie: 97
2025-10-10T14:57:32.430799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 193  requestId: <none> cookie: 98
2025-10-10T14:57:32.430813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 194  requestId: <none> cookie: 99
2025-10-10T14:57:32.430831Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 195  requestId: <none> cookie: 100
2025-10-10T14:57:32.430849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 196  requestId: <none> cookie: 101
2025-10-10T14:57:32.431228Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.431707Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.431749Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.431794Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.431820Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.431845Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.431873Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.432282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.432328Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.432364Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.432397Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.432432Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.432095Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 61 count 15 size 113689 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.432144Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.432188Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 113550 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.432216Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432245Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-10T14:57:32.432262Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432281Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-10T14:57:32.432292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432311Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-10T14:57:32.432323Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432340Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-10T14:57:32.432350Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432368Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-10T14:57:32.432381Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432402Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-10T14:57:32.433748Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.432412Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432429Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-10T14:57:32.433969Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 61 EndOffset 61 newEndOffset 76 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-10-10T14:57:32.432438Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.433990Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 61 endOffset 76
2025-10-10T14:57:32.432453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-10T14:57:32.432464Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.434029Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 61, endOffset# 76, WTime# 1760108252336, sizeLag# 113689
2025-10-10T14:57:32.432481Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-10T14:57:32.434042Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.432492Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.434090Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# e80e4d37-90b286a1-7892de8a-f4b1aabf, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 136426, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.432511Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-10T14:57:32.434150Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 136426 maxTimeLagMs 0 readTimestampMs 0 readOffset 61 EndOffset 76 ClientCommitOffset 0 committedOffset 0 Guid e80e4d37-90b286a1-7892de8a-f4b1aabf
2025-10-10T14:57:32.432522Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432555Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-10T14:57:32.432566Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432584Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-10T14:57:32.432593Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432611Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-10T14:57:32.432623Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432641Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-10T14:57:32.432646Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 61 partno 0 count 15 parts 0 suffix '63' size 113689
2025-10-10T14:57:32.432651Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.432673Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-10T14:57:32.432858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.432933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.432943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-10T14:57:32.433025Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-10T14:57:32.433949Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 8517 count 1 nextOffset 77 batches 1
2025-10-10T14:57:32.434002Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-10T14:57:32.434032Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 17112 count 2 nextOffset 78 batches 1
2025-10-10T14:57:32.434053Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-10T14:57:32.434076Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 25817 count 3 nextOffset 79 batches 1
2025-10-10T14:57:32.434095Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-10T14:57:32.434708Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.434115Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 34632 count 4 nextOffset 80 batches 1
2025-10-10T14:57:32.434139Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-10T14:57:32.434160Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 43557 count 5 nextOffset 81 batches 1
2025-10-10T14:57:32.434179Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-10T14:57:32.434196Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 52592 count 6 nextOffset 82 batches 1
2025-10-10T14:57:32.434215Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-10T14:57:32.434234Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 61737 count 7 nextOffset 83 batches 1
2025-10-10T14:57:32.434253Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-10T14:57:32.434271Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 70992 count 8 nextOffset 84 batches 1
2025-10-10T14:57:32.434290Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-10T14:57:32.434312Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 80357 count 9 nextOffset 85 batches 1
2025-10-10T14:57:32.434332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-10T14:57:32.434350Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 89832 count 10 nextOffset 86 batches 1
2025-10-10T14:57:32.434368Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-10T14:57:32.434388Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 99417 count 11 nextOffset 87 batches 1
2025-10-10T14:57:32.434406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-10T14:57:32.434424Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 109112 count 12 nextOffset 88 batches 1
2025-10-10T14:57:32.434444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-10T14:57:32.434462Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 118917 count 13 nextOffset 89 batches 1
2025-10-10T14:57:32.435019Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.434496Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-10T14:57:32.434521Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 128832 count 14 nextOffset 90 batches 1
2025-10-10T14:57:32.434541Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-10T14:57:32.434558Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 138857 count 15 nextOffset 91 batches 1
2025-10-10T14:57:32.434575Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-10T14:57:32.434594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 148992 count 16 nextOffset 92 batches 1
2025-10-10T14:57:32.434612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-10T14:57:32.434634Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 159237 count 17 nextOffset 93 batches 1
2025-10-10T14:57:32.434652Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-10T14:57:32.434674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 169592 count 18 nextOffset 94 batches 1
2025-10-10T14:57:32.435314Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.434692Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-10T14:57:32.434711Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 180057 count 19 nextOffset 95 batches 1
2025-10-10T14:57:32.434733Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-10T14:57:32.434752Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 76 PartNo 0 PackedSize 190632 count 20 nextOffset 96 batches 1
2025-10-10T14:57:32.434768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.435858Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 76,20 HeadOffset 76 endOffset 76 curOffset 96 d0000000000_00000000000000000076_00000_0000000020_00000? size 190054 WTime 1760108252433
2025-10-10T14:57:32.437360Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437422Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437484Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437501Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437522Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437541Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437560Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437579Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437598Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437619Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437638Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437660Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.437684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.436431Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.436505Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 127  requestId: <none> cookie: 62
2025-10-10T14:57:32.436550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 128  requestId: <none> cookie: 63
2025-10-10T14:57:32.436577Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 129  requestId: <none> cookie: 64
2025-10-10T14:57:32.436605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 130  requestId: <none> cookie: 65
2025-10-10T14:57:32.436632Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 131  requestId: <none> cookie: 66
2025-10-10T14:57:32.436658Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 137  requestId: <none> cookie: 67
2025-10-10T14:57:32.436686Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 138  requestId: <none> cookie: 68
2025-10-10T14:57:32.436713Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 139  requestId: <none> cookie: 69
2025-10-10T14:57:32.436743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 140  requestId: <none> cookie: 70
2025-10-10T14:57:32.436770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 141  requestId: <none> cookie: 71
2025-10-10T14:57:32.436795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 147  requestId: <none> cookie: 72
2025-10-10T14:57:32.436820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 148  requestId: <none> cookie: 73
2025-10-10T14:57:32.436846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 149  requestId: <none> cookie: 74
2025-10-10T14:57:32.436871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 150  requestId: <none> cookie: 75
2025-10-10T14:57:32.436899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 151  requestId: <none> cookie: 76
2025-10-10T14:57:32.436980Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437000Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 197 size 10643 offset: -1
2025-10-10T14:57:32.437104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 198 size 10753 offset: -1
2025-10-10T14:57:32.437211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437222Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437243Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 199 size 10863 offset: -1
2025-10-10T14:57:32.437291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437302Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437323Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 200 size 10973 offset: -1
2025-10-10T14:57:32.437379Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 101 partNo : 0 messageNo: 201 size 11083 offset: -1
2025-10-10T14:57:32.437459Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437503Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437513Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437540Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437583Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437593Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437632Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437698Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.437710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.437750Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.437876Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 76 partNo 0 count 20 size 190054
2025-10-10T14:57:32.437913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.437952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.437966Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.437981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.437993Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.438009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.438019Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.438036Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.438048Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.438059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.438273Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 202  requestId: <none> cookie: 102
2025-10-10T14:57:32.438299Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 203  requestId: <none> cookie: 103
2025-10-10T14:57:32.438317Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 204  requestId: <none> cookie: 104
2025-10-10T14:57:32.438335Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 205  requestId: <none> cookie: 105
2025-10-10T14:57:32.438352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 206  requestId: <none> cookie: 106
2025-10-10T14:57:32.438448Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 61 count 18 size 136426 endOffset 76 max time lag 0ms effective offset 61
2025-10-10T14:57:32.438620Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 113689 count 15 last offset 61, current partition end offset: 76
2025-10-10T14:57:32.438635Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-10T14:57:32.438683Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 61 partno 0 count 15 parts_count 0 source 1 size 113689 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.438707Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-10T14:57:32.438781Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.439298Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 61 totakecount 15 count 15 size 113667 from pos 0 cbcount 15
2025-10-10T14:57:32.439542Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 61
2025-10-10T14:57:32.441584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 62 offsets: 61 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 68 }
2025-10-10T14:57:32.441626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 62
2025-10-10T14:57:32.441831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 63 offsets: 62 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 68 }
2025-10-10T14:57:32.441857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 63
2025-10-10T14:57:32.442005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 64 offsets: 63 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 68 }
2025-10-10T14:57:32.442030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 64
2025-10-10T14:57:32.442150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 65 offsets: 64 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 68 }
2025-10-10T14:57:32.442169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 65
2025-10-10T14:57:32.442294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 66 offsets: 65 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 68 }
2025-10-10T14:57:32.442316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 66
2025-10-10T14:57:32.442420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 67 offsets: 66 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 60 }
2025-10-10T14:57:32.442440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 67
2025-10-10T14:57:32.442551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 68 offsets: 67 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 60 }
2025-10-10T14:57:32.442572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 68
2025-10-10T14:57:32.442696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 69 offsets: 68 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 60 }
2025-10-10T14:57:32.442718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 69
2025-10-10T14:57:32.442841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 70 offsets: 69 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 60 }
2025-10-10T14:57:32.442864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 70
2025-10-10T14:57:32.442964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 71 offsets: 70 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 60 }
2025-10-10T14:57:32.442984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 71
2025-10-10T14:57:32.443098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 72 offsets: 71 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 53 }
2025-10-10T14:57:32.443117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 72
2025-10-10T14:57:32.443231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 73 offsets: 72 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 53 }
2025-10-10T14:57:32.443256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 73
2025-10-10T14:57:32.443371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 74 offsets: 73 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 53 }
2025-10-10T14:57:32.443391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 74
2025-10-10T14:57:32.443495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 75 offsets: 74 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 53 }
2025-10-10T14:57:32.443515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 75
2025-10-10T14:57:32.443623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 76 offsets: 75 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 52 }
2025-10-10T14:57:32.443642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 76
2025-10-10T14:57:32.442023Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.442091Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.442122Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.442151Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.442182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.442491Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.442562Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.442697Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.442738Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.442782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.443890Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 76 Result { Offset: 61 Data: "... 6793 bytes ..." SourceId: "\000src_id" SeqNo: 62 WriteTimestampMS: 1760108252358 CreateTimestampMS: 1760108252075 UncompressedSize: 6721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 62 Data: "... 6903 bytes ..." SourceId: "\000src_id" SeqNo: 63 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252075 UncompressedSize: 6831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 63 Data: "... 7013 bytes ..." SourceId: "\000src_id" SeqNo: 64 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252075 UncompressedSize: 6941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 64 Data: "... 7123 bytes ..." SourceId: "\000src_id" SeqNo: 65 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252075 UncompressedSize: 7051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 65 Data: "... 7233 bytes ..." SourceId: "\000src_id" SeqNo: 66 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252076 UncompressedSize: 7161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 66 Data: "... 7343 bytes ..." SourceId: "\000src_id" SeqNo: 67 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252076 UncompressedSize: 7271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 67 Data: "... 7453 bytes ..." SourceId: "\000src_id" SeqNo: 68 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252076 UncompressedSize: 7381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 68 Data: "... 7563 bytes ..." SourceId: "\000src_id" SeqNo: 69 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252076 UncompressedSize: 7491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 69 Data: "... 7673 bytes ..." SourceId: "\000src_id" SeqNo: 70 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252076 UncompressedSize: 7601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 70 Data: "... 7783 bytes ..." SourceId: "\000src_id" SeqNo: 71 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252076 UncompressedSize: 7711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 71 Data: "... 7893 bytes ..." SourceId: "\000src_id" SeqNo: 72 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252076 UncompressedSize: 7821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 72 Data: "... 8003 bytes ..." SourceId: "\000src_id" SeqNo: 73 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252076 UncompressedSize: 7931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 73 Data: "... 8113 bytes ..." SourceId: "\000src_id" SeqNo: 74 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252076 UncompressedSize: 8041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 74 Data: "... 8223 bytes ..." SourceId: "\000src_id" SeqNo: 75 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252077 UncompressedSize: 8151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 75 Data: "... 8333 bytes ..." SourceId: "\000src_id" SeqNo: 76 WriteTimestampMS: 1760108252407 CreateTimestampMS: 1760108252078 UncompressedSize: 8261 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551230 RealReadOffset: 75 WaitQuotaTimeMs: 0 EndOffset: 76 StartOffset: 0 } Cookie: 61 }
2025-10-10T14:57:32.444268Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 76
2025-10-10T14:57:32.444305Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 76 ReadOffset 76 ReadGuid e80e4d37-90b286a1-7892de8a-f4b1aabf has messages 1
2025-10-10T14:57:32.444490Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# e80e4d37-90b286a1-7892de8a-f4b1aabf, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 113126
2025-10-10T14:57:32.444517Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# e80e4d37-90b286a1-7892de8a-f4b1aabf
2025-10-10T14:57:32.444810Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.441697Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 61 partno 0 count 15 parts 0 suffix '63'
2025-10-10T14:57:32.444880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.444907Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.444957Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 102 partNo : 0 messageNo: 207 size 11193 offset: -1
2025-10-10T14:57:32.445017Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.445027Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.445047Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 103 partNo : 0 messageNo: 208 size 11303 offset: -1
2025-10-10T14:57:32.445093Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.445103Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.445140Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 104 partNo : 0 messageNo: 209 size 11413 offset: -1
2025-10-10T14:57:32.445187Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.445197Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.445216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 105 partNo : 0 messageNo: 210 size 11523 offset: -1
2025-10-10T14:57:32.445269Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.445279Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.445300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 106 partNo : 0 messageNo: 211 size 11633 offset: -1
2025-10-10T14:57:32.445332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.445341Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.445372Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.445383Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.445409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.445420Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.445447Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.445458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.445506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.445522Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.445614Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.445657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.445671Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.445685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.445696Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.445709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.445719Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.445732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.445742Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.445774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.446257Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 212  requestId: <none> cookie: 107
2025-10-10T14:57:32.446291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 213  requestId: <none> cookie: 108
2025-10-10T14:57:32.446308Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 214  requestId: <none> cookie: 109
2025-10-10T14:57:32.446334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 215  requestId: <none> cookie: 110
2025-10-10T14:57:32.446352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 216  requestId: <none> cookie: 111
2025-10-10T14:57:32.448194Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.448254Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.448311Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.448340Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.448367Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.448392Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.448958Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.448997Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.449021Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.449044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.449070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.450323Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450358Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450408Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 107 partNo : 0 messageNo: 217 size 11743 offset: -1
2025-10-10T14:57:32.450474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450485Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 108 partNo : 0 messageNo: 218 size 11853 offset: -1
2025-10-10T14:57:32.450547Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450560Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450581Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 109 partNo : 0 messageNo: 219 size 11963 offset: -1
2025-10-10T14:57:32.450641Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 110 partNo : 0 messageNo: 220 size 12073 offset: -1
2025-10-10T14:57:32.450711Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450721Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 111 partNo : 0 messageNo: 221 size 12183 offset: -1
2025-10-10T14:57:32.450767Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450811Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450850Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.450956Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.450978Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.451020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.451034Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.451051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.451063Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.451076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.451088Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.451102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.451112Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.451124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.451204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 222  requestId: <none> cookie: 112
2025-10-10T14:57:32.451234Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 223  requestId: <none> cookie: 113
2025-10-10T14:57:32.451250Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 224  requestId: <none> cookie: 114
2025-10-10T14:57:32.451268Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 225  requestId: <none> cookie: 115
2025-10-10T14:57:32.451283Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 226  requestId: <none> cookie: 116
2025-10-10T14:57:32.453424Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 113126, now ReadSizeBudget = 0, ReadSizeServerDelta = 411162
2025-10-10T14:57:32.453577Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 411162
2025-10-10T14:57:32.452520Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.452567Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.452618Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.452646Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.452674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.452699Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.453322Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.453359Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.453992Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (61-75)
2025-10-10T14:57:32.453407Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.453445Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.454030Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 113126 to budget
2025-10-10T14:57:32.453479Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.453513Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.454060Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 113126, ReadSizeServerDelta = 411162
2025-10-10T14:57:32.454302Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.454395Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (61-61)
2025-10-10T14:57:32.454459Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (62-62)
2025-10-10T14:57:32.454516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (63-63)
2025-10-10T14:57:32.454542Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (64-64)
2025-10-10T14:57:32.454645Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (65-65)
2025-10-10T14:57:32.454676Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (66-66)
2025-10-10T14:57:32.454711Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (67-67)
2025-10-10T14:57:32.454741Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (68-68)
2025-10-10T14:57:32.454494Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.454800Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (69-69)
2025-10-10T14:57:32.454828Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (70-70)
2025-10-10T14:57:32.454857Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (71-71)
2025-10-10T14:57:32.454883Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (72-72)
2025-10-10T14:57:32.454911Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (73-73)
2025-10-10T14:57:32.454944Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (74-74)
2025-10-10T14:57:32.454972Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (75-75)
2025-10-10T14:57:32.454821Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.455086Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-10-10T14:57:32.455400Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.455698Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..6721 bytes.. Information: { Offset: 61 ProducerId: "src_id" SeqNo: 62 CreateTime: 2025-10-10T14:57:32.075000Z WriteTime: 2025-10-10T14:57:32.358000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6831 bytes.. Information: { Offset: 62 ProducerId: "src_id" SeqNo: 63 CreateTime: 2025-10-10T14:57:32.075000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6941 bytes.. Information: { Offset: 63 ProducerId: "src_id" SeqNo: 64 CreateTime: 2025-10-10T14:57:32.075000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7051 bytes.. Information: { Offset: 64 ProducerId: "src_id" SeqNo: 65 CreateTime: 2025-10-10T14:57:32.075000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7161 bytes.. Information: { Offset: 65 ProducerId: "src_id" SeqNo: 66 CreateTime: 2025-10-10T14:57:32.076000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7271 bytes.. Information: { Offset: 66 ProducerId: "src_id" SeqNo: 67 CreateTime: 2025-10-10T14:57:32.076000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7381 bytes.. Information: { Offset: 67 ProducerId: "src_id" SeqNo: 68 CreateTime: 2025-10-10T14:57:32.076000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7491 bytes.. Information: { Offset: 68 ProducerId: "src_id" SeqNo: 69 CreateTime: 2025-10-10T14:57:32.076000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7601 bytes.. Information: { Offset: 69 ProducerId: "src_id" SeqNo: 70 CreateTime: 2025-10-10T14:57:32.076000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7711 bytes.. Information: { Offset: 70 ProducerId: "src_id" SeqNo: 71 CreateTime: 2025-10-10T14:57:32.076000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7821 bytes.. Information: { Offset: 71 ProducerId: "src_id" SeqNo: 72 CreateTime: 2025-10-10T14:57:32.076000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7931 bytes.. Information: { Offset: 72 ProducerId: "src_id" SeqNo: 73 CreateTime: 2025-10-10T14:57:32.076000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8041 bytes.. Information: { Offset: 73 ProducerId: "src_id" SeqNo: 74 CreateTime: 2025-10-10T14:57:32.076000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8151 bytes.. Information: { Offset: 74 ProducerId: "src_id" SeqNo: 75 CreateTime: 2025-10-10T14:57:32.077000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8261 bytes.. Information: { Offset: 75 ProducerId: "src_id" SeqNo: 76 CreateTime: 2025-10-10T14:57:32.078000Z WriteTime: 2025-10-10T14:57:32.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.456003Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 15, size 112365 bytes
2025-10-10T14:57:32.455931Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.456043Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.454340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.454388Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.454450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 112 partNo : 0 messageNo: 227 size 12293 offset: -1
2025-10-10T14:57:32.454538Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.454550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.454572Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 113 partNo : 0 messageNo: 228 size 12403 offset: -1
2025-10-10T14:57:32.454657Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 76 count 20 size 190054 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.454733Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.454747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.454771Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 114 partNo : 0 messageNo: 229 size 12513 offset: -1
2025-10-10T14:57:32.454822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.454837Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.454861Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 115 partNo : 0 messageNo: 230 size 12623 offset: -1
2025-10-10T14:57:32.454918Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.454929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.454949Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 116 partNo : 0 messageNo: 231 size 12733 offset: -1
2025-10-10T14:57:32.454979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.454990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.455024Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.455036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.455080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.455096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.455131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.455143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.455191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.455209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.455239Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.455281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.455295Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.455317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.455336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.455384Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 189900 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.455411Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455440Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-10T14:57:32.455456Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455476Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-10T14:57:32.455489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455507Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-10T14:57:32.455519Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455536Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-10T14:57:32.455548Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455598Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-10T14:57:32.455616Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455635Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-10T14:57:32.455647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455665Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-10T14:57:32.455677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455697Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-10T14:57:32.455709Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455734Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-10T14:57:32.455745Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455763Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-10T14:57:32.455775Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455794Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-10T14:57:32.455804Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455824Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-10T14:57:32.455836Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455863Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-10T14:57:32.455885Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-10T14:57:32.455923Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455943Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-10-10T14:57:32.455956Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.455975Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-10T14:57:32.455987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.456008Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-10T14:57:32.456019Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.456037Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-10T14:57:32.456048Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.457861Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 113126 } }
2025-10-10T14:57:32.457983Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 2bc61080-d021102-bc7ba843-65acc4c6
2025-10-10T14:57:32.458048Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 76 EndOffset 76 newEndOffset 96 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-10-10T14:57:32.458070Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 76 endOffset 96
2025-10-10T14:57:32.456067Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-10T14:57:32.456079Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.456096Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-10T14:57:32.456234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.456281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.456287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (17)
2025-10-10T14:57:32.456350Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-10T14:57:32.457031Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 10717 count 1 nextOffset 97 batches 1
2025-10-10T14:57:32.457065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-10T14:57:32.457086Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 21512 count 2 nextOffset 98 batches 1
2025-10-10T14:57:32.457099Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-10T14:57:32.457113Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 32417 count 3 nextOffset 99 batches 1
2025-10-10T14:57:32.457604Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 76 partno 0 count 20 parts 0 suffix '63' size 190054
2025-10-10T14:57:32.458619Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-10T14:57:32.458657Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 43432 count 4 nextOffset 100 batches 1
2025-10-10T14:57:32.458691Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 101 partNo 0
2025-10-10T14:57:32.458715Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 101 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 54557 count 5 nextOffset 101 batches 1
2025-10-10T14:57:32.458734Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 102 partNo 0
2025-10-10T14:57:32.458753Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 102 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 65792 count 6 nextOffset 102 batches 1
2025-10-10T14:57:32.458773Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 103 partNo 0
2025-10-10T14:57:32.458792Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 103 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 77137 count 7 nextOffset 103 batches 1
2025-10-10T14:57:32.458810Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 104 partNo 0
2025-10-10T14:57:32.458830Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 104 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 88592 count 8 nextOffset 104 batches 1
2025-10-10T14:57:32.458849Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 105 partNo 0
2025-10-10T14:57:32.458872Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 105 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 100157 count 9 nextOffset 105 batches 1
2025-10-10T14:57:32.458888Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 106 partNo 0
2025-10-10T14:57:32.458908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 106 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 111832 count 10 nextOffset 106 batches 1
2025-10-10T14:57:32.458927Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 107 partNo 0
2025-10-10T14:57:32.458944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 107 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 123617 count 11 nextOffset 107 batches 1
2025-10-10T14:57:32.458964Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 108 partNo 0
2025-10-10T14:57:32.458982Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 108 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 135512 count 12 nextOffset 108 batches 1
2025-10-10T14:57:32.459000Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 109 partNo 0
2025-10-10T14:57:32.459019Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 109 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 147517 count 13 nextOffset 109 batches 1
2025-10-10T14:57:32.459037Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 110 partNo 0
2025-10-10T14:57:32.459055Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 110 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 159632 count 14 nextOffset 110 batches 1
2025-10-10T14:57:32.459073Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 111 partNo 0
2025-10-10T14:57:32.458105Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 76, endOffset# 96, WTime# 1760108252407, sizeLag# 190054
2025-10-10T14:57:32.458119Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.458154Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 6375fa3-29368af-c569b426-ad26f0ad, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 24, size# 228064, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.458209Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 24 maxSize 228064 maxTimeLagMs 0 readTimestampMs 0 readOffset 76 EndOffset 96 ClientCommitOffset 0 committedOffset 0 Guid 6375fa3-29368af-c569b426-ad26f0ad
2025-10-10T14:57:32.459091Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 111 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 171857 count 15 nextOffset 111 batches 1
2025-10-10T14:57:32.459119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 112 partNo 0
2025-10-10T14:57:32.459137Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 112 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 184192 count 16 nextOffset 112 batches 1
2025-10-10T14:57:32.459157Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 113 partNo 0
2025-10-10T14:57:32.459179Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 113 partNo 0 FormedBlobsCount 0 NewHead: Offset 96 PartNo 0 PackedSize 196637 count 17 nextOffset 113 batches 1
2025-10-10T14:57:32.459193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.460076Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 96,17 HeadOffset 96 endOffset 96 curOffset 113 d0000000000_00000000000000000096_00000_0000000017_00000? size 196155 WTime 1760108252458
2025-10-10T14:57:32.460329Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.460369Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.460405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.460424Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.460440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.460459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.460476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.460569Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 157  requestId: <none> cookie: 77
2025-10-10T14:57:32.460627Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 158  requestId: <none> cookie: 78
2025-10-10T14:57:32.460658Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 159  requestId: <none> cookie: 79
2025-10-10T14:57:32.460683Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 160  requestId: <none> cookie: 80
2025-10-10T14:57:32.460707Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 161  requestId: <none> cookie: 81
2025-10-10T14:57:32.460733Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 167  requestId: <none> cookie: 82
2025-10-10T14:57:32.460755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 168  requestId: <none> cookie: 83
2025-10-10T14:57:32.460779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 169  requestId: <none> cookie: 84
2025-10-10T14:57:32.460803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 170  requestId: <none> cookie: 85
2025-10-10T14:57:32.460825Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 171  requestId: <none> cookie: 86
2025-10-10T14:57:32.460848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 177  requestId: <none> cookie: 87
2025-10-10T14:57:32.460870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 178  requestId: <none> cookie: 88
2025-10-10T14:57:32.460896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 179  requestId: <none> cookie: 89
2025-10-10T14:57:32.460919Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 180  requestId: <none> cookie: 90
2025-10-10T14:57:32.460944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 181  requestId: <none> cookie: 91
2025-10-10T14:57:32.460967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 187  requestId: <none> cookie: 92
2025-10-10T14:57:32.460990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 188  requestId: <none> cookie: 93
2025-10-10T14:57:32.461012Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 189  requestId: <none> cookie: 94
2025-10-10T14:57:32.461036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 190  requestId: <none> cookie: 95
2025-10-10T14:57:32.461058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 191  requestId: <none> cookie: 96
2025-10-10T14:57:32.461165Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.461186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.461228Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.461326Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 96 partNo 0 count 17 size 196155
2025-10-10T14:57:32.461360Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 232  requestId: <none> cookie: 117
2025-10-10T14:57:32.461390Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 233  requestId: <none> cookie: 118
2025-10-10T14:57:32.461409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 234  requestId: <none> cookie: 119
2025-10-10T14:57:32.461427Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 235  requestId: <none> cookie: 120
2025-10-10T14:57:32.461444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 236  requestId: <none> cookie: 121
2025-10-10T14:57:32.461636Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 76 count 24 size 228064 endOffset 96 max time lag 0ms effective offset 76
2025-10-10T14:57:32.461808Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 190054 count 20 last offset 76, current partition end offset: 96
2025-10-10T14:57:32.461822Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-10T14:57:32.461865Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 76 partno 0 count 20 parts_count 0 source 1 size 190054 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.461884Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-10T14:57:32.461921Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.461946Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 76 partno 0 count 20 parts 0 suffix '63'
2025-10-10T14:57:32.466017Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 76 totakecount 20 count 20 size 190032 from pos 0 cbcount 20
2025-10-10T14:57:32.466474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 76
2025-10-10T14:57:32.463649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.463725Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.463755Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.463782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.463808Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.463832Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.463859Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.463888Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.463924Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.463947Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.471832Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 189251, now ReadSizeBudget = 0, ReadSizeServerDelta = 335037
2025-10-10T14:57:32.463977Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.464003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.464031Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.464058Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.464091Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.469387Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 96 Result { Offset: 76 Data: "... 8443 bytes ..." SourceId: "\000src_id" SeqNo: 77 WriteTimestampMS: 1760108252429 CreateTimestampMS: 1760108252078 UncompressedSize: 8371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 77 Data: "... 8553 bytes ..." SourceId: "\000src_id" SeqNo: 78 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252079 UncompressedSize: 8481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 78 Data: "... 8663 bytes ..." SourceId: "\000src_id" SeqNo: 79 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252079 UncompressedSize: 8591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 79 Data: "... 8773 bytes ..." SourceId: "\000src_id" SeqNo: 80 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252080 UncompressedSize: 8701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 80 Data: "... 8883 bytes ..." SourceId: "\000src_id" SeqNo: 81 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252080 UncompressedSize: 8811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 81 Data: "... 8993 bytes ..." SourceId: "\000src_id" SeqNo: 82 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252080 UncompressedSize: 8921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 82 Data: "... 9103 bytes ..." SourceId: "\000src_id" SeqNo: 83 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252080 UncompressedSize: 9031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 83 Data: "... 9213 bytes ..." SourceId: "\000src_id" SeqNo: 84 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252080 UncompressedSize: 9141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 84 Data: "... 9323 bytes ..." SourceId: "\000src_id" SeqNo: 85 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252080 UncompressedSize: 9251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 85 Data: "... 9433 bytes ..." SourceId: "\000src_id" SeqNo: 86 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252080 UncompressedSize: 9361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 86 Data: "... 9543 bytes ..." SourceId: "\000src_id" SeqNo: 87 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252080 UncompressedSize: 9471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 87 Data: "... 9653 bytes ..." SourceId: "\000src_id" SeqNo: 88 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252080 UncompressedSize: 9581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 88 Data: "... 9763 bytes ..." SourceId: "\000src_id" SeqNo: 89 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252081 UncompressedSize: 9691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 89 Data: "... 9873 bytes ..." SourceId: "\000src_id" SeqNo: 90 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252081 UncompressedSize: 9801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 90 Data: "... 9983 bytes ..." SourceId: "\000src_id" SeqNo: 91 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252081 UncompressedSize: 9911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 91 Data: "... 10093 bytes ..." SourceId: "\000src_id" SeqNo: 92 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252081 UncompressedSize: 10021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 92 Data: "... 10203 bytes ..." SourceId: "\000src_id" SeqNo: 93 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252081 UncompressedSize: 10131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 93 Data: "... 10313 bytes ..." SourceId: "\000src_id" SeqNo: 94 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252081 UncompressedSize: 10241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 94 Data: "... 10423 bytes ..." SourceId: "\000src_id" SeqNo: 95 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252081 UncompressedSize: 10351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 95 Data: "... 10533 bytes ..." SourceId: "\000src_id" SeqNo: 96 WriteTimestampMS: 1760108252433 CreateTimestampMS: 1760108252082 UncompressedSize: 10461 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551070 RealReadOffset: 95 WaitQuotaTimeMs: 0 EndOffset: 96 StartOffset: 0 } Cookie: 76 }
2025-10-10T14:57:32.469812Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 96
2025-10-10T14:57:32.469851Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 96 ReadOffset 96 ReadGuid 6375fa3-29368af-c569b426-ad26f0ad has messages 1
2025-10-10T14:57:32.471984Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 335037
2025-10-10T14:57:32.470039Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 6375fa3-29368af-c569b426-ad26f0ad, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 189251
2025-10-10T14:57:32.470067Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 6375fa3-29368af-c569b426-ad26f0ad
2025-10-10T14:57:32.470620Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.472121Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (76-95)
2025-10-10T14:57:32.472157Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 189251 to budget
2025-10-10T14:57:32.472184Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 189251, ReadSizeServerDelta = 335037
2025-10-10T14:57:32.472362Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.472416Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (76-76)
2025-10-10T14:57:32.472461Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (77-77)
2025-10-10T14:57:32.472502Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (78-78)
2025-10-10T14:57:32.472530Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (79-79)
2025-10-10T14:57:32.472575Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (80-80)
2025-10-10T14:57:32.472610Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (81-81)
2025-10-10T14:57:32.472653Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (82-82)
2025-10-10T14:57:32.472691Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (83-83)
2025-10-10T14:57:32.472749Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (84-84)
2025-10-10T14:57:32.472782Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (85-85)
2025-10-10T14:57:32.472812Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (86-86)
2025-10-10T14:57:32.472838Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (87-87)
2025-10-10T14:57:32.472872Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (88-88)
2025-10-10T14:57:32.472908Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (89-89)
2025-10-10T14:57:32.472936Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (90-90)
2025-10-10T14:57:32.472970Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 14} (91-91)
2025-10-10T14:57:32.473063Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 15} (92-92)
2025-10-10T14:57:32.473103Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 16} (93-93)
2025-10-10T14:57:32.473155Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 17} (94-94)
2025-10-10T14:57:32.473184Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 18} (95-95)
2025-10-10T14:57:32.472385Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 96 count 17 size 196155 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.472439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
>>> event from dataHandler: 2025-10-10T14:57:32.472483Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 196010 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.472511Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472539Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-10T14:57:32.472556Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472577Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-10T14:57:32.472588Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472607Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-10T14:57:32.472619Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472636Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-10T14:57:32.472648Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472666Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 101, partNo: 0, Offset: 100 is stored on disk
2025-10-10T14:57:32.472679Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472698Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 102, partNo: 0, Offset: 101 is stored on disk
2025-10-10T14:57:32.472708Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472726Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 103, partNo: 0, Offset: 102 is stored on disk
2025-10-10T14:57:32.472738Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472757Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 104, partNo: 0, Offset: 103 is stored on disk
2025-10-10T14:57:32.472770Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472787Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 105, partNo: 0, Offset: 104 is stored on disk
2025-10-10T14:57:32.472798Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 106, partNo: 0, Offset: 105 is stored on disk
2025-10-10T14:57:32.472827Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472843Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 107, partNo: 0, Offset: 106 is stored on disk
2025-10-10T14:57:32.472855Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472871Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 108, partNo: 0, Offset: 107 is stored on disk
2025-10-10T14:57:32.472881Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472899Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 109, partNo: 0, Offset: 108 is stored on disk
2025-10-10T14:57:32.472909Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472927Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 110, partNo: 0, Offset: 109 is stored on disk
2025-10-10T14:57:32.472937Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472955Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 111, partNo: 0, Offset: 110 is stored on disk
2025-10-10T14:57:32.472966Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.472983Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 112, partNo: 0, Offset: 111 is stored on disk
2025-10-10T14:57:32.472994Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.473010Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 113, partNo: 0, Offset: 112 is stored on disk
2025-10-10T14:57:32.473221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.473254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.473263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:57:32.473343Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 114 partNo 0
2025-10-10T14:57:32.473635Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 96 partno 0 count 17 parts 0 suffix '63' size 196155
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..8371 bytes.. Information: { Offset: 76 ProducerId: "src_id" SeqNo: 77 CreateTime: 2025-10-10T14:57:32.078000Z WriteTime: 2025-10-10T14:57:32.429000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8481 bytes.. Information: { Offset: 77 ProducerId: "src_id" SeqNo: 78 CreateTime: 2025-10-10T14:57:32.079000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8591 bytes.. Information: { Offset: 78 ProducerId: "src_id" SeqNo: 79 CreateTime: 2025-10-10T14:57:32.079000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8701 bytes.. Information: { Offset: 79 ProducerId: "src_id" SeqNo: 80 CreateTime: 2025-10-10T14:57:32.080000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8811 bytes.. Information: { Offset: 80 ProducerId: "src_id" SeqNo: 81 CreateTime: 2025-10-10T14:57:32.080000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8921 bytes.. Information: { Offset: 81 ProducerId: "src_id" SeqNo: 82 CreateTime: 2025-10-10T14:57:32.080000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9031 bytes.. Information: { Offset: 82 ProducerId: "src_id" SeqNo: 83 CreateTime: 2025-10-10T14:57:32.080000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9141 bytes.. Information: { Offset: 83 ProducerId: "src_id" SeqNo: 84 CreateTime: 2025-10-10T14:57:32.080000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9251 bytes.. Information: { Offset: 84 ProducerId: "src_id" SeqNo: 85 CreateTime: 2025-10-10T14:57:32.080000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9361 bytes.. Information: { Offset: 85 ProducerId: "src_id" SeqNo: 86 CreateTime: 2025-10-10T14:57:32.080000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9471 bytes.. Information: { Offset: 86 ProducerId: "src_id" SeqNo: 87 CreateTime: 2025-10-10T14:57:32.080000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9581 bytes.. Information: { Offset: 87 ProducerId: "src_id" SeqNo: 88 CreateTime: 2025-10-10T14:57:32.080000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9691 bytes.. Information: { Offset: 88 ProducerId: "src_id" SeqNo: 89 CreateTime: 2025-10-10T14:57:32.081000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9801 bytes.. Information: { Offset: 89 ProducerId: "src_id" SeqNo: 90 CreateTime: 2025-10-10T14:57:32.081000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9911 bytes.. Information: { Offset: 90 ProducerId: "src_id" SeqNo: 91 CreateTime: 2025-10-10T14:57:32.081000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10021 bytes.. Information: { Offset: 91 ProducerId: "src_id" SeqNo: 92 CreateTime: 2025-10-10T14:57:32.081000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10131 bytes.. Information: { Offset: 92 ProducerId: "src_id" SeqNo: 93 CreateTime: 2025-10-10T14:57:32.081000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10241 bytes.. Information: { Offset: 93 ProducerId: "src_id" SeqNo: 94 CreateTime: 2025-10-10T14:57:32.081000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10351 bytes.. Information: { Offset: 94 ProducerId: "src_id" SeqNo: 95 CreateTime: 2025-10-10T14:57:32.081000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10461 bytes.. Information: { Offset: 95 ProducerId: "src_id" SeqNo: 96 CreateTime: 2025-10-10T14:57:32.082000Z WriteTime: 2025-10-10T14:57:32.433000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.475647Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 20, size 188320 bytes
2025-10-10T14:57:32.475693Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.474780Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 96 EndOffset 96 newEndOffset 113 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-10-10T14:57:32.474817Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 96 endOffset 113
2025-10-10T14:57:32.474857Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 96, endOffset# 113, WTime# 1760108252433, sizeLag# 196155
2025-10-10T14:57:32.474871Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.474912Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 70bda6c2-86161b3a-73f713ca-d67c75a5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 20, size# 235386, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.474963Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 20 maxSize 235386 maxTimeLagMs 0 readTimestampMs 0 readOffset 96 EndOffset 113 ClientCommitOffset 0 committedOffset 0 Guid 70bda6c2-86161b3a-73f713ca-d67c75a5
2025-10-10T14:57:32.475210Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 189251 } }
2025-10-10T14:57:32.475313Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 340a76b8-61b51d72-99775ba5-4b812208
2025-10-10T14:57:32.476945Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 114 partNo 0 FormedBlobsCount 0 NewHead: Offset 113 PartNo 0 PackedSize 12587 count 1 nextOffset 114 batches 1
2025-10-10T14:57:32.477016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 115 partNo 0
2025-10-10T14:57:32.477054Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 115 partNo 0 FormedBlobsCount 0 NewHead: Offset 113 PartNo 0 PackedSize 25252 count 2 nextOffset 115 batches 1
2025-10-10T14:57:32.477075Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 116 partNo 0
2025-10-10T14:57:32.477098Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 116 partNo 0 FormedBlobsCount 0 NewHead: Offset 113 PartNo 0 PackedSize 38027 count 3 nextOffset 116 batches 1
2025-10-10T14:57:32.477114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.477692Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 113,3 HeadOffset 113 endOffset 113 curOffset 116 d0000000000_00000000000000000113_00000_0000000003_00000? size 37993 WTime 1760108252477
2025-10-10T14:57:32.477894Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.477963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 197  requestId: <none> cookie: 97
2025-10-10T14:57:32.478020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 198  requestId: <none> cookie: 98
2025-10-10T14:57:32.478044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 199  requestId: <none> cookie: 99
2025-10-10T14:57:32.478069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 200  requestId: <none> cookie: 100
2025-10-10T14:57:32.478093Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 201  requestId: <none> cookie: 101
2025-10-10T14:57:32.478119Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 207  requestId: <none> cookie: 102
2025-10-10T14:57:32.478144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 208  requestId: <none> cookie: 103
2025-10-10T14:57:32.478169Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 209  requestId: <none> cookie: 104
2025-10-10T14:57:32.478192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 210  requestId: <none> cookie: 105
2025-10-10T14:57:32.478216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 211  requestId: <none> cookie: 106
2025-10-10T14:57:32.478240Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 217  requestId: <none> cookie: 107
2025-10-10T14:57:32.478265Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 218  requestId: <none> cookie: 108
2025-10-10T14:57:32.478290Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 219  requestId: <none> cookie: 109
2025-10-10T14:57:32.478314Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 220  requestId: <none> cookie: 110
2025-10-10T14:57:32.478337Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 221  requestId: <none> cookie: 111
2025-10-10T14:57:32.478365Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 227  requestId: <none> cookie: 112
2025-10-10T14:57:32.478390Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 228  requestId: <none> cookie: 113
2025-10-10T14:57:32.478488Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.478508Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.478553Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.478657Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 113 partNo 0 count 3 size 37993
2025-10-10T14:57:32.478896Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 96 count 20 size 235386 endOffset 113 max time lag 0ms effective offset 96
2025-10-10T14:57:32.479059Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 196155 count 17 last offset 96, current partition end offset: 113
2025-10-10T14:57:32.479072Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-10T14:57:32.479115Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 96 partno 0 count 17 parts_count 0 source 1 size 196155 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.479139Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-10T14:57:32.479178Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.480089Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 96 totakecount 17 count 17 size 196133 from pos 0 cbcount 17
2025-10-10T14:57:32.480300Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 96
2025-10-10T14:57:32.481311Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 96 partno 0 count 17 parts 0 suffix '63'
2025-10-10T14:57:32.483602Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 113 Result { Offset: 96 Data: "... 10643 bytes ..." SourceId: "\000src_id" SeqNo: 97 WriteTimestampMS: 1760108252456 CreateTimestampMS: 1760108252082 UncompressedSize: 10571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 97 Data: "... 10753 bytes ..." SourceId: "\000src_id" SeqNo: 98 WriteTimestampMS: 1760108252456 CreateTimestampMS: 1760108252082 UncompressedSize: 10681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 98 Data: "... 10863 bytes ..." SourceId: "\000src_id" SeqNo: 99 WriteTimestampMS: 1760108252457 CreateTimestampMS: 1760108252082 UncompressedSize: 10791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 99 Data: "... 10973 bytes ..." SourceId: "\000src_id" SeqNo: 100 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252082 UncompressedSize: 10901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 100 Data: "... 11083 bytes ..." SourceId: "\000src_id" SeqNo: 101 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252082 UncompressedSize: 11011 PartitionKey: "" ExplicitHash: "" } Result { Offset: 101 Data: "... 11193 bytes ..." SourceId: "\000src_id" SeqNo: 102 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252086 UncompressedSize: 11121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 102 Data: "... 11303 bytes ..." SourceId: "\000src_id" SeqNo: 103 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252087 UncompressedSize: 11231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 103 Data: "... 11413 bytes ..." SourceId: "\000src_id" SeqNo: 104 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252087 UncompressedSize: 11341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 104 Data: "... 11523 bytes ..." SourceId: "\000src_id" SeqNo: 105 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252087 UncompressedSize: 11451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 105 Data: "... 11633 bytes ..." SourceId: "\000src_id" SeqNo: 106 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252087 UncompressedSize: 11561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 106 Data: "... 11743 bytes ..." SourceId: "\000src_id" SeqNo: 107 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252087 UncompressedSize: 11671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 107 Data: "... 11853 bytes ..." SourceId: "\000src_id" SeqNo: 108 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252087 UncompressedSize: 11781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 108 Data: "... 11963 bytes ..." SourceId: "\000src_id" SeqNo: 109 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252087 UncompressedSize: 11891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 109 Data: "... 12073 bytes ..." SourceId: "\000src_id" SeqNo: 110 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252088 UncompressedSize: 12001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 110 Data: "... 12183 bytes ..." SourceId: "\000src_id" SeqNo: 111 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252088 UncompressedSize: 12111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 111 Data: "... 12293 bytes ..." SourceId: "\000src_id" SeqNo: 112 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252101 UncompressedSize: 12221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 112 Data: "... 12403 bytes ..." SourceId: "\000src_id" SeqNo: 113 WriteTimestampMS: 1760108252458 CreateTimestampMS: 1760108252101 UncompressedSize: 12331 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551166 RealReadOffset: 112 WaitQuotaTimeMs: 0 EndOffset: 113 StartOffset: 0 } Cookie: 96 }
2025-10-10T14:57:32.484086Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 113
2025-10-10T14:57:32.484132Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 113 ReadOffset 113 ReadGuid 70bda6c2-86161b3a-73f713ca-d67c75a5 has messages 1
2025-10-10T14:57:32.484268Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 70bda6c2-86161b3a-73f713ca-d67c75a5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 195615
2025-10-10T14:57:32.484300Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 70bda6c2-86161b3a-73f713ca-d67c75a5
2025-10-10T14:57:32.484757Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.486024Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 195615, now ReadSizeBudget = 0, ReadSizeServerDelta = 328673
2025-10-10T14:57:32.486170Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 328673
2025-10-10T14:57:32.486317Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (96-112)
2025-10-10T14:57:32.486356Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 195615 to budget
2025-10-10T14:57:32.486386Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 195615, ReadSizeServerDelta = 328673
2025-10-10T14:57:32.486596Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.486690Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (96-96)
2025-10-10T14:57:32.486780Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (97-97)
2025-10-10T14:57:32.486879Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (98-98)
2025-10-10T14:57:32.486939Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (99-99)
2025-10-10T14:57:32.487097Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (100-100)
2025-10-10T14:57:32.487170Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (101-101)
2025-10-10T14:57:32.487227Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 3} (102-102)
2025-10-10T14:57:32.487282Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 4} (103-103)
2025-10-10T14:57:32.487541Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 5} (104-104)
2025-10-10T14:57:32.487609Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 6} (105-105)
2025-10-10T14:57:32.487667Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 7} (106-106)
2025-10-10T14:57:32.487722Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 8} (107-107)
2025-10-10T14:57:32.487775Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 9} (108-108)
2025-10-10T14:57:32.487833Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 10} (109-109)
2025-10-10T14:57:32.487867Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 11} (110-110)
2025-10-10T14:57:32.487905Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 12} (111-111)
2025-10-10T14:57:32.488324Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 13} (112-112)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..10571 bytes.. Information: { Offset: 96 ProducerId: "src_id" SeqNo: 97 CreateTime: 2025-10-10T14:57:32.082000Z WriteTime: 2025-10-10T14:57:32.456000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10681 bytes.. Information: { Offset: 97 ProducerId: "src_id" SeqNo: 98 CreateTime: 2025-10-10T14:57:32.082000Z WriteTime: 2025-10-10T14:57:32.456000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10791 bytes.. Information: { Offset: 98 ProducerId: "src_id" SeqNo: 99 CreateTime: 2025-10-10T14:57:32.082000Z WriteTime: 2025-10-10T14:57:32.457000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10901 bytes.. Information: { Offset: 99 ProducerId: "src_id" SeqNo: 100 CreateTime: 2025-10-10T14:57:32.082000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11011 bytes.. Information: { Offset: 100 ProducerId: "src_id" SeqNo: 101 CreateTime: 2025-10-10T14:57:32.082000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11121 bytes.. Information: { Offset: 101 ProducerId: "src_id" SeqNo: 102 CreateTime: 2025-10-10T14:57:32.086000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11231 bytes.. Information: { Offset: 102 ProducerId: "src_id" SeqNo: 103 CreateTime: 2025-10-10T14:57:32.087000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11341 bytes.. Information: { Offset: 103 ProducerId: "src_id" SeqNo: 104 CreateTime: 2025-10-10T14:57:32.087000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11451 bytes.. Information: { Offset: 104 ProducerId: "src_id" SeqNo: 105 CreateTime: 2025-10-10T14:57:32.087000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11561 bytes.. Information: { Offset: 105 ProducerId: "src_id" SeqNo: 106 CreateTime: 2025-10-10T14:57:32.087000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11671 bytes.. Information: { Offset: 106 ProducerId: "src_id" SeqNo: 107 CreateTime: 2025-10-10T14:57:32.087000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11781 bytes.. Information: { Offset: 107 ProducerId: "src_id" SeqNo: 108 CreateTime: 2025-10-10T14:57:32.087000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11891 bytes.. Information: { Offset: 108 ProducerId: "src_id" SeqNo: 109 CreateTime: 2025-10-10T14:57:32.087000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12001 bytes.. Information: { Offset: 109 ProducerId: "src_id" SeqNo: 110 CreateTime: 2025-10-10T14:57:32.088000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12111 bytes.. Information: { Offset: 110 ProducerId: "src_id" SeqNo: 111 CreateTime: 2025-10-10T14:57:32.088000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12221 bytes.. Information: { Offset: 111 ProducerId: "src_id" SeqNo: 112 CreateTime: 2025-10-10T14:57:32.101000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12331 bytes.. Information: { Offset: 112 ProducerId: "src_id" SeqNo: 113 CreateTime: 2025-10-10T14:57:32.101000Z WriteTime: 2025-10-10T14:57:32.458000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.491697Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 17, size 194667 bytes
2025-10-10T14:57:32.491736Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.492043Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 195615 } }
2025-10-10T14:57:32.492191Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 5005ddd0-93e008be-89750dd5-b0ce2971
2025-10-10T14:57:32.495276Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 113 count 3 size 37993 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.495335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.495388Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 37890 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.495418Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.495450Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 114, partNo: 0, Offset: 113 is stored on disk
2025-10-10T14:57:32.495473Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.495493Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 115, partNo: 0, Offset: 114 is stored on disk
2025-10-10T14:57:32.495512Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.495535Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 116, partNo: 0, Offset: 115 is stored on disk
2025-10-10T14:57:32.496003Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 113 EndOffset 113 newEndOffset 116 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-10-10T14:57:32.496034Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 113 endOffset 116
2025-10-10T14:57:32.496076Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 113, endOffset# 116, WTime# 1760108252458, sizeLag# 37993
2025-10-10T14:57:32.496091Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.496131Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 8ed2a7ba-150f9b1a-cf357abd-fd44cf8a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 45591, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.496181Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 45591 maxTimeLagMs 0 readTimestampMs 0 readOffset 113 EndOffset 116 ClientCommitOffset 0 committedOffset 0 Guid 8ed2a7ba-150f9b1a-cf357abd-fd44cf8a
2025-10-10T14:57:32.495680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.495696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.495707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.495733Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.495737Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 113 partno 0 count 3 parts 0 suffix '63' size 37993
2025-10-10T14:57:32.495776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 229  requestId: <none> cookie: 114
2025-10-10T14:57:32.495813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 230  requestId: <none> cookie: 115
2025-10-10T14:57:32.495842Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 231  requestId: <none> cookie: 116
2025-10-10T14:57:32.496469Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.496491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.496571Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 113 count 3 size 45591 endOffset 116 max time lag 0ms effective offset 113
2025-10-10T14:57:32.496707Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 37993 count 3 last offset 113, current partition end offset: 116
2025-10-10T14:57:32.496727Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-10T14:57:32.496770Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 113 partno 0 count 3 parts_count 0 source 1 size 37993 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.496796Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-10T14:57:32.496852Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.497071Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 113 totakecount 3 count 3 size 37971 from pos 0 cbcount 3
2025-10-10T14:57:32.497193Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 113
2025-10-10T14:57:32.497247Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 113 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:57:32.498714Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 38006, now ReadSizeBudget = 0, ReadSizeServerDelta = 486282
2025-10-10T14:57:32.498815Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 486282
2025-10-10T14:57:32.498951Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (113-115)
2025-10-10T14:57:32.498983Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 38006 to budget
2025-10-10T14:57:32.499014Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 38006, ReadSizeServerDelta = 486282
2025-10-10T14:57:32.499209Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.499301Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (113-113)
2025-10-10T14:57:32.499378Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (114-114)
2025-10-10T14:57:32.499464Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (115-115)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..12441 bytes.. Information: { Offset: 113 ProducerId: "src_id" SeqNo: 114 CreateTime: 2025-10-10T14:57:32.102000Z WriteTime: 2025-10-10T14:57:32.472000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12551 bytes.. Information: { Offset: 114 ProducerId: "src_id" SeqNo: 115 CreateTime: 2025-10-10T14:57:32.102000Z WriteTime: 2025-10-10T14:57:32.474000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12661 bytes.. Information: { Offset: 115 ProducerId: "src_id" SeqNo: 116 CreateTime: 2025-10-10T14:57:32.102000Z WriteTime: 2025-10-10T14:57:32.474000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.499942Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 3, size 37653 bytes
2025-10-10T14:57:32.499976Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.497800Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 116 Result { Offset: 113 Data: "... 12513 bytes ..." SourceId: "\000src_id" SeqNo: 114 WriteTimestampMS: 1760108252472 CreateTimestampMS: 1760108252102 UncompressedSize: 12441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 114 Data: "... 12623 bytes ..." SourceId: "\000src_id" SeqNo: 115 WriteTimestampMS: 1760108252474 CreateTimestampMS: 1760108252102 UncompressedSize: 12551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 115 Data: "... 12733 bytes ..." SourceId: "\000src_id" SeqNo: 116 WriteTimestampMS: 1760108252474 CreateTimestampMS: 1760108252102 UncompressedSize: 12661 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551614 RealReadOffset: 115 WaitQuotaTimeMs: 0 EndOffset: 116 StartOffset: 0 } Cookie: 113 }
2025-10-10T14:57:32.497927Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 116
2025-10-10T14:57:32.497950Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 116 ReadOffset 116 ReadGuid 8ed2a7ba-150f9b1a-cf357abd-fd44cf8a has messages 1
2025-10-10T14:57:32.498031Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 8ed2a7ba-150f9b1a-cf357abd-fd44cf8a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 38006
2025-10-10T14:57:32.498055Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 8ed2a7ba-150f9b1a-cf357abd-fd44cf8a
2025-10-10T14:57:32.498282Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.501435Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 38006 } }
2025-10-10T14:57:32.501539Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 7c2d7735-50b0d3b0-2b15385c-e2b25f85
2025-10-10T14:57:32.513951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.513981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.513995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.543325Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543387Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543413Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543440Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543490Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543526Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543554Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543580Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543604Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543723Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543750Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543772Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543795Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543819Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543843Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543866Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543890Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543914Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543941Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543966Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.543991Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.544018Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.544044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.544070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.544095Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.544120Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.544146Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.544174Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.544219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.545450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 77 offsets: 76 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:32.545491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 77
2025-10-10T14:57:32.545801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 78 offsets: 77 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:32.545829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 78
2025-10-10T14:57:32.545983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 79 offsets: 78 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:32.546009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 79
2025-10-10T14:57:32.546115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 80 offsets: 79 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:32.546135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 80
2025-10-10T14:57:32.546231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 81 offsets: 80 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:32.546250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 81
2025-10-10T14:57:32.545678Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.546335Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.545720Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.546593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 82 offsets: 81 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.546418Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.546471Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.546630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 82
2025-10-10T14:57:32.546513Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.546551Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.546742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 83 offsets: 82 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.546762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 83
2025-10-10T14:57:32.546860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 84 offsets: 83 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.546878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 84
2025-10-10T14:57:32.546980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 85 offsets: 84 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.545787Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 117 partNo : 0 messageNo: 237 size 12843 offset: -1
2025-10-10T14:57:32.547002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 85
2025-10-10T14:57:32.545885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.545898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.545923Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 118 partNo : 0 messageNo: 238 size 12953 offset: -1
2025-10-10T14:57:32.545978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.547106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 86 offsets: 85 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.545989Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.547126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 86
2025-10-10T14:57:32.546011Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 119 partNo : 0 messageNo: 239 size 13063 offset: -1
2025-10-10T14:57:32.546065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.546075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.546094Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 120 partNo : 0 messageNo: 240 size 13173 offset: -1
2025-10-10T14:57:32.547235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 87 offsets: 86 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.546142Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.546153Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.547260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 87
2025-10-10T14:57:32.546170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 121 partNo : 0 messageNo: 241 size 13283 offset: -1
2025-10-10T14:57:32.546194Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.546241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.546264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.546274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:57:32.546389Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 117 partNo 0
2025-10-10T14:57:32.547381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 88 offsets: 87 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.547400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 88
2025-10-10T14:57:32.547487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 89 offsets: 88 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.547504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 89
2025-10-10T14:57:32.547238Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.547593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 90 offsets: 89 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.547611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 90
2025-10-10T14:57:32.547703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 91 offsets: 90 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.547722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 91
2025-10-10T14:57:32.549613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 92 offsets: 91 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 4 }
2025-10-10T14:57:32.549645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 92
2025-10-10T14:57:32.549789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 93 offsets: 92 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 4 }
2025-10-10T14:57:32.549809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 93
2025-10-10T14:57:32.549914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 94 offsets: 93 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 4 }
2025-10-10T14:57:32.549935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 94
2025-10-10T14:57:32.550037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 95 offsets: 94 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 4 }
2025-10-10T14:57:32.550060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 95
2025-10-10T14:57:32.550171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 96 offsets: 95 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 4 }
2025-10-10T14:57:32.550192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 96
2025-10-10T14:57:32.550291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 97 offsets: 96 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:32.550310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 97
2025-10-10T14:57:32.550400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 98 offsets: 97 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:32.550418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 98
2025-10-10T14:57:32.553474Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.556281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 99 offsets: 98 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:32.556321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 99
2025-10-10T14:57:32.556480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 100 offsets: 99 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 20 }
2025-10-10T14:57:32.556504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 100
2025-10-10T14:57:32.556609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 101 offsets: 100 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 20 }
2025-10-10T14:57:32.556631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 101
2025-10-10T14:57:32.556736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 102 offsets: 101 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 14 }
2025-10-10T14:57:32.556758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 102
2025-10-10T14:57:32.556853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 103 offsets: 102 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 14 }
2025-10-10T14:57:32.556873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 103
2025-10-10T14:57:32.556968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 104 offsets: 103 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 14 }
2025-10-10T14:57:32.556987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 104
2025-10-10T14:57:32.557093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 105 offsets: 104 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 14 }
2025-10-10T14:57:32.557112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 105
2025-10-10T14:57:32.557237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 106 offsets: 105 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 14 }
2025-10-10T14:57:32.557259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 106
2025-10-10T14:57:32.557359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 107 offsets: 106 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.557376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 107
2025-10-10T14:57:32.557490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 108 offsets: 107 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.557511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 108
2025-10-10T14:57:32.557610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 109 offsets: 108 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.557630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 109
2025-10-10T14:57:32.557722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 110 offsets: 109 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.557742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 110
2025-10-10T14:57:32.557856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 111 offsets: 110 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.557876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 111
2025-10-10T14:57:32.557974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 112 offsets: 111 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 4 }
2025-10-10T14:57:32.557993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 112
2025-10-10T14:57:32.558083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 113 offsets: 112 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 4 }
2025-10-10T14:57:32.558104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 113
2025-10-10T14:57:32.558207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 114 offsets: 113 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.558229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 114
2025-10-10T14:57:32.558326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 115 offsets: 114 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.558347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 115
2025-10-10T14:57:32.558446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 116 offsets: 115 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.558466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 116
2025-10-10T14:57:32.561108Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.582070Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 117 partNo 0 FormedBlobsCount 0 NewHead: Offset 116 PartNo 0 PackedSize 12917 count 1 nextOffset 117 batches 1
2025-10-10T14:57:32.582137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.582621Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 116,1 HeadOffset 116 endOffset 116 curOffset 117 d0000000000_00000000000000000116_00000_0000000001_00000? size 12905 WTime 1760108252581
2025-10-10T14:57:32.582804Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.582847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.582859Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.582874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.582884Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.582900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.582913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.582927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.582989Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.583013Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.583052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.583062Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.583089Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.583098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.583132Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.583142Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.583170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.583181Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.583200Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.583321Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 116 partNo 0 count 1 size 12905
2025-10-10T14:57:32.583551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 242  requestId: <none> cookie: 122
2025-10-10T14:57:32.583597Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 243  requestId: <none> cookie: 123
2025-10-10T14:57:32.583613Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 244  requestId: <none> cookie: 124
2025-10-10T14:57:32.583630Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 245  requestId: <none> cookie: 125
2025-10-10T14:57:32.583645Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 246  requestId: <none> cookie: 126
2025-10-10T14:57:32.585929Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.586014Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.586045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.586083Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.586109Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.586454Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.586668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.586711Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.586749Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.586785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.586927Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.587587Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.587631Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.587681Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 122 partNo : 0 messageNo: 247 size 13393 offset: -1
2025-10-10T14:57:32.587744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.587754Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.587779Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 123 partNo : 0 messageNo: 248 size 13503 offset: -1
2025-10-10T14:57:32.587826Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.587839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.587863Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 124 partNo : 0 messageNo: 249 size 13613 offset: -1
2025-10-10T14:57:32.587910Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.587920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.587938Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 125 partNo : 0 messageNo: 250 size 13723 offset: -1
2025-10-10T14:57:32.587997Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.588008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.588028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 126 partNo : 0 messageNo: 251 size 13833 offset: -1
2025-10-10T14:57:32.588059Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.588069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.588100Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.588110Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.588137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.588147Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.588174Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.588184Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.588210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.588223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.588293Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.588333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.588347Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.588362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.588373Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.588386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.588395Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.588408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.588420Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.588432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.588872Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 252  requestId: <none> cookie: 127
2025-10-10T14:57:32.588906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 253  requestId: <none> cookie: 128
2025-10-10T14:57:32.588923Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 254  requestId: <none> cookie: 129
2025-10-10T14:57:32.588940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 255  requestId: <none> cookie: 130
2025-10-10T14:57:32.588955Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 256  requestId: <none> cookie: 131
2025-10-10T14:57:32.590028Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.590700Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.591039Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.595590Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 116 count 1 size 12905 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.595651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.595699Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 12850 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.595729Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.595760Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 117, partNo: 0, Offset: 116 is stored on disk
2025-10-10T14:57:32.595973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.596023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.596033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (9)
2025-10-10T14:57:32.596119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 118 partNo 0
2025-10-10T14:57:32.596455Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 116 partno 0 count 1 parts 0 suffix '63' size 12905
2025-10-10T14:57:32.597001Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 118 partNo 0 FormedBlobsCount 0 NewHead: Offset 117 PartNo 0 PackedSize 13027 count 1 nextOffset 118 batches 1
2025-10-10T14:57:32.597047Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 119 partNo 0
2025-10-10T14:57:32.597079Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 119 partNo 0 FormedBlobsCount 0 NewHead: Offset 117 PartNo 0 PackedSize 26132 count 2 nextOffset 119 batches 1
2025-10-10T14:57:32.597103Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 120 partNo 0
2025-10-10T14:57:32.597146Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 120 partNo 0 FormedBlobsCount 0 NewHead: Offset 117 PartNo 0 PackedSize 39347 count 3 nextOffset 120 batches 1
2025-10-10T14:57:32.597170Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 121 partNo 0
2025-10-10T14:57:32.597191Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 121 partNo 0 FormedBlobsCount 0 NewHead: Offset 117 PartNo 0 PackedSize 52672 count 4 nextOffset 121 batches 1
2025-10-10T14:57:32.597211Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 122 partNo 0
2025-10-10T14:57:32.597234Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 122 partNo 0 FormedBlobsCount 0 NewHead: Offset 117 PartNo 0 PackedSize 66107 count 5 nextOffset 122 batches 1
2025-10-10T14:57:32.597254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 123 partNo 0
2025-10-10T14:57:32.597274Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 123 partNo 0 FormedBlobsCount 0 NewHead: Offset 117 PartNo 0 PackedSize 79652 count 6 nextOffset 123 batches 1
2025-10-10T14:57:32.597291Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 124 partNo 0
2025-10-10T14:57:32.597307Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 124 partNo 0 FormedBlobsCount 0 NewHead: Offset 117 PartNo 0 PackedSize 93307 count 7 nextOffset 124 batches 1
2025-10-10T14:57:32.597326Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 125 partNo 0
2025-10-10T14:57:32.597346Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 125 partNo 0 FormedBlobsCount 0 NewHead: Offset 117 PartNo 0 PackedSize 107072 count 8 nextOffset 125 batches 1
2025-10-10T14:57:32.597364Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 126 partNo 0
2025-10-10T14:57:32.597386Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 126 partNo 0 FormedBlobsCount 0 NewHead: Offset 117 PartNo 0 PackedSize 120947 count 9 nextOffset 126 batches 1
2025-10-10T14:57:32.597399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.598143Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 117,9 HeadOffset 117 endOffset 117 curOffset 126 d0000000000_00000000000000000117_00000_0000000009_00000? size 120721 WTime 1760108252597
2025-10-10T14:57:32.598297Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.598355Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 237  requestId: <none> cookie: 117
2025-10-10T14:57:32.598471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.598491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.598537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 127 partNo : 0 messageNo: 257 size 13943 offset: -1
2025-10-10T14:57:32.598595Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.598605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.598627Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 128 partNo : 0 messageNo: 258 size 14054 offset: -1
2025-10-10T14:57:32.598673Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.598681Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.598700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 129 partNo : 0 messageNo: 259 size 14164 offset: -1
2025-10-10T14:57:32.598742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.598752Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.598770Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 130 partNo : 0 messageNo: 260 size 14274 offset: -1
2025-10-10T14:57:32.598827Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.598839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.598859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 131 partNo : 0 messageNo: 261 size 14384 offset: -1
2025-10-10T14:57:32.598888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.598898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.598928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.598937Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.598962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.598971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.598994Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.599020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.599054Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.599065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.599129Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.599140Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.599178Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.599276Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 117 partNo 0 count 9 size 120721
2025-10-10T14:57:32.599308Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.599343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.599355Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.599370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.599380Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.599394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.599404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.599423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.599435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.599446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.599662Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 262  requestId: <none> cookie: 132
2025-10-10T14:57:32.599694Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 263  requestId: <none> cookie: 133
2025-10-10T14:57:32.599713Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 264  requestId: <none> cookie: 134
2025-10-10T14:57:32.599728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 265  requestId: <none> cookie: 135
2025-10-10T14:57:32.599746Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 266  requestId: <none> cookie: 136
2025-10-10T14:57:32.599825Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 116 count 1 size 15486 endOffset 117 max time lag 0ms effective offset 116
2025-10-10T14:57:32.599979Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 12905 count 1 last offset 116, current partition end offset: 117
2025-10-10T14:57:32.599993Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-10T14:57:32.600042Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 116 partno 0 count 1 parts_count 0 source 1 size 12905 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.600063Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-10T14:57:32.600103Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.600208Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 116 totakecount 1 count 1 size 12885 from pos 0 cbcount 1
2025-10-10T14:57:32.600282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 116
2025-10-10T14:57:32.595437Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.595501Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.595532Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.595561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.595588Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.595926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.596098Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.596140Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.596187Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.596234Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.597103Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 116 EndOffset 116 newEndOffset 117 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-10-10T14:57:32.597145Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 116 endOffset 117
2025-10-10T14:57:32.597195Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 116, endOffset# 117, WTime# 1760108252474, sizeLag# 12905
2025-10-10T14:57:32.597208Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.597251Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 3a22b99f-e5d7983d-dbd095d4-2a99d098, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 15486, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.597302Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 15486 maxTimeLagMs 0 readTimestampMs 0 readOffset 116 EndOffset 117 ClientCommitOffset 0 committedOffset 0 Guid 3a22b99f-e5d7983d-dbd095d4-2a99d098
2025-10-10T14:57:32.601824Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.602903Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 117 Result { Offset: 116 Data: "... 12843 bytes ..." SourceId: "\000src_id" SeqNo: 117 WriteTimestampMS: 1760108252544 CreateTimestampMS: 1760108252103 UncompressedSize: 12771 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 116 WaitQuotaTimeMs: 0 EndOffset: 117 StartOffset: 0 } Cookie: 116 }
2025-10-10T14:57:32.603002Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 117
2025-10-10T14:57:32.603037Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 117 ReadOffset 117 ReadGuid 3a22b99f-e5d7983d-dbd095d4-2a99d098 has messages 1
2025-10-10T14:57:32.603131Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 3a22b99f-e5d7983d-dbd095d4-2a99d098, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 12935
2025-10-10T14:57:32.603154Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 3a22b99f-e5d7983d-dbd095d4-2a99d098
2025-10-10T14:57:32.603389Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.603473Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.603517Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.603552Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.603580Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.603608Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.603638Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.603672Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.604266Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.601603Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 116 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:57:32.605628Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 12935, now ReadSizeBudget = 0, ReadSizeServerDelta = 511353
2025-10-10T14:57:32.605713Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 511353
2025-10-10T14:57:32.605958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 117 offsets: 116 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 37 }
2025-10-10T14:57:32.605992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 117
2025-10-10T14:57:32.606478Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (116-116)
2025-10-10T14:57:32.606531Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 12935 to budget
2025-10-10T14:57:32.606562Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 12935, ReadSizeServerDelta = 511353
2025-10-10T14:57:32.606740Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.606799Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (116-116)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..12771 bytes.. Information: { Offset: 116 ProducerId: "src_id" SeqNo: 117 CreateTime: 2025-10-10T14:57:32.103000Z WriteTime: 2025-10-10T14:57:32.544000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.607047Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 1, size 12771 bytes
2025-10-10T14:57:32.607079Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.604314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.604358Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.604393Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.604436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.607873Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 12935 } }
2025-10-10T14:57:32.607963Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 15d800cc-4caa0ed4-48650cbc-d849a565
2025-10-10T14:57:32.608006Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.608574Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.608728Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.608847Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.609304Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.608334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.608424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 132 partNo : 0 messageNo: 267 size 14494 offset: -1
2025-10-10T14:57:32.608498Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.608535Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 133 partNo : 0 messageNo: 268 size 14604 offset: -1
2025-10-10T14:57:32.608587Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608597Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.608617Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 134 partNo : 0 messageNo: 269 size 14714 offset: -1
2025-10-10T14:57:32.608660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608670Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.608689Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 135 partNo : 0 messageNo: 270 size 14824 offset: -1
2025-10-10T14:57:32.608743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.608775Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 136 partNo : 0 messageNo: 271 size 14934 offset: -1
2025-10-10T14:57:32.608804Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608815Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.608845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608856Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.608882Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608892Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.608917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608929Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.608954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.608962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.609055Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.609097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.609109Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.609147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.609159Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.609173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.609184Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.609197Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.609207Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.609222Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.609666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 272  requestId: <none> cookie: 137
2025-10-10T14:57:32.609700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 273  requestId: <none> cookie: 138
2025-10-10T14:57:32.609717Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 274  requestId: <none> cookie: 139
2025-10-10T14:57:32.609734Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 275  requestId: <none> cookie: 140
2025-10-10T14:57:32.609749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 276  requestId: <none> cookie: 141
2025-10-10T14:57:32.611319Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.611380Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.611411Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.611440Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.611467Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.611751Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.611887Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.611925Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.611959Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.611994Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.612109Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.613529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.613564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.613612Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 137 partNo : 0 messageNo: 277 size 15044 offset: -1
2025-10-10T14:57:32.613678Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.613688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.613710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 138 partNo : 0 messageNo: 278 size 15154 offset: -1
2025-10-10T14:57:32.613771Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.613782Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.613803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 139 partNo : 0 messageNo: 279 size 15264 offset: -1
2025-10-10T14:57:32.613847Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.613855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.613875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 140 partNo : 0 messageNo: 280 size 15374 offset: -1
2025-10-10T14:57:32.613920Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.613933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.613953Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 141 partNo : 0 messageNo: 281 size 15484 offset: -1
2025-10-10T14:57:32.613982Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.613992Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.614024Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.614035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.614062Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.614072Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.614098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.614107Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.614133Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.614143Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.614300Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.614339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.614351Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.614368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.614380Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.614393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.614404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.614417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.614427Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.614441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.614547Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 117 count 9 size 120721 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.614597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.614619Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 282  requestId: <none> cookie: 142
2025-10-10T14:57:32.614645Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 283  requestId: <none> cookie: 143
2025-10-10T14:57:32.614662Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 284  requestId: <none> cookie: 144
2025-10-10T14:57:32.614679Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 285  requestId: <none> cookie: 145
2025-10-10T14:57:32.614695Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 286  requestId: <none> cookie: 146
2025-10-10T14:57:32.614713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.614755Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 120600 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.614782Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.614810Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 118, partNo: 0, Offset: 117 is stored on disk
2025-10-10T14:57:32.614828Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.614846Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 119, partNo: 0, Offset: 118 is stored on disk
2025-10-10T14:57:32.614857Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.614878Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 120, partNo: 0, Offset: 119 is stored on disk
2025-10-10T14:57:32.614893Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.614913Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 121, partNo: 0, Offset: 120 is stored on disk
2025-10-10T14:57:32.614924Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.614944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 122, partNo: 0, Offset: 121 is stored on disk
2025-10-10T14:57:32.614955Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.614974Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 123, partNo: 0, Offset: 122 is stored on disk
2025-10-10T14:57:32.614985Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.615005Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 124, partNo: 0, Offset: 123 is stored on disk
2025-10-10T14:57:32.615016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.615035Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 125, partNo: 0, Offset: 124 is stored on disk
2025-10-10T14:57:32.615047Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.615065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 126, partNo: 0, Offset: 125 is stored on disk
2025-10-10T14:57:32.615243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.615310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.615321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:57:32.615404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 127 partNo 0
2025-10-10T14:57:32.616307Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 127 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 14017 count 1 nextOffset 127 batches 1
2025-10-10T14:57:32.616366Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 128 partNo 0
2025-10-10T14:57:32.616402Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 128 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 28113 count 2 nextOffset 128 batches 1
2025-10-10T14:57:32.616425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 129 partNo 0
2025-10-10T14:57:32.616450Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 129 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 42319 count 3 nextOffset 129 batches 1
2025-10-10T14:57:32.616473Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 130 partNo 0
2025-10-10T14:57:32.616493Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 130 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 56635 count 4 nextOffset 130 batches 1
2025-10-10T14:57:32.616513Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 131 partNo 0
2025-10-10T14:57:32.616536Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 131 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 71061 count 5 nextOffset 131 batches 1
2025-10-10T14:57:32.617551Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.616556Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 132 partNo 0
2025-10-10T14:57:32.617603Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.616576Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 132 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 85597 count 6 nextOffset 132 batches 1
2025-10-10T14:57:32.617654Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.616598Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 133 partNo 0
2025-10-10T14:57:32.617684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.617713Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.616617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 133 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 100243 count 7 nextOffset 133 batches 1
2025-10-10T14:57:32.616637Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 134 partNo 0
2025-10-10T14:57:32.617741Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.616656Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 134 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 114999 count 8 nextOffset 134 batches 1
2025-10-10T14:57:32.618309Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.616677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 135 partNo 0
2025-10-10T14:57:32.618362Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.616700Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 135 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 129865 count 9 nextOffset 135 batches 1
2025-10-10T14:57:32.618398Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.618437Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.616720Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 136 partNo 0
2025-10-10T14:57:32.618472Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.616740Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 136 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 144841 count 10 nextOffset 136 batches 1
2025-10-10T14:57:32.618628Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 117 EndOffset 117 newEndOffset 126 commitOffset 0 clientCommitOffset 0 cookie 11 readingFinished 0 firstRead 0
2025-10-10T14:57:32.616761Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 137 partNo 0
2025-10-10T14:57:32.618650Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 117 endOffset 126
2025-10-10T14:57:32.616781Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 137 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 159927 count 11 nextOffset 137 batches 1
2025-10-10T14:57:32.618689Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 117, endOffset# 126, WTime# 1760108252544, sizeLag# 120721
2025-10-10T14:57:32.616800Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 138 partNo 0
2025-10-10T14:57:32.618704Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.616820Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 138 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 175123 count 12 nextOffset 138 batches 1
2025-10-10T14:57:32.618750Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 46b94c5b-7e0e4f3-135138b6-af9d61e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 144865, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.616840Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 139 partNo 0
2025-10-10T14:57:32.618804Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 144865 maxTimeLagMs 0 readTimestampMs 0 readOffset 117 EndOffset 126 ClientCommitOffset 0 committedOffset 0 Guid 46b94c5b-7e0e4f3-135138b6-af9d61e
2025-10-10T14:57:32.616860Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 139 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 190429 count 13 nextOffset 139 batches 1
2025-10-10T14:57:32.616879Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 140 partNo 0
2025-10-10T14:57:32.616896Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 140 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 205845 count 14 nextOffset 140 batches 1
2025-10-10T14:57:32.616916Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 141 partNo 0
2025-10-10T14:57:32.616936Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 141 partNo 0 FormedBlobsCount 0 NewHead: Offset 126 PartNo 0 PackedSize 221371 count 15 nextOffset 141 batches 1
2025-10-10T14:57:32.616949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.617256Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 117 partno 0 count 9 parts 0 suffix '63' size 120721
2025-10-10T14:57:32.619578Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.620141Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.620552Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.620770Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.620957Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.625908Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.625975Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.626006Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.626035Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.626062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.622268Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 126,15 HeadOffset 126 endOffset 126 curOffset 141 d0000000000_00000000000000000126_00000_0000000015_00000? size 220953 WTime 1760108252621
2025-10-10T14:57:32.622640Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.622705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 238  requestId: <none> cookie: 118
2025-10-10T14:57:32.622755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 239  requestId: <none> cookie: 119
2025-10-10T14:57:32.622782Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 240  requestId: <none> cookie: 120
2025-10-10T14:57:32.622805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 241  requestId: <none> cookie: 121
2025-10-10T14:57:32.622828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 247  requestId: <none> cookie: 122
2025-10-10T14:57:32.622851Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 248  requestId: <none> cookie: 123
2025-10-10T14:57:32.622875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 249  requestId: <none> cookie: 124
2025-10-10T14:57:32.622900Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 250  requestId: <none> cookie: 125
2025-10-10T14:57:32.622923Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 251  requestId: <none> cookie: 126
2025-10-10T14:57:32.623010Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623029Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 142 partNo : 0 messageNo: 287 size 15594 offset: -1
2025-10-10T14:57:32.623140Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623154Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 143 partNo : 0 messageNo: 288 size 15704 offset: -1
2025-10-10T14:57:32.623231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623242Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623264Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 144 partNo : 0 messageNo: 289 size 15814 offset: -1
2025-10-10T14:57:32.623319Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623329Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623347Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 145 partNo : 0 messageNo: 290 size 15924 offset: -1
2025-10-10T14:57:32.623401Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 146 partNo : 0 messageNo: 291 size 16034 offset: -1
2025-10-10T14:57:32.623467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623542Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623581Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623644Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623654Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623719Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.623731Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.623769Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.623874Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 126 partNo 0 count 15 size 220953
2025-10-10T14:57:32.623906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.623947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.623960Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.623975Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.623987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.624004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.624015Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.624029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.624039Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.624054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.624249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 292  requestId: <none> cookie: 147
2025-10-10T14:57:32.624276Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 293  requestId: <none> cookie: 148
2025-10-10T14:57:32.624293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 294  requestId: <none> cookie: 149
2025-10-10T14:57:32.624310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 295  requestId: <none> cookie: 150
2025-10-10T14:57:32.624329Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 296  requestId: <none> cookie: 151
2025-10-10T14:57:32.624415Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 117 count 10 size 144865 endOffset 126 max time lag 0ms effective offset 117
2025-10-10T14:57:32.624574Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 1 blobs, size 120721 count 9 last offset 117, current partition end offset: 126
2025-10-10T14:57:32.624587Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-10T14:57:32.624635Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 117 partno 0 count 9 parts_count 0 source 1 size 120721 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.624658Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 14. All 1 blobs are from cache.
2025-10-10T14:57:32.624716Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.625528Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 117 partno 0 count 9 parts 0 suffix '63'
2025-10-10T14:57:32.629277Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 117 totakecount 9 count 9 size 120699 from pos 0 cbcount 9
2025-10-10T14:57:32.629605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 117
2025-10-10T14:57:32.629456Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.629496Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.629557Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.629587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.629626Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.629664Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.629691Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.629718Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.629747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.630690Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.630805Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.630842Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.630875Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.630911Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.636950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 118 offsets: 117 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.636987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 118
2025-10-10T14:57:32.637210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 119 offsets: 118 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.637239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 119
2025-10-10T14:57:32.637367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 120 offsets: 119 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.637390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 120
2025-10-10T14:57:32.637495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 121 offsets: 120 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.637513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 121
2025-10-10T14:57:32.637613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 122 offsets: 121 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.637635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 122
2025-10-10T14:57:32.637737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 123 offsets: 122 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.637774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 123
2025-10-10T14:57:32.637899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 124 offsets: 123 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.637924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 124
2025-10-10T14:57:32.638021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 125 offsets: 124 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.638042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 125
2025-10-10T14:57:32.638148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 126 offsets: 125 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:32.638168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 126
2025-10-10T14:57:32.637889Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.637926Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.637979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 147 partNo : 0 messageNo: 297 size 16144 offset: -1
2025-10-10T14:57:32.638047Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.638060Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.638085Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 148 partNo : 0 messageNo: 298 size 16254 offset: -1
2025-10-10T14:57:32.638150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.638162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.638183Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 149 partNo : 0 messageNo: 299 size 16364 offset: -1
2025-10-10T14:57:32.638246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.638257Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.638278Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 150 partNo : 0 messageNo: 300 size 16475 offset: -1
2025-10-10T14:57:32.638332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.638345Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.638364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 151 partNo : 0 messageNo: 301 size 16585 offset: -1
2025-10-10T14:57:32.638395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.638404Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.638434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.638443Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.638466Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.638478Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.638503Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.638512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.638535Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.638545Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.638567Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.638607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.638620Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.638637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.638651Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.638664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.638673Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.638688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.638699Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.638712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.638806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 302  requestId: <none> cookie: 152
2025-10-10T14:57:32.638869Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 303  requestId: <none> cookie: 153
2025-10-10T14:57:32.638896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 304  requestId: <none> cookie: 154
2025-10-10T14:57:32.638919Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 305  requestId: <none> cookie: 155
2025-10-10T14:57:32.638936Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 306  requestId: <none> cookie: 156
2025-10-10T14:57:32.642242Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 120447, now ReadSizeBudget = 0, ReadSizeServerDelta = 403841
2025-10-10T14:57:32.642356Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 403841
2025-10-10T14:57:32.642493Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (117-125)
2025-10-10T14:57:32.642530Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 120447 to budget
2025-10-10T14:57:32.642561Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 120447, ReadSizeServerDelta = 403841
2025-10-10T14:57:32.642732Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.642793Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (117-117)
2025-10-10T14:57:32.642896Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (118-118)
2025-10-10T14:57:32.642982Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (119-119)
2025-10-10T14:57:32.643082Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (120-120)
2025-10-10T14:57:32.643203Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (121-121)
2025-10-10T14:57:32.643254Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (122-122)
2025-10-10T14:57:32.643305Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (123-123)
2025-10-10T14:57:32.643364Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (124-124)
2025-10-10T14:57:32.643550Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (125-125)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..12881 bytes.. Information: { Offset: 117 ProducerId: "src_id" SeqNo: 118 CreateTime: 2025-10-10T14:57:32.103000Z WriteTime: 2025-10-10T14:57:32.593000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12991 bytes.. Information: { Offset: 118 ProducerId: "src_id" SeqNo: 119 CreateTime: 2025-10-10T14:57:32.103000Z WriteTime: 2025-10-10T14:57:32.593000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13101 bytes.. Information: { Offset: 119 ProducerId: "src_id" SeqNo: 120 CreateTime: 2025-10-10T14:57:32.103000Z WriteTime: 2025-10-10T14:57:32.593000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13211 bytes.. Information: { Offset: 120 ProducerId: "src_id" SeqNo: 121 CreateTime: 2025-10-10T14:57:32.103000Z WriteTime: 2025-10-10T14:57:32.597000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13321 bytes.. Information: { Offset: 121 ProducerId: "src_id" SeqNo: 122 CreateTime: 2025-10-10T14:57:32.103000Z WriteTime: 2025-10-10T14:57:32.597000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13431 bytes.. Information: { Offset: 122 ProducerId: "src_id" SeqNo: 123 CreateTime: 2025-10-10T14:57:32.103000Z WriteTime: 2025-10-10T14:57:32.597000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13541 bytes.. Information: { Offset: 123 ProducerId: "src_id" SeqNo: 124 CreateTime: 2025-10-10T14:57:32.104000Z WriteTime: 2025-10-10T14:57:32.597000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13651 bytes.. Information: { Offset: 124 ProducerId: "src_id" SeqNo: 125 CreateTime: 2025-10-10T14:57:32.104000Z WriteTime: 2025-10-10T14:57:32.597000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13761 bytes.. Information: { Offset: 125 ProducerId: "src_id" SeqNo: 126 CreateTime: 2025-10-10T14:57:32.104000Z WriteTime: 2025-10-10T14:57:32.597000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.644732Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 9, size 119889 bytes
2025-10-10T14:57:32.644778Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.638442Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.639458Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 126 Result { Offset: 117 Data: "... 12953 bytes ..." SourceId: "\000src_id" SeqNo: 118 WriteTimestampMS: 1760108252593 CreateTimestampMS: 1760108252103 UncompressedSize: 12881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 118 Data: "... 13063 bytes ..." SourceId: "\000src_id" SeqNo: 119 WriteTimestampMS: 1760108252593 CreateTimestampMS: 1760108252103 UncompressedSize: 12991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 119 Data: "... 13173 bytes ..." SourceId: "\000src_id" SeqNo: 120 WriteTimestampMS: 1760108252593 CreateTimestampMS: 1760108252103 UncompressedSize: 13101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 120 Data: "... 13283 bytes ..." SourceId: "\000src_id" SeqNo: 121 WriteTimestampMS: 1760108252597 CreateTimestampMS: 1760108252103 UncompressedSize: 13211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 121 Data: "... 13393 bytes ..." SourceId: "\000src_id" SeqNo: 122 WriteTimestampMS: 1760108252597 CreateTimestampMS: 1760108252103 UncompressedSize: 13321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 122 Data: "... 13503 bytes ..." SourceId: "\000src_id" SeqNo: 123 WriteTimestampMS: 1760108252597 CreateTimestampMS: 1760108252103 UncompressedSize: 13431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 123 Data: "... 13613 bytes ..." SourceId: "\000src_id" SeqNo: 124 WriteTimestampMS: 1760108252597 CreateTimestampMS: 1760108252104 UncompressedSize: 13541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 124 Data: "... 13723 bytes ..." SourceId: "\000src_id" SeqNo: 125 WriteTimestampMS: 1760108252597 CreateTimestampMS: 1760108252104 UncompressedSize: 13651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 125 Data: "... 13833 bytes ..." SourceId: "\000src_id" SeqNo: 126 WriteTimestampMS: 1760108252597 CreateTimestampMS: 1760108252104 UncompressedSize: 13761 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551422 RealReadOffset: 125 WaitQuotaTimeMs: 0 EndOffset: 126 StartOffset: 0 } Cookie: 117 }
2025-10-10T14:57:32.639987Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 12 from offset 126
2025-10-10T14:57:32.640027Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 126 ReadOffset 126 ReadGuid 46b94c5b-7e0e4f3-135138b6-af9d61e has messages 1
2025-10-10T14:57:32.640152Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 46b94c5b-7e0e4f3-135138b6-af9d61e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 120447
2025-10-10T14:57:32.640178Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 46b94c5b-7e0e4f3-135138b6-af9d61e
2025-10-10T14:57:32.640452Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.640568Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.640618Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.640646Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.640675Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.640706Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.641043Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.641098Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.641155Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.641193Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.641232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.645974Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.646308Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 120447 } }
2025-10-10T14:57:32.646410Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# f173360-713ff21b-ebe3bc11-8106e19
2025-10-10T14:57:32.645906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.645944Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.645997Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 152 partNo : 0 messageNo: 307 size 16695 offset: -1
2025-10-10T14:57:32.646060Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.646071Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.646093Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 153 partNo : 0 messageNo: 308 size 16805 offset: -1
2025-10-10T14:57:32.646140Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.646151Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.646172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 154 partNo : 0 messageNo: 309 size 16915 offset: -1
2025-10-10T14:57:32.646215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.646225Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.646245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 155 partNo : 0 messageNo: 310 size 17025 offset: -1
2025-10-10T14:57:32.646291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.646301Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.646320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 156 partNo : 0 messageNo: 311 size 17135 offset: -1
2025-10-10T14:57:32.646349Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.646359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.646389Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.646401Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.646428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.646438Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.646464Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.646473Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.646499Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.646512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.646537Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.646581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.646595Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.646609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.646620Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.646636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.646647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.646661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.646672Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.646688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.646762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 312  requestId: <none> cookie: 157
2025-10-10T14:57:32.646803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 313  requestId: <none> cookie: 158
2025-10-10T14:57:32.646820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 314  requestId: <none> cookie: 159
2025-10-10T14:57:32.646840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 315  requestId: <none> cookie: 160
2025-10-10T14:57:32.646858Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 316  requestId: <none> cookie: 161
2025-10-10T14:57:32.647457Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 126 count 15 size 220953 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.647501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.647544Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 220814 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.647573Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647601Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 127, partNo: 0, Offset: 126 is stored on disk
2025-10-10T14:57:32.647617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647636Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 128, partNo: 0, Offset: 127 is stored on disk
2025-10-10T14:57:32.647647Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647667Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 129, partNo: 0, Offset: 128 is stored on disk
2025-10-10T14:57:32.647678Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647698Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 130, partNo: 0, Offset: 129 is stored on disk
2025-10-10T14:57:32.647709Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647728Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 131, partNo: 0, Offset: 130 is stored on disk
2025-10-10T14:57:32.647738Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647758Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 132, partNo: 0, Offset: 131 is stored on disk
2025-10-10T14:57:32.647771Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647788Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 133, partNo: 0, Offset: 132 is stored on disk
2025-10-10T14:57:32.647800Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647818Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 134, partNo: 0, Offset: 133 is stored on disk
2025-10-10T14:57:32.647829Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 135, partNo: 0, Offset: 134 is stored on disk
2025-10-10T14:57:32.647859Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647878Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 136, partNo: 0, Offset: 135 is stored on disk
2025-10-10T14:57:32.647891Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647894Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 126 partno 0 count 15 parts 0 suffix '63' size 220953
2025-10-10T14:57:32.647909Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 137, partNo: 0, Offset: 136 is stored on disk
2025-10-10T14:57:32.647921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647939Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 138, partNo: 0, Offset: 137 is stored on disk
2025-10-10T14:57:32.647951Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647968Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 139, partNo: 0, Offset: 138 is stored on disk
2025-10-10T14:57:32.647978Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.647998Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 140, partNo: 0, Offset: 139 is stored on disk
2025-10-10T14:57:32.648010Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.648029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 141, partNo: 0, Offset: 140 is stored on disk
2025-10-10T14:57:32.648217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.648281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.648290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:57:32.648375Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 142 partNo 0
2025-10-10T14:57:32.649255Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 142 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 15668 count 1 nextOffset 142 batches 1
2025-10-10T14:57:32.649303Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 143 partNo 0
2025-10-10T14:57:32.649333Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 143 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 31414 count 2 nextOffset 143 batches 1
2025-10-10T14:57:32.649354Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 144 partNo 0
2025-10-10T14:57:32.649377Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 144 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 47270 count 3 nextOffset 144 batches 1
2025-10-10T14:57:32.649400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 145 partNo 0
2025-10-10T14:57:32.649419Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 145 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 63236 count 4 nextOffset 145 batches 1
2025-10-10T14:57:32.649437Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 146 partNo 0
2025-10-10T14:57:32.649459Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 146 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 79312 count 5 nextOffset 146 batches 1
2025-10-10T14:57:32.649479Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 147 partNo 0
2025-10-10T14:57:32.649499Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 147 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 95498 count 6 nextOffset 147 batches 1
2025-10-10T14:57:32.649518Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 148 partNo 0
2025-10-10T14:57:32.649541Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 148 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 111794 count 7 nextOffset 148 batches 1
2025-10-10T14:57:32.649560Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 149 partNo 0
2025-10-10T14:57:32.649582Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 149 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 128200 count 8 nextOffset 149 batches 1
2025-10-10T14:57:32.649599Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 150 partNo 0
2025-10-10T14:57:32.649620Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 150 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 144717 count 9 nextOffset 150 batches 1
2025-10-10T14:57:32.649640Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 151 partNo 0
2025-10-10T14:57:32.649659Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 151 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 161344 count 10 nextOffset 151 batches 1
2025-10-10T14:57:32.649676Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 152 partNo 0
2025-10-10T14:57:32.649694Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 152 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 178081 count 11 nextOffset 152 batches 1
2025-10-10T14:57:32.649712Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 153 partNo 0
2025-10-10T14:57:32.649732Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 153 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 194928 count 12 nextOffset 153 batches 1
2025-10-10T14:57:32.649749Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 154 partNo 0
2025-10-10T14:57:32.649784Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 154 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 211885 count 13 nextOffset 154 batches 1
2025-10-10T14:57:32.649803Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 155 partNo 0
2025-10-10T14:57:32.649823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 155 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 228952 count 14 nextOffset 155 batches 1
2025-10-10T14:57:32.649844Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 156 partNo 0
2025-10-10T14:57:32.649862Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 156 partNo 0 FormedBlobsCount 0 NewHead: Offset 141 PartNo 0 PackedSize 246129 count 15 nextOffset 156 batches 1
2025-10-10T14:57:32.649876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.650987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 141,15 HeadOffset 141 endOffset 141 curOffset 156 d0000000000_00000000000000000141_00000_0000000015_00000? size 245720 WTime 1760108252648
2025-10-10T14:57:32.651348Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.651410Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 257  requestId: <none> cookie: 127
2025-10-10T14:57:32.651452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 258  requestId: <none> cookie: 128
2025-10-10T14:57:32.651477Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 259  requestId: <none> cookie: 129
2025-10-10T14:57:32.651502Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 260  requestId: <none> cookie: 130
2025-10-10T14:57:32.651525Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 261  requestId: <none> cookie: 131
2025-10-10T14:57:32.651550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 267  requestId: <none> cookie: 132
2025-10-10T14:57:32.651572Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 268  requestId: <none> cookie: 133
2025-10-10T14:57:32.651596Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 269  requestId: <none> cookie: 134
2025-10-10T14:57:32.651620Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 270  requestId: <none> cookie: 135
2025-10-10T14:57:32.651643Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 271  requestId: <none> cookie: 136
2025-10-10T14:57:32.651664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 277  requestId: <none> cookie: 137
2025-10-10T14:57:32.651686Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 278  requestId: <none> cookie: 138
2025-10-10T14:57:32.651707Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 279  requestId: <none> cookie: 139
2025-10-10T14:57:32.651730Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 280  requestId: <none> cookie: 140
2025-10-10T14:57:32.651752Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 281  requestId: <none> cookie: 141
2025-10-10T14:57:32.651778Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.651874Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 141 partNo 0 count 15 size 245720
2025-10-10T14:57:32.648011Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.648070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.648138Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.648166Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.648191Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.648214Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.648649Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.648685Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.648733Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.648762Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.648784Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.655735Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 126 EndOffset 126 newEndOffset 141 commitOffset 0 clientCommitOffset 0 cookie 12 readingFinished 0 firstRead 0
2025-10-10T14:57:32.655752Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 126 endOffset 141
2025-10-10T14:57:32.655791Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.655839Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.655865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.655883Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.655905Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.655922Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.655939Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.655958Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.655975Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.656013Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.656030Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.656050Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.656066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.656082Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.656101Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.656187Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.657010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 127 offsets: 126 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 17 }
2025-10-10T14:57:32.657045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 127
2025-10-10T14:57:32.658485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 128 offsets: 127 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 17 }
2025-10-10T14:57:32.658521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 128
2025-10-10T14:57:32.658670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 129 offsets: 128 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 17 }
2025-10-10T14:57:32.658691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 129
2025-10-10T14:57:32.658791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 130 offsets: 129 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 17 }
2025-10-10T14:57:32.658812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 130
2025-10-10T14:57:32.658903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 131 offsets: 130 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 17 }
2025-10-10T14:57:32.658926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 131
2025-10-10T14:57:32.659027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 132 offsets: 131 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.659047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 132
2025-10-10T14:57:32.659138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 133 offsets: 132 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.659157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 133
2025-10-10T14:57:32.659245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 134 offsets: 133 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.659265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 134
2025-10-10T14:57:32.659363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 135 offsets: 134 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.659386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 135
2025-10-10T14:57:32.659475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 136 offsets: 135 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:32.659495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 136
2025-10-10T14:57:32.659593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 137 offsets: 136 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.659622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 137
2025-10-10T14:57:32.659753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 138 offsets: 137 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.659775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 138
2025-10-10T14:57:32.659871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 139 offsets: 138 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.659892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 139
2025-10-10T14:57:32.660006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 140 offsets: 139 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.660034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 140
2025-10-10T14:57:32.660136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 141 offsets: 140 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.660167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 141
2025-10-10T14:57:32.656780Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 126, endOffset# 141, WTime# 1760108252597, sizeLag# 220953
2025-10-10T14:57:32.656798Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.656842Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# a65cb5f5-eb32604c-927a25f5-fa8a63, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 265143, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.656882Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 265143 maxTimeLagMs 0 readTimestampMs 0 readOffset 126 EndOffset 141 ClientCommitOffset 0 committedOffset 0 Guid a65cb5f5-eb32604c-927a25f5-fa8a63
2025-10-10T14:57:32.659315Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.660036Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.660351Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.660565Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.660782Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.660820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.660873Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 157 partNo : 0 messageNo: 317 size 17245 offset: -1
2025-10-10T14:57:32.660948Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.660961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.660985Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 158 partNo : 0 messageNo: 318 size 17355 offset: -1
2025-10-10T14:57:32.661039Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.661052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.661076Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 159 partNo : 0 messageNo: 319 size 17465 offset: -1
2025-10-10T14:57:32.661139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.661152Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.661172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 160 partNo : 0 messageNo: 320 size 17575 offset: -1
2025-10-10T14:57:32.661225Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.661237Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.663642Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.661260Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 161 partNo : 0 messageNo: 321 size 17685 offset: -1
2025-10-10T14:57:32.663698Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.661293Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.661306Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.663763Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.661341Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.663793Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.661354Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.663824Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.661384Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.663855Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.661397Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.664468Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.661429Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.664519Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.661443Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.664541Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.661471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.664581Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.664618Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.661484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.664654Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.661555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.664965Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.661568Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.661654Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.661694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.661710Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.661728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.661740Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.661771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.661785Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.661803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.661817Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.661829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.662326Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 322  requestId: <none> cookie: 162
2025-10-10T14:57:32.662366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 323  requestId: <none> cookie: 163
2025-10-10T14:57:32.662388Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 324  requestId: <none> cookie: 164
2025-10-10T14:57:32.662406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 325  requestId: <none> cookie: 165
2025-10-10T14:57:32.662426Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 326  requestId: <none> cookie: 166
2025-10-10T14:57:32.662483Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 126 count 18 size 265143 endOffset 141 max time lag 0ms effective offset 126
2025-10-10T14:57:32.662680Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 1 blobs, size 220953 count 15 last offset 126, current partition end offset: 141
2025-10-10T14:57:32.662696Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-10-10T14:57:32.662753Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 126 partno 0 count 15 parts_count 0 source 1 size 220953 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.662777Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 15. All 1 blobs are from cache.
2025-10-10T14:57:32.662822Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.662908Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 126 partno 0 count 15 parts 0 suffix '63'
2025-10-10T14:57:32.665898Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 126 totakecount 15 count 15 size 220931 from pos 0 cbcount 15
2025-10-10T14:57:32.666152Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.666123Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 162 partNo : 0 messageNo: 327 size 17795 offset: -1
2025-10-10T14:57:32.666274Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666289Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 163 partNo : 0 messageNo: 328 size 17905 offset: -1
2025-10-10T14:57:32.666392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666435Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 164 partNo : 0 messageNo: 329 size 18015 offset: -1
2025-10-10T14:57:32.666492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666503Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666526Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 165 partNo : 0 messageNo: 330 size 18125 offset: -1
2025-10-10T14:57:32.666582Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666595Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 166 partNo : 0 messageNo: 331 size 18235 offset: -1
2025-10-10T14:57:32.666649Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666661Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666692Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666747Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666806Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666832Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.666843Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.666932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 126
2025-10-10T14:57:32.667006Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.667049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.667061Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.667075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.667087Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.667102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.667113Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.667126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.667137Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.667151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.667409Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.667613Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 141 count 15 size 245720 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.667666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 332  requestId: <none> cookie: 167
2025-10-10T14:57:32.667692Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 333  requestId: <none> cookie: 168
2025-10-10T14:57:32.667724Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 334  requestId: <none> cookie: 169
2025-10-10T14:57:32.667744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 335  requestId: <none> cookie: 170
2025-10-10T14:57:32.667762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 336  requestId: <none> cookie: 171
2025-10-10T14:57:32.667782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.667826Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 245572 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.667853Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.667866Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 141 partno 0 count 15 parts 0 suffix '63' size 245720
2025-10-10T14:57:32.667880Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 142, partNo: 0, Offset: 141 is stored on disk
2025-10-10T14:57:32.667895Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.667912Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 143, partNo: 0, Offset: 142 is stored on disk
2025-10-10T14:57:32.667924Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.667945Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 144, partNo: 0, Offset: 143 is stored on disk
2025-10-10T14:57:32.667957Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.667976Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 145, partNo: 0, Offset: 144 is stored on disk
2025-10-10T14:57:32.667988Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668009Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 146, partNo: 0, Offset: 145 is stored on disk
2025-10-10T14:57:32.668021Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668040Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 147, partNo: 0, Offset: 146 is stored on disk
2025-10-10T14:57:32.668050Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668067Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 148, partNo: 0, Offset: 147 is stored on disk
2025-10-10T14:57:32.668077Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668094Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 149, partNo: 0, Offset: 148 is stored on disk
2025-10-10T14:57:32.668105Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 150, partNo: 0, Offset: 149 is stored on disk
2025-10-10T14:57:32.668134Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668154Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 151, partNo: 0, Offset: 150 is stored on disk
2025-10-10T14:57:32.668162Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668181Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 152, partNo: 0, Offset: 151 is stored on disk
2025-10-10T14:57:32.668191Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668208Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 153, partNo: 0, Offset: 152 is stored on disk
2025-10-10T14:57:32.668218Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668235Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 154, partNo: 0, Offset: 153 is stored on disk
2025-10-10T14:57:32.668245Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668264Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 155, partNo: 0, Offset: 154 is stored on disk
2025-10-10T14:57:32.668273Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.668291Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 156, partNo: 0, Offset: 155 is stored on disk
2025-10-10T14:57:32.668445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.668492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.668501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:57:32.668585Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 157 partNo 0
2025-10-10T14:57:32.668425Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.668478Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.668519Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.668543Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.668562Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.668584Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.668998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.669031Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.669057Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.669085Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.670593Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.670767Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 141 Result { Offset: 126 Data: "... 13943 bytes ..." SourceId: "\000src_id" SeqNo: 127 WriteTimestampMS: 1760108252615 CreateTimestampMS: 1760108252104 UncompressedSize: 13871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 127 Data: "... 14054 bytes ..." SourceId: "\000src_id" SeqNo: 128 WriteTimestampMS: 1760108252615 CreateTimestampMS: 1760108252104 UncompressedSize: 13981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 128 Data: "... 14164 bytes ..." SourceId: "\000src_id" SeqNo: 129 WriteTimestampMS: 1760108252615 CreateTimestampMS: 1760108252104 UncompressedSize: 14091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 129 Data: "... 14274 bytes ..." SourceId: "\000src_id" SeqNo: 130 WriteTimestampMS: 1760108252615 CreateTimestampMS: 1760108252104 UncompressedSize: 14201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 130 Data: "... 14384 bytes ..." SourceId: "\000src_id" SeqNo: 131 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252104 UncompressedSize: 14311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 131 Data: "... 14494 bytes ..." SourceId: "\000src_id" SeqNo: 132 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252105 UncompressedSize: 14421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 132 Data: "... 14604 bytes ..." SourceId: "\000src_id" SeqNo: 133 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252108 UncompressedSize: 14531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 133 Data: "... 14714 bytes ..." SourceId: "\000src_id" SeqNo: 134 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252109 UncompressedSize: 14641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 134 Data: "... 14824 bytes ..." SourceId: "\000src_id" SeqNo: 135 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252109 UncompressedSize: 14751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 135 Data: "... 14934 bytes ..." SourceId: "\000src_id" SeqNo: 136 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252110 UncompressedSize: 14861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 136 Data: "... 15044 bytes ..." SourceId: "\000src_id" SeqNo: 137 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252110 UncompressedSize: 14971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 137 Data: "... 15154 bytes ..." SourceId: "\000src_id" SeqNo: 138 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252110 UncompressedSize: 15081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 138 Data: "... 15264 bytes ..." SourceId: "\000src_id" SeqNo: 139 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252110 UncompressedSize: 15191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 139 Data: "... 15374 bytes ..." SourceId: "\000src_id" SeqNo: 140 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252110 UncompressedSize: 15301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 140 Data: "... 15484 bytes ..." SourceId: "\000src_id" SeqNo: 141 WriteTimestampMS: 1760108252616 CreateTimestampMS: 1760108252110 UncompressedSize: 15411 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551230 RealReadOffset: 140 WaitQuotaTimeMs: 0 EndOffset: 141 StartOffset: 0 } Cookie: 126 }
2025-10-10T14:57:32.670790Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.671297Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 13 from offset 141
2025-10-10T14:57:32.671342Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 141 ReadOffset 141 ReadGuid a65cb5f5-eb32604c-927a25f5-fa8a63 has messages 1
2025-10-10T14:57:32.671506Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# a65cb5f5-eb32604c-927a25f5-fa8a63, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 220404
2025-10-10T14:57:32.671537Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# a65cb5f5-eb32604c-927a25f5-fa8a63
2025-10-10T14:57:32.672057Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.673867Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 220404, now ReadSizeBudget = 0, ReadSizeServerDelta = 303884
2025-10-10T14:57:32.674005Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 303884
2025-10-10T14:57:32.674192Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (126-140)
2025-10-10T14:57:32.674226Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 220404 to budget
2025-10-10T14:57:32.674257Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 220404, ReadSizeServerDelta = 303884
2025-10-10T14:57:32.674434Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.674491Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (126-126)
2025-10-10T14:57:32.674569Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (127-127)
2025-10-10T14:57:32.674674Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (128-128)
2025-10-10T14:57:32.674742Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (129-129)
2025-10-10T14:57:32.674934Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (130-130)
2025-10-10T14:57:32.674994Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (131-131)
2025-10-10T14:57:32.675046Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (132-132)
2025-10-10T14:57:32.675106Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (133-133)
2025-10-10T14:57:32.675383Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (134-134)
2025-10-10T14:57:32.675448Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (135-135)
2025-10-10T14:57:32.675520Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (136-136)
2025-10-10T14:57:32.675592Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (137-137)
2025-10-10T14:57:32.675666Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (138-138)
2025-10-10T14:57:32.675731Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (139-139)
2025-10-10T14:57:32.675791Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (140-140)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..13871 bytes.. Information: { Offset: 126 ProducerId: "src_id" SeqNo: 127 CreateTime: 2025-10-10T14:57:32.104000Z WriteTime: 2025-10-10T14:57:32.615000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13981 bytes.. Information: { Offset: 127 ProducerId: "src_id" SeqNo: 128 CreateTime: 2025-10-10T14:57:32.104000Z WriteTime: 2025-10-10T14:57:32.615000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14091 bytes.. Information: { Offset: 128 ProducerId: "src_id" SeqNo: 129 CreateTime: 2025-10-10T14:57:32.104000Z WriteTime: 2025-10-10T14:57:32.615000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14201 bytes.. Information: { Offset: 129 ProducerId: "src_id" SeqNo: 130 CreateTime: 2025-10-10T14:57:32.104000Z WriteTime: 2025-10-10T14:57:32.615000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14311 bytes.. Information: { Offset: 130 ProducerId: "src_id" SeqNo: 131 CreateTime: 2025-10-10T14:57:32.104000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14421 bytes.. Information: { Offset: 131 ProducerId: "src_id" SeqNo: 132 CreateTime: 2025-10-10T14:57:32.105000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14531 bytes.. Information: { Offset: 132 ProducerId: "src_id" SeqNo: 133 CreateTime: 2025-10-10T14:57:32.108000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14641 bytes.. Information: { Offset: 133 ProducerId: "src_id" SeqNo: 134 CreateTime: 2025-10-10T14:57:32.109000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14751 bytes.. Information: { Offset: 134 ProducerId: "src_id" SeqNo: 135 CreateTime: 2025-10-10T14:57:32.109000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14861 bytes.. Information: { Offset: 135 ProducerId: "src_id" SeqNo: 136 CreateTime: 2025-10-10T14:57:32.110000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14971 bytes.. Information: { Offset: 136 ProducerId: "src_id" SeqNo: 137 CreateTime: 2025-10-10T14:57:32.110000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15081 bytes.. Information: { Offset: 137 ProducerId: "src_id" SeqNo: 138 CreateTime: 2025-10-10T14:57:32.110000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15191 bytes.. Information: { Offset: 138 ProducerId: "src_id" SeqNo: 139 CreateTime: 2025-10-10T14:57:32.110000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15301 bytes.. Information: { Offset: 139 ProducerId: "src_id" SeqNo: 140 CreateTime: 2025-10-10T14:57:32.110000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15411 bytes.. Information: { Offset: 140 ProducerId: "src_id" SeqNo: 141 CreateTime: 2025-10-10T14:57:32.110000Z WriteTime: 2025-10-10T14:57:32.616000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.678008Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 15, size 219615 bytes
2025-10-10T14:57:32.678049Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.678555Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.678911Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 220404 } }
2025-10-10T14:57:32.679016Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 1ef288f4-3ad2c0ef-8817c879-4c309361
2025-10-10T14:57:32.679203Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.679500Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.679804Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.758322Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 157 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 17319 count 1 nextOffset 157 batches 1
2025-10-10T14:57:32.758408Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 158 partNo 0
2025-10-10T14:57:32.758456Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 158 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 34716 count 2 nextOffset 158 batches 1
2025-10-10T14:57:32.758478Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 159 partNo 0
2025-10-10T14:57:32.758498Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 159 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 52223 count 3 nextOffset 159 batches 1
2025-10-10T14:57:32.758520Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 160 partNo 0
2025-10-10T14:57:32.758541Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 160 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 69840 count 4 nextOffset 160 batches 1
2025-10-10T14:57:32.758562Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 161 partNo 0
2025-10-10T14:57:32.758583Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 161 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 87567 count 5 nextOffset 161 batches 1
2025-10-10T14:57:32.758602Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 162 partNo 0
2025-10-10T14:57:32.758623Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 162 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 105404 count 6 nextOffset 162 batches 1
2025-10-10T14:57:32.758644Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 163 partNo 0
2025-10-10T14:57:32.758662Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 163 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 123351 count 7 nextOffset 163 batches 1
2025-10-10T14:57:32.758682Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 164 partNo 0
2025-10-10T14:57:32.758702Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 164 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 141408 count 8 nextOffset 164 batches 1
2025-10-10T14:57:32.758724Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 165 partNo 0
2025-10-10T14:57:32.758746Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 165 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 159575 count 9 nextOffset 165 batches 1
2025-10-10T14:57:32.758767Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 166 partNo 0
2025-10-10T14:57:32.758785Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 166 partNo 0 FormedBlobsCount 0 NewHead: Offset 156 PartNo 0 PackedSize 177852 count 10 nextOffset 166 batches 1
2025-10-10T14:57:32.758801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.759944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 156,10 HeadOffset 156 endOffset 156 curOffset 166 d0000000000_00000000000000000156_00000_0000000010_00000? size 177606 WTime 1760108252759
2025-10-10T14:57:32.760246Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.760344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 287  requestId: <none> cookie: 142
2025-10-10T14:57:32.760402Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 288  requestId: <none> cookie: 143
2025-10-10T14:57:32.760430Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 289  requestId: <none> cookie: 144
2025-10-10T14:57:32.760454Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 290  requestId: <none> cookie: 145
2025-10-10T14:57:32.760482Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 291  requestId: <none> cookie: 146
2025-10-10T14:57:32.760513Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 297  requestId: <none> cookie: 147
2025-10-10T14:57:32.760537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 298  requestId: <none> cookie: 148
2025-10-10T14:57:32.760564Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 299  requestId: <none> cookie: 149
2025-10-10T14:57:32.760589Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 300  requestId: <none> cookie: 150
2025-10-10T14:57:32.760614Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 301  requestId: <none> cookie: 151
2025-10-10T14:57:32.760638Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 307  requestId: <none> cookie: 152
2025-10-10T14:57:32.760663Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 308  requestId: <none> cookie: 153
2025-10-10T14:57:32.760687Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 309  requestId: <none> cookie: 154
2025-10-10T14:57:32.760710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 310  requestId: <none> cookie: 155
2025-10-10T14:57:32.760735Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 311  requestId: <none> cookie: 156
2025-10-10T14:57:32.760828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.760848Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.760893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 167 partNo : 0 messageNo: 337 size 18345 offset: -1
2025-10-10T14:57:32.760960Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.760971Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.760991Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 168 partNo : 0 messageNo: 338 size 18455 offset: -1
2025-10-10T14:57:32.761046Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.761058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.761080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 169 partNo : 0 messageNo: 339 size 18565 offset: -1
2025-10-10T14:57:32.761148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.761161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.761184Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 170 partNo : 0 messageNo: 340 size 18675 offset: -1
2025-10-10T14:57:32.761242Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.761252Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.761276Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 171 partNo : 0 messageNo: 341 size 18785 offset: -1
2025-10-10T14:57:32.761307Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.761320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.761353Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.761365Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.761392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.761404Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.761434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.761444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.761471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.761483Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.761534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.761551Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.761656Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 156 partNo 0 count 10 size 177606
2025-10-10T14:57:32.761684Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.761717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.761729Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.761746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.761774Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.761791Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.761803Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.761818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.761830Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.761844Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.762052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 342  requestId: <none> cookie: 172
2025-10-10T14:57:32.762078Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 343  requestId: <none> cookie: 173
2025-10-10T14:57:32.762097Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 344  requestId: <none> cookie: 174
2025-10-10T14:57:32.762114Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 345  requestId: <none> cookie: 175
2025-10-10T14:57:32.762134Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 346  requestId: <none> cookie: 176
2025-10-10T14:57:32.765229Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765313Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765376Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765432Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765458Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765486Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765513Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765564Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765592Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765618Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765647Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765677Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765706Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765742Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765787Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765819Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.765846Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.766901Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.767030Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.767071Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.767108Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.767146Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.767331Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 141 EndOffset 141 newEndOffset 156 commitOffset 0 clientCommitOffset 0 cookie 13 readingFinished 0 firstRead 0
2025-10-10T14:57:32.767353Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 141 endOffset 156
2025-10-10T14:57:32.767394Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 141, endOffset# 156, WTime# 1760108252616, sizeLag# 245720
2025-10-10T14:57:32.767406Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.767454Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 2fcba0e4-8629d025-ccb9cd93-7efb865e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 294864, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.767505Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 294864 maxTimeLagMs 0 readTimestampMs 0 readOffset 141 EndOffset 156 ClientCommitOffset 0 committedOffset 0 Guid 2fcba0e4-8629d025-ccb9cd93-7efb865e
2025-10-10T14:57:32.771030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 142 offsets: 141 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 25 }
2025-10-10T14:57:32.771073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 142
2025-10-10T14:57:32.771244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 143 offsets: 142 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 25 }
2025-10-10T14:57:32.771266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 143
2025-10-10T14:57:32.771379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 144 offsets: 143 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 25 }
2025-10-10T14:57:32.771402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 144
2025-10-10T14:57:32.771515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 145 offsets: 144 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 25 }
2025-10-10T14:57:32.771536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 145
2025-10-10T14:57:32.771633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 146 offsets: 145 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 25 }
2025-10-10T14:57:32.771651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 146
2025-10-10T14:57:32.771753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 147 offsets: 146 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.771774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 147
2025-10-10T14:57:32.771864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 148 offsets: 147 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.771884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 148
2025-10-10T14:57:32.771990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 149 offsets: 148 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.772013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 149
2025-10-10T14:57:32.772123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 150 offsets: 149 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.772143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 150
2025-10-10T14:57:32.772239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 151 offsets: 150 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:32.772261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 151
2025-10-10T14:57:32.772362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 152 offsets: 151 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.772386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 152
2025-10-10T14:57:32.772503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 153 offsets: 152 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.772525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 153
2025-10-10T14:57:32.772615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 154 offsets: 153 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.772638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 154
2025-10-10T14:57:32.772724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 155 offsets: 154 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.772744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 155
2025-10-10T14:57:32.772859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 156 offsets: 155 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:32.772884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 156
2025-10-10T14:57:32.771230Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771271Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.771322Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 172 partNo : 0 messageNo: 347 size 18895 offset: -1
2025-10-10T14:57:32.771418Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771432Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.771457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 173 partNo : 0 messageNo: 348 size 19005 offset: -1
2025-10-10T14:57:32.771543Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771558Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.771581Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 174 partNo : 0 messageNo: 349 size 19115 offset: -1
2025-10-10T14:57:32.771636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771648Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.771670Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 175 partNo : 0 messageNo: 350 size 19225 offset: -1
2025-10-10T14:57:32.771718Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771730Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.771753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 176 partNo : 0 messageNo: 351 size 19335 offset: -1
2025-10-10T14:57:32.771785Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771797Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.771829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.771872Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.771913Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771925Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.771961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.771976Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.772051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.772063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.772101Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.772156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.772170Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.772184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.772195Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.772208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.772218Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.772232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.772242Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.772256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.772353Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 352  requestId: <none> cookie: 177
2025-10-10T14:57:32.772399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 353  requestId: <none> cookie: 178
2025-10-10T14:57:32.772417Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 354  requestId: <none> cookie: 179
2025-10-10T14:57:32.772435Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 355  requestId: <none> cookie: 180
2025-10-10T14:57:32.772453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 356  requestId: <none> cookie: 181
2025-10-10T14:57:32.772511Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 16 Topic 'rt3.dc1--test-topic' partition 0 user user offset 141 count 18 size 294864 endOffset 156 max time lag 0ms effective offset 141
2025-10-10T14:57:32.772695Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 16 added 1 blobs, size 245720 count 15 last offset 141, current partition end offset: 156
2025-10-10T14:57:32.772708Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 16. Send blob request.
2025-10-10T14:57:32.772753Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 141 partno 0 count 15 parts_count 0 source 1 size 245720 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.772788Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 16. All 1 blobs are from cache.
2025-10-10T14:57:32.772837Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.773225Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 141 partno 0 count 15 parts 0 suffix '63'
2025-10-10T14:57:32.773710Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 141 totakecount 15 count 15 size 245697 from pos 0 cbcount 15
2025-10-10T14:57:32.773975Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 141
2025-10-10T14:57:32.773992Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.774076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.774127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.775123Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.775156Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.775200Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 177 partNo : 0 messageNo: 357 size 19445 offset: -1
2025-10-10T14:57:32.775267Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.775295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.775318Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 178 partNo : 0 messageNo: 358 size 19555 offset: -1
2025-10-10T14:57:32.775373Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.775384Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.775405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 179 partNo : 0 messageNo: 359 size 19665 offset: -1
2025-10-10T14:57:32.775461Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.775473Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.775495Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 180 partNo : 0 messageNo: 360 size 19775 offset: -1
2025-10-10T14:57:32.775519Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.775556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.775570Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.775585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.775596Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.775608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.775618Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.775632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.776479Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.776510Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.776556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 181 partNo : 0 messageNo: 361 size 19885 offset: -1
2025-10-10T14:57:32.776607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.776620Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.776656Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.776670Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.776701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.776713Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.776741Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.776753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.776781Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.776794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.776815Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.776848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.776922Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 362  requestId: <none> cookie: 182
2025-10-10T14:57:32.774155Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.774182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.774212Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.774771Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.774828Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.774865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.774899Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.774935Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.775993Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 156 Result { Offset: 141 Data: "... 15594 bytes ..." SourceId: "\000src_id" SeqNo: 142 WriteTimestampMS: 1760108252647 CreateTimestampMS: 1760108252110 UncompressedSize: 15521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 142 Data: "... 15704 bytes ..." SourceId: "\000src_id" SeqNo: 143 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252110 UncompressedSize: 15631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 143 Data: "... 15814 bytes ..." SourceId: "\000src_id" SeqNo: 144 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252111 UncompressedSize: 15741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 144 Data: "... 15924 bytes ..." SourceId: "\000src_id" SeqNo: 145 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252111 UncompressedSize: 15851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 145 Data: "... 16034 bytes ..." SourceId: "\000src_id" SeqNo: 146 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252111 UncompressedSize: 15961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 146 Data: "... 16144 bytes ..." SourceId: "\000src_id" SeqNo: 147 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252111 UncompressedSize: 16071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 147 Data: "... 16254 bytes ..." SourceId: "\000src_id" SeqNo: 148 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252111 UncompressedSize: 16181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 148 Data: "... 16364 bytes ..." SourceId: "\000src_id" SeqNo: 149 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252111 UncompressedSize: 16291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 149 Data: "... 16475 bytes ..." SourceId: "\000src_id" SeqNo: 150 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252111 UncompressedSize: 16401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 150 Data: "... 16585 bytes ..." SourceId: "\000src_id" SeqNo: 151 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252112 UncompressedSize: 16511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 151 Data: "... 16695 bytes ..." SourceId: "\000src_id" SeqNo: 152 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252112 UncompressedSize: 16621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 152 Data: "... 16805 bytes ..." SourceId: "\000src_id" SeqNo: 153 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252112 UncompressedSize: 16731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 153 Data: "... 16915 bytes ..." SourceId: "\000src_id" SeqNo: 154 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252112 UncompressedSize: 16841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 154 Data: "... 17025 bytes ..." SourceId: "\000src_id" SeqNo: 155 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252112 UncompressedSize: 16951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 155 Data: "... 17135 bytes ..." SourceId: "\000src_id" SeqNo: 156 WriteTimestampMS: 1760108252648 CreateTimestampMS: 1760108252112 UncompressedSize: 17061 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551239 RealReadOffset: 155 WaitQuotaTimeMs: 0 EndOffset: 156 StartOffset: 0 } Cookie: 141 }
2025-10-10T14:57:32.776967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 363  requestId: <none> cookie: 183
2025-10-10T14:57:32.776993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 364  requestId: <none> cookie: 184
2025-10-10T14:57:32.777014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 365  requestId: <none> cookie: 185
2025-10-10T14:57:32.777031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 366  requestId: <none> cookie: 186
2025-10-10T14:57:32.778293Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 156 count 10 size 177606 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.778359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.778402Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 156 partno 0 count 10 parts 0 suffix '63' size 177606
2025-10-10T14:57:32.778414Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 177470 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.778442Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778473Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 157, partNo: 0, Offset: 156 is stored on disk
2025-10-10T14:57:32.778492Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778514Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 158, partNo: 0, Offset: 157 is stored on disk
2025-10-10T14:57:32.778526Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778545Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 159, partNo: 0, Offset: 158 is stored on disk
2025-10-10T14:57:32.778559Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778579Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 160, partNo: 0, Offset: 159 is stored on disk
2025-10-10T14:57:32.778592Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 161, partNo: 0, Offset: 160 is stored on disk
2025-10-10T14:57:32.778625Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778645Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 162, partNo: 0, Offset: 161 is stored on disk
2025-10-10T14:57:32.778660Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778679Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 163, partNo: 0, Offset: 162 is stored on disk
2025-10-10T14:57:32.778690Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778709Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 164, partNo: 0, Offset: 163 is stored on disk
2025-10-10T14:57:32.778720Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778740Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 165, partNo: 0, Offset: 164 is stored on disk
2025-10-10T14:57:32.778752Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.778772Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 166, partNo: 0, Offset: 165 is stored on disk
2025-10-10T14:57:32.778937Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.779007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.779024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:57:32.779122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 167 partNo 0
2025-10-10T14:57:32.779906Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 14 from offset 156
2025-10-10T14:57:32.779965Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 156 ReadOffset 156 ReadGuid 2fcba0e4-8629d025-ccb9cd93-7efb865e has messages 1
2025-10-10T14:57:32.780153Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.780202Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.780251Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.780280Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.780316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.780344Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.780947Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.780991Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.781041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.781076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.781110Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.781171Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.781507Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 2fcba0e4-8629d025-ccb9cd93-7efb865e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 245177
2025-10-10T14:57:32.781536Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 2fcba0e4-8629d025-ccb9cd93-7efb865e
2025-10-10T14:57:32.782174Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.785399Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.785753Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.786018Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.786217Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.786426Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.786631Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.786833Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.787054Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.787270Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.794406Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 245177, now ReadSizeBudget = 0, ReadSizeServerDelta = 279111
2025-10-10T14:57:32.801364Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 279111
2025-10-10T14:57:32.803192Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (141-155)
2025-10-10T14:57:32.803252Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 245177 to budget
2025-10-10T14:57:32.803308Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 245177, ReadSizeServerDelta = 279111
2025-10-10T14:57:32.803555Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.803628Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (141-141)
2025-10-10T14:57:32.803691Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (142-142)
2025-10-10T14:57:32.803689Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 167 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 18419 count 1 nextOffset 167 batches 1
2025-10-10T14:57:32.803780Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 168 partNo 0
2025-10-10T14:57:32.803820Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 168 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 36916 count 2 nextOffset 168 batches 1
2025-10-10T14:57:32.803843Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 169 partNo 0
2025-10-10T14:57:32.803867Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 169 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 55523 count 3 nextOffset 169 batches 1
2025-10-10T14:57:32.803888Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 170 partNo 0
2025-10-10T14:57:32.803907Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 170 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 74240 count 4 nextOffset 170 batches 1
2025-10-10T14:57:32.803930Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 171 partNo 0
2025-10-10T14:57:32.803954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 171 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 93067 count 5 nextOffset 171 batches 1
2025-10-10T14:57:32.803984Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 172 partNo 0
2025-10-10T14:57:32.804004Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 172 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 112004 count 6 nextOffset 172 batches 1
2025-10-10T14:57:32.804026Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 173 partNo 0
2025-10-10T14:57:32.804047Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 173 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 131051 count 7 nextOffset 173 batches 1
2025-10-10T14:57:32.804067Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 174 partNo 0
2025-10-10T14:57:32.804088Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 174 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 150208 count 8 nextOffset 174 batches 1
2025-10-10T14:57:32.804108Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 175 partNo 0
2025-10-10T14:57:32.804130Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 175 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 169475 count 9 nextOffset 175 batches 1
2025-10-10T14:57:32.804151Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 176 partNo 0
2025-10-10T14:57:32.804172Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 176 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 188852 count 10 nextOffset 176 batches 1
2025-10-10T14:57:32.804193Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 177 partNo 0
2025-10-10T14:57:32.804212Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 177 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 208339 count 11 nextOffset 177 batches 1
2025-10-10T14:57:32.804231Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 178 partNo 0
2025-10-10T14:57:32.804252Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 178 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 227936 count 12 nextOffset 178 batches 1
2025-10-10T14:57:32.804272Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 179 partNo 0
2025-10-10T14:57:32.804291Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 179 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 247643 count 13 nextOffset 179 batches 1
2025-10-10T14:57:32.804311Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 180 partNo 0
2025-10-10T14:57:32.804331Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 180 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 267460 count 14 nextOffset 180 batches 1
2025-10-10T14:57:32.804352Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 181 partNo 0
2025-10-10T14:57:32.804371Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 181 partNo 0 FormedBlobsCount 0 NewHead: Offset 166 PartNo 0 PackedSize 287387 count 15 nextOffset 181 batches 1
2025-10-10T14:57:32.804386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.805841Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (143-143)
2025-10-10T14:57:32.805656Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 245177 } }
2025-10-10T14:57:32.805809Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 8d273b27-a7fbe45f-77ea04dd-1bb9aa63
2025-10-10T14:57:32.802558Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:57:32.809310Z :INFO: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1007 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:32.816145Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (144-144)
2025-10-10T14:57:32.816374Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (145-145)
2025-10-10T14:57:32.816456Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (146-146)
2025-10-10T14:57:32.816511Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (147-147)
2025-10-10T14:57:32.816551Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (148-148)
2025-10-10T14:57:32.816851Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (149-149)
2025-10-10T14:57:32.816893Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (150-150)
2025-10-10T14:57:32.816930Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (151-151)
2025-10-10T14:57:32.816969Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (152-152)
2025-10-10T14:57:32.816998Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (153-153)
2025-10-10T14:57:32.817042Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (154-154)
2025-10-10T14:57:32.817077Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (155-155)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..15521 bytes.. Information: { Offset: 141 ProducerId: "src_id" SeqNo: 142 CreateTime: 2025-10-10T14:57:32.110000Z WriteTime: 2025-10-10T14:57:32.647000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15631 bytes.. Information: { Offset: 142 ProducerId: "src_id" SeqNo: 143 CreateTime: 2025-10-10T14:57:32.110000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15741 bytes.. Information: { Offset: 143 ProducerId: "src_id" SeqNo: 144 CreateTime: 2025-10-10T14:57:32.111000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15851 bytes.. Information: { Offset: 144 ProducerId: "src_id" SeqNo: 145 CreateTime: 2025-10-10T14:57:32.111000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15961 bytes.. Information: { Offset: 145 ProducerId: "src_id" SeqNo: 146 CreateTime: 2025-10-10T14:57:32.111000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16071 bytes.. Information: { Offset: 146 ProducerId: "src_id" SeqNo: 147 CreateTime: 2025-10-10T14:57:32.111000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16181 bytes.. Information: { Offset: 147 ProducerId: "src_id" SeqNo: 148 CreateTime: 2025-10-10T14:57:32.111000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16291 bytes.. Information: { Offset: 148 ProducerId: "src_id" SeqNo: 149 CreateTime: 2025-10-10T14:57:32.111000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16401 bytes.. Information: { Offset: 149 ProducerId: "src_id" SeqNo: 150 CreateTime: 2025-10-10T14:57:32.111000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16511 bytes.. Information: { Offset: 150 ProducerId: "src_id" SeqNo: 151 CreateTime: 2025-10-10T14:57:32.112000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16621 bytes.. Information: { Offset: 151 ProducerId: "src_id" SeqNo: 152 CreateTime: 2025-10-10T14:57:32.112000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16731 bytes.. Information: { Offset: 152 ProducerId: "src_id" SeqNo: 153 CreateTime: 2025-10-10T14:57:32.112000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16841 bytes.. Information: { Offset: 153 ProducerId: "src_id" SeqNo: 154 CreateTime: 2025-10-10T14:57:32.112000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16951 bytes.. Information: { Offset: 154 ProducerId: "src_id" SeqNo: 155 CreateTime: 2025-10-10T14:57:32.112000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17061 bytes.. Information: { Offset: 155 ProducerId: "src_id" SeqNo: 156 CreateTime: 2025-10-10T14:57:32.112000Z WriteTime: 2025-10-10T14:57:32.648000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.819449Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 15, size 244365 bytes
2025-10-10T14:57:32.819505Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.821274Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 166,15 HeadOffset 166 endOffset 166 curOffset 181 d0000000000_00000000000000000166_00000_0000000015_00000? size 286986 WTime 1760108252821
2025-10-10T14:57:32.821716Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.821846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 317  requestId: <none> cookie: 157
2025-10-10T14:57:32.821916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 318  requestId: <none> cookie: 158
2025-10-10T14:57:32.821943Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 319  requestId: <none> cookie: 159
2025-10-10T14:57:32.821966Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 320  requestId: <none> cookie: 160
2025-10-10T14:57:32.821992Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 321  requestId: <none> cookie: 161
2025-10-10T14:57:32.822017Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 327  requestId: <none> cookie: 162
2025-10-10T14:57:32.822042Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 328  requestId: <none> cookie: 163
2025-10-10T14:57:32.822065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 329  requestId: <none> cookie: 164
2025-10-10T14:57:32.822091Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 330  requestId: <none> cookie: 165
2025-10-10T14:57:32.822116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 331  requestId: <none> cookie: 166
2025-10-10T14:57:32.822246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822268Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 182 partNo : 0 messageNo: 367 size 19995 offset: -1
2025-10-10T14:57:32.822380Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822416Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 183 partNo : 0 messageNo: 368 size 20105 offset: -1
2025-10-10T14:57:32.822471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 184 partNo : 0 messageNo: 369 size 20215 offset: -1
2025-10-10T14:57:32.822574Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822587Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 185 partNo : 0 messageNo: 370 size 20325 offset: -1
2025-10-10T14:57:32.822679Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822691Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 186 partNo : 0 messageNo: 371 size 20435 offset: -1
2025-10-10T14:57:32.822745Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822758Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822809Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822850Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822881Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822894Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822923Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.822936Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.822958Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.823062Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 166 partNo 0 count 15 size 286986
2025-10-10T14:57:32.823120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.823161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.823173Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.823189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.823202Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.823220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.823233Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.823247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.823258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.823277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.823478Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 372  requestId: <none> cookie: 187
2025-10-10T14:57:32.823508Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 373  requestId: <none> cookie: 188
2025-10-10T14:57:32.823526Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 374  requestId: <none> cookie: 189
2025-10-10T14:57:32.823544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 375  requestId: <none> cookie: 190
2025-10-10T14:57:32.823562Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 376  requestId: <none> cookie: 191
2025-10-10T14:57:32.825218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825308Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825336Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825362Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825392Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825423Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825451Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825481Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825508Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825533Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825560Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825594Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825622Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825653Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.825680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.826676Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.826805Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.826842Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.826877Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.826914Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.827106Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 156 EndOffset 156 newEndOffset 166 commitOffset 0 clientCommitOffset 0 cookie 14 readingFinished 0 firstRead 0
2025-10-10T14:57:32.827129Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 156 endOffset 166
2025-10-10T14:57:32.827194Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 156, endOffset# 166, WTime# 1760108252648, sizeLag# 177606
2025-10-10T14:57:32.827208Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.827249Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 31db414a-12c27a35-cced2e2d-2ceb6e04, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 213127, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.827301Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 213127 maxTimeLagMs 0 readTimestampMs 0 readOffset 156 EndOffset 166 ClientCommitOffset 0 committedOffset 0 Guid 31db414a-12c27a35-cced2e2d-2ceb6e04
2025-10-10T14:57:32.828458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 157 offsets: 156 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 96 }
2025-10-10T14:57:32.828501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 157
2025-10-10T14:57:32.828695Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.829249Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.829642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 158 offsets: 157 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 96 }
2025-10-10T14:57:32.829681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 158
2025-10-10T14:57:32.829870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 159 offsets: 158 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 96 }
2025-10-10T14:57:32.829890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 159
2025-10-10T14:57:32.830007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 160 offsets: 159 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 96 }
2025-10-10T14:57:32.830032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 160
2025-10-10T14:57:32.830109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 161 offsets: 160 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 95 }
2025-10-10T14:57:32.830126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 161
2025-10-10T14:57:32.830313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 162 offsets: 161 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 92 }
2025-10-10T14:57:32.830346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 162
2025-10-10T14:57:32.830504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 163 offsets: 162 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 92 }
2025-10-10T14:57:32.830531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 163
2025-10-10T14:57:32.830304Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.830659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 164 offsets: 163 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 92 }
2025-10-10T14:57:32.830693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 164
2025-10-10T14:57:32.830606Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.830827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 165 offsets: 164 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 92 }
2025-10-10T14:57:32.830848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 165
2025-10-10T14:57:32.830958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 166 offsets: 165 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 92 }
2025-10-10T14:57:32.830980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 166
2025-10-10T14:57:32.827903Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.827941Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.827992Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 187 partNo : 0 messageNo: 377 size 20545 offset: -1
2025-10-10T14:57:32.828064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828078Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828103Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 188 partNo : 0 messageNo: 378 size 20655 offset: -1
2025-10-10T14:57:32.828177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828190Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828214Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 189 partNo : 0 messageNo: 379 size 20765 offset: -1
2025-10-10T14:57:32.828275Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828288Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828311Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 190 partNo : 0 messageNo: 380 size 20875 offset: -1
2025-10-10T14:57:32.828413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828458Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 191 partNo : 0 messageNo: 381 size 20985 offset: -1
2025-10-10T14:57:32.828541Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828591Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828604Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828633Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828647Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828675Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828686Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828716Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828729Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828796Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.828811Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.828851Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.828894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.828908Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.828925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.828935Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.828949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.828960Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.828976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.828986Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.829000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.829551Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 382  requestId: <none> cookie: 192
2025-10-10T14:57:32.829595Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 383  requestId: <none> cookie: 193
2025-10-10T14:57:32.829616Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 384  requestId: <none> cookie: 194
2025-10-10T14:57:32.829634Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 385  requestId: <none> cookie: 195
2025-10-10T14:57:32.829652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 386  requestId: <none> cookie: 196
2025-10-10T14:57:32.829709Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 17 Topic 'rt3.dc1--test-topic' partition 0 user user offset 156 count 12 size 213127 endOffset 166 max time lag 0ms effective offset 156
2025-10-10T14:57:32.829914Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 17 added 1 blobs, size 177606 count 10 last offset 156, current partition end offset: 166
2025-10-10T14:57:32.829928Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 17. Send blob request.
2025-10-10T14:57:32.829978Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 156 partno 0 count 10 parts_count 0 source 1 size 177606 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.830004Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 17. All 1 blobs are from cache.
2025-10-10T14:57:32.830065Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.830771Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 156 totakecount 10 count 10 size 177583 from pos 0 cbcount 10
2025-10-10T14:57:32.830938Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 156
2025-10-10T14:57:32.832645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.832725Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.832755Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.832788Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.832817Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.833264Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:155:0
2025-10-10T14:57:32.833326Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1004 BytesRead: 1331616 MessagesRead: 156 BytesReadCompressed: 1331616 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:32.832510Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 156 partno 0 count 10 parts 0 suffix '63'
2025-10-10T14:57:32.833230Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.833400Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.833439Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.833495Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.833535Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.834097Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.834621Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 166 Result { Offset: 156 Data: "... 17245 bytes ..." SourceId: "\000src_id" SeqNo: 157 WriteTimestampMS: 1760108252668 CreateTimestampMS: 1760108252112 UncompressedSize: 17171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 157 Data: "... 17355 bytes ..." SourceId: "\000src_id" SeqNo: 158 WriteTimestampMS: 1760108252757 CreateTimestampMS: 1760108252113 UncompressedSize: 17281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 158 Data: "... 17465 bytes ..." SourceId: "\000src_id" SeqNo: 159 WriteTimestampMS: 1760108252757 CreateTimestampMS: 1760108252118 UncompressedSize: 17391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 159 Data: "... 17575 bytes ..." SourceId: "\000src_id" SeqNo: 160 WriteTimestampMS: 1760108252757 CreateTimestampMS: 1760108252118 UncompressedSize: 17501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 160 Data: "... 17685 bytes ..." SourceId: "\000src_id" SeqNo: 161 WriteTimestampMS: 1760108252757 CreateTimestampMS: 1760108252118 UncompressedSize: 17611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 161 Data: "... 17795 bytes ..." SourceId: "\000src_id" SeqNo: 162 WriteTimestampMS: 1760108252757 CreateTimestampMS: 1760108252118 UncompressedSize: 17721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 162 Data: "... 17905 bytes ..." SourceId: "\000src_id" SeqNo: 163 WriteTimestampMS: 1760108252757 CreateTimestampMS: 1760108252119 UncompressedSize: 17831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 163 Data: "... 18015 bytes ..." SourceId: "\000src_id" SeqNo: 164 WriteTimestampMS: 1760108252757 CreateTimestampMS: 1760108252119 UncompressedSize: 17941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 164 Data: "... 18125 bytes ..." SourceId: "\000src_id" SeqNo: 165 WriteTimestampMS: 1760108252757 CreateTimestampMS: 1760108252119 UncompressedSize: 18051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 165 Data: "... 18235 bytes ..." SourceId: "\000src_id" SeqNo: 166 WriteTimestampMS: 1760108252757 CreateTimestampMS: 1760108252119 UncompressedSize: 18161 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551402 RealReadOffset: 165 WaitQuotaTimeMs: 0 EndOffset: 166 StartOffset: 0 } Cookie: 156 }
2025-10-10T14:57:32.834131Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.835109Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 15 from offset 166
2025-10-10T14:57:32.834181Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 192 partNo : 0 messageNo: 387 size 21095 offset: -1
2025-10-10T14:57:32.835144Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 166 ReadOffset 166 ReadGuid 31db414a-12c27a35-cced2e2d-2ceb6e04 has messages 1
2025-10-10T14:57:32.834304Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.834337Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.834379Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 193 partNo : 0 messageNo: 388 size 21205 offset: -1
2025-10-10T14:57:32.834528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.834556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.834602Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 194 partNo : 0 messageNo: 389 size 21315 offset: -1
2025-10-10T14:57:32.834752Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.834768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.835284Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 31db414a-12c27a35-cced2e2d-2ceb6e04, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 177302
2025-10-10T14:57:32.834791Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 195 partNo : 0 messageNo: 390 size 21425 offset: -1
2025-10-10T14:57:32.835316Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 31db414a-12c27a35-cced2e2d-2ceb6e04
2025-10-10T14:57:32.834886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.834908Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.834933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 196 partNo : 0 messageNo: 391 size 21535 offset: -1
2025-10-10T14:57:32.834967Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.835016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.835032Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.835055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.835071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.835089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.835099Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.835112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.835123Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.835138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.835687Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.835714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.835752Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.835764Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.835789Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.835800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.835828Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.835839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.835866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.835877Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.835999Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 392  requestId: <none> cookie: 197
2025-10-10T14:57:32.836049Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 393  requestId: <none> cookie: 198
2025-10-10T14:57:32.836067Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 394  requestId: <none> cookie: 199
2025-10-10T14:57:32.836084Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 395  requestId: <none> cookie: 200
2025-10-10T14:57:32.836101Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 396  requestId: <none> cookie: 201
2025-10-10T14:57:32.835796Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.836610Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.836661Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.836690Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.836719Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.836747Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.837114Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.837184Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.837228Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.837281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.837316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.837437Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.838390Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 177302, now ReadSizeBudget = 0, ReadSizeServerDelta = 346986
2025-10-10T14:57:32.838497Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 346986
2025-10-10T14:57:32.839261Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (156-165)
2025-10-10T14:57:32.839307Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 177302 to budget
2025-10-10T14:57:32.839337Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 177302, ReadSizeServerDelta = 346986
2025-10-10T14:57:32.839547Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.839656Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (156-156)
2025-10-10T14:57:32.839768Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (157-157)
2025-10-10T14:57:32.839909Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (158-158)
2025-10-10T14:57:32.840007Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (159-159)
2025-10-10T14:57:32.840207Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (160-160)
2025-10-10T14:57:32.840276Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (161-161)
2025-10-10T14:57:32.840350Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (162-162)
2025-10-10T14:57:32.840418Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (163-163)
2025-10-10T14:57:32.840788Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (164-164)
2025-10-10T14:57:32.840873Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (165-165)
2025-10-10T14:57:32.838705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.838739Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.838786Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 197 partNo : 0 messageNo: 397 size 21645 offset: -1
2025-10-10T14:57:32.838893Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.838907Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.838932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 198 partNo : 0 messageNo: 398 size 21755 offset: -1
2025-10-10T14:57:32.839021Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.839036Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.839062Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 199 partNo : 0 messageNo: 399 size 21865 offset: -1
2025-10-10T14:57:32.839158Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.839173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.839214Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 200 partNo : 0 messageNo: 400 size 21975 offset: -1
2025-10-10T14:57:32.839304Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.839319Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.839343Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 201 partNo : 0 messageNo: 401 size 22085 offset: -1
2025-10-10T14:57:32.839377Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.839389Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.839422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.839433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.839460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.839473Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.839499Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.839510Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.839539Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.839550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.839619Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 166 count 15 size 286986 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.839674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.839718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.839728Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 166 partno 0 count 15 parts 0 suffix '63' size 286986
2025-10-10T14:57:32.839740Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.839760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.839772Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.839788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.839799Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.839822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.839837Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.839861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.839936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.839986Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 286830 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.840018Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840052Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 167, partNo: 0, Offset: 166 is stored on disk
2025-10-10T14:57:32.840071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840098Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 168, partNo: 0, Offset: 167 is stored on disk
2025-10-10T14:57:32.840122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840149Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 169, partNo: 0, Offset: 168 is stored on disk
2025-10-10T14:57:32.840164Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840191Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 170, partNo: 0, Offset: 169 is stored on disk
2025-10-10T14:57:32.840207Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840224Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 171, partNo: 0, Offset: 170 is stored on disk
2025-10-10T14:57:32.840240Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840262Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 172, partNo: 0, Offset: 171 is stored on disk
2025-10-10T14:57:32.840276Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840296Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 173, partNo: 0, Offset: 172 is stored on disk
2025-10-10T14:57:32.840305Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840334Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 174, partNo: 0, Offset: 173 is stored on disk
2025-10-10T14:57:32.840349Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840367Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 175, partNo: 0, Offset: 174 is stored on disk
2025-10-10T14:57:32.840379Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840408Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 176, partNo: 0, Offset: 175 is stored on disk
2025-10-10T14:57:32.840426Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840445Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 177, partNo: 0, Offset: 176 is stored on disk
2025-10-10T14:57:32.840465Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840495Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 178, partNo: 0, Offset: 177 is stored on disk
2025-10-10T14:57:32.840512Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840540Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 179, partNo: 0, Offset: 178 is stored on disk
2025-10-10T14:57:32.840555Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840574Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 180, partNo: 0, Offset: 179 is stored on disk
2025-10-10T14:57:32.840595Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.840625Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 181, partNo: 0, Offset: 180 is stored on disk
2025-10-10T14:57:32.841047Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.841157Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.841168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-10T14:57:32.841268Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 182 partNo 0
2025-10-10T14:57:32.841392Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.843516Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:57:32.843596Z :INFO: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1004 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..17171 bytes.. Information: { Offset: 156 ProducerId: "src_id" SeqNo: 157 CreateTime: 2025-10-10T14:57:32.112000Z WriteTime: 2025-10-10T14:57:32.668000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17281 bytes.. Information: { Offset: 157 ProducerId: "src_id" SeqNo: 158 CreateTime: 2025-10-10T14:57:32.113000Z WriteTime: 2025-10-10T14:57:32.757000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17391 bytes.. Information: { Offset: 158 ProducerId: "src_id" SeqNo: 159 CreateTime: 2025-10-10T14:57:32.118000Z WriteTime: 2025-10-10T14:57:32.757000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17501 bytes.. Information: { Offset: 159 ProducerId: "src_id" SeqNo: 160 CreateTime: 2025-10-10T14:57:32.118000Z WriteTime: 2025-10-10T14:57:32.757000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17611 bytes.. Information: { Offset: 160 ProducerId: "src_id" SeqNo: 161 CreateTime: 2025-10-10T14:57:32.118000Z WriteTime: 2025-10-10T14:57:32.757000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17721 bytes.. Information: { Offset: 161 ProducerId: "src_id" SeqNo: 162 CreateTime: 2025-10-10T14:57:32.118000Z WriteTime: 2025-10-10T14:57:32.757000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17831 bytes.. Information: { Offset: 162 ProducerId: "src_id" SeqNo: 163 CreateTime: 2025-10-10T14:57:32.119000Z WriteTime: 2025-10-10T14:57:32.757000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17941 bytes.. Information: { Offset: 163 ProducerId: "src_id" SeqNo: 164 CreateTime: 2025-10-10T14:57:32.119000Z WriteTime: 2025-10-10T14:57:32.757000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18051 bytes.. Information: { Offset: 164 ProducerId: "src_id" SeqNo: 165 CreateTime: 2025-10-10T14:57:32.119000Z WriteTime: 2025-10-10T14:57:32.757000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18161 bytes.. Information: { Offset: 165 ProducerId: "src_id" SeqNo: 166 CreateTime: 2025-10-10T14:57:32.119000Z WriteTime: 2025-10-10T14:57:32.757000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.849514Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 10, size 176660 bytes
2025-10-10T14:57:32.849573Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.850584Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 182 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 20069 count 1 nextOffset 182 batches 1
2025-10-10T14:57:32.850673Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 183 partNo 0
2025-10-10T14:57:32.850715Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 183 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 40216 count 2 nextOffset 183 batches 1
2025-10-10T14:57:32.850739Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 184 partNo 0
2025-10-10T14:57:32.850763Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 184 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 60473 count 3 nextOffset 184 batches 1
2025-10-10T14:57:32.850788Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 185 partNo 0
2025-10-10T14:57:32.850809Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 185 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 80840 count 4 nextOffset 185 batches 1
2025-10-10T14:57:32.850831Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 186 partNo 0
2025-10-10T14:57:32.850854Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 186 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 101317 count 5 nextOffset 186 batches 1
2025-10-10T14:57:32.850877Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 187 partNo 0
2025-10-10T14:57:32.850900Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 187 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 121904 count 6 nextOffset 187 batches 1
2025-10-10T14:57:32.850923Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 188 partNo 0
2025-10-10T14:57:32.850944Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 188 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 142601 count 7 nextOffset 188 batches 1
2025-10-10T14:57:32.850967Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 189 partNo 0
2025-10-10T14:57:32.850988Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 189 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 163408 count 8 nextOffset 189 batches 1
2025-10-10T14:57:32.851008Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 190 partNo 0
2025-10-10T14:57:32.851032Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 190 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 184325 count 9 nextOffset 190 batches 1
2025-10-10T14:57:32.851054Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 191 partNo 0
2025-10-10T14:57:32.851074Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 191 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 205352 count 10 nextOffset 191 batches 1
2025-10-10T14:57:32.851106Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 192 partNo 0
2025-10-10T14:57:32.851130Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 192 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 226489 count 11 nextOffset 192 batches 1
2025-10-10T14:57:32.851152Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 193 partNo 0
2025-10-10T14:57:32.851171Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 193 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 247736 count 12 nextOffset 193 batches 1
2025-10-10T14:57:32.851194Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 194 partNo 0
2025-10-10T14:57:32.851214Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 194 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 269093 count 13 nextOffset 194 batches 1
2025-10-10T14:57:32.851234Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 195 partNo 0
2025-10-10T14:57:32.851254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 195 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 290560 count 14 nextOffset 195 batches 1
2025-10-10T14:57:32.851272Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 196 partNo 0
2025-10-10T14:57:32.851294Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 196 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 312137 count 15 nextOffset 196 batches 1
2025-10-10T14:57:32.851316Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 197 partNo 0
2025-10-10T14:57:32.851337Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 197 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 333824 count 16 nextOffset 197 batches 1
2025-10-10T14:57:32.851360Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 198 partNo 0
2025-10-10T14:57:32.851381Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 198 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 355621 count 17 nextOffset 198 batches 1
2025-10-10T14:57:32.851401Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 199 partNo 0
2025-10-10T14:57:32.851422Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 199 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 377528 count 18 nextOffset 199 batches 1
2025-10-10T14:57:32.851443Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 200 partNo 0
2025-10-10T14:57:32.851465Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 200 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 399545 count 19 nextOffset 200 batches 1
2025-10-10T14:57:32.851487Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 201 partNo 0
2025-10-10T14:57:32.851507Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 201 partNo 0 FormedBlobsCount 0 NewHead: Offset 181 PartNo 0 PackedSize 421672 count 20 nextOffset 201 batches 1
2025-10-10T14:57:32.851523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.853109Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 181,20 HeadOffset 181 endOffset 181 curOffset 201 d0000000000_00000000000000000181_00000_0000000020_00000? size 421116 WTime 1760108252852
2025-10-10T14:57:32.853443Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.853786Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 166 EndOffset 166 newEndOffset 181 commitOffset 0 clientCommitOffset 0 cookie 15 readingFinished 0 firstRead 0
2025-10-10T14:57:32.853808Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 166 endOffset 181
2025-10-10T14:57:32.853889Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 177302 } }
2025-10-10T14:57:32.853935Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 166, endOffset# 181, WTime# 1760108252757, sizeLag# 286986
2025-10-10T14:57:32.853949Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.853989Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 3bc42728-a4bda8c0-5a0c2255-502316dc, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 344383, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.854120Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# d4254cee-7849f3b6-a25379bf-d3f593e7
2025-10-10T14:57:32.854160Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 344383 maxTimeLagMs 0 readTimestampMs 0 readOffset 166 EndOffset 181 ClientCommitOffset 0 committedOffset 0 Guid 3bc42728-a4bda8c0-5a0c2255-502316dc
2025-10-10T14:57:32.854478Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.855445Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.855529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 402  requestId: <none> cookie: 202
2025-10-10T14:57:32.855590Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 403  requestId: <none> cookie: 203
2025-10-10T14:57:32.855617Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 404  requestId: <none> cookie: 204
2025-10-10T14:57:32.855642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 405  requestId: <none> cookie: 205
2025-10-10T14:57:32.855667Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 406  requestId: <none> cookie: 206
2025-10-10T14:57:32.855693Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 337  requestId: <none> cookie: 167
2025-10-10T14:57:32.855727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 338  requestId: <none> cookie: 168
2025-10-10T14:57:32.855757Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 339  requestId: <none> cookie: 169
2025-10-10T14:57:32.855787Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 340  requestId: <none> cookie: 170
2025-10-10T14:57:32.855814Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 341  requestId: <none> cookie: 171
2025-10-10T14:57:32.855840Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 347  requestId: <none> cookie: 172
2025-10-10T14:57:32.855867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 348  requestId: <none> cookie: 173
2025-10-10T14:57:32.855897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 349  requestId: <none> cookie: 174
2025-10-10T14:57:32.855922Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 350  requestId: <none> cookie: 175
2025-10-10T14:57:32.855952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 351  requestId: <none> cookie: 176
2025-10-10T14:57:32.855979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 357  requestId: <none> cookie: 177
2025-10-10T14:57:32.856005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 358  requestId: <none> cookie: 178
2025-10-10T14:57:32.856032Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 359  requestId: <none> cookie: 179
2025-10-10T14:57:32.856060Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 360  requestId: <none> cookie: 180
2025-10-10T14:57:32.856088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 361  requestId: <none> cookie: 181
2025-10-10T14:57:32.856188Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.856216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.856254Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.856360Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 181 partNo 0 count 20 size 421116
2025-10-10T14:57:32.856588Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 18 Topic 'rt3.dc1--test-topic' partition 0 user user offset 166 count 18 size 344383 endOffset 181 max time lag 0ms effective offset 166
2025-10-10T14:57:32.856751Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 18 added 1 blobs, size 286986 count 15 last offset 166, current partition end offset: 181
2025-10-10T14:57:32.856764Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 18. Send blob request.
2025-10-10T14:57:32.856807Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 166 partno 0 count 15 parts_count 0 source 1 size 286986 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.856829Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 18. All 1 blobs are from cache.
2025-10-10T14:57:32.856886Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.857043Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 166 partno 0 count 15 parts 0 suffix '63'
2025-10-10T14:57:32.854936Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.858070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858277Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858328Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858375Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858403Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858449Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858513Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858575Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858625Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858741Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858768Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858825Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858861Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.858970Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.859000Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.859026Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.859280Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.859364Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.859414Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.859448Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.859534Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.859599Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.858412Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 166 totakecount 15 count 15 size 286963 from pos 0 cbcount 15
2025-10-10T14:57:32.859846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.859870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.859917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 202 partNo : 0 messageNo: 407 size 22195 offset: -1
2025-10-10T14:57:32.860041Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.860056Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.860086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 203 partNo : 0 messageNo: 408 size 22305 offset: -1
2025-10-10T14:57:32.860176Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.860190Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.860215Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 204 partNo : 0 messageNo: 409 size 22415 offset: -1
2025-10-10T14:57:32.860304Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 166
2025-10-10T14:57:32.860374Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.860411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.860429Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.860451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.860464Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.860481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.861618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.862914Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.864086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 167 offsets: 166 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 42 }
2025-10-10T14:57:32.864125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 167
2025-10-10T14:57:32.864027Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.864090Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.864155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 205 partNo : 0 messageNo: 410 size 22525 offset: -1
2025-10-10T14:57:32.864309Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.864355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 168 offsets: 167 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 42 }
2025-10-10T14:57:32.864336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.864381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 168
2025-10-10T14:57:32.864365Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 206 partNo : 0 messageNo: 411 size 22635 offset: -1
2025-10-10T14:57:32.864411Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.864439Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.864481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.864491Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.864525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 169 offsets: 168 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 41 }
2025-10-10T14:57:32.864515Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.864549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 169
2025-10-10T14:57:32.864535Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.864560Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.864570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.864648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 170 offsets: 169 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 41 }
2025-10-10T14:57:32.864670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 170
2025-10-10T14:57:32.864759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 171 offsets: 170 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 41 }
2025-10-10T14:57:32.864778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 171
2025-10-10T14:57:32.864594Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.864873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 172 offsets: 171 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 31 }
2025-10-10T14:57:32.864610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.864632Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.864894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 172
2025-10-10T14:57:32.864678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.864691Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.864708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.864781Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 412  requestId: <none> cookie: 207
2025-10-10T14:57:32.864822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 413  requestId: <none> cookie: 208
2025-10-10T14:57:32.864999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 173 offsets: 172 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 31 }
2025-10-10T14:57:32.864839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 414  requestId: <none> cookie: 209
2025-10-10T14:57:32.865017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 173
2025-10-10T14:57:32.864855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 415  requestId: <none> cookie: 210
2025-10-10T14:57:32.864871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 416  requestId: <none> cookie: 211
2025-10-10T14:57:32.865104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 174 offsets: 173 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 31 }
2025-10-10T14:57:32.865146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 174
2025-10-10T14:57:32.865284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 175 offsets: 174 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 31 }
2025-10-10T14:57:32.865309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 175
2025-10-10T14:57:32.865410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 176 offsets: 175 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 32 }
2025-10-10T14:57:32.865430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 176
2025-10-10T14:57:32.865197Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 181 Result { Offset: 166 Data: "... 18345 bytes ..." SourceId: "\000src_id" SeqNo: 167 WriteTimestampMS: 1760108252779 CreateTimestampMS: 1760108252119 UncompressedSize: 18271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 167 Data: "... 18455 bytes ..." SourceId: "\000src_id" SeqNo: 168 WriteTimestampMS: 1760108252803 CreateTimestampMS: 1760108252119 UncompressedSize: 18381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 168 Data: "... 18565 bytes ..." SourceId: "\000src_id" SeqNo: 169 WriteTimestampMS: 1760108252803 CreateTimestampMS: 1760108252119 UncompressedSize: 18491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 169 Data: "... 18675 bytes ..." SourceId: "\000src_id" SeqNo: 170 WriteTimestampMS: 1760108252803 CreateTimestampMS: 1760108252119 UncompressedSize: 18601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 170 Data: "... 18785 bytes ..." SourceId: "\000src_id" SeqNo: 171 WriteTimestampMS: 1760108252803 CreateTimestampMS: 1760108252119 UncompressedSize: 18711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 171 Data: "... 18895 bytes ..." SourceId: "\000src_id" SeqNo: 172 WriteTimestampMS: 1760108252803 CreateTimestampMS: 1760108252120 UncompressedSize: 18821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 172 Data: "... 19005 bytes ..." SourceId: "\000src_id" SeqNo: 173 WriteTimestampMS: 1760108252803 CreateTimestampMS: 1760108252120 UncompressedSize: 18931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 173 Data: "... 19115 bytes ..." SourceId: "\000src_id" SeqNo: 174 WriteTimestampMS: 1760108252803 CreateTimestampMS: 1760108252120 UncompressedSize: 19041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 174 Data: "... 19225 bytes ..." SourceId: "\000src_id" SeqNo: 175 WriteTimestampMS: 1760108252803 CreateTimestampMS: 1760108252120 UncompressedSize: 19151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 175 Data: "... 19335 bytes ..." SourceId: "\000src_id" SeqNo: 176 WriteTimestampMS: 1760108252804 CreateTimestampMS: 1760108252120 UncompressedSize: 19261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 176 Data: "... 19445 bytes ..." SourceId: "\000src_id" SeqNo: 177 WriteTimestampMS: 1760108252804 CreateTimestampMS: 1760108252120 UncompressedSize: 19371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 177 Data: "... 19555 bytes ..." SourceId: "\000src_id" SeqNo: 178 WriteTimestampMS: 1760108252804 CreateTimestampMS: 1760108252120 UncompressedSize: 19481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 178 Data: "... 19665 bytes ..." SourceId: "\000src_id" SeqNo: 179 WriteTimestampMS: 1760108252804 CreateTimestampMS: 1760108252120 UncompressedSize: 19591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 179 Data: "... 19775 bytes ..." SourceId: "\000src_id" SeqNo: 180 WriteTimestampMS: 1760108252804 CreateTimestampMS: 1760108252120 UncompressedSize: 19701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 180 Data: "... 19885 bytes ..." SourceId: "\000src_id" SeqNo: 181 WriteTimestampMS: 1760108252804 CreateTimestampMS: 1760108252121 UncompressedSize: 19811 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551247 RealReadOffset: 180 WaitQuotaTimeMs: 0 EndOffset: 181 StartOffset: 0 } Cookie: 166 }
2025-10-10T14:57:32.872491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 177 offsets: 176 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 28 }
2025-10-10T14:57:32.872533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 177
2025-10-10T14:57:32.872663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 178 offsets: 177 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 28 }
2025-10-10T14:57:32.872687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 178
2025-10-10T14:57:32.872789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 179 offsets: 178 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 28 }
2025-10-10T14:57:32.872808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 179
2025-10-10T14:57:32.872903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 180 offsets: 179 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 28 }
2025-10-10T14:57:32.872920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 180
2025-10-10T14:57:32.873008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 181 offsets: 180 already_written: false write_statistics { persist_duration_ms: 35 queued_in_partition_duration_ms: 27 }
2025-10-10T14:57:32.873028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 181
2025-10-10T14:57:32.869318Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 181 count 20 size 421116 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:32.869398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:32.869456Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 420940 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:32.869484Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869523Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 182, partNo: 0, Offset: 181 is stored on disk
2025-10-10T14:57:32.869543Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869572Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 183, partNo: 0, Offset: 182 is stored on disk
2025-10-10T14:57:32.869587Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869605Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 184, partNo: 0, Offset: 183 is stored on disk
2025-10-10T14:57:32.869617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869645Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 185, partNo: 0, Offset: 184 is stored on disk
2025-10-10T14:57:32.869660Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869678Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 186, partNo: 0, Offset: 185 is stored on disk
2025-10-10T14:57:32.869698Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869720Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 187, partNo: 0, Offset: 186 is stored on disk
2025-10-10T14:57:32.869730Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869774Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 188, partNo: 0, Offset: 187 is stored on disk
2025-10-10T14:57:32.869788Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869808Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 189, partNo: 0, Offset: 188 is stored on disk
2025-10-10T14:57:32.869829Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869850Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 190, partNo: 0, Offset: 189 is stored on disk
2025-10-10T14:57:32.869862Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869895Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 191, partNo: 0, Offset: 190 is stored on disk
2025-10-10T14:57:32.869910Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869929Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 192, partNo: 0, Offset: 191 is stored on disk
2025-10-10T14:57:32.869941Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869962Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 193, partNo: 0, Offset: 192 is stored on disk
2025-10-10T14:57:32.869972Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.869992Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 194, partNo: 0, Offset: 193 is stored on disk
2025-10-10T14:57:32.870012Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.870031Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 195, partNo: 0, Offset: 194 is stored on disk
2025-10-10T14:57:32.870041Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.870060Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 196, partNo: 0, Offset: 195 is stored on disk
2025-10-10T14:57:32.870071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.870088Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 197, partNo: 0, Offset: 196 is stored on disk
2025-10-10T14:57:32.870098Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.870116Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 198, partNo: 0, Offset: 197 is stored on disk
2025-10-10T14:57:32.870127Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.870144Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 199, partNo: 0, Offset: 198 is stored on disk
2025-10-10T14:57:32.870153Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.870173Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 200, partNo: 0, Offset: 199 is stored on disk
2025-10-10T14:57:32.870184Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:32.870203Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 201, partNo: 0, Offset: 200 is stored on disk
2025-10-10T14:57:32.870572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:32.870613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:32.870622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:57:32.870717Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 202 partNo 0
2025-10-10T14:57:32.874495Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 286571, now ReadSizeBudget = 0, ReadSizeServerDelta = 237717
2025-10-10T14:57:32.869977Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 16 from offset 181
2025-10-10T14:57:32.870039Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 181 ReadOffset 181 ReadGuid 3bc42728-a4bda8c0-5a0c2255-502316dc has messages 1
2025-10-10T14:57:32.870254Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.870306Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.870389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.870459Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.870529Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.870567Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.874657Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 237717
2025-10-10T14:57:32.871314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.871364Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.871398Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.871430Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.871463Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.871647Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 3bc42728-a4bda8c0-5a0c2255-502316dc, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 286571
2025-10-10T14:57:32.871681Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 3bc42728-a4bda8c0-5a0c2255-502316dc
2025-10-10T14:57:32.873782Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:32.874801Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (166-180)
2025-10-10T14:57:32.874843Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 286571 to budget
2025-10-10T14:57:32.874879Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 286571, ReadSizeServerDelta = 237717
2025-10-10T14:57:32.875106Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:32.875180Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (166-166)
2025-10-10T14:57:32.875324Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (167-167)
2025-10-10T14:57:32.875452Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (168-168)
2025-10-10T14:57:32.875534Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (169-169)
2025-10-10T14:57:32.875722Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (170-170)
2025-10-10T14:57:32.875781Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (171-171)
2025-10-10T14:57:32.875877Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (172-172)
2025-10-10T14:57:32.875947Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (173-173)
2025-10-10T14:57:32.875128Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 181 partno 0 count 20 parts 0 suffix '63' size 421116
2025-10-10T14:57:32.876257Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (174-174)
2025-10-10T14:57:32.876322Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (175-175)
2025-10-10T14:57:32.876436Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (176-176)
2025-10-10T14:57:32.876496Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (177-177)
2025-10-10T14:57:32.876556Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 3} (178-178)
2025-10-10T14:57:32.876623Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 4} (179-179)
2025-10-10T14:57:32.876692Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 5} (180-180)
2025-10-10T14:57:32.877569Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..18271 bytes.. Information: { Offset: 166 ProducerId: "src_id" SeqNo: 167 CreateTime: 2025-10-10T14:57:32.119000Z WriteTime: 2025-10-10T14:57:32.779000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18381 bytes.. Information: { Offset: 167 ProducerId: "src_id" SeqNo: 168 CreateTime: 2025-10-10T14:57:32.119000Z WriteTime: 2025-10-10T14:57:32.803000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18491 bytes.. Information: { Offset: 168 ProducerId: "src_id" SeqNo: 169 CreateTime: 2025-10-10T14:57:32.119000Z WriteTime: 2025-10-10T14:57:32.803000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18601 bytes.. Information: { Offset: 169 ProducerId: "src_id" SeqNo: 170 CreateTime: 2025-10-10T14:57:32.119000Z WriteTime: 2025-10-10T14:57:32.803000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18711 bytes.. Information: { Offset: 170 ProducerId: "src_id" SeqNo: 171 CreateTime: 2025-10-10T14:57:32.119000Z WriteTime: 2025-10-10T14:57:32.803000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18821 bytes.. Information: { Offset: 171 ProducerId: "src_id" SeqNo: 172 CreateTime: 2025-10-10T14:57:32.120000Z WriteTime: 2025-10-10T14:57:32.803000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18931 bytes.. Information: { Offset: 172 ProducerId: "src_id" SeqNo: 173 CreateTime: 2025-10-10T14:57:32.120000Z WriteTime: 2025-10-10T14:57:32.803000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19041 bytes.. Information: { Offset: 173 ProducerId: "src_id" SeqNo: 174 CreateTime: 2025-10-10T14:57:32.120000Z WriteTime: 2025-10-10T14:57:32.803000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19151 bytes.. Information: { Offset: 174 ProducerId: "src_id" SeqNo: 175 CreateTime: 2025-10-10T14:57:32.120000Z WriteTime: 2025-10-10T14:57:32.803000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19261 bytes.. Information: { Offset: 175 ProducerId: "src_id" SeqNo: 176 CreateTime: 2025-10-10T14:57:32.120000Z WriteTime: 2025-10-10T14:57:32.804000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19371 bytes.. Information: { Offset: 176 ProducerId: "src_id" SeqNo: 177 CreateTime: 2025-10-10T14:57:32.120000Z WriteTime: 2025-10-10T14:57:32.804000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19481 bytes.. Information: { Offset: 177 ProducerId: "src_id" SeqNo: 178 CreateTime: 2025-10-10T14:57:32.120000Z WriteTime: 2025-10-10T14:57:32.804000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19591 bytes.. Information: { Offset: 178 ProducerId: "src_id" SeqNo: 179 CreateTime: 2025-10-10T14:57:32.120000Z WriteTime: 2025-10-10T14:57:32.804000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19701 bytes.. Information: { Offset: 179 ProducerId: "src_id" SeqNo: 180 CreateTime: 2025-10-10T14:57:32.120000Z WriteTime: 2025-10-10T14:57:32.804000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19811 bytes.. Information: { Offset: 180 ProducerId: "src_id" SeqNo: 181 CreateTime: 2025-10-10T14:57:32.121000Z WriteTime: 2025-10-10T14:57:32.804000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:32.883263Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 15, size 285615 bytes
2025-10-10T14:57:32.883312Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:32.883731Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 286571 } }
2025-10-10T14:57:32.883911Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# cce0ed09-9c7edb05-d7f0b71d-60f0805e
2025-10-10T14:57:32.883963Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.884727Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.887760Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.888760Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.889200Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.889529Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.889995Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.890357Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.908189Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 202 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 22269 count 1 nextOffset 202 batches 1
2025-10-10T14:57:32.908277Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 203 partNo 0
2025-10-10T14:57:32.908314Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 203 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 44616 count 2 nextOffset 203 batches 1
2025-10-10T14:57:32.908332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 204 partNo 0
2025-10-10T14:57:32.908349Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 204 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 67073 count 3 nextOffset 204 batches 1
2025-10-10T14:57:32.908367Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 205 partNo 0
2025-10-10T14:57:32.908382Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 205 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 89640 count 4 nextOffset 205 batches 1
2025-10-10T14:57:32.908397Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 206 partNo 0
2025-10-10T14:57:32.908413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 206 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 112317 count 5 nextOffset 206 batches 1
2025-10-10T14:57:32.908428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:32.914205Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 201,5 HeadOffset 201 endOffset 201 curOffset 206 d0000000000_00000000000000000201_00000_0000000005_00000? size 112226 WTime 1760108252913
2025-10-10T14:57:32.914404Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:32.914523Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 367  requestId: <none> cookie: 182
2025-10-10T14:57:32.914587Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 368  requestId: <none> cookie: 183
2025-10-10T14:57:32.914630Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 369  requestId: <none> cookie: 184
2025-10-10T14:57:32.914666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 370  requestId: <none> cookie: 185
2025-10-10T14:57:32.914691Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 371  requestId: <none> cookie: 186
2025-10-10T14:57:32.914716Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 377  requestId: <none> cookie: 187
2025-10-10T14:57:32.914741Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 378  requestId: <none> cookie: 188
2025-10-10T14:57:32.914769Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 379  requestId: <none> cookie: 189
2025-10-10T14:57:32.914794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 380  requestId: <none> cookie: 190
2025-10-10T14:57:32.914819Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 381  requestId: <none> cookie: 191
2025-10-10T14:57:32.914845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 387  requestId: <none> cookie: 192
2025-10-10T14:57:32.914873Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 388  requestId: <none> cookie: 193
2025-10-10T14:57:32.914901Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 389  requestId: <none> cookie: 194
2025-10-10T14:57:32.914937Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 390  requestId: <none> cookie: 195
2025-10-10T14:57:32.914967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 391  requestId: <none> cookie: 196
2025-10-10T14:57:32.914992Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 397  requestId: <none> cookie: 197
2025-10-10T14:57:32.915016Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 398  requestId: <none> cookie: 198
2025-10-10T14:57:32.915043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 399  requestId: <none> cookie: 199
2025-10-10T14:57:32.915069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 400  requestId: <none> cookie: 200
2025-10-10T14:57:32.915097Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 401  requestId: <none> cookie: 201
2025-10-10T14:57:32.915274Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.915307Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.915359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 207 partNo : 0 messageNo: 417 size 22745 offset: -1
2025-10-10T14:57:32.915468Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.915486Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.915514Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 208 partNo : 0 messageNo: 418 size 22855 offset: -1
2025-10-10T14:57:32.915610Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.915625Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.915652Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 209 partNo : 0 messageNo: 419 size 22965 offset: -1
2025-10-10T14:57:32.915749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.915765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.915792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 210 partNo : 0 messageNo: 420 size 23075 offset: -1
2025-10-10T14:57:32.915887Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.915902Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.915928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 211 partNo : 0 messageNo: 421 size 23185 offset: -1
2025-10-10T14:57:32.915965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.915979Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.916015Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.916027Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.916057Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.916070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.916101Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.916113Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.916144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.916157Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.916180Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:32.916296Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 201 partNo 0 count 5 size 112226
2025-10-10T14:57:32.916358Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.916399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.916413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.916428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.916439Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.916456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.916468Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.916486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.916497Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.916512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.916705Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 422  requestId: <none> cookie: 212
2025-10-10T14:57:32.916734Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 423  requestId: <none> cookie: 213
2025-10-10T14:57:32.916753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 424  requestId: <none> cookie: 214
2025-10-10T14:57:32.916772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 425  requestId: <none> cookie: 215
2025-10-10T14:57:32.916791Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 426  requestId: <none> cookie: 216
2025-10-10T14:57:32.918705Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.918824Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.918866Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.918900Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.918932Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.918960Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.918990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919021Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919083Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919114Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919145Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919176Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919238Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919268Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919344Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919401Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919434Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919474Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919506Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919540Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.919569Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.941431Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 181 EndOffset 181 newEndOffset 201 commitOffset 0 clientCommitOffset 0 cookie 16 readingFinished 0 firstRead 0
2025-10-10T14:57:32.941460Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 181 endOffset 201
2025-10-10T14:57:32.941494Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 181, endOffset# 201, WTime# 1760108252804, sizeLag# 421116
2025-10-10T14:57:32.941506Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:32.941540Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 39b16fa1-961e68d2-7dc4c5a0-90022d4c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 24, size# 505339, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:32.941578Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 24 maxSize 505339 maxTimeLagMs 0 readTimestampMs 0 readOffset 181 EndOffset 201 ClientCommitOffset 0 committedOffset 0 Guid 39b16fa1-961e68d2-7dc4c5a0-90022d4c
2025-10-10T14:57:32.942001Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.942081Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.942108Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.942133Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.942157Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.946790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.946850Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.946927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 212 partNo : 0 messageNo: 427 size 23295 offset: -1
2025-10-10T14:57:32.961470Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.961515Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.961571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 213 partNo : 0 messageNo: 428 size 23405 offset: -1
2025-10-10T14:57:32.961726Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.961744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.961788Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 214 partNo : 0 messageNo: 429 size 23515 offset: -1
2025-10-10T14:57:32.961935Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.961953Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.961978Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 215 partNo : 0 messageNo: 430 size 23625 offset: -1
2025-10-10T14:57:32.962071Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.962087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.966060Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.962112Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 216 partNo : 0 messageNo: 431 size 23735 offset: -1
2025-10-10T14:57:32.962148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.962161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.962231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.962244Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.962283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.962328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.962343Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.962357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.962368Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.962381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.962402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.962413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.962425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.962435Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:32.962448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:32.962500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 432  requestId: <none> cookie: 217
2025-10-10T14:57:32.962574Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 19 Topic 'rt3.dc1--test-topic' partition 0 user user offset 181 count 24 size 505339 endOffset 201 max time lag 0ms effective offset 181
2025-10-10T14:57:32.962748Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 19 added 1 blobs, size 421116 count 20 last offset 181, current partition end offset: 201
2025-10-10T14:57:32.962764Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 19. Send blob request.
2025-10-10T14:57:32.962813Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 181 partno 0 count 20 parts_count 0 source 1 size 421116 accessed 0 times before, last time 2025-10-10T14:57:32.000000Z
2025-10-10T14:57:32.962837Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 19. All 1 blobs are from cache.
2025-10-10T14:57:32.962877Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:32.967021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 182 offsets: 181 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 27 }
2025-10-10T14:57:32.967055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 182
2025-10-10T14:57:32.973780Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 181 partno 0 count 20 parts 0 suffix '63'
2025-10-10T14:57:32.975632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 183 offsets: 182 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 27 }
2025-10-10T14:57:32.975687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 183
2025-10-10T14:57:32.975934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 184 offsets: 183 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 27 }
2025-10-10T14:57:32.975979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 184
2025-10-10T14:57:32.976103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 185 offsets: 184 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 27 }
2025-10-10T14:57:32.976133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 185
2025-10-10T14:57:32.977018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 186 offsets: 185 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 27 }
2025-10-10T14:57:32.975732Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.975851Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:32.977260Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:32.978620Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:32.979713Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 181 totakecount 20 count 20 size 421093 from pos 0 cbcount 20
2025-10-10T14:57:32.977056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 186
2025-10-10T14:57:32.985478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 187 offsets: 186 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.985553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 187
2025-10-10T14:57:32.985855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 188 offsets: 187 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.985890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 188
2025-10-10T14:57:32.986020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 189 offsets: 188 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.986043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 189
2025-10-10T14:57:32.986151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 190 offsets: 189 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.986172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 190
2025-10-10T14:57:32.986282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 191 offsets: 190 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 22 }
2025-10-10T14:57:32.986307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 191
2025-10-10T14:57:32.986421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 192 offsets: 191 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.986448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 192
2025-10-10T14:57:32.986565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 193 offsets: 192 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.986590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 193
2025-10-10T14:57:32.986698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 194 offsets: 193 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.986720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 194
2025-10-10T14:57:32.986819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 195 offsets: 194 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:32.986839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 195
2025-10-10T14:57:32.986627Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.986671Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.986720Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.986732Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.986807Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.986817Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.986843Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.986853Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.990086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.990132Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.990185Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 217 partNo : 0 messageNo: 437 size 23845 offset: -1
2025-10-10T14:57:32.990248Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:32.990258Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:32.990398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 181
2025-10-10T14:57:32.993324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 196 offsets: 195 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 16 }
2025-10-10T14:57:32.993377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 196
2025-10-10T14:57:32.992493Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.001487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 197 offsets: 196 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.001580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 197
2025-10-10T14:57:33.002002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 198 offsets: 197 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.002050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 198
2025-10-10T14:57:33.002315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 199 offsets: 198 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.002368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 199
2025-10-10T14:57:33.002644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 200 offsets: 199 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.002673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 200
2025-10-10T14:57:33.002786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 201 offsets: 200 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.002810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 201
2025-10-10T14:57:33.009513Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.048446Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.048504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.048855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 433  requestId: <none> cookie: 218
2025-10-10T14:57:33.048892Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 434  requestId: <none> cookie: 219
2025-10-10T14:57:33.048911Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 435  requestId: <none> cookie: 220
2025-10-10T14:57:33.048930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 436  requestId: <none> cookie: 221
2025-10-10T14:57:33.048946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 438  requestId: <none> cookie: 222
2025-10-10T14:57:33.050645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.050726Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.050757Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.050797Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.050851Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.050897Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:57:33.051482Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.051687Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.051756Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.051816Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.051859Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.054042Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 201 Result { Offset: 181 Data: "... 19995 bytes ..." SourceId: "\000src_id" SeqNo: 182 WriteTimestampMS: 1760108252841 CreateTimestampMS: 1760108252121 UncompressedSize: 19921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 182 Data: "... 20105 bytes ..." SourceId: "\000src_id" SeqNo: 183 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252121 UncompressedSize: 20031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 183 Data: "... 20215 bytes ..." SourceId: "\000src_id" SeqNo: 184 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252121 UncompressedSize: 20141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 184 Data: "... 20325 bytes ..." SourceId: "\000src_id" SeqNo: 185 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252121 UncompressedSize: 20251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 185 Data: "... 20435 bytes ..." SourceId: "\000src_id" SeqNo: 186 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252122 UncompressedSize: 20361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 186 Data: "... 20545 bytes ..." SourceId: "\000src_id" SeqNo: 187 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252122 UncompressedSize: 20471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 187 Data: "... 20655 bytes ..." SourceId: "\000src_id" SeqNo: 188 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252122 UncompressedSize: 20581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 188 Data: "... 20765 bytes ..." SourceId: "\000src_id" SeqNo: 189 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252122 UncompressedSize: 20691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 189 Data: "... 20875 bytes ..." SourceId: "\000src_id" SeqNo: 190 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252122 UncompressedSize: 20801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 190 Data: "... 20985 bytes ..." SourceId: "\000src_id" SeqNo: 191 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252122 UncompressedSize: 20911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 191 Data: "... 21095 bytes ..." SourceId: "\000src_id" SeqNo: 192 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252123 UncompressedSize: 21021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 192 Data: "... 21205 bytes ..." SourceId: "\000src_id" SeqNo: 193 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252123 UncompressedSize: 21131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 193 Data: "... 21315 bytes ..." SourceId: "\000src_id" SeqNo: 194 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252123 UncompressedSize: 21241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 194 Data: "... 21425 bytes ..." SourceId: "\000src_id" SeqNo: 195 WriteTimestampMS: 1760108252850 CreateTimestampMS: 1760108252123 UncompressedSize: 21351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 195 Data: "... 21535 bytes ..." SourceId: "\000src_id" SeqNo: 196 WriteTimestampMS: 1760108252851 CreateTimestampMS: 1760108252123 UncompressedSize: 21461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 196 Data: "... 21645 bytes ..." SourceId: "\000src_id" SeqNo: 197 WriteTimestampMS: 1760108252851 CreateTimestampMS: 1760108252123 UncompressedSize: 21571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 197 Data: "... 21755 bytes ..." SourceId: "\000src_id" SeqNo: 198 WriteTimestampMS: 1760108252851 CreateTimestampMS: 1760108252123 UncompressedSize: 21681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 198 Data: "... 21865 bytes ..." SourceId: "\000src_id" SeqNo: 199 WriteTimestampMS: 1760108252851 CreateTimestampMS: 1760108252135 UncompressedSize: 21791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 199 Data: "... 21975 bytes ..." SourceId: "\000src_id" SeqNo: 200 WriteTimestampMS: 1760108252851 CreateTimestampMS: 1760108252135 UncompressedSize: 21901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 200 Data: "... 22085 bytes ..." SourceId: "\000src_id" SeqNo: 201 WriteTimestampMS: 1760108252851 CreateTimestampMS: 1760108252135 UncompressedSize: 22011 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551092 RealReadOffset: 200 WaitQuotaTimeMs: 0 EndOffset: 201 StartOffset: 0 } Cookie: 181 }
2025-10-10T14:57:33.055363Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 17 from offset 201
2025-10-10T14:57:33.055406Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 201 ReadOffset 201 ReadGuid 39b16fa1-961e68d2-7dc4c5a0-90022d4c has messages 1
2025-10-10T14:57:33.066786Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 39b16fa1-961e68d2-7dc4c5a0-90022d4c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 420471
2025-10-10T14:57:33.066840Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 39b16fa1-961e68d2-7dc4c5a0-90022d4c
2025-10-10T14:57:33.067698Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:33.067904Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.065356Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.065404Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.065454Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 218 partNo : 0 messageNo: 439 size 23955 offset: -1
2025-10-10T14:57:33.065548Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.065559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.065581Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 219 partNo : 0 messageNo: 440 size 24065 offset: -1
2025-10-10T14:57:33.065636Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.065646Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.065666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 220 partNo : 0 messageNo: 441 size 24175 offset: -1
2025-10-10T14:57:33.069386Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 420471, now ReadSizeBudget = 0, ReadSizeServerDelta = 103817
2025-10-10T14:57:33.065784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.065797Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.065823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 221 partNo : 0 messageNo: 442 size 24285 offset: -1
2025-10-10T14:57:33.065924Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.065936Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.065958Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 222 partNo : 0 messageNo: 443 size 24395 offset: -1
2025-10-10T14:57:33.065993Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.066003Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.066035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.069555Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 103817
2025-10-10T14:57:33.066044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.066068Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.066080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.066109Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.066120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.066145Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.066154Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.066383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.069703Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (181-200)
2025-10-10T14:57:33.066400Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.066440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.069748Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 420471 to budget
2025-10-10T14:57:33.069802Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 420471, ReadSizeServerDelta = 103817
2025-10-10T14:57:33.069981Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.066450Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.066463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.066472Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.066489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.066498Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.066511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.066521Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.066534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.066677Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 201 count 5 size 112226 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.066734Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 444  requestId: <none> cookie: 223
2025-10-10T14:57:33.066768Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 445  requestId: <none> cookie: 224
2025-10-10T14:57:33.066784Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 446  requestId: <none> cookie: 225
2025-10-10T14:57:33.066800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 447  requestId: <none> cookie: 226
2025-10-10T14:57:33.070536Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (181-181)
2025-10-10T14:57:33.070703Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (182-182)
2025-10-10T14:57:33.070836Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (183-183)
2025-10-10T14:57:33.070906Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (184-184)
2025-10-10T14:57:33.071108Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (185-185)
2025-10-10T14:57:33.071188Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (186-186)
2025-10-10T14:57:33.071580Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (187-187)
2025-10-10T14:57:33.071699Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (188-188)
2025-10-10T14:57:33.069575Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.069659Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.066815Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 448  requestId: <none> cookie: 227
2025-10-10T14:57:33.069723Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.066833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.069783Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.066876Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 112110 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.069834Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.066918Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.069867Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.066950Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 202, partNo: 0, Offset: 201 is stored on disk
2025-10-10T14:57:33.070464Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.066968Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.070521Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.066989Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 203, partNo: 0, Offset: 202 is stored on disk
2025-10-10T14:57:33.070579Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.067001Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.070625Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.067024Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 204, partNo: 0, Offset: 203 is stored on disk
2025-10-10T14:57:33.070674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.067038Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.070749Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.071104Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.067060Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 205, partNo: 0, Offset: 204 is stored on disk
2025-10-10T14:57:33.071297Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 201 EndOffset 201 newEndOffset 206 commitOffset 0 clientCommitOffset 0 cookie 17 readingFinished 0 firstRead 0
2025-10-10T14:57:33.067074Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.071321Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 201 endOffset 206
2025-10-10T14:57:33.067096Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 206, partNo: 0, Offset: 205 is stored on disk
2025-10-10T14:57:33.071399Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 420471 } }
2025-10-10T14:57:33.067278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.071440Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 201, endOffset# 206, WTime# 1760108252851, sizeLag# 112226
2025-10-10T14:57:33.067342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.071454Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:33.067354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (16)
2025-10-10T14:57:33.071493Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 9ebdd2dc-f27c8d2f-9a6b4fa0-fb100a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 103817, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.067445Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 207 partNo 0
2025-10-10T14:57:33.071601Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 4c84017d-787874f1-4cee9385-69acbdf3
2025-10-10T14:57:33.067918Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 201 partno 0 count 5 parts 0 suffix '63' size 112226
2025-10-10T14:57:33.071642Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.068295Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 207 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 22819 count 1 nextOffset 207 batches 1
2025-10-10T14:57:33.068342Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 208 partNo 0
2025-10-10T14:57:33.068386Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 208 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 45716 count 2 nextOffset 208 batches 1
2025-10-10T14:57:33.068412Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 209 partNo 0
2025-10-10T14:57:33.068449Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 209 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 68723 count 3 nextOffset 209 batches 1
2025-10-10T14:57:33.068481Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 210 partNo 0
2025-10-10T14:57:33.068506Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 210 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 91840 count 4 nextOffset 210 batches 1
2025-10-10T14:57:33.068539Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 211 partNo 0
2025-10-10T14:57:33.068572Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 211 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 115067 count 5 nextOffset 211 batches 1
2025-10-10T14:57:33.068601Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 212 partNo 0
2025-10-10T14:57:33.068629Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 212 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 138404 count 6 nextOffset 212 batches 1
2025-10-10T14:57:33.068660Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 213 partNo 0
2025-10-10T14:57:33.068684Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 213 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 161851 count 7 nextOffset 213 batches 1
2025-10-10T14:57:33.068718Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 214 partNo 0
2025-10-10T14:57:33.073144Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.068742Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 214 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 185408 count 8 nextOffset 214 batches 1
2025-10-10T14:57:33.068762Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 215 partNo 0
2025-10-10T14:57:33.068794Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 215 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 209075 count 9 nextOffset 215 batches 1
2025-10-10T14:57:33.068825Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 216 partNo 0
2025-10-10T14:57:33.068852Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 216 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 232852 count 10 nextOffset 216 batches 1
2025-10-10T14:57:33.068878Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 217 partNo 0
2025-10-10T14:57:33.068907Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 217 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 256739 count 11 nextOffset 217 batches 1
2025-10-10T14:57:33.068935Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 218 partNo 0
2025-10-10T14:57:33.068959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 218 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 280736 count 12 nextOffset 218 batches 1
2025-10-10T14:57:33.068987Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 219 partNo 0
2025-10-10T14:57:33.069008Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 219 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 304843 count 13 nextOffset 219 batches 1
2025-10-10T14:57:33.069029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 220 partNo 0
2025-10-10T14:57:33.069057Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 220 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 329060 count 14 nextOffset 220 batches 1
2025-10-10T14:57:33.069090Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 221 partNo 0
2025-10-10T14:57:33.069115Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 221 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 353387 count 15 nextOffset 221 batches 1
2025-10-10T14:57:33.069851Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 222 partNo 0
2025-10-10T14:57:33.069887Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 222 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 377824 count 16 nextOffset 222 batches 1
2025-10-10T14:57:33.069905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.073489Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 103817 maxTimeLagMs 0 readTimestampMs 0 readOffset 201 EndOffset 206 ClientCommitOffset 0 committedOffset 0 Guid 9ebdd2dc-f27c8d2f-9a6b4fa0-fb100a
2025-10-10T14:57:33.082841Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (189-189)
2025-10-10T14:57:33.082931Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (190-190)
2025-10-10T14:57:33.083040Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (191-191)
2025-10-10T14:57:33.083119Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (192-192)
2025-10-10T14:57:33.083193Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (193-193)
2025-10-10T14:57:33.083267Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (194-194)
2025-10-10T14:57:33.083340Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (195-195)
2025-10-10T14:57:33.083415Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (196-196)
2025-10-10T14:57:33.084084Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (197-197)
2025-10-10T14:57:33.082487Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 206,16 HeadOffset 206 endOffset 206 curOffset 222 d0000000000_00000000000000000206_00000_0000000016_00000? size 377392 WTime 1760108253081
2025-10-10T14:57:33.084189Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 3} (198-198)
2025-10-10T14:57:33.084261Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 4} (199-199)
2025-10-10T14:57:33.084344Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 5} (200-200)
2025-10-10T14:57:33.084933Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.085034Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 407  requestId: <none> cookie: 202
2025-10-10T14:57:33.085108Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 408  requestId: <none> cookie: 203
2025-10-10T14:57:33.085158Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 409  requestId: <none> cookie: 204
2025-10-10T14:57:33.085184Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 410  requestId: <none> cookie: 205
2025-10-10T14:57:33.085212Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 411  requestId: <none> cookie: 206
2025-10-10T14:57:33.085693Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.085727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.085797Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 223 partNo : 0 messageNo: 449 size 24505 offset: -1
2025-10-10T14:57:33.085941Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.085963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.086002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 224 partNo : 0 messageNo: 450 size 24615 offset: -1
>>> event from dataHandler: 2025-10-10T14:57:33.113424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.113486Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.113559Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 225 partNo : 0 messageNo: 451 size 24725 offset: -1
2025-10-10T14:57:33.114265Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.114288Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.114326Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 226 partNo : 0 messageNo: 452 size 24835 offset: -1
2025-10-10T14:57:33.114468Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.114484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.114511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 227 partNo : 0 messageNo: 453 size 24945 offset: -1
2025-10-10T14:57:33.114549Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.114565Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.114605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.114618Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.114651Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.114664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.114697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.114709Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.114742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.114753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.114832Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.114844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.114885Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.115015Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 206 partNo 0 count 16 size 377392
2025-10-10T14:57:33.115057Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.115110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.115124Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.115139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.115151Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.115165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.115175Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.115193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.115201Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.115215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.115441Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 454  requestId: <none> cookie: 228
2025-10-10T14:57:33.115492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 455  requestId: <none> cookie: 229
2025-10-10T14:57:33.115512Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 456  requestId: <none> cookie: 230
2025-10-10T14:57:33.115530Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 457  requestId: <none> cookie: 231
2025-10-10T14:57:33.115549Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 458  requestId: <none> cookie: 232
2025-10-10T14:57:33.115645Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 20 Topic 'rt3.dc1--test-topic' partition 0 user user offset 201 count 6 size 103817 endOffset 206 max time lag 0ms effective offset 201
2025-10-10T14:57:33.115826Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 20 added 1 blobs, size 112226 count 5 last offset 201, current partition end offset: 206
2025-10-10T14:57:33.115841Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 20. Send blob request.
2025-10-10T14:57:33.115906Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 201 partno 0 count 5 parts_count 0 source 1 size 112226 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.115934Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 20. All 1 blobs are from cache.
2025-10-10T14:57:33.115988Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:33.116708Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 201 partno 0 count 5 parts 0 suffix '63'
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..19921 bytes.. Information: { Offset: 181 ProducerId: "src_id" SeqNo: 182 CreateTime: 2025-10-10T14:57:32.121000Z WriteTime: 2025-10-10T14:57:32.841000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20031 bytes.. Information: { Offset: 182 ProducerId: "src_id" SeqNo: 183 CreateTime: 2025-10-10T14:57:32.121000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20141 bytes.. Information: { Offset: 183 ProducerId: "src_id" SeqNo: 184 CreateTime: 2025-10-10T14:57:32.121000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20251 bytes.. Information: { Offset: 184 ProducerId: "src_id" SeqNo: 185 CreateTime: 2025-10-10T14:57:32.121000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20361 bytes.. Information: { Offset: 185 ProducerId: "src_id" SeqNo: 186 CreateTime: 2025-10-10T14:57:32.122000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20471 bytes.. Information: { Offset: 186 ProducerId: "src_id" SeqNo: 187 CreateTime: 2025-10-10T14:57:32.122000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20581 bytes.. Information: { Offset: 187 ProducerId: "src_id" SeqNo: 188 CreateTime: 2025-10-10T14:57:32.122000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20691 bytes.. Information: { Offset: 188 ProducerId: "src_id" SeqNo: 189 CreateTime: 2025-10-10T14:57:32.122000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20801 bytes.. Information: { Offset: 189 ProducerId: "src_id" SeqNo: 190 CreateTime: 2025-10-10T14:57:32.122000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20911 bytes.. Information: { Offset: 190 ProducerId: "src_id" SeqNo: 191 CreateTime: 2025-10-10T14:57:32.122000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21021 bytes.. Information: { Offset: 191 ProducerId: "src_id" SeqNo: 192 CreateTime: 2025-10-10T14:57:32.123000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21131 bytes.. Information: { Offset: 192 ProducerId: "src_id" SeqNo: 193 CreateTime: 2025-10-10T14:57:32.123000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21241 bytes.. Information: { Offset: 193 ProducerId: "src_id" SeqNo: 194 CreateTime: 2025-10-10T14:57:32.123000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21351 bytes.. Information: { Offset: 194 ProducerId: "src_id" SeqNo: 195 CreateTime: 2025-10-10T14:57:32.123000Z WriteTime: 2025-10-10T14:57:32.850000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21461 bytes.. Information: { Offset: 195 ProducerId: "src_id" SeqNo: 196 CreateTime: 2025-10-10T14:57:32.123000Z WriteTime: 2025-10-10T14:57:32.851000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21571 bytes.. Information: { Offset: 196 ProducerId: "src_id" SeqNo: 197 CreateTime: 2025-10-10T14:57:32.123000Z WriteTime: 2025-10-10T14:57:32.851000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21681 bytes.. Information: { Offset: 197 ProducerId: "src_id" SeqNo: 198 CreateTime: 2025-10-10T14:57:32.123000Z WriteTime: 2025-10-10T14:57:32.851000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21791 bytes.. Information: { Offset: 198 ProducerId: "src_id" SeqNo: 199 CreateTime: 2025-10-10T14:57:32.135000Z WriteTime: 2025-10-10T14:57:32.851000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21901 bytes.. Information: { Offset: 199 ProducerId: "src_id" SeqNo: 200 CreateTime: 2025-10-10T14:57:32.135000Z WriteTime: 2025-10-10T14:57:32.851000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22011 bytes.. Information: { Offset: 200 ProducerId: "src_id" SeqNo: 201 CreateTime: 2025-10-10T14:57:32.135000Z WriteTime: 2025-10-10T14:57:32.851000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.129111Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 20, size 419320 bytes
2025-10-10T14:57:33.129186Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.132786Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 201 totakecount 5 count 5 size 112203 from pos 0 cbcount 5
2025-10-10T14:57:33.133072Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 201
2025-10-10T14:57:33.141506Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 206 count 16 size 377392 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.141589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.141636Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 377232 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.141666Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.141697Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 207, partNo: 0, Offset: 206 is stored on disk
2025-10-10T14:57:33.141716Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.141736Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 208, partNo: 0, Offset: 207 is stored on disk
2025-10-10T14:57:33.141748Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.141780Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 209, partNo: 0, Offset: 208 is stored on disk
2025-10-10T14:57:33.141792Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.141812Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 210, partNo: 0, Offset: 209 is stored on disk
2025-10-10T14:57:33.141825Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.141844Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 211, partNo: 0, Offset: 210 is stored on disk
2025-10-10T14:57:33.141855Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.141877Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 212, partNo: 0, Offset: 211 is stored on disk
2025-10-10T14:57:33.141889Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.141910Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 213, partNo: 0, Offset: 212 is stored on disk
2025-10-10T14:57:33.141922Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.141941Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 214, partNo: 0, Offset: 213 is stored on disk
2025-10-10T14:57:33.141954Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.141972Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 215, partNo: 0, Offset: 214 is stored on disk
2025-10-10T14:57:33.141983Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.142000Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 216, partNo: 0, Offset: 215 is stored on disk
2025-10-10T14:57:33.142011Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.142028Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 217, partNo: 0, Offset: 216 is stored on disk
2025-10-10T14:57:33.142039Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.142056Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 218, partNo: 0, Offset: 217 is stored on disk
2025-10-10T14:57:33.142067Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.142087Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 219, partNo: 0, Offset: 218 is stored on disk
2025-10-10T14:57:33.142098Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.142116Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 220, partNo: 0, Offset: 219 is stored on disk
2025-10-10T14:57:33.142131Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.142151Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 221, partNo: 0, Offset: 220 is stored on disk
2025-10-10T14:57:33.142163Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.142180Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 222, partNo: 0, Offset: 221 is stored on disk
2025-10-10T14:57:33.142564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.142603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.142614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:57:33.142705Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 223 partNo 0
2025-10-10T14:57:33.148884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 202 offsets: 201 already_written: false write_statistics { persist_duration_ms: 157 queued_in_partition_duration_ms: 48 }
2025-10-10T14:57:33.148956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 202
2025-10-10T14:57:33.146661Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.146730Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.146839Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.146895Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.146952Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.147005Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.147058Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.147100Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.147126Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.147172Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.147221Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.148497Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.148612Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.148669Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.148756Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.148819Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.149488Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 206 partno 0 count 16 parts 0 suffix '63' size 377392
2025-10-10T14:57:33.150868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 203 offsets: 202 already_written: false write_statistics { persist_duration_ms: 157 queued_in_partition_duration_ms: 48 }
2025-10-10T14:57:33.150906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 203
2025-10-10T14:57:33.151083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 204 offsets: 203 already_written: false write_statistics { persist_duration_ms: 157 queued_in_partition_duration_ms: 48 }
2025-10-10T14:57:33.151123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 204
2025-10-10T14:57:33.151338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 205 offsets: 204 already_written: false write_statistics { persist_duration_ms: 157 queued_in_partition_duration_ms: 44 }
2025-10-10T14:57:33.151379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 205
2025-10-10T14:57:33.151910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 206 offsets: 205 already_written: false write_statistics { persist_duration_ms: 157 queued_in_partition_duration_ms: 44 }
2025-10-10T14:57:33.151958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 206
2025-10-10T14:57:33.157440Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 112152, now ReadSizeBudget = 0, ReadSizeServerDelta = 412136
2025-10-10T14:57:33.157550Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 412136
2025-10-10T14:57:33.157708Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (201-205)
2025-10-10T14:57:33.157748Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 112152 to budget
2025-10-10T14:57:33.157795Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 112152, ReadSizeServerDelta = 412136
2025-10-10T14:57:33.158019Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.158123Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (201-201)
2025-10-10T14:57:33.158170Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (202-202)
2025-10-10T14:57:33.158218Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (203-203)
2025-10-10T14:57:33.158261Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (204-204)
2025-10-10T14:57:33.158332Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (205-205)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..22121 bytes.. Information: { Offset: 201 ProducerId: "src_id" SeqNo: 202 CreateTime: 2025-10-10T14:57:32.135000Z WriteTime: 2025-10-10T14:57:32.870000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22231 bytes.. Information: { Offset: 202 ProducerId: "src_id" SeqNo: 203 CreateTime: 2025-10-10T14:57:32.135000Z WriteTime: 2025-10-10T14:57:32.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22341 bytes.. Information: { Offset: 203 ProducerId: "src_id" SeqNo: 204 CreateTime: 2025-10-10T14:57:32.136000Z WriteTime: 2025-10-10T14:57:32.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22451 bytes.. Information: { Offset: 204 ProducerId: "src_id" SeqNo: 205 CreateTime: 2025-10-10T14:57:32.136000Z WriteTime: 2025-10-10T14:57:32.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22561 bytes.. Information: { Offset: 205 ProducerId: "src_id" SeqNo: 206 CreateTime: 2025-10-10T14:57:32.136000Z WriteTime: 2025-10-10T14:57:32.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.158787Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 5, size 111705 bytes
2025-10-10T14:57:33.158822Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.151120Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 206 Result { Offset: 201 Data: "... 22195 bytes ..." SourceId: "\000src_id" SeqNo: 202 WriteTimestampMS: 1760108252870 CreateTimestampMS: 1760108252135 UncompressedSize: 22121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 202 Data: "... 22305 bytes ..." SourceId: "\000src_id" SeqNo: 203 WriteTimestampMS: 1760108252908 CreateTimestampMS: 1760108252135 UncompressedSize: 22231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 203 Data: "... 22415 bytes ..." SourceId: "\000src_id" SeqNo: 204 WriteTimestampMS: 1760108252908 CreateTimestampMS: 1760108252136 UncompressedSize: 22341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 204 Data: "... 22525 bytes ..." SourceId: "\000src_id" SeqNo: 205 WriteTimestampMS: 1760108252908 CreateTimestampMS: 1760108252136 UncompressedSize: 22451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 205 Data: "... 22635 bytes ..." SourceId: "\000src_id" SeqNo: 206 WriteTimestampMS: 1760108252908 CreateTimestampMS: 1760108252136 UncompressedSize: 22561 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 205 WaitQuotaTimeMs: 0 EndOffset: 206 StartOffset: 0 } Cookie: 201 }
2025-10-10T14:57:33.151702Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 18 from offset 206
2025-10-10T14:57:33.151751Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 206 ReadOffset 206 ReadGuid 9ebdd2dc-f27c8d2f-9a6b4fa0-fb100a has messages 1
2025-10-10T14:57:33.152131Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.152662Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 9ebdd2dc-f27c8d2f-9a6b4fa0-fb100a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 112152
2025-10-10T14:57:33.152689Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 9ebdd2dc-f27c8d2f-9a6b4fa0-fb100a
2025-10-10T14:57:33.152961Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:33.153387Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.169012Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 223 partNo 0 FormedBlobsCount 0 NewHead: Offset 222 PartNo 0 PackedSize 24579 count 1 nextOffset 223 batches 1
2025-10-10T14:57:33.169120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 224 partNo 0
2025-10-10T14:57:33.169178Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 224 partNo 0 FormedBlobsCount 0 NewHead: Offset 222 PartNo 0 PackedSize 49236 count 2 nextOffset 224 batches 1
2025-10-10T14:57:33.169201Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 225 partNo 0
2025-10-10T14:57:33.169221Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 225 partNo 0 FormedBlobsCount 0 NewHead: Offset 222 PartNo 0 PackedSize 74003 count 3 nextOffset 225 batches 1
2025-10-10T14:57:33.169240Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 226 partNo 0
2025-10-10T14:57:33.169259Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 226 partNo 0 FormedBlobsCount 0 NewHead: Offset 222 PartNo 0 PackedSize 98880 count 4 nextOffset 226 batches 1
2025-10-10T14:57:33.169292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 227 partNo 0
2025-10-10T14:57:33.169315Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 227 partNo 0 FormedBlobsCount 0 NewHead: Offset 222 PartNo 0 PackedSize 123867 count 5 nextOffset 227 batches 1
2025-10-10T14:57:33.169338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.170119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 222,5 HeadOffset 222 endOffset 222 curOffset 227 d0000000000_00000000000000000222_00000_0000000005_00000? size 123776 WTime 1760108253169
2025-10-10T14:57:33.170433Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.170528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 417  requestId: <none> cookie: 207
2025-10-10T14:57:33.170597Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 418  requestId: <none> cookie: 208
2025-10-10T14:57:33.170622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 419  requestId: <none> cookie: 209
2025-10-10T14:57:33.170646Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 420  requestId: <none> cookie: 210
2025-10-10T14:57:33.170673Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 421  requestId: <none> cookie: 211
2025-10-10T14:57:33.170697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 427  requestId: <none> cookie: 212
2025-10-10T14:57:33.170723Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 428  requestId: <none> cookie: 213
2025-10-10T14:57:33.170749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 429  requestId: <none> cookie: 214
2025-10-10T14:57:33.170774Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 430  requestId: <none> cookie: 215
2025-10-10T14:57:33.170796Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 431  requestId: <none> cookie: 216
2025-10-10T14:57:33.170820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 437  requestId: <none> cookie: 217
2025-10-10T14:57:33.170844Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 439  requestId: <none> cookie: 218
2025-10-10T14:57:33.170870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 440  requestId: <none> cookie: 219
2025-10-10T14:57:33.170892Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 441  requestId: <none> cookie: 220
2025-10-10T14:57:33.170916Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 442  requestId: <none> cookie: 221
2025-10-10T14:57:33.170941Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 443  requestId: <none> cookie: 222
2025-10-10T14:57:33.171051Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171125Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 228 partNo : 0 messageNo: 459 size 25055 offset: -1
2025-10-10T14:57:33.171199Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 229 partNo : 0 messageNo: 460 size 25165 offset: -1
2025-10-10T14:57:33.171294Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171311Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171333Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 230 partNo : 0 messageNo: 461 size 25275 offset: -1
2025-10-10T14:57:33.171450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171472Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171498Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 231 partNo : 0 messageNo: 462 size 25385 offset: -1
2025-10-10T14:57:33.171577Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171590Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171614Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 232 partNo : 0 messageNo: 463 size 25495 offset: -1
2025-10-10T14:57:33.171653Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171702Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171715Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171744Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171756Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171786Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171798Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.171843Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.171894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.171912Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.172020Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 222 partNo 0 count 5 size 123776
2025-10-10T14:57:33.172049Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.172087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.172099Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.172112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.172122Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.172139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.172149Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.172163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.172173Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.172187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.173562Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 464  requestId: <none> cookie: 233
2025-10-10T14:57:33.173595Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 465  requestId: <none> cookie: 234
2025-10-10T14:57:33.173614Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 466  requestId: <none> cookie: 235
2025-10-10T14:57:33.173632Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 467  requestId: <none> cookie: 236
2025-10-10T14:57:33.173648Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 468  requestId: <none> cookie: 237
2025-10-10T14:57:33.182933Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 222 count 5 size 123776 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.183002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.183049Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 123660 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.183092Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.183109Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 222 partno 0 count 5 parts 0 suffix '63' size 123776
2025-10-10T14:57:33.183132Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 223, partNo: 0, Offset: 222 is stored on disk
2025-10-10T14:57:33.183153Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.183173Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 224, partNo: 0, Offset: 223 is stored on disk
2025-10-10T14:57:33.183183Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.183201Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 225, partNo: 0, Offset: 224 is stored on disk
2025-10-10T14:57:33.183211Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.183233Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 226, partNo: 0, Offset: 225 is stored on disk
2025-10-10T14:57:33.183246Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.183269Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 227, partNo: 0, Offset: 226 is stored on disk
2025-10-10T14:57:33.183450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.183491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.183502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:57:33.183589Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 228 partNo 0
2025-10-10T14:57:33.184505Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 228 partNo 0 FormedBlobsCount 0 NewHead: Offset 227 PartNo 0 PackedSize 25129 count 1 nextOffset 228 batches 1
2025-10-10T14:57:33.184561Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 229 partNo 0
2025-10-10T14:57:33.184590Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 229 partNo 0 FormedBlobsCount 0 NewHead: Offset 227 PartNo 0 PackedSize 50336 count 2 nextOffset 229 batches 1
2025-10-10T14:57:33.184617Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 230 partNo 0
2025-10-10T14:57:33.184642Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 230 partNo 0 FormedBlobsCount 0 NewHead: Offset 227 PartNo 0 PackedSize 75653 count 3 nextOffset 230 batches 1
2025-10-10T14:57:33.184671Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 231 partNo 0
2025-10-10T14:57:33.184691Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 231 partNo 0 FormedBlobsCount 0 NewHead: Offset 227 PartNo 0 PackedSize 101080 count 4 nextOffset 231 batches 1
2025-10-10T14:57:33.184710Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 232 partNo 0
2025-10-10T14:57:33.184733Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 232 partNo 0 FormedBlobsCount 0 NewHead: Offset 227 PartNo 0 PackedSize 126617 count 5 nextOffset 232 batches 1
2025-10-10T14:57:33.184746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.185546Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 227,5 HeadOffset 227 endOffset 227 curOffset 232 d0000000000_00000000000000000227_00000_0000000005_00000? size 126526 WTime 1760108253185
2025-10-10T14:57:33.185867Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.185923Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 449  requestId: <none> cookie: 223
2025-10-10T14:57:33.185987Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 450  requestId: <none> cookie: 224
2025-10-10T14:57:33.186013Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 451  requestId: <none> cookie: 225
2025-10-10T14:57:33.186038Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 452  requestId: <none> cookie: 226
2025-10-10T14:57:33.186062Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 453  requestId: <none> cookie: 227
2025-10-10T14:57:33.186089Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.186190Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 227 partNo 0 count 5 size 126526
2025-10-10T14:57:33.195155Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 227 count 5 size 126526 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.195232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.195279Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 126410 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.195287Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 227 partno 0 count 5 parts 0 suffix '63' size 126526
2025-10-10T14:57:33.195311Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.195353Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 228, partNo: 0, Offset: 227 is stored on disk
2025-10-10T14:57:33.195372Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.195394Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 229, partNo: 0, Offset: 228 is stored on disk
2025-10-10T14:57:33.195406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.195427Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 230, partNo: 0, Offset: 229 is stored on disk
2025-10-10T14:57:33.195439Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.195460Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 231, partNo: 0, Offset: 230 is stored on disk
2025-10-10T14:57:33.195473Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.195492Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 232, partNo: 0, Offset: 231 is stored on disk
2025-10-10T14:57:33.196092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.196111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.196122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.196154Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.196203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 459  requestId: <none> cookie: 228
2025-10-10T14:57:33.196253Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 460  requestId: <none> cookie: 229
2025-10-10T14:57:33.196277Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 461  requestId: <none> cookie: 230
2025-10-10T14:57:33.196301Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 462  requestId: <none> cookie: 231
2025-10-10T14:57:33.196325Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 463  requestId: <none> cookie: 232
2025-10-10T14:57:33.269681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.269711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.269723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.319450Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.319539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319620Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319663Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319695Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319724Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319757Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319816Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319847Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319878Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319908Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319937Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319964Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.319994Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320021Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320052Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320077Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320120Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320145Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320170Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320198Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320243Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320265Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320290Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320341Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320371Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320400Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320426Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.320483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.323096Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.323170Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.323215Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.323239Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.323279Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.323316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.324003Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 112152 } }
2025-10-10T14:57:33.324076Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 2a4b0a9a-5b3be4a1-48da3b8b-ad653b5c
2025-10-10T14:57:33.324155Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 206 EndOffset 206 newEndOffset 222 commitOffset 0 clientCommitOffset 0 cookie 18 readingFinished 0 firstRead 0
2025-10-10T14:57:33.324177Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 206 endOffset 222
2025-10-10T14:57:33.324341Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 206, endOffset# 222, WTime# 1760108252908, sizeLag# 377392
2025-10-10T14:57:33.324355Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 1
2025-10-10T14:57:33.324393Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 2db1f50e-ee8c4d69-bc141bee-234426e1, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 452870, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.324776Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 452870 maxTimeLagMs 0 readTimestampMs 0 readOffset 206 EndOffset 222 ClientCommitOffset 0 committedOffset 0 Guid 2db1f50e-ee8c4d69-bc141bee-234426e1
2025-10-10T14:57:33.325015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 207 offsets: 206 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 149 }
2025-10-10T14:57:33.325059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 207
2025-10-10T14:57:33.326134Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.327896Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.324871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.324915Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.324970Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 233 partNo : 0 messageNo: 469 size 25605 offset: -1
2025-10-10T14:57:33.325045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.325056Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.329301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 208 offsets: 207 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 149 }
2025-10-10T14:57:33.329348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 208
2025-10-10T14:57:33.329590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 209 offsets: 208 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 149 }
2025-10-10T14:57:33.329621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 209
2025-10-10T14:57:33.329826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 210 offsets: 209 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 149 }
2025-10-10T14:57:33.329855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 210
2025-10-10T14:57:33.329988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 211 offsets: 210 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 149 }
2025-10-10T14:57:33.330009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 211
2025-10-10T14:57:33.330115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 212 offsets: 211 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 103 }
2025-10-10T14:57:33.330138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 212
2025-10-10T14:57:33.330254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 213 offsets: 212 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 103 }
2025-10-10T14:57:33.330278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 213
2025-10-10T14:57:33.330403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 214 offsets: 213 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 103 }
2025-10-10T14:57:33.330424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 214
2025-10-10T14:57:33.330515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 215 offsets: 214 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 103 }
2025-10-10T14:57:33.330534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 215
2025-10-10T14:57:33.330635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 216 offsets: 215 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 103 }
2025-10-10T14:57:33.330656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 216
2025-10-10T14:57:33.325079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 234 partNo : 0 messageNo: 470 size 25715 offset: -1
2025-10-10T14:57:33.325161Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.325173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.325196Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 235 partNo : 0 messageNo: 471 size 25825 offset: -1
2025-10-10T14:57:33.325253Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.325265Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.325286Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 236 partNo : 0 messageNo: 472 size 25935 offset: -1
2025-10-10T14:57:33.325342Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.325356Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.325378Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 237 partNo : 0 messageNo: 473 size 26045 offset: -1
2025-10-10T14:57:33.325404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.325448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.325467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.325477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:57:33.325573Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 233 partNo 0
2025-10-10T14:57:33.331262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 217 offsets: 216 already_written: false write_statistics { persist_duration_ms: 74 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:33.331294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 217
2025-10-10T14:57:33.331448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 218 offsets: 217 already_written: false write_statistics { persist_duration_ms: 74 }
2025-10-10T14:57:33.331470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 218
2025-10-10T14:57:33.331583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 219 offsets: 218 already_written: false write_statistics { persist_duration_ms: 74 }
2025-10-10T14:57:33.331606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 219
2025-10-10T14:57:33.331718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 220 offsets: 219 already_written: false write_statistics { persist_duration_ms: 74 }
2025-10-10T14:57:33.331744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 220
2025-10-10T14:57:33.332169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 221 offsets: 220 already_written: false write_statistics { persist_duration_ms: 70 queued_in_partition_duration_ms: 4 }
2025-10-10T14:57:33.332205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 221
2025-10-10T14:57:33.332346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 222 offsets: 221 already_written: false write_statistics { persist_duration_ms: 70 queued_in_partition_duration_ms: 4 }
2025-10-10T14:57:33.332376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 222
2025-10-10T14:57:33.332511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 223 offsets: 222 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 52 }
2025-10-10T14:57:33.332535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 223
2025-10-10T14:57:33.332655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 224 offsets: 223 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 52 }
2025-10-10T14:57:33.332677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 224
2025-10-10T14:57:33.330365Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.331787Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.332233Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.332798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 225 offsets: 224 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 55 }
2025-10-10T14:57:33.332819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 225
2025-10-10T14:57:33.332914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 226 offsets: 225 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 55 }
2025-10-10T14:57:33.332935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 226
2025-10-10T14:57:33.333037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 227 offsets: 226 already_written: false write_statistics { persist_duration_ms: 11 queued_in_partition_duration_ms: 55 }
2025-10-10T14:57:33.333058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 227
2025-10-10T14:57:33.333413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 228 offsets: 227 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.333443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 228
2025-10-10T14:57:33.333211Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.333571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 229 offsets: 228 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.333593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 229
2025-10-10T14:57:33.334096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 230 offsets: 229 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.334127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 230
2025-10-10T14:57:33.334250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 231 offsets: 230 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.334271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 231
2025-10-10T14:57:33.334375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 232 offsets: 231 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 11 }
2025-10-10T14:57:33.334396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 232
2025-10-10T14:57:33.340566Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 233 partNo 0 FormedBlobsCount 0 NewHead: Offset 232 PartNo 0 PackedSize 25679 count 1 nextOffset 233 batches 1
2025-10-10T14:57:33.343019Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.343104Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.343138Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.343163Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.343188Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.343680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.343936Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.344034Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.344104Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.344165Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.344285Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.340743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.341221Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 232,1 HeadOffset 232 endOffset 232 curOffset 233 d0000000000_00000000000000000232_00000_0000000001_00000? size 25670 WTime 1760108253339
2025-10-10T14:57:33.341747Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.341799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.341866Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.341886Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.341923Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.341934Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.341963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.341974Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.342006Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.342018Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.342045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.342055Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.342115Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.342128Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.342163Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.342184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.342197Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.342215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.342227Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.342241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.342259Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.342361Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 232 partNo 0 count 1 size 25670
2025-10-10T14:57:33.342613Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 474  requestId: <none> cookie: 238
2025-10-10T14:57:33.344788Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.342649Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 475  requestId: <none> cookie: 239
2025-10-10T14:57:33.342669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 476  requestId: <none> cookie: 240
2025-10-10T14:57:33.342688Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 477  requestId: <none> cookie: 241
2025-10-10T14:57:33.342708Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 478  requestId: <none> cookie: 242
2025-10-10T14:57:33.342812Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 21 Topic 'rt3.dc1--test-topic' partition 0 user user offset 206 count 19 size 452870 endOffset 232 max time lag 0ms effective offset 206
2025-10-10T14:57:33.343229Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 21 added 2 blobs, size 501168 count 21 last offset 222, current partition end offset: 232
2025-10-10T14:57:33.343244Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 21. Send blob request.
2025-10-10T14:57:33.343291Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 206 partno 0 count 16 parts_count 0 source 1 size 377392 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.343315Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 222 partno 0 count 5 parts_count 0 source 1 size 123776 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.343347Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 21. All 2 blobs are from cache.
2025-10-10T14:57:33.343391Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-10-10T14:57:33.345092Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.344759Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 206 totakecount 16 count 16 size 377369 from pos 0 cbcount 16
2025-10-10T14:57:33.345325Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.345505Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 206 partno 0 count 16 parts 0 suffix '63'
2025-10-10T14:57:33.345556Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 222 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:57:33.349447Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 222 totakecount 5 count 5 size 123753 from pos 0 cbcount 5
2025-10-10T14:57:33.349671Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.349694Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.349742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 238 partNo : 0 messageNo: 479 size 26155 offset: -1
2025-10-10T14:57:33.349835Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.349846Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.349871Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 239 partNo : 0 messageNo: 480 size 26265 offset: -1
2025-10-10T14:57:33.350037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 206
2025-10-10T14:57:33.350120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.350158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.350171Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.350185Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.352799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.352830Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.352877Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 240 partNo : 0 messageNo: 481 size 26375 offset: -1
2025-10-10T14:57:33.352948Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.352962Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.352988Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 241 partNo : 0 messageNo: 482 size 26485 offset: -1
2025-10-10T14:57:33.353058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.353070Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.353095Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 242 partNo : 0 messageNo: 483 size 26595 offset: -1
2025-10-10T14:57:33.353144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.353155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.353191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.353204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.353234Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.353246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.353282Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.353295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.353321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.353332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.353354Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.353390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.353403Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.353416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.353426Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.353439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.353510Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 484  requestId: <none> cookie: 243
2025-10-10T14:57:33.353542Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 485  requestId: <none> cookie: 244
2025-10-10T14:57:33.353563Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 486  requestId: <none> cookie: 245
2025-10-10T14:57:33.353580Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 487  requestId: <none> cookie: 246
2025-10-10T14:57:33.353597Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 488  requestId: <none> cookie: 247
2025-10-10T14:57:33.353993Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 232 Result { Offset: 206 Data: "... 22745 bytes ..." SourceId: "\000src_id" SeqNo: 207 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252136 UncompressedSize: 22671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 207 Data: "... 22855 bytes ..." SourceId: "\000src_id" SeqNo: 208 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252136 UncompressedSize: 22781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 208 Data: "... 22965 bytes ..." SourceId: "\000src_id" SeqNo: 209 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252136 UncompressedSize: 22891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 209 Data: "... 23075 bytes ..." SourceId: "\000src_id" SeqNo: 210 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252137 UncompressedSize: 23001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 210 Data: "... 23185 bytes ..." SourceId: "\000src_id" SeqNo: 211 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252141 UncompressedSize: 23111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 211 Data: "... 23295 bytes ..." SourceId: "\000src_id" SeqNo: 212 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252144 UncompressedSize: 23221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 212 Data: "... 23405 bytes ..." SourceId: "\000src_id" SeqNo: 213 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252144 UncompressedSize: 23331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 213 Data: "... 23515 bytes ..." SourceId: "\000src_id" SeqNo: 214 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252144 UncompressedSize: 23441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 214 Data: "... 23625 bytes ..." SourceId: "\000src_id" SeqNo: 215 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252144 UncompressedSize: 23551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 215 Data: "... 23735 bytes ..." SourceId: "\000src_id" SeqNo: 216 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252144 UncompressedSize: 23661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 216 Data: "... 23845 bytes ..." SourceId: "\000src_id" SeqNo: 217 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252145 UncompressedSize: 23771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 217 Data: "... 23955 bytes ..." SourceId: "\000src_id" SeqNo: 218 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252145 UncompressedSize: 23881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 218 Data: "... 24065 bytes ..." SourceId: "\000src_id" SeqNo: 219 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252145 UncompressedSize: 23991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 219 Data: "... 24175 bytes ..." SourceId: "\000src_id" SeqNo: 220 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252145 UncompressedSize: 24101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 220 Data: "... 24285 bytes ..." SourceId: "\000src_id" SeqNo: 221 WriteTimestampMS: 1760108253065 CreateTimestampMS: 1760108252145 UncompressedSize: 24211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 221 Data: "... 24395 bytes ..." SourceId: "\000src_id" SeqNo: 222 WriteTimestampMS: 1760108253069 CreateTimestampMS: 1760108252146 UncompressedSize: 24321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 222 Data: "... 24505 bytes ..." SourceId: "\000src_id" SeqNo: 223 WriteTimestampMS: 1760108253140 CreateTimestampMS: 1760108252146 UncompressedSize: 24431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 223 Data: "... 24615 bytes ..." SourceId: "\000src_id" SeqNo: 224 WriteTimestampMS: 1760108253165 CreateTimestampMS: 1760108252146 UncompressedSize: 24541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 224 Data: "... 24725 bytes ..." SourceId: "\000src_id" SeqNo: 225 WriteTimestampMS: 1760108253169 CreateTimestampMS: 1760108252146 UncompressedSize: 24651 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 426797 RealReadOffset: 224 WaitQuotaTimeMs: 0 EndOffset: 232 StartOffset: 0 } Cookie: 206 }
2025-10-10T14:57:33.354739Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 225 endOffset 232
2025-10-10T14:57:33.354782Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 232 ReadOffset 225 ReadGuid 2db1f50e-ee8c4d69-bc141bee-234426e1 has messages 1
2025-10-10T14:57:33.355146Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 225, endOffset# 232, WTime# 1760108253169, sizeLag# 426797
2025-10-10T14:57:33.355164Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:57:33.355240Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 2db1f50e-ee8c4d69-bc141bee-234426e1, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 450904
2025-10-10T14:57:33.355272Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 2db1f50e-ee8c4d69-bc141bee-234426e1
2025-10-10T14:57:33.356269Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 1
2025-10-10T14:57:33.356341Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 14a7c0b6-7252669c-1c26d557-a7d9c848, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 73384, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.356540Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.356598Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.356627Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.356653Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.356678Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.356712Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 232 count 1 size 25670 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.356771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.356818Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 25612 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.356844Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.356872Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 233, partNo: 0, Offset: 232 is stored on disk
2025-10-10T14:57:33.357023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.357067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.357077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (9)
2025-10-10T14:57:33.357180Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 234 partNo 0
2025-10-10T14:57:33.358041Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 234 partNo 0 FormedBlobsCount 0 NewHead: Offset 233 PartNo 0 PackedSize 25789 count 1 nextOffset 234 batches 1
2025-10-10T14:57:33.358092Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 235 partNo 0
2025-10-10T14:57:33.358125Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 235 partNo 0 FormedBlobsCount 0 NewHead: Offset 233 PartNo 0 PackedSize 51656 count 2 nextOffset 235 batches 1
2025-10-10T14:57:33.358147Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 236 partNo 0
2025-10-10T14:57:33.358169Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 236 partNo 0 FormedBlobsCount 0 NewHead: Offset 233 PartNo 0 PackedSize 77633 count 3 nextOffset 236 batches 1
2025-10-10T14:57:33.358193Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 237 partNo 0
2025-10-10T14:57:33.358214Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 237 partNo 0 FormedBlobsCount 0 NewHead: Offset 233 PartNo 0 PackedSize 103720 count 4 nextOffset 237 batches 1
2025-10-10T14:57:33.358234Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 238 partNo 0
2025-10-10T14:57:33.358254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 238 partNo 0 FormedBlobsCount 0 NewHead: Offset 233 PartNo 0 PackedSize 129917 count 5 nextOffset 238 batches 1
2025-10-10T14:57:33.358276Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 239 partNo 0
2025-10-10T14:57:33.358297Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 239 partNo 0 FormedBlobsCount 0 NewHead: Offset 233 PartNo 0 PackedSize 156224 count 6 nextOffset 239 batches 1
2025-10-10T14:57:33.358318Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 240 partNo 0
2025-10-10T14:57:33.358338Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 240 partNo 0 FormedBlobsCount 0 NewHead: Offset 233 PartNo 0 PackedSize 182641 count 7 nextOffset 240 batches 1
2025-10-10T14:57:33.358360Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 241 partNo 0
2025-10-10T14:57:33.358381Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 241 partNo 0 FormedBlobsCount 0 NewHead: Offset 233 PartNo 0 PackedSize 209168 count 8 nextOffset 241 batches 1
2025-10-10T14:57:33.358404Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 242 partNo 0
2025-10-10T14:57:33.358426Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 242 partNo 0 FormedBlobsCount 0 NewHead: Offset 233 PartNo 0 PackedSize 235805 count 9 nextOffset 242 batches 1
2025-10-10T14:57:33.358441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.359516Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 233,9 HeadOffset 233 endOffset 233 curOffset 242 d0000000000_00000000000000000233_00000_0000000009_00000? size 235590 WTime 1760108253359
2025-10-10T14:57:33.359867Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.359925Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 469  requestId: <none> cookie: 233
2025-10-10T14:57:33.359973Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.360068Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 233 partNo 0 count 9 size 235590
2025-10-10T14:57:33.360621Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 232 partno 0 count 1 parts 0 suffix '63' size 25670
2025-10-10T14:57:33.361907Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 450904, now ReadSizeBudget = 0, ReadSizeServerDelta = 73384
2025-10-10T14:57:33.362077Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 73384
2025-10-10T14:57:33.362284Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (206-224)
2025-10-10T14:57:33.362367Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 450904 to budget
2025-10-10T14:57:33.362418Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 450904, ReadSizeServerDelta = 73384
2025-10-10T14:57:33.361478Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.361770Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.361838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.361880Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.361921Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.362018Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.362057Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.362350Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.362695Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.362816Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (206-206)
2025-10-10T14:57:33.362980Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (207-207)
2025-10-10T14:57:33.363120Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (208-208)
2025-10-10T14:57:33.363195Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (209-209)
2025-10-10T14:57:33.363425Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (210-210)
2025-10-10T14:57:33.363497Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (211-211)
2025-10-10T14:57:33.363608Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (212-212)
2025-10-10T14:57:33.363678Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (213-213)
2025-10-10T14:57:33.364090Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (214-214)
2025-10-10T14:57:33.364179Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (215-215)
2025-10-10T14:57:33.364252Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (216-216)
2025-10-10T14:57:33.364322Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (217-217)
2025-10-10T14:57:33.364392Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (218-218)
2025-10-10T14:57:33.364436Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (219-219)
2025-10-10T14:57:33.364473Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (220-220)
2025-10-10T14:57:33.364513Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (221-221)
2025-10-10T14:57:33.365088Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (222-222)
2025-10-10T14:57:33.365150Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (223-223)
2025-10-10T14:57:33.365187Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (224-224)
2025-10-10T14:57:33.365690Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 73384 maxTimeLagMs 0 readTimestampMs 0 readOffset 225 EndOffset 232 ClientCommitOffset 0 committedOffset 0 Guid 14a7c0b6-7252669c-1c26d557-a7d9c848
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..22671 bytes.. Information: { Offset: 206 ProducerId: "src_id" SeqNo: 207 CreateTime: 2025-10-10T14:57:32.136000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22781 bytes.. Information: { Offset: 207 ProducerId: "src_id" SeqNo: 208 CreateTime: 2025-10-10T14:57:32.136000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22891 bytes.. Information: { Offset: 208 ProducerId: "src_id" SeqNo: 209 CreateTime: 2025-10-10T14:57:32.136000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23001 bytes.. Information: { Offset: 209 ProducerId: "src_id" SeqNo: 210 CreateTime: 2025-10-10T14:57:32.137000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23111 bytes.. Information: { Offset: 210 ProducerId: "src_id" SeqNo: 211 CreateTime: 2025-10-10T14:57:32.141000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23221 bytes.. Information: { Offset: 211 ProducerId: "src_id" SeqNo: 212 CreateTime: 2025-10-10T14:57:32.144000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23331 bytes.. Information: { Offset: 212 ProducerId: "src_id" SeqNo: 213 CreateTime: 2025-10-10T14:57:32.144000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23441 bytes.. Information: { Offset: 213 ProducerId: "src_id" SeqNo: 214 CreateTime: 2025-10-10T14:57:32.144000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23551 bytes.. Information: { Offset: 214 ProducerId: "src_id" SeqNo: 215 CreateTime: 2025-10-10T14:57:32.144000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23661 bytes.. Information: { Offset: 215 ProducerId: "src_id" SeqNo: 216 CreateTime: 2025-10-10T14:57:32.144000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23771 bytes.. Information: { Offset: 216 ProducerId: "src_id" SeqNo: 217 CreateTime: 2025-10-10T14:57:32.145000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23881 bytes.. Information: { Offset: 217 ProducerId: "src_id" SeqNo: 218 CreateTime: 2025-10-10T14:57:32.145000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23991 bytes.. Information: { Offset: 218 ProducerId: "src_id" SeqNo: 219 CreateTime: 2025-10-10T14:57:32.145000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24101 bytes.. Information: { Offset: 219 ProducerId: "src_id" SeqNo: 220 CreateTime: 2025-10-10T14:57:32.145000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24211 bytes.. Information: { Offset: 220 ProducerId: "src_id" SeqNo: 221 CreateTime: 2025-10-10T14:57:32.145000Z WriteTime: 2025-10-10T14:57:33.065000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24321 bytes.. Information: { Offset: 221 ProducerId: "src_id" SeqNo: 222 CreateTime: 2025-10-10T14:57:32.146000Z WriteTime: 2025-10-10T14:57:33.069000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24431 bytes.. Information: { Offset: 222 ProducerId: "src_id" SeqNo: 223 CreateTime: 2025-10-10T14:57:32.146000Z WriteTime: 2025-10-10T14:57:33.140000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24541 bytes.. Information: { Offset: 223 ProducerId: "src_id" SeqNo: 224 CreateTime: 2025-10-10T14:57:32.146000Z WriteTime: 2025-10-10T14:57:33.165000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24651 bytes.. Information: { Offset: 224 ProducerId: "src_id" SeqNo: 225 CreateTime: 2025-10-10T14:57:32.146000Z WriteTime: 2025-10-10T14:57:33.169000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.369144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 233 offsets: 232 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 13 }
2025-10-10T14:57:33.369184Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 19, size 449559 bytes
2025-10-10T14:57:33.365980Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 450904 } }
2025-10-10T14:57:33.366052Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 57aef3d8-642467e5-50db93d6-8e4d4646
2025-10-10T14:57:33.369245Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.366514Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.369591Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.370040Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.369188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 233
2025-10-10T14:57:33.371112Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371155Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.371210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 243 partNo : 0 messageNo: 489 size 26705 offset: -1
2025-10-10T14:57:33.371288Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371301Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.371327Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 244 partNo : 0 messageNo: 490 size 26815 offset: -1
2025-10-10T14:57:33.371393Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371406Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.371433Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 245 partNo : 0 messageNo: 491 size 26925 offset: -1
2025-10-10T14:57:33.371501Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371514Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.371537Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 246 partNo : 0 messageNo: 492 size 27035 offset: -1
2025-10-10T14:57:33.371666Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371683Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.371708Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 247 partNo : 0 messageNo: 493 size 27145 offset: -1
2025-10-10T14:57:33.371749Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.371794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.371834Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.371884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371898Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.371934Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.371949Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.372018Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.372031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.372115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.372131Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.372165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.372178Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.372193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.372203Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.372217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.372226Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.372242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.372252Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.372264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.372373Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 494  requestId: <none> cookie: 248
2025-10-10T14:57:33.372413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 495  requestId: <none> cookie: 249
2025-10-10T14:57:33.372430Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 496  requestId: <none> cookie: 250
2025-10-10T14:57:33.372446Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 497  requestId: <none> cookie: 251
2025-10-10T14:57:33.372463Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 498  requestId: <none> cookie: 252
2025-10-10T14:57:33.372511Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 22 Topic 'rt3.dc1--test-topic' partition 0 user user offset 225 count 8 size 73384 endOffset 233 max time lag 0ms effective offset 225
2025-10-10T14:57:33.372848Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 22 added 2 blobs, size 126526 count 7 last offset 227, current partition end offset: 233
2025-10-10T14:57:33.372862Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 22. Send blob request.
2025-10-10T14:57:33.372916Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 222 partno 0 count 5 parts_count 0 source 1 size 123776 accessed 1 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.372940Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 227 partno 0 count 5 parts_count 0 source 1 size 126526 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.372966Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 22. All 2 blobs are from cache.
2025-10-10T14:57:33.373015Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-10-10T14:57:33.373729Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 222 totakecount 5 count 5 size 123753 from pos 3 cbcount 5
2025-10-10T14:57:33.374415Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 227 totakecount 5 count 5 size 126503 from pos 0 cbcount 5
2025-10-10T14:57:33.374568Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 225
2025-10-10T14:57:33.375204Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 222 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:57:33.375231Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 227 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:57:33.379028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.379066Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.379116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 248 partNo : 0 messageNo: 499 size 27255 offset: -1
2025-10-10T14:57:33.379256Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.379270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.379308Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 249 partNo : 0 messageNo: 500 size 27365 offset: -1
2025-10-10T14:57:33.379436Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.379450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.379477Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 250 partNo : 0 messageNo: 501 size 27475 offset: -1
2025-10-10T14:57:33.376976Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.377062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.377094Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.377139Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.377167Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.377640Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.377880Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.377925Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.380054Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.377965Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.380080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.378000Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.380115Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 251 partNo : 0 messageNo: 502 size 27585 offset: -1
2025-10-10T14:57:33.379073Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 233 Result { Offset: 225 Data: "... 24835 bytes ..." SourceId: "\000src_id" SeqNo: 226 WriteTimestampMS: 1760108253169 CreateTimestampMS: 1760108252146 UncompressedSize: 24761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 226 Data: "... 24945 bytes ..." SourceId: "\000src_id" SeqNo: 227 WriteTimestampMS: 1760108253169 CreateTimestampMS: 1760108252146 UncompressedSize: 24871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 227 Data: "... 25055 bytes ..." SourceId: "\000src_id" SeqNo: 228 WriteTimestampMS: 1760108253180 CreateTimestampMS: 1760108252146 UncompressedSize: 24981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 228 Data: "... 25165 bytes ..." SourceId: "\000src_id" SeqNo: 229 WriteTimestampMS: 1760108253180 CreateTimestampMS: 1760108252147 UncompressedSize: 25091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 229 Data: "... 25275 bytes ..." SourceId: "\000src_id" SeqNo: 230 WriteTimestampMS: 1760108253180 CreateTimestampMS: 1760108252148 UncompressedSize: 25201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 230 Data: "... 25385 bytes ..." SourceId: "\000src_id" SeqNo: 231 WriteTimestampMS: 1760108253180 CreateTimestampMS: 1760108252148 UncompressedSize: 25311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 231 Data: "... 25495 bytes ..." SourceId: "\000src_id" SeqNo: 232 WriteTimestampMS: 1760108253180 CreateTimestampMS: 1760108252148 UncompressedSize: 25421 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 197629 RealReadOffset: 231 WaitQuotaTimeMs: 0 EndOffset: 233 StartOffset: 0 } Cookie: 225 }
2025-10-10T14:57:33.380234Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.379739Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 232 endOffset 233
2025-10-10T14:57:33.380249Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.379778Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 233 ReadOffset 232 ReadGuid 14a7c0b6-7252669c-1c26d557-a7d9c848 has messages 1
2025-10-10T14:57:33.380279Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 252 partNo : 0 messageNo: 503 size 27695 offset: -1
2025-10-10T14:57:33.379867Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 232, endOffset# 233, WTime# 1760108253180, sizeLag# 197629
2025-10-10T14:57:33.380316Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.379883Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:57:33.380328Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.379942Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 14a7c0b6-7252669c-1c26d557-a7d9c848, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 176160
2025-10-10T14:57:33.380373Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.379978Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 14a7c0b6-7252669c-1c26d557-a7d9c848
2025-10-10T14:57:33.380385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.380412Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.380423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.380452Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.380461Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.380485Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.380494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.380517Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.380557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.380570Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.380583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.380594Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.380608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.380619Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.380633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.380643Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.380660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.380745Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 504  requestId: <none> cookie: 253
2025-10-10T14:57:33.380795Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 505  requestId: <none> cookie: 254
2025-10-10T14:57:33.380812Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 506  requestId: <none> cookie: 255
2025-10-10T14:57:33.380829Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 507  requestId: <none> cookie: 256
2025-10-10T14:57:33.380845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 508  requestId: <none> cookie: 257
2025-10-10T14:57:33.383796Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 1
2025-10-10T14:57:33.383864Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# d267238f-c1c5f4a8-d9f9abc7-47d6eaf8, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 237154, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.385027Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.385084Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.385110Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.385167Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.385202Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.385239Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.385880Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.385936Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.385976Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.386012Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.386050Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.386211Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 237154 maxTimeLagMs 0 readTimestampMs 0 readOffset 232 EndOffset 233 ClientCommitOffset 0 committedOffset 0 Guid d267238f-c1c5f4a8-d9f9abc7-47d6eaf8
2025-10-10T14:57:33.389770Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 176160, now ReadSizeBudget = 0, ReadSizeServerDelta = 348128
2025-10-10T14:57:33.389907Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 348128
2025-10-10T14:57:33.390079Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (225-231)
2025-10-10T14:57:33.390122Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 176160 to budget
2025-10-10T14:57:33.390147Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 176160, ReadSizeServerDelta = 348128
2025-10-10T14:57:33.390350Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.390460Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (225-225)
2025-10-10T14:57:33.390581Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (226-226)
2025-10-10T14:57:33.390740Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (227-227)
2025-10-10T14:57:33.390847Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (228-228)
2025-10-10T14:57:33.391079Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (229-229)
2025-10-10T14:57:33.391150Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (230-230)
2025-10-10T14:57:33.391234Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (231-231)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..24761 bytes.. Information: { Offset: 225 ProducerId: "src_id" SeqNo: 226 CreateTime: 2025-10-10T14:57:32.146000Z WriteTime: 2025-10-10T14:57:33.169000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24871 bytes.. Information: { Offset: 226 ProducerId: "src_id" SeqNo: 227 CreateTime: 2025-10-10T14:57:32.146000Z WriteTime: 2025-10-10T14:57:33.169000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24981 bytes.. Information: { Offset: 227 ProducerId: "src_id" SeqNo: 228 CreateTime: 2025-10-10T14:57:32.146000Z WriteTime: 2025-10-10T14:57:33.180000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25091 bytes.. Information: { Offset: 228 ProducerId: "src_id" SeqNo: 229 CreateTime: 2025-10-10T14:57:32.147000Z WriteTime: 2025-10-10T14:57:33.180000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25201 bytes.. Information: { Offset: 229 ProducerId: "src_id" SeqNo: 230 CreateTime: 2025-10-10T14:57:32.148000Z WriteTime: 2025-10-10T14:57:33.180000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25311 bytes.. Information: { Offset: 230 ProducerId: "src_id" SeqNo: 231 CreateTime: 2025-10-10T14:57:32.148000Z WriteTime: 2025-10-10T14:57:33.180000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25421 bytes.. Information: { Offset: 231 ProducerId: "src_id" SeqNo: 232 CreateTime: 2025-10-10T14:57:32.148000Z WriteTime: 2025-10-10T14:57:33.180000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.393630Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 7, size 175637 bytes
2025-10-10T14:57:33.393689Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.393909Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.393952Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 253 partNo : 0 messageNo: 509 size 27805 offset: -1
2025-10-10T14:57:33.394126Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394164Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 254 partNo : 0 messageNo: 510 size 27915 offset: -1
2025-10-10T14:57:33.394271Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394284Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394308Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 255 partNo : 0 messageNo: 511 size 28025 offset: -1
2025-10-10T14:57:33.394409Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394425Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394448Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 256 partNo : 0 messageNo: 512 size 28135 offset: -1
2025-10-10T14:57:33.394571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394584Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394658Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394670Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394750Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 257 partNo : 0 messageNo: 513 size 28245 offset: -1
2025-10-10T14:57:33.394810Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394853Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394867Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394909Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394940Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394951Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.394977Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.394989Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.395189Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.395248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.395267Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.395283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.395292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.395305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.395315Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.395329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.395354Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.395368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.395472Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 233 count 9 size 235590 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.395558Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 514  requestId: <none> cookie: 258
2025-10-10T14:57:33.395593Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 515  requestId: <none> cookie: 259
2025-10-10T14:57:33.395609Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 516  requestId: <none> cookie: 260
2025-10-10T14:57:33.395625Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 517  requestId: <none> cookie: 261
2025-10-10T14:57:33.395642Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 518  requestId: <none> cookie: 262
2025-10-10T14:57:33.395659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.395702Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 235458 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.395734Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.395760Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 234, partNo: 0, Offset: 233 is stored on disk
2025-10-10T14:57:33.395777Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.395795Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 235, partNo: 0, Offset: 234 is stored on disk
2025-10-10T14:57:33.395803Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.395821Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 236, partNo: 0, Offset: 235 is stored on disk
2025-10-10T14:57:33.395833Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.395848Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 237, partNo: 0, Offset: 236 is stored on disk
2025-10-10T14:57:33.395859Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.395877Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 238, partNo: 0, Offset: 237 is stored on disk
2025-10-10T14:57:33.395888Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.395906Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 239, partNo: 0, Offset: 238 is stored on disk
2025-10-10T14:57:33.395916Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.395933Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 240, partNo: 0, Offset: 239 is stored on disk
2025-10-10T14:57:33.395945Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.395962Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 241, partNo: 0, Offset: 240 is stored on disk
2025-10-10T14:57:33.395971Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.395990Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 242, partNo: 0, Offset: 241 is stored on disk
2025-10-10T14:57:33.396152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.396205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.396216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:57:33.396301Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 243 partNo 0
2025-10-10T14:57:33.397504Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 233 partno 0 count 9 parts 0 suffix '63' size 235590
2025-10-10T14:57:33.398549Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 243 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 26779 count 1 nextOffset 243 batches 1
2025-10-10T14:57:33.398624Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 244 partNo 0
2025-10-10T14:57:33.398658Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 244 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 53636 count 2 nextOffset 244 batches 1
2025-10-10T14:57:33.398678Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 245 partNo 0
2025-10-10T14:57:33.398697Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 245 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 80603 count 3 nextOffset 245 batches 1
2025-10-10T14:57:33.398728Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 246 partNo 0
2025-10-10T14:57:33.398752Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 246 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 107680 count 4 nextOffset 246 batches 1
2025-10-10T14:57:33.398775Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 247 partNo 0
2025-10-10T14:57:33.398795Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 247 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 134867 count 5 nextOffset 247 batches 1
2025-10-10T14:57:33.398813Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 248 partNo 0
2025-10-10T14:57:33.398830Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 248 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 162164 count 6 nextOffset 248 batches 1
2025-10-10T14:57:33.398850Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 249 partNo 0
2025-10-10T14:57:33.398867Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 249 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 189571 count 7 nextOffset 249 batches 1
2025-10-10T14:57:33.398886Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 250 partNo 0
2025-10-10T14:57:33.398903Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 250 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 217088 count 8 nextOffset 250 batches 1
2025-10-10T14:57:33.398923Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 251 partNo 0
2025-10-10T14:57:33.398942Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 251 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 244715 count 9 nextOffset 251 batches 1
2025-10-10T14:57:33.398960Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 252 partNo 0
2025-10-10T14:57:33.398976Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 252 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 272452 count 10 nextOffset 252 batches 1
2025-10-10T14:57:33.398995Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 253 partNo 0
2025-10-10T14:57:33.399012Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 253 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 300299 count 11 nextOffset 253 batches 1
2025-10-10T14:57:33.399029Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 254 partNo 0
2025-10-10T14:57:33.399046Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 254 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 328256 count 12 nextOffset 254 batches 1
2025-10-10T14:57:33.399065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 255 partNo 0
2025-10-10T14:57:33.399083Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 255 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 356323 count 13 nextOffset 255 batches 1
2025-10-10T14:57:33.399103Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 256 partNo 0
2025-10-10T14:57:33.399120Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 256 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 384500 count 14 nextOffset 256 batches 1
2025-10-10T14:57:33.399139Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 257 partNo 0
2025-10-10T14:57:33.399157Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 257 partNo 0 FormedBlobsCount 0 NewHead: Offset 242 PartNo 0 PackedSize 412787 count 15 nextOffset 257 batches 1
2025-10-10T14:57:33.399170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.401344Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 242,15 HeadOffset 242 endOffset 242 curOffset 257 d0000000000_00000000000000000242_00000_0000000015_00000? size 412386 WTime 1760108253400
2025-10-10T14:57:33.402367Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.402447Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 23 Topic 'rt3.dc1--test-topic' partition 0 user user offset 232 count 1 size 237154 endOffset 242 max time lag 0ms effective offset 232
2025-10-10T14:57:33.402613Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 23 added 1 blobs, size 25670 count 1 last offset 232, current partition end offset: 242
2025-10-10T14:57:33.402627Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 23. Send blob request.
2025-10-10T14:57:33.402675Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 470  requestId: <none> cookie: 234
2025-10-10T14:57:33.402741Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 471  requestId: <none> cookie: 235
2025-10-10T14:57:33.402764Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 472  requestId: <none> cookie: 236
2025-10-10T14:57:33.402790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 473  requestId: <none> cookie: 237
2025-10-10T14:57:33.402813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 479  requestId: <none> cookie: 238
2025-10-10T14:57:33.402836Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 480  requestId: <none> cookie: 239
2025-10-10T14:57:33.402860Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 481  requestId: <none> cookie: 240
2025-10-10T14:57:33.402884Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 482  requestId: <none> cookie: 241
2025-10-10T14:57:33.402908Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 483  requestId: <none> cookie: 242
2025-10-10T14:57:33.402935Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.403038Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 242 partNo 0 count 15 size 412386
2025-10-10T14:57:33.403094Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 232 partno 0 count 1 parts_count 0 source 1 size 25670 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.403124Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 23. All 1 blobs are from cache.
2025-10-10T14:57:33.403280Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:33.403588Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 232 partno 0 count 1 parts 0 suffix '63'
2025-10-10T14:57:33.403959Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 232 totakecount 1 count 1 size 25647 from pos 0 cbcount 1
2025-10-10T14:57:33.404109Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 232
2025-10-10T14:57:33.407943Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 176160 } }
2025-10-10T14:57:33.408130Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 683242cf-61a4444b-20de575-b0bee956
2025-10-10T14:57:33.408173Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.408219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408278Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408333Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408361Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408425Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408452Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408480Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408509Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408566Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408592Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.408618Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.410307Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.410345Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.410399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 258 partNo : 0 messageNo: 519 size 28355 offset: -1
2025-10-10T14:57:33.410474Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.410486Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.410510Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 259 partNo : 0 messageNo: 520 size 28465 offset: -1
2025-10-10T14:57:33.410574Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.410586Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.410611Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 260 partNo : 0 messageNo: 521 size 28575 offset: -1
2025-10-10T14:57:33.410679Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.410720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.410734Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.410750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.410760Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.410776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.413034Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.413114Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.413174Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.413218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.413260Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.413286Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.414468Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 242 Result { Offset: 232 Data: "... 25605 bytes ..." SourceId: "\000src_id" SeqNo: 233 WriteTimestampMS: 1760108253325 CreateTimestampMS: 1760108252148 UncompressedSize: 25531 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 25693 RealReadOffset: 232 WaitQuotaTimeMs: 0 EndOffset: 242 StartOffset: 0 } Cookie: 232 }
2025-10-10T14:57:33.414644Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 233 endOffset 242
2025-10-10T14:57:33.414679Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 242 ReadOffset 233 ReadGuid d267238f-c1c5f4a8-d9f9abc7-47d6eaf8 has messages 1
2025-10-10T14:57:33.414738Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.414957Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 233, endOffset# 242, WTime# 1760108253325, sizeLag# 25693
2025-10-10T14:57:33.414981Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:57:33.415035Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# d267238f-c1c5f4a8-d9f9abc7-47d6eaf8, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 25703
2025-10-10T14:57:33.415060Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# d267238f-c1c5f4a8-d9f9abc7-47d6eaf8
2025-10-10T14:57:33.416706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 234 offsets: 233 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 16 }
2025-10-10T14:57:33.416749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 234
2025-10-10T14:57:33.416724Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.416757Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.416923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 235 offsets: 234 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 15 }
2025-10-10T14:57:33.416950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 235
2025-10-10T14:57:33.417068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 236 offsets: 235 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 16 }
2025-10-10T14:57:33.417155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 236
2025-10-10T14:57:33.417265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 237 offsets: 236 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 16 }
2025-10-10T14:57:33.417287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 237
2025-10-10T14:57:33.417431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 238 offsets: 237 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:33.417454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 238
2025-10-10T14:57:33.417555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 239 offsets: 238 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 8 }
2025-10-10T14:57:33.417574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 239
2025-10-10T14:57:33.417662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 240 offsets: 239 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 5 }
2025-10-10T14:57:33.417680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 240
2025-10-10T14:57:33.417808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 241 offsets: 240 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 5 }
2025-10-10T14:57:33.417831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 241
2025-10-10T14:57:33.417938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 242 offsets: 241 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 5 }
2025-10-10T14:57:33.417958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 242
2025-10-10T14:57:33.415299Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 1
2025-10-10T14:57:33.415353Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 7cea1157-a920c896-c3e06c0f-3e0850bd, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 30831, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.416932Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 261 partNo : 0 messageNo: 522 size 28685 offset: -1
2025-10-10T14:57:33.417024Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.421577Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 25703, now ReadSizeBudget = 0, ReadSizeServerDelta = 498585
2025-10-10T14:57:33.417038Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.417063Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 262 partNo : 0 messageNo: 523 size 28795 offset: -1
2025-10-10T14:57:33.417094Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.417103Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.417152Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.421674Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 498585
2025-10-10T14:57:33.417162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.417192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.417204Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.417233Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.417246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.417276Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.417288Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.417492Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.421837Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (232-232)
2025-10-10T14:57:33.421877Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 25703 to budget
2025-10-10T14:57:33.417533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.421907Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 25703, ReadSizeServerDelta = 498585
2025-10-10T14:57:33.417547Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.417564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.417672Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 242 count 15 size 412386 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.417725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 524  requestId: <none> cookie: 263
2025-10-10T14:57:33.417778Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 525  requestId: <none> cookie: 264
2025-10-10T14:57:33.417799Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 526  requestId: <none> cookie: 265
2025-10-10T14:57:33.417817Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 527  requestId: <none> cookie: 266
2025-10-10T14:57:33.422008Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.417838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 528  requestId: <none> cookie: 267
2025-10-10T14:57:33.417857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.417901Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 412230 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.422072Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (232-232)
2025-10-10T14:57:33.417932Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.417959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 243, partNo: 0, Offset: 242 is stored on disk
2025-10-10T14:57:33.417977Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.417997Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 244, partNo: 0, Offset: 243 is stored on disk
2025-10-10T14:57:33.418009Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418028Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 245, partNo: 0, Offset: 244 is stored on disk
2025-10-10T14:57:33.418040Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418060Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 246, partNo: 0, Offset: 245 is stored on disk
>>> event from dataHandler: 2025-10-10T14:57:33.418075Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418094Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 247, partNo: 0, Offset: 246 is stored on disk
2025-10-10T14:57:33.418107Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418126Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 248, partNo: 0, Offset: 247 is stored on disk
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..25531 bytes.. Information: { Offset: 232 ProducerId: "src_id" SeqNo: 233 CreateTime: 2025-10-10T14:57:32.148000Z WriteTime: 2025-10-10T14:57:33.325000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.418138Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418155Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 249, partNo: 0, Offset: 248 is stored on disk
2025-10-10T14:57:33.418165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418183Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 250, partNo: 0, Offset: 249 is stored on disk
2025-10-10T14:57:33.418195Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418215Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 251, partNo: 0, Offset: 250 is stored on disk
2025-10-10T14:57:33.418224Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418243Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 252, partNo: 0, Offset: 251 is stored on disk
2025-10-10T14:57:33.418254Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418272Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 253, partNo: 0, Offset: 252 is stored on disk
2025-10-10T14:57:33.418284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418303Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 254, partNo: 0, Offset: 253 is stored on disk
2025-10-10T14:57:33.418315Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 255, partNo: 0, Offset: 254 is stored on disk
2025-10-10T14:57:33.418343Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418360Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 256, partNo: 0, Offset: 255 is stored on disk
2025-10-10T14:57:33.418370Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.418387Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 257, partNo: 0, Offset: 256 is stored on disk
2025-10-10T14:57:33.418794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.418837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.422699Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 1, size 25531 bytes
2025-10-10T14:57:33.418847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-10T14:57:33.422733Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.418939Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 258 partNo 0
2025-10-10T14:57:33.419931Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 258 partNo 0 FormedBlobsCount 0 NewHead: Offset 257 PartNo 0 PackedSize 28429 count 1 nextOffset 258 batches 1
2025-10-10T14:57:33.419981Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 259 partNo 0
2025-10-10T14:57:33.420013Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 259 partNo 0 FormedBlobsCount 0 NewHead: Offset 257 PartNo 0 PackedSize 56936 count 2 nextOffset 259 batches 1
2025-10-10T14:57:33.420036Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 260 partNo 0
2025-10-10T14:57:33.420059Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 260 partNo 0 FormedBlobsCount 0 NewHead: Offset 257 PartNo 0 PackedSize 85553 count 3 nextOffset 260 batches 1
2025-10-10T14:57:33.420079Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 261 partNo 0
2025-10-10T14:57:33.420099Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 261 partNo 0 FormedBlobsCount 0 NewHead: Offset 257 PartNo 0 PackedSize 114280 count 4 nextOffset 261 batches 1
2025-10-10T14:57:33.420119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 262 partNo 0
2025-10-10T14:57:33.420142Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 262 partNo 0 FormedBlobsCount 0 NewHead: Offset 257 PartNo 0 PackedSize 143117 count 5 nextOffset 262 batches 1
2025-10-10T14:57:33.420157Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.421240Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 242 partno 0 count 15 parts 0 suffix '63' size 412386
2025-10-10T14:57:33.423202Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 257,5 HeadOffset 257 endOffset 257 curOffset 262 d0000000000_00000000000000000257_00000_0000000005_00000? size 143026 WTime 1760108253423
2025-10-10T14:57:33.425673Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.425774Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 489  requestId: <none> cookie: 243
2025-10-10T14:57:33.425838Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 490  requestId: <none> cookie: 244
2025-10-10T14:57:33.425865Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 491  requestId: <none> cookie: 245
2025-10-10T14:57:33.425889Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 492  requestId: <none> cookie: 246
2025-10-10T14:57:33.425912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 493  requestId: <none> cookie: 247
2025-10-10T14:57:33.425938Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 499  requestId: <none> cookie: 248
2025-10-10T14:57:33.425963Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 500  requestId: <none> cookie: 249
2025-10-10T14:57:33.425990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 501  requestId: <none> cookie: 250
2025-10-10T14:57:33.426017Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 502  requestId: <none> cookie: 251
2025-10-10T14:57:33.426045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 503  requestId: <none> cookie: 252
2025-10-10T14:57:33.426077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 509  requestId: <none> cookie: 253
2025-10-10T14:57:33.426114Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 510  requestId: <none> cookie: 254
2025-10-10T14:57:33.426137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 511  requestId: <none> cookie: 255
2025-10-10T14:57:33.426163Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 512  requestId: <none> cookie: 256
2025-10-10T14:57:33.426185Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 513  requestId: <none> cookie: 257
2025-10-10T14:57:33.426213Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.426318Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 257 partNo 0 count 5 size 143026
2025-10-10T14:57:33.425884Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.425943Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.426000Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.426028Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.426059Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.426105Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.426819Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.426873Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.426914Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.426951Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.426988Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.427136Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 30831 maxTimeLagMs 0 readTimestampMs 0 readOffset 233 EndOffset 242 ClientCommitOffset 0 committedOffset 0 Guid 7cea1157-a920c896-c3e06c0f-3e0850bd
2025-10-10T14:57:33.430953Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 25703 } }
2025-10-10T14:57:33.431105Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 4fa422a8-35aec275-ba53ce50-62d2185d
2025-10-10T14:57:33.431261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.431317Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.431346Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.431375Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.431405Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.431436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.431466Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.431493Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.431520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.430099Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.431548Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.431573Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.430136Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.430187Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 263 partNo : 0 messageNo: 529 size 28905 offset: -1
2025-10-10T14:57:33.431600Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.430279Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.431628Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.430294Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.431655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.430320Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 264 partNo : 0 messageNo: 530 size 29015 offset: -1
2025-10-10T14:57:33.431682Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.430378Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.431722Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.430388Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.432648Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.430407Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 265 partNo : 0 messageNo: 531 size 29125 offset: -1
2025-10-10T14:57:33.430459Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.430468Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.430490Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 266 partNo : 0 messageNo: 532 size 29235 offset: -1
2025-10-10T14:57:33.430550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.430561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.430584Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 267 partNo : 0 messageNo: 533 size 29345 offset: -1
2025-10-10T14:57:33.430615Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.430629Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.430664Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.430678Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.430708Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.430720Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.430751Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.430763Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.430792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.430805Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.430876Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.430890Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.430928Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.430968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.430982Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.430996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.431007Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.431021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.431032Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.431049Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.431060Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.431073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.431166Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 534  requestId: <none> cookie: 268
2025-10-10T14:57:33.431217Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 535  requestId: <none> cookie: 269
2025-10-10T14:57:33.431236Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 536  requestId: <none> cookie: 270
2025-10-10T14:57:33.431254Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 537  requestId: <none> cookie: 271
2025-10-10T14:57:33.431271Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 538  requestId: <none> cookie: 272
2025-10-10T14:57:33.431326Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 24 Topic 'rt3.dc1--test-topic' partition 0 user user offset 233 count 10 size 30831 endOffset 257 max time lag 0ms effective offset 233
2025-10-10T14:57:33.431504Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 24 added 1 blobs, size 235590 count 9 last offset 233, current partition end offset: 257
2025-10-10T14:57:33.431517Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 24. Send blob request.
2025-10-10T14:57:33.431567Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 233 partno 0 count 9 parts_count 0 source 1 size 235590 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.431596Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 24. All 1 blobs are from cache.
2025-10-10T14:57:33.431638Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:33.432911Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 233 totakecount 9 count 9 size 235567 from pos 0 cbcount 9
2025-10-10T14:57:33.434039Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.434491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 243 offsets: 242 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 26 }
2025-10-10T14:57:33.434527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 243
2025-10-10T14:57:33.434178Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 233 partno 0 count 9 parts 0 suffix '63'
2025-10-10T14:57:33.434705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 244 offsets: 243 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 26 }
2025-10-10T14:57:33.434744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 244
2025-10-10T14:57:33.434890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 245 offsets: 244 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 26 }
2025-10-10T14:57:33.434914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 245
2025-10-10T14:57:33.435022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 246 offsets: 245 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 26 }
2025-10-10T14:57:33.435043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 246
2025-10-10T14:57:33.435177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 247 offsets: 246 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 26 }
2025-10-10T14:57:33.435202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 247
2025-10-10T14:57:33.435306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 248 offsets: 247 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:33.435340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 248
2025-10-10T14:57:33.435486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 249 offsets: 248 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:33.435510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 249
2025-10-10T14:57:33.435628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 250 offsets: 249 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:33.435650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 250
2025-10-10T14:57:33.435749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 251 offsets: 250 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:33.435773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 251
2025-10-10T14:57:33.434729Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.434807Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.434839Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.434865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.434895Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.435898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 252 offsets: 251 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:33.435934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 252
2025-10-10T14:57:33.436060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 253 offsets: 252 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 3 }
2025-10-10T14:57:33.436082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 253
2025-10-10T14:57:33.436180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 254 offsets: 253 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 3 }
2025-10-10T14:57:33.436201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 254
2025-10-10T14:57:33.436303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 255 offsets: 254 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 3 }
2025-10-10T14:57:33.436325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 255
2025-10-10T14:57:33.435373Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.436425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 256 offsets: 255 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 3 }
2025-10-10T14:57:33.435441Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.436449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 256
2025-10-10T14:57:33.435484Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.435521Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.435559Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.436550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 257 offsets: 256 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 3 }
2025-10-10T14:57:33.436569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 257
2025-10-10T14:57:33.437083Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.437607Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.438054Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.438415Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.438739Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.439058Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.439320Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.439613Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.439921Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.440250Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:57:33.458908Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.458954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459001Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 268 partNo : 0 messageNo: 539 size 29455 offset: -1
2025-10-10T14:57:33.459072Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.459080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459096Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 269 partNo : 0 messageNo: 540 size 29565 offset: -1
2025-10-10T14:57:33.459151Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.459159Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 270 partNo : 0 messageNo: 541 size 29675 offset: -1
2025-10-10T14:57:33.459230Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.459238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459255Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 271 partNo : 0 messageNo: 542 size 29785 offset: -1
2025-10-10T14:57:33.459310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.459318Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459334Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 272 partNo : 0 messageNo: 543 size 29895 offset: -1
2025-10-10T14:57:33.459359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.459367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459391Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.459400Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459420Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.459429Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459450Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.459459Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459481Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.459490Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.459554Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 233
2025-10-10T14:57:33.459996Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.460041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.460053Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.460064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.460072Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.460084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.460093Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.460102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.460111Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.460121Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.460344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 544  requestId: <none> cookie: 273
2025-10-10T14:57:33.460370Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 545  requestId: <none> cookie: 274
2025-10-10T14:57:33.460386Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 546  requestId: <none> cookie: 275
2025-10-10T14:57:33.460401Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 547  requestId: <none> cookie: 276
2025-10-10T14:57:33.460418Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 548  requestId: <none> cookie: 277
2025-10-10T14:57:33.466423Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 257 Result { Offset: 233 Data: "... 25715 bytes ..." SourceId: "\000src_id" SeqNo: 234 WriteTimestampMS: 1760108253357 CreateTimestampMS: 1760108252148 UncompressedSize: 25641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 234 Data: "... 25825 bytes ..." SourceId: "\000src_id" SeqNo: 235 WriteTimestampMS: 1760108253357 CreateTimestampMS: 1760108252149 UncompressedSize: 25751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 235 Data: "... 25935 bytes ..." SourceId: "\000src_id" SeqNo: 236 WriteTimestampMS: 1760108253357 CreateTimestampMS: 1760108252149 UncompressedSize: 25861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 236 Data: "... 26045 bytes ..." SourceId: "\000src_id" SeqNo: 237 WriteTimestampMS: 1760108253358 CreateTimestampMS: 1760108252149 UncompressedSize: 25971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 237 Data: "... 26155 bytes ..." SourceId: "\000src_id" SeqNo: 238 WriteTimestampMS: 1760108253358 CreateTimestampMS: 1760108252149 UncompressedSize: 26081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 238 Data: "... 26265 bytes ..." SourceId: "\000src_id" SeqNo: 239 WriteTimestampMS: 1760108253358 CreateTimestampMS: 1760108252149 UncompressedSize: 26191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 239 Data: "... 26375 bytes ..." SourceId: "\000src_id" SeqNo: 240 WriteTimestampMS: 1760108253358 CreateTimestampMS: 1760108252150 UncompressedSize: 26301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 240 Data: "... 26485 bytes ..." SourceId: "\000src_id" SeqNo: 241 WriteTimestampMS: 1760108253358 CreateTimestampMS: 1760108252150 UncompressedSize: 26411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 241 Data: "... 26595 bytes ..." SourceId: "\000src_id" SeqNo: 242 WriteTimestampMS: 1760108253358 CreateTimestampMS: 1760108252150 UncompressedSize: 26521 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 235407 RealReadOffset: 241 WaitQuotaTimeMs: 0 EndOffset: 257 StartOffset: 0 } Cookie: 233 }
2025-10-10T14:57:33.467186Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 242 endOffset 257
2025-10-10T14:57:33.467226Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 257 ReadOffset 242 ReadGuid 7cea1157-a920c896-c3e06c0f-3e0850bd has messages 1
2025-10-10T14:57:33.467357Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.467420Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.467451Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.467483Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.467512Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.467998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.468060Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.468092Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.468124Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.468156Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.468381Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 242, endOffset# 257, WTime# 1760108253358, sizeLag# 235407
2025-10-10T14:57:33.468397Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:57:33.468464Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 7cea1157-a920c896-c3e06c0f-3e0850bd, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 235332
2025-10-10T14:57:33.468491Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 7cea1157-a920c896-c3e06c0f-3e0850bd
2025-10-10T14:57:33.469501Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 257 count 5 size 143026 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.469565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.469615Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 142910 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.469667Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.469699Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 258, partNo: 0, Offset: 257 is stored on disk
2025-10-10T14:57:33.469718Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.469737Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 259, partNo: 0, Offset: 258 is stored on disk
2025-10-10T14:57:33.469748Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.469780Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 260, partNo: 0, Offset: 259 is stored on disk
2025-10-10T14:57:33.469792Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.469798Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 257 partno 0 count 5 parts 0 suffix '63' size 143026
2025-10-10T14:57:33.469811Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 261, partNo: 0, Offset: 260 is stored on disk
2025-10-10T14:57:33.469823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.469842Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 262, partNo: 0, Offset: 261 is stored on disk
2025-10-10T14:57:33.470011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.470061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.470071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:57:33.470165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 263 partNo 0
2025-10-10T14:57:33.469840Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 1
2025-10-10T14:57:33.469900Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# da6e2fc8-7ec864fb-47ddacbb-1855e10b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 282488, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.470033Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 282488 maxTimeLagMs 0 readTimestampMs 0 readOffset 242 EndOffset 257 ClientCommitOffset 0 committedOffset 0 Guid da6e2fc8-7ec864fb-47ddacbb-1855e10b
2025-10-10T14:57:33.473833Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 235332, now ReadSizeBudget = 0, ReadSizeServerDelta = 288956
2025-10-10T14:57:33.473972Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 288956
2025-10-10T14:57:33.474170Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (233-241)
2025-10-10T14:57:33.474205Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 235332 to budget
2025-10-10T14:57:33.474232Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 235332, ReadSizeServerDelta = 288956
2025-10-10T14:57:33.474491Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.474603Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (233-233)
2025-10-10T14:57:33.474724Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (234-234)
2025-10-10T14:57:33.474924Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (235-235)
2025-10-10T14:57:33.475001Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (236-236)
2025-10-10T14:57:33.474970Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 235332 } }
2025-10-10T14:57:33.470990Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 263 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 28979 count 1 nextOffset 263 batches 1
2025-10-10T14:57:33.471053Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 264 partNo 0
2025-10-10T14:57:33.471081Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 264 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 58036 count 2 nextOffset 264 batches 1
2025-10-10T14:57:33.471103Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 265 partNo 0
2025-10-10T14:57:33.471126Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 265 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 87203 count 3 nextOffset 265 batches 1
2025-10-10T14:57:33.471146Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 266 partNo 0
2025-10-10T14:57:33.471167Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 266 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 116480 count 4 nextOffset 266 batches 1
2025-10-10T14:57:33.471190Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 267 partNo 0
2025-10-10T14:57:33.475315Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (237-237)
2025-10-10T14:57:33.471211Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 267 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 145867 count 5 nextOffset 267 batches 1
2025-10-10T14:57:33.471231Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 268 partNo 0
2025-10-10T14:57:33.471250Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 268 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 175364 count 6 nextOffset 268 batches 1
2025-10-10T14:57:33.475390Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (238-238)
2025-10-10T14:57:33.471272Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 269 partNo 0
2025-10-10T14:57:33.471292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 269 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 204971 count 7 nextOffset 269 batches 1
2025-10-10T14:57:33.471308Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 270 partNo 0
2025-10-10T14:57:33.471328Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 270 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 234688 count 8 nextOffset 270 batches 1
2025-10-10T14:57:33.471348Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 271 partNo 0
2025-10-10T14:57:33.475463Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (239-239)
2025-10-10T14:57:33.471368Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 271 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 264515 count 9 nextOffset 271 batches 1
2025-10-10T14:57:33.471388Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 272 partNo 0
2025-10-10T14:57:33.471406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 272 partNo 0 FormedBlobsCount 0 NewHead: Offset 262 PartNo 0 PackedSize 294452 count 10 nextOffset 272 batches 1
2025-10-10T14:57:33.471421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.472812Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 262,10 HeadOffset 262 endOffset 262 curOffset 272 d0000000000_00000000000000000262_00000_0000000010_00000? size 294206 WTime 1760108253466
2025-10-10T14:57:33.475554Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (240-240)
2025-10-10T14:57:33.475159Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 20586858-81172aea-8a20cc1a-11d36b95
2025-10-10T14:57:33.476031Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (241-241)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..25641 bytes.. Information: { Offset: 233 ProducerId: "src_id" SeqNo: 234 CreateTime: 2025-10-10T14:57:32.148000Z WriteTime: 2025-10-10T14:57:33.357000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25751 bytes.. Information: { Offset: 234 ProducerId: "src_id" SeqNo: 235 CreateTime: 2025-10-10T14:57:32.149000Z WriteTime: 2025-10-10T14:57:33.357000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25861 bytes.. Information: { Offset: 235 ProducerId: "src_id" SeqNo: 236 CreateTime: 2025-10-10T14:57:32.149000Z WriteTime: 2025-10-10T14:57:33.357000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25971 bytes.. Information: { Offset: 236 ProducerId: "src_id" SeqNo: 237 CreateTime: 2025-10-10T14:57:32.149000Z WriteTime: 2025-10-10T14:57:33.358000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26081 bytes.. Information: { Offset: 237 ProducerId: "src_id" SeqNo: 238 CreateTime: 2025-10-10T14:57:32.149000Z WriteTime: 2025-10-10T14:57:33.358000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26191 bytes.. Information: { Offset: 238 ProducerId: "src_id" SeqNo: 239 CreateTime: 2025-10-10T14:57:32.149000Z WriteTime: 2025-10-10T14:57:33.358000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26301 bytes.. Information: { Offset: 239 ProducerId: "src_id" SeqNo: 240 CreateTime: 2025-10-10T14:57:32.150000Z WriteTime: 2025-10-10T14:57:33.358000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26411 bytes.. Information: { Offset: 240 ProducerId: "src_id" SeqNo: 241 CreateTime: 2025-10-10T14:57:32.150000Z WriteTime: 2025-10-10T14:57:33.358000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26521 bytes.. Information: { Offset: 241 ProducerId: "src_id" SeqNo: 242 CreateTime: 2025-10-10T14:57:32.150000Z WriteTime: 2025-10-10T14:57:33.358000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.478272Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 9, size 234729 bytes
2025-10-10T14:57:33.478315Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.478951Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.479113Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.479139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.479207Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 273 partNo : 0 messageNo: 549 size 30005 offset: -1
2025-10-10T14:57:33.479342Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.479359Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.479385Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 274 partNo : 0 messageNo: 550 size 30115 offset: -1
2025-10-10T14:57:33.479516Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.479531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.479556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 275 partNo : 0 messageNo: 551 size 30225 offset: -1
2025-10-10T14:57:33.479712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.479728Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.479755Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 276 partNo : 0 messageNo: 552 size 30335 offset: -1
2025-10-10T14:57:33.479858Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.479874Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.479899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 277 partNo : 0 messageNo: 553 size 30445 offset: -1
2025-10-10T14:57:33.479937Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.479949Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.479989Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 519  requestId: <none> cookie: 258
2025-10-10T14:57:33.480079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.480094Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.480126Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.480137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.480164Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.480175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.480208Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 520  requestId: <none> cookie: 259
2025-10-10T14:57:33.480259Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.480272Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.480295Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 521  requestId: <none> cookie: 260
2025-10-10T14:57:33.480323Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 522  requestId: <none> cookie: 261
2025-10-10T14:57:33.480348Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 523  requestId: <none> cookie: 262
2025-10-10T14:57:33.480430Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.480444Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.480493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.480512Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.480636Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 262 partNo 0 count 10 size 294206
2025-10-10T14:57:33.480674Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.480716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.480728Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.480744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.480754Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.480767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.480777Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.480794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.480805Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.480821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.481018Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 554  requestId: <none> cookie: 278
2025-10-10T14:57:33.481043Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 555  requestId: <none> cookie: 279
2025-10-10T14:57:33.481061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 556  requestId: <none> cookie: 280
2025-10-10T14:57:33.481080Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 557  requestId: <none> cookie: 281
2025-10-10T14:57:33.481098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 558  requestId: <none> cookie: 282
2025-10-10T14:57:33.481211Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 25 Topic 'rt3.dc1--test-topic' partition 0 user user offset 242 count 18 size 282488 endOffset 262 max time lag 0ms effective offset 242
2025-10-10T14:57:33.481389Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 25 added 1 blobs, size 412386 count 15 last offset 242, current partition end offset: 262
2025-10-10T14:57:33.481404Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 25. Send blob request.
2025-10-10T14:57:33.481447Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 242 partno 0 count 15 parts_count 0 source 1 size 412386 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.481468Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 25. All 1 blobs are from cache.
2025-10-10T14:57:33.481514Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:33.481567Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 242 partno 0 count 15 parts 0 suffix '63'
2025-10-10T14:57:33.484788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 258 offsets: 257 already_written: false write_statistics { persist_duration_ms: 46 queued_in_partition_duration_ms: 9 }
2025-10-10T14:57:33.484829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 258
2025-10-10T14:57:33.484982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 259 offsets: 258 already_written: false write_statistics { persist_duration_ms: 46 queued_in_partition_duration_ms: 9 }
2025-10-10T14:57:33.485004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 259
2025-10-10T14:57:33.485109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 260 offsets: 259 already_written: false write_statistics { persist_duration_ms: 46 queued_in_partition_duration_ms: 9 }
2025-10-10T14:57:33.485148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 260
2025-10-10T14:57:33.482410Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.482502Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.482534Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.485255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 261 offsets: 260 already_written: false write_statistics { persist_duration_ms: 46 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:33.482563Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.485274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 261
2025-10-10T14:57:33.482594Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.482624Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.482679Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.482710Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.482741Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.482785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.485376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 262 offsets: 261 already_written: false write_statistics { persist_duration_ms: 46 queued_in_partition_duration_ms: 2 }
2025-10-10T14:57:33.483658Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.485395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 262
2025-10-10T14:57:33.483722Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.483756Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.483789Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.483826Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.498350Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 242 totakecount 15 count 15 size 412363 from pos 0 cbcount 15
2025-10-10T14:57:33.498875Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.498901Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.498953Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 278 partNo : 0 messageNo: 559 size 30555 offset: -1
2025-10-10T14:57:33.499072Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.499087Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.499112Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 279 partNo : 0 messageNo: 560 size 30665 offset: -1
2025-10-10T14:57:33.499213Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.499225Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.499247Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 280 partNo : 0 messageNo: 561 size 30775 offset: -1
2025-10-10T14:57:33.499352Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.499366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.499389Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 281 partNo : 0 messageNo: 562 size 30885 offset: -1
2025-10-10T14:57:33.499494Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.499506Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.499529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 282 partNo : 0 messageNo: 563 size 30995 offset: -1
2025-10-10T14:57:33.499561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.499571Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.499603Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.499613Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.499638Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.499648Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.499675Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.499685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.499712Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.499721Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.499855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 242
2025-10-10T14:57:33.499934Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.499975Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.499989Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.500004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.500016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.500032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.500042Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.500056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.500067Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.500081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.500727Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 564  requestId: <none> cookie: 283
2025-10-10T14:57:33.500761Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 565  requestId: <none> cookie: 284
2025-10-10T14:57:33.500780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 566  requestId: <none> cookie: 285
2025-10-10T14:57:33.500800Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 567  requestId: <none> cookie: 286
2025-10-10T14:57:33.500818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 568  requestId: <none> cookie: 287
2025-10-10T14:57:33.504157Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 262 Result { Offset: 242 Data: "... 26705 bytes ..." SourceId: "\000src_id" SeqNo: 243 WriteTimestampMS: 1760108253395 CreateTimestampMS: 1760108252150 UncompressedSize: 26631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 243 Data: "... 26815 bytes ..." SourceId: "\000src_id" SeqNo: 244 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252150 UncompressedSize: 26741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 244 Data: "... 26925 bytes ..." SourceId: "\000src_id" SeqNo: 245 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252150 UncompressedSize: 26851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 245 Data: "... 27035 bytes ..." SourceId: "\000src_id" SeqNo: 246 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252151 UncompressedSize: 26961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 246 Data: "... 27145 bytes ..." SourceId: "\000src_id" SeqNo: 247 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252151 UncompressedSize: 27071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 247 Data: "... 27255 bytes ..." SourceId: "\000src_id" SeqNo: 248 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252153 UncompressedSize: 27181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 248 Data: "... 27365 bytes ..." SourceId: "\000src_id" SeqNo: 249 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252154 UncompressedSize: 27291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 249 Data: "... 27475 bytes ..." SourceId: "\000src_id" SeqNo: 250 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252154 UncompressedSize: 27401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 250 Data: "... 27585 bytes ..." SourceId: "\000src_id" SeqNo: 251 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252154 UncompressedSize: 27511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 251 Data: "... 27695 bytes ..." SourceId: "\000src_id" SeqNo: 252 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252154 UncompressedSize: 27621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 252 Data: "... 27805 bytes ..." SourceId: "\000src_id" SeqNo: 253 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252154 UncompressedSize: 27731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 253 Data: "... 27915 bytes ..." SourceId: "\000src_id" SeqNo: 254 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252154 UncompressedSize: 27841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 254 Data: "... 28025 bytes ..." SourceId: "\000src_id" SeqNo: 255 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252155 UncompressedSize: 27951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 255 Data: "... 28135 bytes ..." SourceId: "\000src_id" SeqNo: 256 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252155 UncompressedSize: 28061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 256 Data: "... 28245 bytes ..." SourceId: "\000src_id" SeqNo: 257 WriteTimestampMS: 1760108253398 CreateTimestampMS: 1760108252155 UncompressedSize: 28171 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 412017 RealReadOffset: 256 WaitQuotaTimeMs: 0 EndOffset: 262 StartOffset: 0 } Cookie: 242 }
2025-10-10T14:57:33.505336Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 257 endOffset 262
2025-10-10T14:57:33.505371Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 262 ReadOffset 257 ReadGuid da6e2fc8-7ec864fb-47ddacbb-1855e10b has messages 1
2025-10-10T14:57:33.505497Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.505553Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.505581Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.505618Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.505648Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.506117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.506170Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.506206Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.506239Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.506269Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.506394Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 257, endOffset# 262, WTime# 1760108253398, sizeLag# 412017
2025-10-10T14:57:33.506408Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:57:33.506466Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# da6e2fc8-7ec864fb-47ddacbb-1855e10b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 411852
2025-10-10T14:57:33.506493Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# da6e2fc8-7ec864fb-47ddacbb-1855e10b
2025-10-10T14:57:33.508568Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 1
2025-10-10T14:57:33.508616Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 47e7079f-44710f2a-e69249c-48c671cb, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 112436, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.510186Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.510225Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.510281Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 283 partNo : 0 messageNo: 569 size 31105 offset: -1
2025-10-10T14:57:33.510411Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.510424Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.510448Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 284 partNo : 0 messageNo: 570 size 31215 offset: -1
2025-10-10T14:57:33.510557Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.510570Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.510593Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 285 partNo : 0 messageNo: 571 size 31325 offset: -1
2025-10-10T14:57:33.510697Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.510710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.510729Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 286 partNo : 0 messageNo: 572 size 31435 offset: -1
2025-10-10T14:57:33.511148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.511174Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.511214Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 287 partNo : 0 messageNo: 573 size 31545 offset: -1
2025-10-10T14:57:33.511256Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.511268Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.511319Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.511330Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.511356Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.511367Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.511390Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.511399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.511440Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.511453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.511478Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.511518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.511531Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.511549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.511561Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.511573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.511752Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.511772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.511783Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.511795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.511900Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 262 count 10 size 294206 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.511954Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 574  requestId: <none> cookie: 288
2025-10-10T14:57:33.511990Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 575  requestId: <none> cookie: 289
2025-10-10T14:57:33.512007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 576  requestId: <none> cookie: 290
2025-10-10T14:57:33.512025Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 577  requestId: <none> cookie: 291
2025-10-10T14:57:33.512039Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 578  requestId: <none> cookie: 292
2025-10-10T14:57:33.512055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.512097Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 294070 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.512125Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512149Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 263, partNo: 0, Offset: 262 is stored on disk
2025-10-10T14:57:33.512165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512182Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 264, partNo: 0, Offset: 263 is stored on disk
2025-10-10T14:57:33.512193Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512208Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 265, partNo: 0, Offset: 264 is stored on disk
2025-10-10T14:57:33.512218Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512233Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 266, partNo: 0, Offset: 265 is stored on disk
2025-10-10T14:57:33.512245Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512260Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 267, partNo: 0, Offset: 266 is stored on disk
2025-10-10T14:57:33.512268Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512283Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 268, partNo: 0, Offset: 267 is stored on disk
2025-10-10T14:57:33.512292Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512321Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 269, partNo: 0, Offset: 268 is stored on disk
2025-10-10T14:57:33.512335Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512352Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 270, partNo: 0, Offset: 269 is stored on disk
2025-10-10T14:57:33.512361Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512375Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 271, partNo: 0, Offset: 270 is stored on disk
2025-10-10T14:57:33.512384Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.512399Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 272, partNo: 0, Offset: 271 is stored on disk
2025-10-10T14:57:33.512702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.512758Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.512768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-10T14:57:33.512847Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 273 partNo 0
2025-10-10T14:57:33.513034Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 262 partno 0 count 10 parts 0 suffix '63' size 294206
2025-10-10T14:57:33.518848Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 273 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 30079 count 1 nextOffset 273 batches 1
2025-10-10T14:57:33.518924Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 274 partNo 0
2025-10-10T14:57:33.518962Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 274 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 60236 count 2 nextOffset 274 batches 1
2025-10-10T14:57:33.518985Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 275 partNo 0
2025-10-10T14:57:33.519010Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 275 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 90503 count 3 nextOffset 275 batches 1
2025-10-10T14:57:33.519031Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 276 partNo 0
2025-10-10T14:57:33.519050Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 276 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 120880 count 4 nextOffset 276 batches 1
2025-10-10T14:57:33.519074Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 277 partNo 0
2025-10-10T14:57:33.519096Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 277 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 151367 count 5 nextOffset 277 batches 1
2025-10-10T14:57:33.519118Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 278 partNo 0
2025-10-10T14:57:33.519139Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 278 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 181964 count 6 nextOffset 278 batches 1
2025-10-10T14:57:33.519159Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 279 partNo 0
2025-10-10T14:57:33.519177Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 279 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 212671 count 7 nextOffset 279 batches 1
2025-10-10T14:57:33.519197Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 280 partNo 0
2025-10-10T14:57:33.519215Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 280 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 243488 count 8 nextOffset 280 batches 1
2025-10-10T14:57:33.519235Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 281 partNo 0
2025-10-10T14:57:33.519258Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 281 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 274415 count 9 nextOffset 281 batches 1
2025-10-10T14:57:33.519274Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 282 partNo 0
2025-10-10T14:57:33.519296Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 282 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 305452 count 10 nextOffset 282 batches 1
2025-10-10T14:57:33.519319Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 283 partNo 0
2025-10-10T14:57:33.519338Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 283 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 336599 count 11 nextOffset 283 batches 1
2025-10-10T14:57:33.519357Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 284 partNo 0
2025-10-10T14:57:33.519375Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 284 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 367856 count 12 nextOffset 284 batches 1
2025-10-10T14:57:33.519396Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 285 partNo 0
2025-10-10T14:57:33.519413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 285 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 399223 count 13 nextOffset 285 batches 1
2025-10-10T14:57:33.519433Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 286 partNo 0
2025-10-10T14:57:33.519471Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 286 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 430700 count 14 nextOffset 286 batches 1
2025-10-10T14:57:33.519508Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 287 partNo 0
2025-10-10T14:57:33.519533Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 287 partNo 0 FormedBlobsCount 0 NewHead: Offset 272 PartNo 0 PackedSize 462287 count 15 nextOffset 287 batches 1
2025-10-10T14:57:33.519547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.523142Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 272,15 HeadOffset 272 endOffset 272 curOffset 287 d0000000000_00000000000000000272_00000_0000000015_00000? size 461886 WTime 1760108253521
2025-10-10T14:57:33.523998Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.524090Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 529  requestId: <none> cookie: 263
2025-10-10T14:57:33.524150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 530  requestId: <none> cookie: 264
2025-10-10T14:57:33.524175Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 531  requestId: <none> cookie: 265
2025-10-10T14:57:33.524198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 532  requestId: <none> cookie: 266
2025-10-10T14:57:33.524221Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 533  requestId: <none> cookie: 267
2025-10-10T14:57:33.524245Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 539  requestId: <none> cookie: 268
2025-10-10T14:57:33.524268Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 540  requestId: <none> cookie: 269
2025-10-10T14:57:33.524291Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 541  requestId: <none> cookie: 270
2025-10-10T14:57:33.524315Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 542  requestId: <none> cookie: 271
2025-10-10T14:57:33.524339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 543  requestId: <none> cookie: 272
2025-10-10T14:57:33.524366Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.524464Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 272 partNo 0 count 15 size 461886
2025-10-10T14:57:33.527114Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 112436 maxTimeLagMs 0 readTimestampMs 0 readOffset 257 EndOffset 262 ClientCommitOffset 0 committedOffset 0 Guid 47e7079f-44710f2a-e69249c-48c671cb
2025-10-10T14:57:33.527244Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527300Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527328Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527356Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527384Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527431Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527466Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527494Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527519Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527549Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527579Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527617Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527653Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.527718Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.528180Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.528237Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.528276Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.528314Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.528351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.529777Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.529820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.530002Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.530031Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.530090Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 288 partNo : 0 messageNo: 579 size 31655 offset: -1
2025-10-10T14:57:33.530680Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.530710Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.530748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 289 partNo : 0 messageNo: 580 size 31765 offset: -1
2025-10-10T14:57:33.530908Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.530927Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.530959Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 290 partNo : 0 messageNo: 581 size 31875 offset: -1
2025-10-10T14:57:33.531077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.531091Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.531116Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 291 partNo : 0 messageNo: 582 size 31985 offset: -1
2025-10-10T14:57:33.531224Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.531239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.531265Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 292 partNo : 0 messageNo: 583 size 32095 offset: -1
2025-10-10T14:57:33.531299Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.531310Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.531343Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.531355Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.531384Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.531395Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.531423Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.531434Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.531460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.531471Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.531513Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.531554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.531567Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.533236Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.533304Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.533336Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.533364Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.533405Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.533884Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.533945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.533983Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:57:33.531581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.531592Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.531609Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.531620Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.531633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.531645Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.531658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.531772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 584  requestId: <none> cookie: 293
2025-10-10T14:57:33.531820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 585  requestId: <none> cookie: 294
2025-10-10T14:57:33.531839Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 586  requestId: <none> cookie: 295
2025-10-10T14:57:33.531859Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 587  requestId: <none> cookie: 296
2025-10-10T14:57:33.531880Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 588  requestId: <none> cookie: 297
2025-10-10T14:57:33.531914Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 26 Topic 'rt3.dc1--test-topic' partition 0 user user offset 257 count 6 size 112436 endOffset 272 max time lag 0ms effective offset 257
2025-10-10T14:57:33.532104Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 26 added 1 blobs, size 143026 count 5 last offset 257, current partition end offset: 272
2025-10-10T14:57:33.532119Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 26. Send blob request.
2025-10-10T14:57:33.532170Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 257 partno 0 count 5 parts_count 0 source 1 size 143026 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.532196Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 26. All 1 blobs are from cache.
2025-10-10T14:57:33.532237Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:33.532556Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 257 partno 0 count 5 parts 0 suffix '63'
2025-10-10T14:57:33.535100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 263 offsets: 262 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 35 }
2025-10-10T14:57:33.535150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 263
2025-10-10T14:57:33.535564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 264 offsets: 263 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 35 }
2025-10-10T14:57:33.535602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 264
2025-10-10T14:57:33.535827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 265 offsets: 264 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 35 }
2025-10-10T14:57:33.535853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 265
2025-10-10T14:57:33.536077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 266 offsets: 265 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 35 }
2025-10-10T14:57:33.536101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 266
2025-10-10T14:57:33.536139Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 411852, now ReadSizeBudget = 0, ReadSizeServerDelta = 112436
2025-10-10T14:57:33.536280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 267 offsets: 266 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 35 }
2025-10-10T14:57:33.536299Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 112436
2025-10-10T14:57:33.536312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 267
2025-10-10T14:57:33.536432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 268 offsets: 267 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 6 }
2025-10-10T14:57:33.536450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 268
2025-10-10T14:57:33.536591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 269 offsets: 268 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 6 }
2025-10-10T14:57:33.536614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 269
2025-10-10T14:57:33.536708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 270 offsets: 269 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 6 }
2025-10-10T14:57:33.536753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 270
2025-10-10T14:57:33.536872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 271 offsets: 270 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 6 }
2025-10-10T14:57:33.536894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 271
2025-10-10T14:57:33.536995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 272 offsets: 271 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 6 }
2025-10-10T14:57:33.537014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 272
2025-10-10T14:57:33.537177Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (242-256)
2025-10-10T14:57:33.537225Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 411852 to budget
2025-10-10T14:57:33.537257Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 411852, ReadSizeServerDelta = 112436
2025-10-10T14:57:33.537435Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.537550Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (242-242)
2025-10-10T14:57:33.537736Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (243-243)
2025-10-10T14:57:33.537900Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (244-244)
2025-10-10T14:57:33.537970Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (245-245)
2025-10-10T14:57:33.538219Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (246-246)
2025-10-10T14:57:33.538322Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (247-247)
2025-10-10T14:57:33.536313Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 257 totakecount 5 count 5 size 143003 from pos 0 cbcount 5
2025-10-10T14:57:33.536582Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.538393Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (248-248)
2025-10-10T14:57:33.536605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.536660Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 293 partNo : 0 messageNo: 589 size 32205 offset: -1
2025-10-10T14:57:33.536733Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.538461Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (249-249)
2025-10-10T14:57:33.536753Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.536780Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 294 partNo : 0 messageNo: 590 size 32315 offset: -1
2025-10-10T14:57:33.536845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.536855Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.536874Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 295 partNo : 0 messageNo: 591 size 32425 offset: -1
2025-10-10T14:57:33.536933Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.536943Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.536967Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 296 partNo : 0 messageNo: 592 size 32535 offset: -1
2025-10-10T14:57:33.537028Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.537040Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.537061Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 297 partNo : 0 messageNo: 593 size 32645 offset: -1
2025-10-10T14:57:33.537094Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.537104Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.537157Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.537169Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.537198Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.537209Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.538889Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (250-250)
2025-10-10T14:57:33.537267Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 257
2025-10-10T14:57:33.537337Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.538992Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (251-251)
2025-10-10T14:57:33.537383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.537396Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.537416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.539073Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (252-252)
2025-10-10T14:57:33.537430Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.537445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.537458Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.537474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.539151Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (253-253)
2025-10-10T14:57:33.537485Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.537520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.537746Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 594  requestId: <none> cookie: 298
2025-10-10T14:57:33.539237Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (254-254)
2025-10-10T14:57:33.539314Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (255-255)
2025-10-10T14:57:33.539400Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (256-256)
2025-10-10T14:57:33.537807Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 595  requestId: <none> cookie: 299
2025-10-10T14:57:33.537843Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 596  requestId: <none> cookie: 300
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..26631 bytes.. Information: { Offset: 242 ProducerId: "src_id" SeqNo: 243 CreateTime: 2025-10-10T14:57:32.150000Z WriteTime: 2025-10-10T14:57:33.395000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26741 bytes.. Information: { Offset: 243 ProducerId: "src_id" SeqNo: 244 CreateTime: 2025-10-10T14:57:32.150000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26851 bytes.. Information: { Offset: 244 ProducerId: "src_id" SeqNo: 245 CreateTime: 2025-10-10T14:57:32.150000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26961 bytes.. Information: { Offset: 245 ProducerId: "src_id" SeqNo: 246 CreateTime: 2025-10-10T14:57:32.151000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27071 bytes.. Information: { Offset: 246 ProducerId: "src_id" SeqNo: 247 CreateTime: 2025-10-10T14:57:32.151000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27181 bytes.. Information: { Offset: 247 ProducerId: "src_id" SeqNo: 248 CreateTime: 2025-10-10T14:57:32.153000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27291 bytes.. Information: { Offset: 248 ProducerId: "src_id" SeqNo: 249 CreateTime: 2025-10-10T14:57:32.154000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27401 bytes.. Information: { Offset: 249 ProducerId: "src_id" SeqNo: 250 CreateTime: 2025-10-10T14:57:32.154000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27511 bytes.. Information: { Offset: 250 ProducerId: "src_id" SeqNo: 251 CreateTime: 2025-10-10T14:57:32.154000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27621 bytes.. Information: { Offset: 251 ProducerId: "src_id" SeqNo: 252 CreateTime: 2025-10-10T14:57:32.154000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27731 bytes.. Information: { Offset: 252 ProducerId: "src_id" SeqNo: 253 CreateTime: 2025-10-10T14:57:32.154000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27841 bytes.. Information: { Offset: 253 ProducerId: "src_id" SeqNo: 254 CreateTime: 2025-10-10T14:57:32.154000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27951 bytes.. Information: { Offset: 254 ProducerId: "src_id" SeqNo: 255 CreateTime: 2025-10-10T14:57:32.155000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28061 bytes.. Information: { Offset: 255 ProducerId: "src_id" SeqNo: 256 CreateTime: 2025-10-10T14:57:32.155000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28171 bytes.. Information: { Offset: 256 ProducerId: "src_id" SeqNo: 257 CreateTime: 2025-10-10T14:57:32.155000Z WriteTime: 2025-10-10T14:57:33.398000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.543099Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 15, size 411015 bytes
2025-10-10T14:57:33.543140Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.544930Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 272 count 15 size 461886 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.544988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.545036Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 461730 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.545065Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 272 partno 0 count 15 parts 0 suffix '63' size 461886
2025-10-10T14:57:33.545071Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545104Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 273, partNo: 0, Offset: 272 is stored on disk
2025-10-10T14:57:33.545119Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545154Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 274, partNo: 0, Offset: 273 is stored on disk
2025-10-10T14:57:33.545165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545182Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 275, partNo: 0, Offset: 274 is stored on disk
2025-10-10T14:57:33.543575Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 272 Result { Offset: 257 Data: "... 28355 bytes ..." SourceId: "\000src_id" SeqNo: 258 WriteTimestampMS: 1760108253418 CreateTimestampMS: 1760108252155 UncompressedSize: 28281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 258 Data: "... 28465 bytes ..." SourceId: "\000src_id" SeqNo: 259 WriteTimestampMS: 1760108253419 CreateTimestampMS: 1760108252161 UncompressedSize: 28391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 259 Data: "... 28575 bytes ..." SourceId: "\000src_id" SeqNo: 260 WriteTimestampMS: 1760108253420 CreateTimestampMS: 1760108252161 UncompressedSize: 28501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 260 Data: "... 28685 bytes ..." SourceId: "\000src_id" SeqNo: 261 WriteTimestampMS: 1760108253420 CreateTimestampMS: 1760108252161 UncompressedSize: 28611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 261 Data: "... 28795 bytes ..." SourceId: "\000src_id" SeqNo: 262 WriteTimestampMS: 1760108253420 CreateTimestampMS: 1760108252161 UncompressedSize: 28721 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 142967 RealReadOffset: 261 WaitQuotaTimeMs: 0 EndOffset: 272 StartOffset: 0 } Cookie: 257 }
2025-10-10T14:57:33.545193Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545211Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 276, partNo: 0, Offset: 275 is stored on disk
2025-10-10T14:57:33.544070Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 262 endOffset 272
2025-10-10T14:57:33.545222Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545239Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 277, partNo: 0, Offset: 276 is stored on disk
2025-10-10T14:57:33.544103Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 272 ReadOffset 262 ReadGuid 47e7079f-44710f2a-e69249c-48c671cb has messages 1
2025-10-10T14:57:33.545248Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.544207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.545263Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 278, partNo: 0, Offset: 277 is stored on disk
2025-10-10T14:57:33.545273Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.544256Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.545290Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 279, partNo: 0, Offset: 278 is stored on disk
2025-10-10T14:57:33.544284Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.544653Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 411852 } }
2025-10-10T14:57:33.545298Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545314Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 280, partNo: 0, Offset: 279 is stored on disk
2025-10-10T14:57:33.544702Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 262, endOffset# 272, WTime# 1760108253420, sizeLag# 142967
2025-10-10T14:57:33.545322Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.544715Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:57:33.544751Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 47e7079f-44710f2a-e69249c-48c671cb, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 143071
2025-10-10T14:57:33.544774Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 47e7079f-44710f2a-e69249c-48c671cb
2025-10-10T14:57:33.545314Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 1
2025-10-10T14:57:33.545415Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 67fd8055-ca3c5870-d13cecb8-b396b690
2025-10-10T14:57:33.545339Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 281, partNo: 0, Offset: 280 is stored on disk
2025-10-10T14:57:33.545471Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# d2ca655a-40b198dc-9c81d284-22e892ff, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 171560, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.545348Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545544Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 171560 maxTimeLagMs 0 readTimestampMs 0 readOffset 262 EndOffset 272 ClientCommitOffset 0 committedOffset 0 Guid d2ca655a-40b198dc-9c81d284-22e892ff
2025-10-10T14:57:33.545364Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 282, partNo: 0, Offset: 281 is stored on disk
2025-10-10T14:57:33.545376Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545395Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 283, partNo: 0, Offset: 282 is stored on disk
2025-10-10T14:57:33.545406Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545423Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 284, partNo: 0, Offset: 283 is stored on disk
2025-10-10T14:57:33.545433Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 285, partNo: 0, Offset: 284 is stored on disk
2025-10-10T14:57:33.545463Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545481Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 286, partNo: 0, Offset: 285 is stored on disk
2025-10-10T14:57:33.545493Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.545513Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 287, partNo: 0, Offset: 286 is stored on disk
2025-10-10T14:57:33.545923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.545978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.545988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-10T14:57:33.546083Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 288 partNo 0
2025-10-10T14:57:33.547026Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 143071, now ReadSizeBudget = 0, ReadSizeServerDelta = 381217
2025-10-10T14:57:33.547133Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 381217
2025-10-10T14:57:33.547258Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (257-261)
2025-10-10T14:57:33.547296Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 143071 to budget
2025-10-10T14:57:33.547321Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 143071, ReadSizeServerDelta = 381217
2025-10-10T14:57:33.547055Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 288 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 31729 count 1 nextOffset 288 batches 1
2025-10-10T14:57:33.547115Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 289 partNo 0
2025-10-10T14:57:33.547146Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 289 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 63536 count 2 nextOffset 289 batches 1
2025-10-10T14:57:33.547512Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.547166Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 290 partNo 0
2025-10-10T14:57:33.547185Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 290 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 95453 count 3 nextOffset 290 batches 1
2025-10-10T14:57:33.547205Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 291 partNo 0
2025-10-10T14:57:33.547223Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 291 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 127480 count 4 nextOffset 291 batches 1
2025-10-10T14:57:33.547241Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 292 partNo 0
2025-10-10T14:57:33.547261Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 292 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 159617 count 5 nextOffset 292 batches 1
2025-10-10T14:57:33.547281Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 293 partNo 0
2025-10-10T14:57:33.547298Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 293 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 191864 count 6 nextOffset 293 batches 1
2025-10-10T14:57:33.547315Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 294 partNo 0
2025-10-10T14:57:33.547332Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 294 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 224221 count 7 nextOffset 294 batches 1
2025-10-10T14:57:33.547350Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 295 partNo 0
2025-10-10T14:57:33.547366Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 295 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 256688 count 8 nextOffset 295 batches 1
2025-10-10T14:57:33.547383Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 296 partNo 0
2025-10-10T14:57:33.547405Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 296 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 289265 count 9 nextOffset 296 batches 1
2025-10-10T14:57:33.547425Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 297 partNo 0
2025-10-10T14:57:33.547440Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 297 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 321952 count 10 nextOffset 297 batches 1
2025-10-10T14:57:33.547454Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.547862Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (257-257)
2025-10-10T14:57:33.548025Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (258-258)
2025-10-10T14:57:33.548274Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (259-259)
2025-10-10T14:57:33.548359Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 1} (260-260)
2025-10-10T14:57:33.548436Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 143071 } }
2025-10-10T14:57:33.548548Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# fdef6471-515bae7e-fc16f655-76a22988
2025-10-10T14:57:33.550453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 287,10 HeadOffset 287 endOffset 287 curOffset 297 d0000000000_00000000000000000287_00000_0000000010_00000? size 321706 WTime 1760108253549
2025-10-10T14:57:33.550914Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.551046Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.551077Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.551125Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 298 partNo : 0 messageNo: 597 size 32755 offset: -1
2025-10-10T14:57:33.551201Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.551211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.551227Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 299 partNo : 0 messageNo: 598 size 32865 offset: -1
2025-10-10T14:57:33.551264Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 549  requestId: <none> cookie: 273
2025-10-10T14:57:33.551364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.551372Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.551392Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 300 partNo : 0 messageNo: 599 size 32975 offset: -1
2025-10-10T14:57:33.551416Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 550  requestId: <none> cookie: 274
2025-10-10T14:57:33.551443Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 551  requestId: <none> cookie: 275
2025-10-10T14:57:33.551467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 552  requestId: <none> cookie: 276
2025-10-10T14:57:33.551489Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 553  requestId: <none> cookie: 277
2025-10-10T14:57:33.551510Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 559  requestId: <none> cookie: 278
2025-10-10T14:57:33.551532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 560  requestId: <none> cookie: 279
2025-10-10T14:57:33.551555Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 561  requestId: <none> cookie: 280
2025-10-10T14:57:33.551578Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 562  requestId: <none> cookie: 281
2025-10-10T14:57:33.551602Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 563  requestId: <none> cookie: 282
2025-10-10T14:57:33.551626Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 569  requestId: <none> cookie: 283
2025-10-10T14:57:33.551651Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 570  requestId: <none> cookie: 284
2025-10-10T14:57:33.551672Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 571  requestId: <none> cookie: 285
2025-10-10T14:57:33.551695Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 572  requestId: <none> cookie: 286
2025-10-10T14:57:33.551746Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 573  requestId: <none> cookie: 287
2025-10-10T14:57:33.551822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.551834Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.551869Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.551965Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 287 partNo 0 count 10 size 321706
2025-10-10T14:57:33.552016Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.552063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.552075Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.552087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.552096Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:57:33.552109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.552314Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 27 Topic 'rt3.dc1--test-topic' partition 0 user user offset 262 count 12 size 171560 endOffset 287 max time lag 0ms effective offset 262
2025-10-10T14:57:33.552462Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 27 added 1 blobs, size 294206 count 10 last offset 262, current partition end offset: 287
2025-10-10T14:57:33.552475Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 27. Send blob request.
2025-10-10T14:57:33.552514Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 262 partno 0 count 10 parts_count 0 source 1 size 294206 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.552533Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 27. All 1 blobs are from cache.
2025-10-10T14:57:33.552570Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:33.553308Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 262 partno 0 count 10 parts 0 suffix '63'
2025-10-10T14:57:33.554015Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 262 totakecount 10 count 10 size 294183 from pos 0 cbcount 10
2025-10-10T14:57:33.554390Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 262
2025-10-10T14:57:33.552437Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552514Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552540Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552570Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552597Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552637Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552670Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552731Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552764Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552791Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552820Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552852Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552877Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552901Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.552932Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.560705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 273 offsets: 272 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 37 }
2025-10-10T14:57:33.560755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 273
2025-10-10T14:57:33.559989Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 287 Result { Offset: 262 Data: "... 28905 bytes ..." SourceId: "\000src_id" SeqNo: 263 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252161 UncompressedSize: 28831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 263 Data: "... 29015 bytes ..." SourceId: "\000src_id" SeqNo: 264 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252162 UncompressedSize: 28941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 264 Data: "... 29125 bytes ..." SourceId: "\000src_id" SeqNo: 265 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252162 UncompressedSize: 29051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 265 Data: "... 29235 bytes ..." SourceId: "\000src_id" SeqNo: 266 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252162 UncompressedSize: 29161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 266 Data: "... 29345 bytes ..." SourceId: "\000src_id" SeqNo: 267 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252162 UncompressedSize: 29271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 267 Data: "... 29455 bytes ..." SourceId: "\000src_id" SeqNo: 268 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252162 UncompressedSize: 29381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 268 Data: "... 29565 bytes ..." SourceId: "\000src_id" SeqNo: 269 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252162 UncompressedSize: 29491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 269 Data: "... 29675 bytes ..." SourceId: "\000src_id" SeqNo: 270 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252162 UncompressedSize: 29601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 270 Data: "... 29785 bytes ..." SourceId: "\000src_id" SeqNo: 271 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252163 UncompressedSize: 29711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 271 Data: "... 29895 bytes ..." SourceId: "\000src_id" SeqNo: 272 WriteTimestampMS: 1760108253466 CreateTimestampMS: 1760108252163 UncompressedSize: 29821 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 293992 RealReadOffset: 271 WaitQuotaTimeMs: 0 EndOffset: 287 StartOffset: 0 } Cookie: 262 }
2025-10-10T14:57:33.560862Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 272 endOffset 287
2025-10-10T14:57:33.560895Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 287 ReadOffset 272 ReadGuid d2ca655a-40b198dc-9c81d284-22e892ff has messages 1
2025-10-10T14:57:33.562854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 274 offsets: 273 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 37 }
2025-10-10T14:57:33.562905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 274
2025-10-10T14:57:33.563090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 275 offsets: 274 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 37 }
2025-10-10T14:57:33.563110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 275
2025-10-10T14:57:33.563222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 276 offsets: 275 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 37 }
2025-10-10T14:57:33.563010Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 272, endOffset# 287, WTime# 1760108253466, sizeLag# 293992
2025-10-10T14:57:33.563241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 276
2025-10-10T14:57:33.563033Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:57:33.563101Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# d2ca655a-40b198dc-9c81d284-22e892ff, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 293783
2025-10-10T14:57:33.563127Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# d2ca655a-40b198dc-9c81d284-22e892ff
2025-10-10T14:57:33.563888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 277 offsets: 276 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 37 }
2025-10-10T14:57:33.563930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 277
2025-10-10T14:57:33.565236Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 1
2025-10-10T14:57:33.565302Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# ecc8d0e8-96b6eb8e-d07641e3-cca75948, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 230505, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.565456Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 230505 maxTimeLagMs 0 readTimestampMs 0 readOffset 272 EndOffset 287 ClientCommitOffset 0 committedOffset 0 Guid ecc8d0e8-96b6eb8e-d07641e3-cca75948
2025-10-10T14:57:33.561279Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 287 count 10 size 321706 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.561338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.561380Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 321570 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.561413Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.569435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 278 offsets: 277 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:33.561444Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 288, partNo: 0, Offset: 287 is stored on disk
2025-10-10T14:57:33.561463Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.569479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 278
2025-10-10T14:57:33.561479Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 289, partNo: 0, Offset: 288 is stored on disk
2025-10-10T14:57:33.561489Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.561505Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 290, partNo: 0, Offset: 289 is stored on disk
2025-10-10T14:57:33.561518Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.561544Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 291, partNo: 0, Offset: 290 is stored on disk
2025-10-10T14:57:33.561559Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.561592Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 292, partNo: 0, Offset: 291 is stored on disk
2025-10-10T14:57:33.561609Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.561626Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 293, partNo: 0, Offset: 292 is stored on disk
2025-10-10T14:57:33.561636Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.561654Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 294, partNo: 0, Offset: 293 is stored on disk
2025-10-10T14:57:33.561664Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.561681Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 295, partNo: 0, Offset: 294 is stored on disk
2025-10-10T14:57:33.561692Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.561707Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 296, partNo: 0, Offset: 295 is stored on disk
2025-10-10T14:57:33.561716Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.561731Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 297, partNo: 0, Offset: 296 is stored on disk
2025-10-10T14:57:33.562084Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 287 partno 0 count 10 parts 0 suffix '63' size 321706
2025-10-10T14:57:33.563512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.563557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.563569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-10T14:57:33.563677Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 298 partNo 0
2025-10-10T14:57:33.570865Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 293783, now ReadSizeBudget = 0, ReadSizeServerDelta = 230505
2025-10-10T14:57:33.571021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 279 offsets: 278 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:33.571042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 279
2025-10-10T14:57:33.571157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 280 offsets: 279 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:33.571172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 280
2025-10-10T14:57:33.571241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 281 offsets: 280 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:33.571255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 281
2025-10-10T14:57:33.571327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 282 offsets: 281 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 19 }
2025-10-10T14:57:33.571340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 282
2025-10-10T14:57:33.571405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 283 offsets: 282 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 9 }
2025-10-10T14:57:33.571427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 283
2025-10-10T14:57:33.570209Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 298 partNo 0 FormedBlobsCount 0 NewHead: Offset 297 PartNo 0 PackedSize 32829 count 1 nextOffset 298 batches 1
2025-10-10T14:57:33.570305Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 299 partNo 0
2025-10-10T14:57:33.570349Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 299 partNo 0 FormedBlobsCount 0 NewHead: Offset 297 PartNo 0 PackedSize 65736 count 2 nextOffset 299 batches 1
2025-10-10T14:57:33.570382Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 300 partNo 0
2025-10-10T14:57:33.570412Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 300 partNo 0 FormedBlobsCount 0 NewHead: Offset 297 PartNo 0 PackedSize 98753 count 3 nextOffset 300 batches 1
2025-10-10T14:57:33.570438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.573840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 284 offsets: 283 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 9 }
2025-10-10T14:57:33.573878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 284
2025-10-10T14:57:33.574034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 285 offsets: 284 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 9 }
2025-10-10T14:57:33.574061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 285
2025-10-10T14:57:33.574186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 286 offsets: 285 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 9 }
2025-10-10T14:57:33.574217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 286
2025-10-10T14:57:33.574358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 287 offsets: 286 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 9 }
2025-10-10T14:57:33.574381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 287
2025-10-10T14:57:33.573423Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 297,3 HeadOffset 297 endOffset 297 curOffset 300 d0000000000_00000000000000000297_00000_0000000003_00000? size 98724 WTime 1760108253573
2025-10-10T14:57:33.573603Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.573698Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 579  requestId: <none> cookie: 288
2025-10-10T14:57:33.573790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 580  requestId: <none> cookie: 289
2025-10-10T14:57:33.573820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 581  requestId: <none> cookie: 290
2025-10-10T14:57:33.573845Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 582  requestId: <none> cookie: 291
2025-10-10T14:57:33.573870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 583  requestId: <none> cookie: 292
2025-10-10T14:57:33.573896Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 589  requestId: <none> cookie: 293
2025-10-10T14:57:33.573937Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 590  requestId: <none> cookie: 294
2025-10-10T14:57:33.573961Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 591  requestId: <none> cookie: 295
2025-10-10T14:57:33.573989Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 592  requestId: <none> cookie: 296
2025-10-10T14:57:33.574014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 593  requestId: <none> cookie: 297
2025-10-10T14:57:33.574111Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.574132Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.574173Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:57:33.574272Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 297 partNo 0 count 3 size 98724
2025-10-10T14:57:33.574548Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 28 Topic 'rt3.dc1--test-topic' partition 0 user user offset 272 count 18 size 230505 endOffset 297 max time lag 0ms effective offset 272
2025-10-10T14:57:33.574720Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 28 added 1 blobs, size 461886 count 15 last offset 272, current partition end offset: 297
2025-10-10T14:57:33.574733Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 28. Send blob request.
2025-10-10T14:57:33.574813Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 272 partno 0 count 15 parts_count 0 source 1 size 461886 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.574860Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 28. All 1 blobs are from cache.
2025-10-10T14:57:33.574932Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:33.575624Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 272 partno 0 count 15 parts 0 suffix '63'
2025-10-10T14:57:33.575791Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.575855Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.575887Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.575916Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.575942Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.575968Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.575996Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.576024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.576054Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.576085Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.585602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 288 offsets: 287 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 16 }
2025-10-10T14:57:33.585650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 288
2025-10-10T14:57:33.585887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 289 offsets: 288 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 16 }
2025-10-10T14:57:33.585912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 289
2025-10-10T14:57:33.586049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 290 offsets: 289 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 16 }
2025-10-10T14:57:33.586074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 290
2025-10-10T14:57:33.591459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 291 offsets: 290 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 16 }
2025-10-10T14:57:33.591506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 291
2025-10-10T14:57:33.591680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 292 offsets: 291 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 16 }
2025-10-10T14:57:33.591703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 292
2025-10-10T14:57:33.591812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 293 offsets: 292 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:33.591832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 293
2025-10-10T14:57:33.591943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 294 offsets: 293 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:33.591969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 294
2025-10-10T14:57:33.592089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 295 offsets: 294 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:33.592109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 295
2025-10-10T14:57:33.592227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 296 offsets: 295 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:33.592250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 296
2025-10-10T14:57:33.592363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 297 offsets: 296 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 10 }
2025-10-10T14:57:33.592382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 297
2025-10-10T14:57:33.593449Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 2} (261-261)
2025-10-10T14:57:33.593658Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 230505
2025-10-10T14:57:33.595924Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (262-271)
2025-10-10T14:57:33.596018Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 293783 to budget
2025-10-10T14:57:33.596058Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 293783, ReadSizeServerDelta = 230505
2025-10-10T14:57:33.596694Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 272 totakecount 15 count 15 size 461863 from pos 0 cbcount 15
2025-10-10T14:57:33.597093Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.597200Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (262-262)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..28281 bytes.. Information: { Offset: 257 ProducerId: "src_id" SeqNo: 258 CreateTime: 2025-10-10T14:57:32.155000Z WriteTime: 2025-10-10T14:57:33.418000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28391 bytes.. Information: { Offset: 258 ProducerId: "src_id" SeqNo: 259 CreateTime: 2025-10-10T14:57:32.161000Z WriteTime: 2025-10-10T14:57:33.419000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28501 bytes.. Information: { Offset: 259 ProducerId: "src_id" SeqNo: 260 CreateTime: 2025-10-10T14:57:32.161000Z WriteTime: 2025-10-10T14:57:33.420000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28611 bytes.. Information: { Offset: 260 ProducerId: "src_id" SeqNo: 261 CreateTime: 2025-10-10T14:57:32.161000Z WriteTime: 2025-10-10T14:57:33.420000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28721 bytes.. Information: { Offset: 261 ProducerId: "src_id" SeqNo: 262 CreateTime: 2025-10-10T14:57:32.161000Z WriteTime: 2025-10-10T14:57:33.420000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.598297Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 293783 } }
2025-10-10T14:57:33.598453Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 6849cf50-8f153fbd-f6af250b-758db3e2
2025-10-10T14:57:33.598587Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 5, size 142505 bytes
2025-10-10T14:57:33.598627Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.598919Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (263-263)
2025-10-10T14:57:33.599252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:57:33.599413Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 272
2025-10-10T14:57:33.600572Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (264-264)
2025-10-10T14:57:33.600666Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (265-265)
2025-10-10T14:57:33.600391Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-10T14:57:33.600430Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559607376144943264:2514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:57:33.600962Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (266-266)
2025-10-10T14:57:33.601048Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (267-267)
2025-10-10T14:57:33.601147Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (268-268)
2025-10-10T14:57:33.601228Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (269-269)
2025-10-10T14:57:33.601593Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (270-270)
2025-10-10T14:57:33.601671Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (271-271)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..28831 bytes.. Information: { Offset: 262 ProducerId: "src_id" SeqNo: 263 CreateTime: 2025-10-10T14:57:32.161000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28941 bytes.. Information: { Offset: 263 ProducerId: "src_id" SeqNo: 264 CreateTime: 2025-10-10T14:57:32.162000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29051 bytes.. Information: { Offset: 264 ProducerId: "src_id" SeqNo: 265 CreateTime: 2025-10-10T14:57:32.162000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29161 bytes.. Information: { Offset: 265 ProducerId: "src_id" SeqNo: 266 CreateTime: 2025-10-10T14:57:32.162000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29271 bytes.. Information: { Offset: 266 ProducerId: "src_id" SeqNo: 267 CreateTime: 2025-10-10T14:57:32.162000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29381 bytes.. Information: { Offset: 267 ProducerId: "src_id" SeqNo: 268 CreateTime: 2025-10-10T14:57:32.162000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29491 bytes.. Information: { Offset: 268 ProducerId: "src_id" SeqNo: 269 CreateTime: 2025-10-10T14:57:32.162000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29601 bytes.. Information: { Offset: 269 ProducerId: "src_id" SeqNo: 270 CreateTime: 2025-10-10T14:57:32.162000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29711 bytes.. Information: { Offset: 270 ProducerId: "src_id" SeqNo: 271 CreateTime: 2025-10-10T14:57:32.163000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29821 bytes.. Information: { Offset: 271 ProducerId: "src_id" SeqNo: 272 CreateTime: 2025-10-10T14:57:32.163000Z WriteTime: 2025-10-10T14:57:33.466000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.604380Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 10, size 293260 bytes
2025-10-10T14:57:33.604423Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.605537Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 297 count 3 size 98724 actorID [4:7559607372542885026:2385]
2025-10-10T14:57:33.605621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:57:33.605671Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 297 partno 0 count 3 parts 0 suffix '63' size 98724
2025-10-10T14:57:33.605675Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 98616 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:57:33.605720Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.605784Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 298, partNo: 0, Offset: 297 is stored on disk
2025-10-10T14:57:33.605814Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.605840Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 299, partNo: 0, Offset: 298 is stored on disk
2025-10-10T14:57:33.605854Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:57:33.605876Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 300, partNo: 0, Offset: 299 is stored on disk
2025-10-10T14:57:33.606089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.606104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.606116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.606170Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:57:33.606223Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 597  requestId: <none> cookie: 298
2025-10-10T14:57:33.606283Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 598  requestId: <none> cookie: 299
2025-10-10T14:57:33.606326Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 599  requestId: <none> cookie: 300
2025-10-10T14:57:33.605590Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 297 Result { Offset: 272 Data: "... 30005 bytes ..." SourceId: "\000src_id" SeqNo: 273 WriteTimestampMS: 1760108253508 CreateTimestampMS: 1760108252163 UncompressedSize: 29931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 273 Data: "... 30115 bytes ..." SourceId: "\000src_id" SeqNo: 274 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252163 UncompressedSize: 30041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 274 Data: "... 30225 bytes ..." SourceId: "\000src_id" SeqNo: 275 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252163 UncompressedSize: 30151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 275 Data: "... 30335 bytes ..." SourceId: "\000src_id" SeqNo: 276 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252163 UncompressedSize: 30261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 276 Data: "... 30445 bytes ..." SourceId: "\000src_id" SeqNo: 277 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252164 UncompressedSize: 30371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 277 Data: "... 30555 bytes ..." SourceId: "\000src_id" SeqNo: 278 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252164 UncompressedSize: 30481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 278 Data: "... 30665 bytes ..." SourceId: "\000src_id" SeqNo: 279 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252164 UncompressedSize: 30591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 279 Data: "... 30775 bytes ..." SourceId: "\000src_id" SeqNo: 280 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252164 UncompressedSize: 30701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 280 Data: "... 30885 bytes ..." SourceId: "\000src_id" SeqNo: 281 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252164 UncompressedSize: 30811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 281 Data: "... 30995 bytes ..." SourceId: "\000src_id" SeqNo: 282 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252164 UncompressedSize: 30921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 282 Data: "... 31105 bytes ..." SourceId: "\000src_id" SeqNo: 283 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252164 UncompressedSize: 31031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 283 Data: "... 31215 bytes ..." SourceId: "\000src_id" SeqNo: 284 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252165 UncompressedSize: 31141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 284 Data: "... 31325 bytes ..." SourceId: "\000src_id" SeqNo: 285 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252167 UncompressedSize: 31251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 285 Data: "... 31435 bytes ..." SourceId: "\000src_id" SeqNo: 286 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252167 UncompressedSize: 31361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 286 Data: "... 31545 bytes ..." SourceId: "\000src_id" SeqNo: 287 WriteTimestampMS: 1760108253518 CreateTimestampMS: 1760108252167 UncompressedSize: 31471 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 461517 RealReadOffset: 286 WaitQuotaTimeMs: 0 EndOffset: 297 StartOffset: 0 } Cookie: 272 }
2025-10-10T14:57:33.606520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.606619Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.606684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:57:33.607180Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 287 endOffset 297
2025-10-10T14:57:33.607221Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 297 ReadOffset 287 ReadGuid ecc8d0e8-96b6eb8e-d07641e3-cca75948 has messages 1
2025-10-10T14:57:33.607346Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 287, endOffset# 297, WTime# 1760108253518, sizeLag# 461517
2025-10-10T14:57:33.607366Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:57:33.607429Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# ecc8d0e8-96b6eb8e-d07641e3-cca75948, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 461352
2025-10-10T14:57:33.607462Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# ecc8d0e8-96b6eb8e-d07641e3-cca75948
2025-10-10T14:57:33.608158Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 1
2025-10-10T14:57:33.608217Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# df70a802-46dd899b-e7833951-bcf7c5e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 62936, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.608325Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 62936 maxTimeLagMs 0 readTimestampMs 0 readOffset 287 EndOffset 297 ClientCommitOffset 0 committedOffset 0 Guid df70a802-46dd899b-e7833951-bcf7c5e
2025-10-10T14:57:33.608757Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.608802Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.608918Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 29 Topic 'rt3.dc1--test-topic' partition 0 user user offset 287 count 12 size 62936 endOffset 300 max time lag 0ms effective offset 287
2025-10-10T14:57:33.609088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 298 offsets: 297 already_written: false write_statistics { persist_duration_ms: 34 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:33.609143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 298
2025-10-10T14:57:33.609360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 299 offsets: 298 already_written: false write_statistics { persist_duration_ms: 34 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:33.609399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 299
2025-10-10T14:57:33.609605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session got write response: sequence_numbers: 300 offsets: 299 already_written: false write_statistics { persist_duration_ms: 34 queued_in_partition_duration_ms: 18 }
2025-10-10T14:57:33.609633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: acknoledged message 300
2025-10-10T14:57:33.611051Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 461352, now ReadSizeBudget = 0, ReadSizeServerDelta = 62936
2025-10-10T14:57:33.611180Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 62936
2025-10-10T14:57:33.611332Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (272-286)
2025-10-10T14:57:33.611370Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 461352 to budget
2025-10-10T14:57:33.611399Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 461352, ReadSizeServerDelta = 62936
2025-10-10T14:57:33.611970Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.609149Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 29 added 1 blobs, size 321706 count 10 last offset 287, current partition end offset: 300
2025-10-10T14:57:33.612065Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (272-272)
2025-10-10T14:57:33.612169Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 461352 } }
2025-10-10T14:57:33.612313Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# cbec656d-80916aae-236f2e56-292320c
2025-10-10T14:57:33.609175Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 29. Send blob request.
2025-10-10T14:57:33.612230Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (273-273)
2025-10-10T14:57:33.609228Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 287 partno 0 count 10 parts_count 0 source 1 size 321706 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.609258Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 29. All 1 blobs are from cache.
2025-10-10T14:57:33.609313Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:33.609330Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 287 partno 0 count 10 parts 0 suffix '63'
2025-10-10T14:57:33.613546Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 287 totakecount 10 count 10 size 321683 from pos 0 cbcount 10
2025-10-10T14:57:33.613946Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 287
2025-10-10T14:57:33.614655Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (274-274)
2025-10-10T14:57:33.614818Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (275-275)
2025-10-10T14:57:33.615091Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (276-276)
2025-10-10T14:57:33.615170Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (277-277)
2025-10-10T14:57:33.615272Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (278-278)
2025-10-10T14:57:33.615360Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (279-279)
2025-10-10T14:57:33.616825Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (280-280)
2025-10-10T14:57:33.616911Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (281-281)
2025-10-10T14:57:33.616999Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (282-282)
2025-10-10T14:57:33.617014Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 287 Data: "... 31655 bytes ..." SourceId: "\000src_id" SeqNo: 288 WriteTimestampMS: 1760108253545 CreateTimestampMS: 1760108252167 UncompressedSize: 31581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 288 Data: "... 31765 bytes ..." SourceId: "\000src_id" SeqNo: 289 WriteTimestampMS: 1760108253547 CreateTimestampMS: 1760108252173 UncompressedSize: 31691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 289 Data: "... 31875 bytes ..." SourceId: "\000src_id" SeqNo: 290 WriteTimestampMS: 1760108253547 CreateTimestampMS: 1760108252173 UncompressedSize: 31801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 290 Data: "... 31985 bytes ..." SourceId: "\000src_id" SeqNo: 291 WriteTimestampMS: 1760108253547 CreateTimestampMS: 1760108252173 UncompressedSize: 31911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 291 Data: "... 32095 bytes ..." SourceId: "\000src_id" SeqNo: 292 WriteTimestampMS: 1760108253547 CreateTimestampMS: 1760108252174 UncompressedSize: 32021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 292 Data: "... 32205 bytes ..." SourceId: "\000src_id" SeqNo: 293 WriteTimestampMS: 1760108253547 CreateTimestampMS: 1760108252181 UncompressedSize: 32131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 293 Data: "... 32315 bytes ..." SourceId: "\000src_id" SeqNo: 294 WriteTimestampMS: 1760108253547 CreateTimestampMS: 1760108252181 UncompressedSize: 32241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 294 Data: "... 32425 bytes ..." SourceId: "\000src_id" SeqNo: 295 WriteTimestampMS: 1760108253547 CreateTimestampMS: 1760108252181 UncompressedSize: 32351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 295 Data: "... 32535 bytes ..." SourceId: "\000src_id" SeqNo: 296 WriteTimestampMS: 1760108253547 CreateTimestampMS: 1760108252182 UncompressedSize: 32461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 296 Data: "... 32645 bytes ..." SourceId: "\000src_id" SeqNo: 297 WriteTimestampMS: 1760108253547 CreateTimestampMS: 1760108252182 UncompressedSize: 32571 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 321492 RealReadOffset: 296 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 287 }
2025-10-10T14:57:33.617078Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (283-283)
2025-10-10T14:57:33.617320Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (284-284)
2025-10-10T14:57:33.617389Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (285-285)
2025-10-10T14:57:33.617475Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (286-286)
2025-10-10T14:57:33.618353Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 297 endOffset 300
2025-10-10T14:57:33.618407Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 297 ReadGuid df70a802-46dd899b-e7833951-bcf7c5e has messages 1
2025-10-10T14:57:33.618446Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 297, endOffset# 300, WTime# 1760108253547, sizeLag# 321492
2025-10-10T14:57:33.618464Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1TEvPartitionReady. Aval parts: 0
2025-10-10T14:57:33.618525Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# df70a802-46dd899b-e7833951-bcf7c5e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 321402
2025-10-10T14:57:33.618567Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# df70a802-46dd899b-e7833951-bcf7c5e
>>> event from dataHandler: 2025-10-10T14:57:33.620310Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 1
2025-10-10T14:57:33.620383Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 performing read request: guid# 6d1fb616-1265bbee-d49d5526-1cced5dd, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 202886, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-10T14:57:33.620551Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 202886 maxTimeLagMs 0 readTimestampMs 0 readOffset 297 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid 6d1fb616-1265bbee-d49d5526-1cced5dd
2025-10-10T14:57:33.622046Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 321402, now ReadSizeBudget = 0, ReadSizeServerDelta = 202886
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..29931 bytes.. Information: { Offset: 272 ProducerId: "src_id" SeqNo: 273 CreateTime: 2025-10-10T14:57:32.163000Z WriteTime: 2025-10-10T14:57:33.508000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "server": "ipv6:[::1]:33456", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30041 bytes.. Information: { Offset: 273 ProducerId: "src_id" SeqNo: 274 CreateTime: 2025-10-10T14:57:32.163000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30151 bytes.. Information: { Offset: 274 ProducerId: "src_id" SeqNo: 275 CreateTime: 2025-10-10T14:57:32.163000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30261 bytes.. Information: { Offset: 275 ProducerId: "src_id" SeqNo: 276 CreateTime: 2025-10-10T14:57:32.163000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30371 bytes.. Information: { Offset: 276 ProducerId: "src_id" SeqNo: 277 CreateTime: 2025-10-10T14:57:32.164000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30481 bytes.. Information: { Offset: 277 ProducerId: "src_id" SeqNo: 278 CreateTime: 2025-10-10T14:57:32.164000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30591 bytes.. Information: { Offset: 278 ProducerId: "src_id" SeqNo: 279 CreateTime: 2025-10-10T14:57:32.164000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30701 bytes.. Information: { Offset: 279 ProducerId: "src_id" SeqNo: 280 CreateTime: 2025-10-10T14:57:32.164000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30811 bytes.. Information: { Offset: 280 ProducerId: "src_id" SeqNo: 281 CreateTime: 2025-10-10T14:57:32.164000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30921 bytes.. Information: { Offset: 281 ProducerId: "src_id" SeqNo: 282 CreateTime: 2025-10-10T14:57:32.164000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31031 bytes.. Information: { Offset: 282 ProducerId: "src_id" SeqNo: 283 CreateTime: 2025-10-10T14:57:32.164000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31141 bytes.. Information: { Offset: 283 ProducerId: "src_id" SeqNo: 284 CreateTime: 2025-10-10T14:57:32.165000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31251 bytes.. Information: { Offset: 284 ProducerId: "src_id" SeqNo: 285 CreateTime: 2025-10-10T14:57:32.167000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31361 bytes.. Information: { Offset: 285 ProducerId: "src_id" SeqNo: 286 CreateTime: 2025-10-10T14:57:32.167000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31471 bytes.. Information: { Offset: 286 ProducerId: "src_id" SeqNo: 287 CreateTime: 2025-10-10T14:57:32.167000Z WriteTime: 2025-10-10T14:57:33.518000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.622311Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (287-296)
2025-10-10T14:57:33.622354Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 321402 to budget
2025-10-10T14:57:33.622384Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 321402, ReadSizeServerDelta = 202886
2025-10-10T14:57:33.622386Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 15, size 460515 bytes
2025-10-10T14:57:33.622549Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.622600Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.622662Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (287-287)
2025-10-10T14:57:33.622760Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (288-288)
2025-10-10T14:57:33.622879Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (289-289)
2025-10-10T14:57:33.622961Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (290-290)
2025-10-10T14:57:33.622888Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 321402 } }
2025-10-10T14:57:33.623009Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 64bd641d-2ef44ffa-1063ab1-948a632
2025-10-10T14:57:33.623169Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (291-291)
2025-10-10T14:57:33.623241Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (292-292)
2025-10-10T14:57:33.623295Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (293-293)
2025-10-10T14:57:33.623344Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (294-294)
2025-10-10T14:57:33.623712Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (295-295)
2025-10-10T14:57:33.623766Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (296-296)
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..31581 bytes.. Information: { Offset: 287 ProducerId: "src_id" SeqNo: 288 CreateTime: 2025-10-10T14:57:32.167000Z WriteTime: 2025-10-10T14:57:33.545000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31691 bytes.. Information: { Offset: 288 ProducerId: "src_id" SeqNo: 289 CreateTime: 2025-10-10T14:57:32.173000Z WriteTime: 2025-10-10T14:57:33.547000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31801 bytes.. Information: { Offset: 289 ProducerId: "src_id" SeqNo: 290 CreateTime: 2025-10-10T14:57:32.173000Z WriteTime: 2025-10-10T14:57:33.547000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31911 bytes.. Information: { Offset: 290 ProducerId: "src_id" SeqNo: 291 CreateTime: 2025-10-10T14:57:32.173000Z WriteTime: 2025-10-10T14:57:33.547000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32021 bytes.. Information: { Offset: 291 ProducerId: "src_id" SeqNo: 292 CreateTime: 2025-10-10T14:57:32.174000Z WriteTime: 2025-10-10T14:57:33.547000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32131 bytes.. Information: { Offset: 292 ProducerId: "src_id" SeqNo: 293 CreateTime: 2025-10-10T14:57:32.181000Z WriteTime: 2025-10-10T14:57:33.547000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32241 bytes.. Information: { Offset: 293 ProducerId: "src_id" SeqNo: 294 CreateTime: 2025-10-10T14:57:32.181000Z WriteTime: 2025-10-10T14:57:33.547000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32351 bytes.. Information: { Offset: 294 ProducerId: "src_id" SeqNo: 295 CreateTime: 2025-10-10T14:57:32.181000Z WriteTime: 2025-10-10T14:57:33.547000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32461 bytes.. Information: { Offset: 295 ProducerId: "src_id" SeqNo: 296 CreateTime: 2025-10-10T14:57:32.182000Z WriteTime: 2025-10-10T14:57:33.547000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32571 bytes.. Information: { Offset: 296 ProducerId: "src_id" SeqNo: 297 CreateTime: 2025-10-10T14:57:32.182000Z WriteTime: 2025-10-10T14:57:33.547000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:33456", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.625897Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 10, size 320760 bytes
2025-10-10T14:57:33.625937Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.627082Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:57:33.627126Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:57:33.627239Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 30 Topic 'rt3.dc1--test-topic' partition 0 user user offset 297 count 3 size 202886 endOffset 300 max time lag 0ms effective offset 297
2025-10-10T14:57:33.627444Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 30 added 1 blobs, size 98724 count 3 last offset 297, current partition end offset: 300
2025-10-10T14:57:33.627458Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 30. Send blob request.
2025-10-10T14:57:33.627512Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 297 partno 0 count 3 parts_count 0 source 1 size 98724 accessed 0 times before, last time 2025-10-10T14:57:33.000000Z
2025-10-10T14:57:33.627552Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 30. All 1 blobs are from cache.
2025-10-10T14:57:33.627601Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T14:57:33.627682Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 297 partno 0 count 3 parts 0 suffix '63'
2025-10-10T14:57:33.628166Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 297 totakecount 3 count 3 size 98701 from pos 0 cbcount 3
2025-10-10T14:57:33.628294Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 297
2025-10-10T14:57:33.629486Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 297 Data: "... 32755 bytes ..." SourceId: "\000src_id" SeqNo: 298 WriteTimestampMS: 1760108253563 CreateTimestampMS: 1760108252182 UncompressedSize: 32681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 298 Data: "... 32865 bytes ..." SourceId: "\000src_id" SeqNo: 299 WriteTimestampMS: 1760108253570 CreateTimestampMS: 1760108252182 UncompressedSize: 32791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 299 Data: "... 32975 bytes ..." SourceId: "\000src_id" SeqNo: 300 WriteTimestampMS: 1760108253570 CreateTimestampMS: 1760108252182 UncompressedSize: 32901 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 299 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 297 }
2025-10-10T14:57:33.629846Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 19 from offset 300
2025-10-10T14:57:33.629889Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 300 ReadGuid 6d1fb616-1265bbee-d49d5526-1cced5dd has messages 1
2025-10-10T14:57:33.630039Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 read done: guid# 6d1fb616-1265bbee-d49d5526-1cced5dd, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 98742
2025-10-10T14:57:33.630070Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 response to read: guid# 6d1fb616-1265bbee-d49d5526-1cced5dd
2025-10-10T14:57:33.630441Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 Process answer. Aval parts: 0
2025-10-10T14:57:33.634215Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Got ReadResponse, serverBytesSize = 98742, now ReadSizeBudget = 0, ReadSizeServerDelta = 425546
2025-10-10T14:57:33.634292Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 425546
2025-10-10T14:57:33.636436Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (297-299)
2025-10-10T14:57:33.636486Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 98742 to budget
2025-10-10T14:57:33.636506Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] In ContinueReadingDataImpl, ReadSizeBudget = 98742, ReadSizeServerDelta = 425546
2025-10-10T14:57:33.636702Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-10T14:57:33.636756Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (297-297)
2025-10-10T14:57:33.636840Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (298-298)
2025-10-10T14:57:33.637008Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (299-299)
2025-10-10T14:57:33.637976Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 1, data# { read_request { bytes_size: 98742 } }
2025-10-10T14:57:33.638149Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 got read request: guid# 9ec71501-ad8360f8-b3ad3297-3d4a10b3
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..32681 bytes.. Information: { Offset: 297 ProducerId: "src_id" SeqNo: 298 CreateTime: 2025-10-10T14:57:32.182000Z WriteTime: 2025-10-10T14:57:33.563000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:33456", "logtype": "unknown", "server": "ipv6:[::1]:33456" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32791 bytes.. Information: { Offset: 298 ProducerId: "src_id" SeqNo: 299 CreateTime: 2025-10-10T14:57:32.182000Z WriteTime: 2025-10-10T14:57:33.570000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32901 bytes.. Information: { Offset: 299 ProducerId: "src_id" SeqNo: 300 CreateTime: 2025-10-10T14:57:32.182000Z WriteTime: 2025-10-10T14:57:33.570000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:33456", "logtype": "unknown", "_ip": "ipv6:[::1]:33456", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-10-10T14:57:33.642456Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] The application data is transferred to the client. Number of messages 3, size 98373 bytes
2025-10-10T14:57:33.642496Z :DEBUG: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] [] Returning serverBytesSize = 0 to budget
2025-10-10T14:57:33.642638Z :INFO: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Closing read session. Close timeout: 18446744073709.551615s
2025-10-10T14:57:33.642685Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:57:33.642735Z :INFO: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1847 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:33.643259Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Closing read session. Close timeout: 18446744073709.551615s
2025-10-10T14:57:33.643295Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-10T14:57:33.643325Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1814 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:33.643577Z :INFO: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Closing read session. Close timeout: 18446744073709.551615s
2025-10-10T14:57:33.643611Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:57:33.643638Z :INFO: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1804 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:33.643934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: close. Timeout = 0 ms
2025-10-10T14:57:33.643976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session will now close
2025-10-10T14:57:33.644011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: aborting
2025-10-10T14:57:33.643734Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:57:33.643769Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 grpc read failed
2025-10-10T14:57:33.643805Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 closed
2025-10-10T14:57:33.644171Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_12749517791752966456_v1 is DEAD
2025-10-10T14:57:33.644751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: gracefully shut down, all writes complete
2025-10-10T14:57:33.644802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session is aborting and will not restart
2025-10-10T14:57:33.644912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0] Write session: destroy
2025-10-10T14:57:33.646728Z :INFO: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Closing read session. Close timeout: 0.000000s
2025-10-10T14:57:33.646776Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:57:33.646819Z :INFO: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1851 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:33.646853Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Closing read session. Close timeout: 0.000000s
2025-10-10T14:57:33.646880Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-10T14:57:33.646936Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1818 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:33.646962Z :INFO: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Closing read session. Close timeout: 0.000000s
2025-10-10T14:57:33.646988Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:57:33.647012Z :INFO: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1808 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:33.647037Z :INFO: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Closing read session. Close timeout: 0.000000s
2025-10-10T14:57:33.647062Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:57:33.647097Z :INFO: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1808 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:33.647184Z :NOTICE: [/Root] [/Root] [7e5c82c2-d36394f5-54b9461e-fa889466] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:57:33.647943Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Closing read session. Close timeout: 0.000000s
2025-10-10T14:57:33.647976Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-10-10T14:57:33.648007Z :INFO: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1819 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:33.648056Z :NOTICE: [/Root] [/Root] [3c33bc5b-68c0ad6a-38d3419d-50139858] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:57:33.645853Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:57:33.645875Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc read failed
2025-10-10T14:57:33.645905Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 grpc closed
2025-10-10T14:57:33.645943Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_17876818278139598348_v1 is DEAD
2025-10-10T14:57:33.646638Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 grpc read done: success# 0, data# {  }
2025-10-10T14:57:33.646650Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 grpc read failed
2025-10-10T14:57:33.646668Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 grpc closed
2025-10-10T14:57:33.646685Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_7166244897988296849_v1 is DEAD
2025-10-10T14:57:33.647077Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read done: success: 0 data: 
2025-10-10T14:57:33.647087Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc read failed
2025-10-10T14:57:33.647110Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 grpc closed
2025-10-10T14:57:33.647125Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|10eaf7c4-8daa0ca-d8c251d9-8f3966c8_0 is DEAD
2025-10-10T14:57:33.647587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:57:33.647800Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943266:2504] disconnected; active server actors: 1
2025-10-10T14:57:33.647827Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943266:2504] client user disconnected session shared/user_3_1_12749517791752966456_v1
2025-10-10T14:57:33.647872Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-10T14:57:33.647905Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943255:2508] disconnected; active server actors: 1
2025-10-10T14:57:33.648089Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559607380439910594:2514] destroyed
2025-10-10T14:57:33.647932Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943255:2508] client user disconnected session shared/user_3_2_17876818278139598348_v1
2025-10-10T14:57:33.647980Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943261:2509] disconnected; active server actors: 1
2025-10-10T14:57:33.648135Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_2_17876818278139598348_v1
2025-10-10T14:57:33.647993Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559607376144943261:2509] client user disconnected session shared/user_3_3_7166244897988296849_v1
2025-10-10T14:57:33.648163Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559607376144943265:2519] destroyed
2025-10-10T14:57:33.648189Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:57:33.648215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.648224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.648232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.648294Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_2_17876818278139598348_v1
2025-10-10T14:57:33.648500Z :INFO: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Closing read session. Close timeout: 0.000000s
2025-10-10T14:57:33.648529Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-10T14:57:33.648556Z :INFO: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1853 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:57:33.648600Z :NOTICE: [/Root] [/Root] [869cfdfc-ead37221-4ed81b04-b9774dd7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-10T14:57:33.699955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.699992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.700005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.800111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.800142Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.800154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:33.903204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:57:33.903231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:57:33.903245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:57:34.106739Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T14:57:34.106770Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:10.167394Z :WriteSessionCloseWaitsForWrites INFO: Random seed for debugging is 1760104750167309
2025-10-10T13:59:10.642135Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559592341142037298:2075];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:10.642187Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e9c/r3tmp/tmp9pXwSO/pdisk_1.dat
2025-10-10T13:59:10.895559Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:10.991584Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:11.486000Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:11.486151Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-10T13:59:11.558719Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:11.639534Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:11.650761Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-10T13:59:11.654570Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:11.654659Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:11.656817Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:11.656878Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:11.662809Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:11.680170Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T13:59:11.682708Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:11.744616Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:11.754136Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:11.775437Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 28011, node 1
2025-10-10T13:59:11.977266Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:12.033619Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e9c/r3tmp/yandex4biqE4.tmp
2025-10-10T13:59:12.033641Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e9c/r3tmp/yandex4biqE4.tmp
2025-10-10T13:59:12.037388Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e9c/r3tmp/yandex4biqE4.tmp
2025-10-10T13:59:12.037585Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T13:59:12.118661Z INFO: TTestServer started on Port 5743 GrpcPort 28011
TClient is connected to server localhost:5743
PQClient connected to localhost:28011
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T13:59:12.651321Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T13:59:15.651837Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559592341142037298:2075];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:15.651922Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:17.402757Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:17.424483Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7559592366911842083:2324], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:17.429274Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7559592368414047382:2294], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:17.430816Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=OTQ1MWMwMzctYjE5NWJmYWUtNjdmYTA3OTEtZWQ3YjgwYTY=, ActorId: [1:7559592366911842080:2323], ActorState: ExecuteState, TraceId: 01k776pdfe5rgak34s9pebaehq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:17.431810Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=NWU0ZjU4ZjEtZmU4NzYwNGQtNDU4ZTZjMTAtMTc1NWZhYTI=, ActorId: [2:7559592368414047380:2293], ActorState: ExecuteState, TraceId: 01k776pdk02n5my3wzppf9gw59, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:17.433141Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:17.443156Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:17.694055Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:17.948215Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:28011", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T13:59:18.328267Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k776pevfdhqnsfjwc7bd4r6r, Database: , SessionId: ydb://session/3?node_id=1&id=MTFlODRkMDYtOTE0NjA4NjItZDZiODkxNDAtYjA4MjJiMWE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559592375501777082:2930] 
=== CheckClustersList. Ok
2025-10-10T13:59:23.776059Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715673:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:28011
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:24.068238Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:28011
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T13:59:24.166776Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559592401271581362:3227] connected; active server actors: 1
2025-10-10T13:59:24.166989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T13:59:24.169114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T13:59:24.174363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T13:59:24.197076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:24.208287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:24.208673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T13:59:24.208721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:24.208770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T13:59:24.210585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592401271581391:2444], now have 1 active actors on pipe
2025-10-10T13:59:24.210615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592401271581361:3226], now have 1 active actors on pipe
2025-10-10T13:59:24.211463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.210369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T13:59:24.227749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.244659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592401271581414:3267], now have 1 active actors on pipe
2025-10-10T13:59:24.246285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.250147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.251305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:24.251384Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T13:59:24.251672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:24.252004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592402773786269:2375]
2025-10-10T13:59:24.262523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:24.262568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:24.262595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559592402773786269:2375]
2025-10-10T13:59:24.262625Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T13:59:24.264199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T13:59:24.264243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.264361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.264374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:24.264414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:24.264431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.264443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.264455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:24.264503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:24.265300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.265441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:24.272512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.272689Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760104764285, TxId 281474976715676
2025-10-10T13:59:24.272709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.272729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.272861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.273198Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:24.276958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:24.277299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:24.277331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.277342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.277352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.277382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:24.277711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T13:59:24.277808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:24.278102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.290397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.290504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:24.293775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:24.369409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.369436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.369448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.374803Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715677. Ctx: { TraceId: 01k776pmq456vx2bbhz5w12rxw, Database: , SessionId: ydb://session/3?node_id=1&id=NTU4MGZiZC00YjQ1MDM3My1iOTMxN2E4MC05MGZjMWJkNA==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760104764285
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760104764285
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:28011
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:24.444468Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T13:59:24.469665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.469692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.469701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.577255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.577298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.577309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.681271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.681304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.681322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.781411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.781436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.781445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.881812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.881841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.881850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:28011
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:24.970506Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T13:59:24.985234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:24.985266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:24.985274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:24.992779Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T13:59:25.037315Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T13:59:25.037375Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:28011
2025-10-10T13:59:25.089247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.089280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.089291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.140377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:25.140418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T13:59:25.184335Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:25.193315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:25.193491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:52230
2025-10-10T13:59:25.193247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.193506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:52230 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:25.193520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:25.193276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.193285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.195461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T13:59:25.195624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:25.195634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:25.195641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:25.195670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592405566548866:2476] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:25.201779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592405566548866:2476] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:25.293826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.293853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.293862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.397543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.397571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.397580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.501263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.501295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.501304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.529464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559592405566548866:2476] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:25.530100Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592405566548904:2476] connected; active server actors: 1
2025-10-10T13:59:25.530256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559592405566548866:2476] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T13:59:25.530271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592405566548866:2476] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:25.569114Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592405566548904:2476] disconnected; active server actors: 1
2025-10-10T13:59:25.569848Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592405566548904:2476] disconnected no session
2025-10-10T13:59:25.604747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.604771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.604780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.705450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.705474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.705483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.792078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592405566548941:2476], now have 1 active actors on pipe
2025-10-10T13:59:25.792534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.792569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.792677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|79597be9-1f88ca21-d2f336d6-eec595a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T13:59:25.792761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.792784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.792805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:25.792861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.792908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:25.792971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.789983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592405566548866:2476] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:25.790038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592405566548866:2476] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:25.790060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592405566548866:2476] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:25.790095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:25.792304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T13:59:25.793987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.794013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.794104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.796329Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104765796 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:25.796485Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|79597be9-1f88ca21-d2f336d6-eec595a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:25.796984Z :INFO: [] MessageGroupId [src] SessionId [src|79597be9-1f88ca21-d2f336d6-eec595a3_0] Write session: close. Timeout = 0 ms
2025-10-10T13:59:25.797022Z :INFO: [] MessageGroupId [src] SessionId [src|79597be9-1f88ca21-d2f336d6-eec595a3_0] Write session will now close
2025-10-10T13:59:25.797101Z :DEBUG: [] MessageGroupId [src] SessionId [src|79597be9-1f88ca21-d2f336d6-eec595a3_0] Write session: aborting
2025-10-10T13:59:25.794570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|79597be9-1f88ca21-d2f336d6-eec595a3_0
2025-10-10T13:59:25.797563Z :INFO: [] MessageGroupId [src] SessionId [src|79597be9-1f88ca21-d2f336d6-eec595a3_0] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:25.797596Z :DEBUG: [] MessageGroupId [src] SessionId [src|79597be9-1f88ca21-d2f336d6-eec595a3_0] Write session: destroy
2025-10-10T13:59:25.803704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|79597be9-1f88ca21-d2f336d6-eec595a3_0 grpc read done: success: 0 data: 
2025-10-10T13:59:25.803733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|79597be9-1f88ca21-d2f336d6-eec595a3_0 grpc read failed
2025-10-10T13:59:25.803769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|79597be9-1f88ca21-d2f336d6-eec595a3_0 grpc closed
2025-10-10T13:59:25.803788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|79597be9-1f88ca21-d2f336d6-eec595a3_0 is DEAD
2025-10-10T13:59:25.804321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:25.805056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559592405566548941:2476] destroyed
2025-10-10T13:59:25.805099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:25.805144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.805160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.805170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.806803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.806824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.806833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Ready to answer: ok
2025-10-10T13:59:25.889352Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:28011" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:28011" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:28011" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T13:59:25.909242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.909276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.909287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.916250Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:25.916670Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T13:59:25.937835Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T13:59:25.941706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:25.941739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T13:59:25.961844Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:25.962353Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T13:59:25.963055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:25.963239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:52250
2025-10-10T13:59:25.963268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:52250 proto=topic  topic=test-topic durationSec=0
2025-10-10T13:59:25.963279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:25.964824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T13:59:25.964942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:25.964956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:25.964963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:25.964977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592405566548969:2495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:25.967203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592405566548969:2495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:25.976532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559592405566548969:2495] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:25.977336Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592405566548986:2495] connected; active server actors: 1
2025-10-10T13:59:25.977501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559592405566548969:2495] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T13:59:25.977519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592405566548969:2495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:25.979735Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592405566548986:2495] disconnected; active server actors: 1
2025-10-10T13:59:25.979756Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592405566548986:2495] disconnected no session
2025-10-10T13:59:25.988207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592405566548969:2495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:25.988245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592405566548969:2495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:25.988259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592405566548969:2495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:25.988293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:25.990202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592405566548997:2495], now have 1 active actors on pipe
2025-10-10T13:59:25.990924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T13:59:25.991298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.991327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.991397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:25.991428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:25.991445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:25.991454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:25.991489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:25.991529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:25.991596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.992349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:25.992375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:25.992434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:25.993679Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:25.993761Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104765993 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:25.993888Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T13:59:25.994333Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-10T13:59:25.994475Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
2025-10-10T13:59:25.994512Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
2025-10-10T13:59:25.994556Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 4 to 4
2025-10-10T13:59:25.994598Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 5 to 5
2025-10-10T13:59:25.994632Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 6 to 6
2025-10-10T13:59:25.994659Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 7 to 7
2025-10-10T13:59:25.994734Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 8 to 8
2025-10-10T13:59:25.994772Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 9 to 9
2025-10-10T13:59:25.994807Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 10 to 10
2025-10-10T13:59:25.994843Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 11 to 11
2025-10-10T13:59:25.995099Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 12 to 12
2025-10-10T13:59:25.995158Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 13 to 13
2025-10-10T13:59:25.995196Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 14 to 14
2025-10-10T13:59:25.995248Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 15 to 15
2025-10-10T13:59:25.995294Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 16 to 16
2025-10-10T13:59:25.995411Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 17 to 17
2025-10-10T13:59:25.995462Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 18 to 18
2025-10-10T13:59:25.995513Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 19 to 19
2025-10-10T13:59:25.995568Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 20 to 20
2025-10-10T13:59:25.995606Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 21 to 21
2025-10-10T13:59:25.995640Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 22 to 22
2025-10-10T13:59:25.995693Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 23 to 23
2025-10-10T13:59:25.995746Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 24 to 24
2025-10-10T13:59:25.995783Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 25 to 25
2025-10-10T13:59:25.995871Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 26 to 26
2025-10-10T13:59:25.995927Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 27 to 27
2025-10-10T13:59:25.995960Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 28 to 28
2025-10-10T13:59:25.996002Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 29 to 29
2025-10-10T13:59:25.996039Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 30 to 30
2025-10-10T13:59:25.992855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0
2025-10-10T13:59:25.997444Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 31 to 31
2025-10-10T13:59:25.997511Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 32 to 32
2025-10-10T13:59:25.997578Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 33 to 33
2025-10-10T13:59:25.997615Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 34 to 34
2025-10-10T13:59:25.997684Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 35 to 35
2025-10-10T13:59:25.997723Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 36 to 36
2025-10-10T13:59:25.997757Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 37 to 37
2025-10-10T13:59:25.997789Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 38 to 38
2025-10-10T13:59:25.997823Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 39 to 39
2025-10-10T13:59:25.997857Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 40 to 40
2025-10-10T13:59:25.997893Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 41 to 41
2025-10-10T13:59:25.997941Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 42 to 42
2025-10-10T13:59:25.997974Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 43 to 43
2025-10-10T13:59:25.998038Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 44 to 44
2025-10-10T13:59:25.998072Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 45 to 45
2025-10-10T13:59:25.998113Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 46 to 46
2025-10-10T13:59:25.998147Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 47 to 47
2025-10-10T13:59:25.998385Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 48 to 48
2025-10-10T13:59:25.998442Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 49 to 49
2025-10-10T13:59:25.998474Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 50 to 50
2025-10-10T13:59:25.998499Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 51 to 51
2025-10-10T13:59:25.998533Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 52 to 52
2025-10-10T13:59:25.998571Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 53 to 53
2025-10-10T13:59:25.998605Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 54 to 54
2025-10-10T13:59:25.998685Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 55 to 55
2025-10-10T13:59:25.998733Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 56 to 56
2025-10-10T13:59:25.998771Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 57 to 57
2025-10-10T13:59:25.998806Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 58 to 58
2025-10-10T13:59:25.998841Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 59 to 59
2025-10-10T13:59:25.999001Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 60 to 60
2025-10-10T13:59:25.999088Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 61 to 61
2025-10-10T13:59:26.001049Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 62 to 62
2025-10-10T13:59:26.001145Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 63 to 63
2025-10-10T13:59:26.001219Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 64 to 64
2025-10-10T13:59:26.001295Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 65 to 65
2025-10-10T13:59:26.001382Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 66 to 66
2025-10-10T13:59:26.001416Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 67 to 67
2025-10-10T13:59:26.001473Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 68 to 68
2025-10-10T13:59:26.001529Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 69 to 69
2025-10-10T13:59:26.001570Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 70 to 70
2025-10-10T13:59:26.001599Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 71 to 71
2025-10-10T13:59:26.001640Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 72 to 72
2025-10-10T13:59:26.001705Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 73 to 73
2025-10-10T13:59:26.001747Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 74 to 74
2025-10-10T13:59:26.001788Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 75 to 75
2025-10-10T13:59:26.001846Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 76 to 76
2025-10-10T13:59:26.001885Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 77 to 77
2025-10-10T13:59:26.004124Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 78 to 78
2025-10-10T13:59:26.004221Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 79 to 79
2025-10-10T13:59:26.004269Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 80 to 80
2025-10-10T13:59:26.004319Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 81 to 81
2025-10-10T13:59:26.004398Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 82 to 82
2025-10-10T13:59:26.004428Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 83 to 83
2025-10-10T13:59:26.004483Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 84 to 84
2025-10-10T13:59:26.004529Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 85 to 85
2025-10-10T13:59:26.004565Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 86 to 86
2025-10-10T13:59:26.004594Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 87 to 87
2025-10-10T13:59:26.004636Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 88 to 88
2025-10-10T13:59:26.004671Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 89 to 89
2025-10-10T13:59:26.004706Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 90 to 90
2025-10-10T13:59:26.004744Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 91 to 91
2025-10-10T13:59:26.004775Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 92 to 92
2025-10-10T13:59:26.004806Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 93 to 93
2025-10-10T13:59:26.004841Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 94 to 94
2025-10-10T13:59:26.005157Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 95 to 95
2025-10-10T13:59:26.005195Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 96 to 96
2025-10-10T13:59:26.005261Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 97 to 97
2025-10-10T13:59:26.005298Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 98 to 98
2025-10-10T13:59:26.005328Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 99 to 99
2025-10-10T13:59:26.005365Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write 1 messages with Id from 100 to 100
2025-10-10T13:59:26.010433Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:26.010486Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Send 21 message(s) (79 left), first sequence number is 1
2025-10-10T13:59:26.010006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.010041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.010065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.013441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:26.014064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:26.014725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.014779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.014890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T13:59:26.015531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.016304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.016347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.016749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:26.016984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.016996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 1 size 99 offset: -1
2025-10-10T13:59:26.017313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:26.017478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.017573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.017588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (21)
2025-10-10T13:59:26.017732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T13:59:26.030908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-10T13:59:26.030992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T13:59:26.031033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 312 count 2 nextOffset 2 batches 1
2025-10-10T13:59:26.031060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T13:59:26.031080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 452 count 3 nextOffset 3 batches 1
2025-10-10T13:59:26.031099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-10T13:59:26.031120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 592 count 4 nextOffset 4 batches 1
2025-10-10T13:59:26.031146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-10T13:59:26.031167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 732 count 5 nextOffset 5 batches 1
2025-10-10T13:59:26.031182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-10T13:59:26.031214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 872 count 6 nextOffset 6 batches 1
2025-10-10T13:59:26.031252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-10T13:59:26.031269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1012 count 7 nextOffset 7 batches 1
2025-10-10T13:59:26.031284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-10T13:59:26.031299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1152 count 8 nextOffset 8 batches 1
2025-10-10T13:59:26.031318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-10T13:59:26.031337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1292 count 9 nextOffset 9 batches 1
2025-10-10T13:59:26.031361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-10T13:59:26.031380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1432 count 10 nextOffset 10 batches 1
2025-10-10T13:59:26.031395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-10T13:59:26.031410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1573 count 11 nextOffset 11 batches 1
2025-10-10T13:59:26.031424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-10T13:59:26.031440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1714 count 12 nextOffset 12 batches 1
2025-10-10T13:59:26.031456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-10T13:59:26.031470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1855 count 13 nextOffset 13 batches 1
2025-10-10T13:59:26.031484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-10T13:59:26.031498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1996 count 14 nextOffset 14 batches 1
2025-10-10T13:59:26.031520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-10T13:59:26.031536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2137 count 15 nextOffset 15 batches 1
2025-10-10T13:59:26.031554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-10T13:59:26.031569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2278 count 16 nextOffset 16 batches 1
2025-10-10T13:59:26.031587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-10T13:59:26.031610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2419 count 17 nextOffset 17 batches 1
2025-10-10T13:59:26.031625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-10T13:59:26.031640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2560 count 18 nextOffset 18 batches 1
2025-10-10T13:59:26.031655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-10T13:59:26.031680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2701 count 19 nextOffset 19 batches 1
2025-10-10T13:59:26.031698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-10T13:59:26.031714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2842 count 20 nextOffset 20 batches 1
2025-10-10T13:59:26.031730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-10T13:59:26.031745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2983 count 21 nextOffset 21 batches 1
2025-10-10T13:59:26.031759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.032514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,21 HeadOffset 0 endOffset 0 curOffset 21 d0000000000_00000000000000000000_00000_0000000021_00000? size 2350 WTime 1760104766029
2025-10-10T13:59:26.032739Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:26.032874Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 21 size 2350
2025-10-10T13:59:26.062928Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:26.062961Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Send 41 message(s) (38 left), first sequence number is 22
2025-10-10T13:59:26.065219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:26.065900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:26.068961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.067251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.069027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.067290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.067346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 21 size 2350 actorID [2:7559592402773786251:2375]
2025-10-10T13:59:26.067446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:26.067490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2216 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:26.067524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T13:59:26.067582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T13:59:26.067608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-10T13:59:26.067633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-10T13:59:26.067661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-10T13:59:26.067685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-10T13:59:26.067710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-10T13:59:26.067732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-10T13:59:26.067759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-10T13:59:26.067803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-10T13:59:26.067828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-10T13:59:26.067848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-10T13:59:26.067875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-10T13:59:26.067904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-10T13:59:26.067925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-10T13:59:26.067948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-10T13:59:26.067971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.067983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-10T13:59:26.067991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.068009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-10T13:59:26.068017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.068029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-10T13:59:26.068038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.068052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-10T13:59:26.068060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.068073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-10T13:59:26.068284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:26.068316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:26.068333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.068342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.068350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.068376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:26.068401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-10T13:59:26.068550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 21 parts 0 suffix '63' size 2350
2025-10-10T13:59:26.068560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T13:59:26.068670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 21 max time lag 0ms effective offset 0
2025-10-10T13:59:26.068864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2350 count 21 last offset 0, current partition end offset: 21
2025-10-10T13:59:26.068878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:26.068921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 21 parts_count 0 source 1 size 2350 accessed 0 times before, last time 2025-10-10T13:59:26.000000Z
2025-10-10T13:59:26.068952Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T13:59:26.069014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:26.069331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 21 parts 0 suffix '63'
2025-10-10T13:59:26.069627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 21 count 21 size 2330 from pos 0 cbcount 21
2025-10-10T13:59:26.069730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104766017 queuesize 0 startOffset 0
2025-10-10T13:59:26.073528Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:26.074431Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } acks { seq_no: 2 written { offset: 1 } } acks { seq_no: 3 written { offset: 2 } } acks { seq_no: 4 written { offset: 3 } } acks { seq_no: 5 written { offset: 4 } } acks { seq_no: 6 written { offset: 5 } } acks { seq_no: 7 written { offset: 6 } } acks { seq_no: 8 written { offset: 7 } } acks { seq_no: 9 written { offset: 8 } } acks { seq_no: 10 written { offset: 9 } } acks { seq_no: 11 written { offset: 10 } } acks { seq_no: 12 written { offset: 11 } } acks { seq_no: 13 written { offset: 12 } } acks { seq_no: 14 written { offset: 13 } } acks { seq_no: 15 written { offset: 14 } } acks { seq_no: 16 written { offset: 15 } } acks { seq_no: 17 written { offset: 16 } } acks { seq_no: 18 written { offset: 17 } } acks { seq_no: 19 written { offset: 18 } } acks { seq_no: 20 written { offset: 19 } } acks { seq_no: 21 written { offset: 20 } } write_statistics { persisting_time { nanos: 35000000 } min_queue_wait_time { nanos: 12000000 } max_queue_wait_time { nanos: 12000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T13:59:26.074482Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T13:59:26.074520Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-10T13:59:26.074567Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-10T13:59:26.074586Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 2
2025-10-10T13:59:26.074604Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=3, txId=?
2025-10-10T13:59:26.074630Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 3
2025-10-10T13:59:26.074654Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=4, txId=?
2025-10-10T13:59:26.074690Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 4
2025-10-10T13:59:26.074715Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=5, txId=?
2025-10-10T13:59:26.074734Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 5
2025-10-10T13:59:26.074755Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=6, txId=?
2025-10-10T13:59:26.074773Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 6
2025-10-10T13:59:26.074792Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=7, txId=?
2025-10-10T13:59:26.074806Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 7
2025-10-10T13:59:26.074825Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=8, txId=?
2025-10-10T13:59:26.074841Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 8
2025-10-10T13:59:26.071469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.074864Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=9, txId=?
2025-10-10T13:59:26.074891Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 9
2025-10-10T13:59:26.071502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.074909Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=10, txId=?
2025-10-10T13:59:26.071550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.074923Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 10
2025-10-10T13:59:26.071570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.074953Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=11, txId=?
2025-10-10T13:59:26.071586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.074971Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 11
2025-10-10T13:59:26.071601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.074991Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=12, txId=?
2025-10-10T13:59:26.071626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.071641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075009Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 12
2025-10-10T13:59:26.071654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075035Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=13, txId=?
2025-10-10T13:59:26.071668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075059Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 13
2025-10-10T13:59:26.071711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075092Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=14, txId=?
2025-10-10T13:59:26.071731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.071744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075114Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 14
2025-10-10T13:59:26.071757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075150Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=15, txId=?
2025-10-10T13:59:26.071771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075168Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 15
2025-10-10T13:59:26.071784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.071798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075194Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=16, txId=?
2025-10-10T13:59:26.071812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075211Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 16
2025-10-10T13:59:26.071840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075229Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=17, txId=?
2025-10-10T13:59:26.071854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.071868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075250Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 17
2025-10-10T13:59:26.071882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075273Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=18, txId=?
2025-10-10T13:59:26.071899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075287Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 18
2025-10-10T13:59:26.071913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.075305Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=19, txId=?
2025-10-10T13:59:26.071926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.071940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.071955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.071970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.071986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 3 size 99 offset: -1
2025-10-10T13:59:26.072313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:26.072488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.072577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.072585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (41)
2025-10-10T13:59:26.072686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-10T13:59:26.075327Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 19
2025-10-10T13:59:26.075836Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=20, txId=?
2025-10-10T13:59:26.075858Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 20
2025-10-10T13:59:26.075883Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=21, txId=?
2025-10-10T13:59:26.075900Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 21
2025-10-10T13:59:26.102597Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:26.102645Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Send 38 message(s) (0 left), first sequence number is 63
2025-10-10T13:59:26.103907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:26.104532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:26.128966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.125978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 173 count 1 nextOffset 22 batches 1
2025-10-10T13:59:26.126073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-10T13:59:26.126110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 314 count 2 nextOffset 23 batches 1
2025-10-10T13:59:26.126130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-10T13:59:26.126150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 455 count 3 nextOffset 24 batches 1
2025-10-10T13:59:26.126170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-10T13:59:26.126188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 596 count 4 nextOffset 25 batches 1
2025-10-10T13:59:26.126204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-10T13:59:26.126223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 737 count 5 nextOffset 26 batches 1
2025-10-10T13:59:26.126239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-10T13:59:26.126257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 878 count 6 nextOffset 27 batches 1
2025-10-10T13:59:26.126272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-10T13:59:26.126289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1019 count 7 nextOffset 28 batches 1
2025-10-10T13:59:26.126308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-10T13:59:26.126326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1160 count 8 nextOffset 29 batches 1
2025-10-10T13:59:26.126344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-10T13:59:26.126364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1301 count 9 nextOffset 30 batches 1
2025-10-10T13:59:26.126380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-10T13:59:26.126398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1442 count 10 nextOffset 31 batches 1
2025-10-10T13:59:26.126416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-10T13:59:26.126432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1583 count 11 nextOffset 32 batches 1
2025-10-10T13:59:26.126450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-10T13:59:26.126466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1724 count 12 nextOffset 33 batches 1
2025-10-10T13:59:26.126482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-10T13:59:26.126499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1865 count 13 nextOffset 34 batches 1
2025-10-10T13:59:26.126518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-10T13:59:26.126536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2006 count 14 nextOffset 35 batches 1
2025-10-10T13:59:26.126552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-10T13:59:26.126567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2147 count 15 nextOffset 36 batches 1
2025-10-10T13:59:26.126583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-10T13:59:26.126599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2288 count 16 nextOffset 37 batches 1
2025-10-10T13:59:26.126619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-10T13:59:26.126640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2429 count 17 nextOffset 38 batches 1
2025-10-10T13:59:26.126658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-10T13:59:26.126675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2570 count 18 nextOffset 39 batches 1
2025-10-10T13:59:26.126693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-10T13:59:26.126709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2711 count 19 nextOffset 40 batches 1
2025-10-10T13:59:26.126727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-10T13:59:26.126745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2852 count 20 nextOffset 41 batches 1
2025-10-10T13:59:26.126763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-10T13:59:26.126781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2993 count 21 nextOffset 42 batches 1
2025-10-10T13:59:26.126799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-10T13:59:26.126818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 3134 count 22 nextOffset 43 batches 1
2025-10-10T13:59:26.126834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-10T13:59:26.126850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 3275 count 23 nextOffset 44 batches 1
2025-10-10T13:59:26.126868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-10T13:59:26.126885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 3416 count 24 nextOffset 45 batches 1
2025-10-10T13:59:26.126902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-10T13:59:26.126922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 3557 count 25 nextOffset 46 batches 1
2025-10-10T13:59:26.126940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-10T13:59:26.126957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 3698 count 26 nextOffset 47 batches 1
2025-10-10T13:59:26.126973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-10T13:59:26.126990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 3839 count 27 nextOffset 48 batches 1
2025-10-10T13:59:26.127010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-10T13:59:26.127028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 3980 count 28 nextOffset 49 batches 1
2025-10-10T13:59:26.127044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-10T13:59:26.127062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 4121 count 29 nextOffset 50 batches 1
2025-10-10T13:59:26.127084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-10T13:59:26.127101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 4262 count 30 nextOffset 51 batches 1
2025-10-10T13:59:26.127121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-10T13:59:26.127140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 4403 count 31 nextOffset 52 batches 1
2025-10-10T13:59:26.127162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-10T13:59:26.127181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 4544 count 32 nextOffset 53 batches 1
2025-10-10T13:59:26.127199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-10T13:59:26.127225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 4685 count 33 nextOffset 54 batches 1
2025-10-10T13:59:26.127242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-10T13:59:26.127260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 4826 count 34 nextOffset 55 batches 1
2025-10-10T13:59:26.127277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-10T13:59:26.127295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 4967 count 35 nextOffset 56 batches 1
2025-10-10T13:59:26.127313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-10T13:59:26.127330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 5108 count 36 nextOffset 57 batches 1
2025-10-10T13:59:26.127349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-10T13:59:26.127366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 5249 count 37 nextOffset 58 batches 1
2025-10-10T13:59:26.127384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-10T13:59:26.127400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 5390 count 38 nextOffset 59 batches 1
2025-10-10T13:59:26.127417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-10T13:59:26.127433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 5531 count 39 nextOffset 60 batches 1
2025-10-10T13:59:26.127484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-10-10T13:59:26.127510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 5672 count 40 nextOffset 61 batches 1
2025-10-10T13:59:26.127528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-10-10T13:59:26.127546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 5813 count 41 nextOffset 62 batches 1
2025-10-10T13:59:26.127561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.128135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,41 HeadOffset 21 endOffset 21 curOffset 62 d0000000000_00000000000000000021_00000_0000000041_00000? size 4520 WTime 1760104766126
2025-10-10T13:59:26.128347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.128369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.128414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.128429Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:26.128516Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 0 count 41 size 4520
2025-10-10T13:59:26.128670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-10T13:59:26.131335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:26.131365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:26.131416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.131995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.132012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 5 size 99 offset: -1
2025-10-10T13:59:26.132097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:26.132251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:26.137788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 41 size 4520 actorID [2:7559592402773786251:2375]
2025-10-10T13:59:26.137837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:26.137879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4346 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:26.137913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.137958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-10T13:59:26.137974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.137989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-10T13:59:26.138002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-10T13:59:26.138029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-10T13:59:26.138057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-10T13:59:26.138157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-10T13:59:26.138179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-10T13:59:26.138200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-10T13:59:26.138220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-10T13:59:26.138244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-10T13:59:26.138288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-10T13:59:26.138313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-10T13:59:26.138337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-10T13:59:26.138360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-10T13:59:26.138386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-10T13:59:26.138412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-10T13:59:26.138439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-10T13:59:26.138462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-10T13:59:26.138487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-10T13:59:26.138513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-10T13:59:26.138537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-10T13:59:26.138563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-10T13:59:26.138587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-10T13:59:26.138614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-10T13:59:26.138639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-10T13:59:26.138667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-10T13:59:26.138692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-10T13:59:26.138716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-10T13:59:26.138827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-10T13:59:26.138855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-10T13:59:26.138879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-10T13:59:26.138905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-10T13:59:26.138932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-10T13:59:26.138958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-10T13:59:26.138983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.138999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-10T13:59:26.139009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.139024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-10-10T13:59:26.139033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.139050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-10-10T13:59:26.139059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.139074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-10-10T13:59:26.139083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.139099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-10-10T13:59:26.139109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.139124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-10-10T13:59:26.139134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.139151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-10-10T13:59:26.139312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.139421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.139438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (38)
2025-10-10T13:59:26.139545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-10-10T13:59:26.140398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 173 count 1 nextOffset 63 batches 1
2025-10-10T13:59:26.140447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-10-10T13:59:26.140475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 314 count 2 nextOffset 64 batches 1
2025-10-10T13:59:26.140495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-10-10T13:59:26.140516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 455 count 3 nextOffset 65 batches 1
2025-10-10T13:59:26.140534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-10-10T13:59:26.140552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 596 count 4 nextOffset 66 batches 1
2025-10-10T13:59:26.140573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-10-10T13:59:26.140591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 737 count 5 nextOffset 67 batches 1
2025-10-10T13:59:26.140608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-10-10T13:59:26.140625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 878 count 6 nextOffset 68 batches 1
2025-10-10T13:59:26.140642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-10-10T13:59:26.140658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1019 count 7 nextOffset 69 batches 1
2025-10-10T13:59:26.140672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-10-10T13:59:26.140689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1160 count 8 nextOffset 70 batches 1
2025-10-10T13:59:26.140706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-10-10T13:59:26.140755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1301 count 9 nextOffset 71 batches 1
2025-10-10T13:59:26.140779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-10-10T13:59:26.140799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1442 count 10 nextOffset 72 batches 1
2025-10-10T13:59:26.140815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-10-10T13:59:26.140832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1583 count 11 nextOffset 73 batches 1
2025-10-10T13:59:26.140849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-10-10T13:59:26.140876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1724 count 12 nextOffset 74 batches 1
2025-10-10T13:59:26.140901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-10-10T13:59:26.140920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1865 count 13 nextOffset 75 batches 1
2025-10-10T13:59:26.140938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-10-10T13:59:26.140957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2006 count 14 nextOffset 76 batches 1
2025-10-10T13:59:26.141004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-10-10T13:59:26.141023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2147 count 15 nextOffset 77 batches 1
2025-10-10T13:59:26.141042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-10-10T13:59:26.141061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2288 count 16 nextOffset 78 batches 1
2025-10-10T13:59:26.141081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-10-10T13:59:26.141109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2429 count 17 nextOffset 79 batches 1
2025-10-10T13:59:26.143296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 41 parts 0 suffix '63' size 4520
2025-10-10T13:59:26.143384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-10-10T13:59:26.143426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2570 count 18 nextOffset 80 batches 1
2025-10-10T13:59:26.143464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-10-10T13:59:26.143483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2711 count 19 nextOffset 81 batches 1
2025-10-10T13:59:26.143500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-10-10T13:59:26.143517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2852 count 20 nextOffset 82 batches 1
2025-10-10T13:59:26.143537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-10-10T13:59:26.143553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2993 count 21 nextOffset 83 batches 1
2025-10-10T13:59:26.143569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-10-10T13:59:26.143586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3134 count 22 nextOffset 84 batches 1
2025-10-10T13:59:26.143606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-10-10T13:59:26.143622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3275 count 23 nextOffset 85 batches 1
2025-10-10T13:59:26.143640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-10-10T13:59:26.143657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3416 count 24 nextOffset 86 batches 1
2025-10-10T13:59:26.143675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-10-10T13:59:26.143691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3557 count 25 nextOffset 87 batches 1
2025-10-10T13:59:26.143707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-10-10T13:59:26.143724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3698 count 26 nextOffset 88 batches 1
2025-10-10T13:59:26.143741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-10-10T13:59:26.143758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3839 count 27 nextOffset 89 batches 1
2025-10-10T13:59:26.143776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-10-10T13:59:26.143794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3980 count 28 nextOffset 90 batches 1
2025-10-10T13:59:26.143812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-10-10T13:59:26.143829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4121 count 29 nextOffset 91 batches 1
2025-10-10T13:59:26.143844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-10-10T13:59:26.143860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4262 count 30 nextOffset 92 batches 1
2025-10-10T13:59:26.143908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-10-10T13:59:26.143931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4403 count 31 nextOffset 93 batches 1
2025-10-10T13:59:26.143947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-10-10T13:59:26.143965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4544 count 32 nextOffset 94 batches 1
2025-10-10T13:59:26.143984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-10-10T13:59:26.144013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4685 count 33 nextOffset 95 batches 1
2025-10-10T13:59:26.144029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-10-10T13:59:26.144046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4826 count 34 nextOffset 96 batches 1
2025-10-10T13:59:26.144065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-10-10T13:59:26.144082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4967 count 35 nextOffset 97 batches 1
2025-10-10T13:59:26.144098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-10-10T13:59:26.144115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 5108 count 36 nextOffset 98 batches 1
2025-10-10T13:59:26.144133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-10-10T13:59:26.144149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 5249 count 37 nextOffset 99 batches 1
2025-10-10T13:59:26.144166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-10-10T13:59:26.144181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 5390 count 38 nextOffset 100 batches 1
2025-10-10T13:59:26.144194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.145020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 62,38 HeadOffset 62 endOffset 62 curOffset 100 d0000000000_00000000000000000062_00000_0000000038_00000? size 4196 WTime 1760104766141
2025-10-10T13:59:26.145215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:26.145566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-10T13:59:26.145619Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:26.145711Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 62 partNo 0 count 38 size 4196
2025-10-10T13:59:26.147867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.149166Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:26.149797Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 22 written { offset: 21 } } acks { seq_no: 23 written { offset: 22 } } acks { seq_no: 24 written { offset: 23 } } acks { seq_no: 25 written { offset: 24 } } acks { seq_no: 26 written { offset: 25 } } acks { seq_no: 27 written { offset: 26 } } acks { seq_no: 28 written { offset: 27 } } acks { seq_no: 29 written { offset: 28 } } acks { seq_no: 30 written { offset: 29 } } acks { seq_no: 31 written { offset: 30 } } acks { seq_no: 32 written { offset: 31 } } acks { seq_no: 33 written { offset: 32 } } acks { seq_no: 34 written { offset: 33 } } acks { seq_no: 35 written { offset: 34 } } acks { seq_no: 36 written { offset: 35 } } acks { seq_no: 37 written { offset: 36 } } acks { seq_no: 38 written { offset: 37 } } acks { seq_no: 39 written { offset: 38 } } acks { seq_no: 40 written { offset: 39 } } acks { seq_no: 41 written { offset: 40 } } acks { seq_no: 42 written { offset: 41 } } acks { seq_no: 43 written { offset: 42 } } acks { seq_no: 44 written { offset: 43 } } acks { seq_no: 45 written { offset: 44 } } acks { seq_no: 46 written { offset: 45 } } acks { seq_no: 47 written { offset: 46 } } acks { seq_no: 48 written { offset: 47 } } acks { seq_no: 49 written { offset: 48 } } acks { seq_no: 50 written { offset: 49 } } acks { seq_no: 51 written { offset: 50 } } acks { seq_no: 52 written { offset: 51 } } acks { seq_no: 53 written { offset: 52 } } acks { seq_no: 54 written { offset: 53 } } acks { seq_no: 55 written { offset: 54 } } acks { seq_no: 56 written { offset: 55 } } acks { seq_no: 57 written { offset: 56 } } acks { seq_no: 58 written { offset: 57 } } acks { seq_no: 59 written { offset: 58 } } acks { seq_no: 60 written { offset: 59 } } acks { seq_no: 61 written { offset: 60 } } acks { seq_no: 62 written { offset: 61 } } write_statistics { persisting_time { nanos: 15000000 } min_queue_wait_time { nanos: 52000000 } max_queue_wait_time { nanos: 56000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T13:59:26.149844Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=22, txId=?
2025-10-10T13:59:26.149872Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 22
2025-10-10T13:59:26.149910Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=23, txId=?
2025-10-10T13:59:26.149946Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 23
2025-10-10T13:59:26.149963Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=24, txId=?
2025-10-10T13:59:26.149982Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 24
2025-10-10T13:59:26.150009Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=25, txId=?
2025-10-10T13:59:26.150023Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 25
2025-10-10T13:59:26.150048Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=26, txId=?
2025-10-10T13:59:26.150066Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 26
2025-10-10T13:59:26.150088Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=27, txId=?
2025-10-10T13:59:26.150104Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 27
2025-10-10T13:59:26.150124Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=28, txId=?
2025-10-10T13:59:26.150296Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 28
2025-10-10T13:59:26.150323Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=29, txId=?
2025-10-10T13:59:26.150344Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 29
2025-10-10T13:59:26.150368Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=30, txId=?
2025-10-10T13:59:26.150390Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 30
2025-10-10T13:59:26.150417Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=31, txId=?
2025-10-10T13:59:26.150432Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 31
2025-10-10T13:59:26.150452Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=32, txId=?
2025-10-10T13:59:26.150529Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 32
2025-10-10T13:59:26.150556Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=33, txId=?
2025-10-10T13:59:26.150572Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 33
2025-10-10T13:59:26.150590Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=34, txId=?
2025-10-10T13:59:26.150608Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 34
2025-10-10T13:59:26.150632Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=35, txId=?
2025-10-10T13:59:26.150650Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 35
2025-10-10T13:59:26.150670Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=36, txId=?
2025-10-10T13:59:26.150688Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 36
2025-10-10T13:59:26.150712Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=37, txId=?
2025-10-10T13:59:26.150733Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 37
2025-10-10T13:59:26.150752Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=38, txId=?
2025-10-10T13:59:26.150770Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 38
2025-10-10T13:59:26.150800Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=39, txId=?
2025-10-10T13:59:26.150817Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 39
2025-10-10T13:59:26.150832Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=40, txId=?
2025-10-10T13:59:26.150850Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 40
2025-10-10T13:59:26.150871Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=41, txId=?
2025-10-10T13:59:26.150886Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 41
2025-10-10T13:59:26.150907Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=42, txId=?
2025-10-10T13:59:26.150928Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 42
2025-10-10T13:59:26.150951Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=43, txId=?
2025-10-10T13:59:26.150962Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 43
2025-10-10T13:59:26.150984Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=44, txId=?
2025-10-10T13:59:26.151000Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 44
2025-10-10T13:59:26.151020Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=45, txId=?
2025-10-10T13:59:26.151035Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 45
2025-10-10T13:59:26.151053Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=46, txId=?
2025-10-10T13:59:26.151067Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 46
2025-10-10T13:59:26.151090Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=47, txId=?
2025-10-10T13:59:26.151106Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 47
2025-10-10T13:59:26.151123Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=48, txId=?
2025-10-10T13:59:26.151175Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 48
2025-10-10T13:59:26.151212Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=49, txId=?
2025-10-10T13:59:26.151228Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 49
2025-10-10T13:59:26.151244Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=50, txId=?
2025-10-10T13:59:26.151267Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 50
2025-10-10T13:59:26.151286Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=51, txId=?
2025-10-10T13:59:26.151302Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 51
2025-10-10T13:59:26.151324Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=52, txId=?
2025-10-10T13:59:26.151340Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 52
2025-10-10T13:59:26.151359Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=53, txId=?
2025-10-10T13:59:26.151374Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 53
2025-10-10T13:59:26.151396Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=54, txId=?
2025-10-10T13:59:26.151416Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 54
2025-10-10T13:59:26.151453Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=55, txId=?
2025-10-10T13:59:26.151471Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 55
2025-10-10T13:59:26.151486Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=56, txId=?
2025-10-10T13:59:26.151504Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 56
2025-10-10T13:59:26.151537Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=57, txId=?
2025-10-10T13:59:26.151554Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 57
2025-10-10T13:59:26.151581Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=58, txId=?
2025-10-10T13:59:26.151597Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 58
2025-10-10T13:59:26.151621Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=59, txId=?
2025-10-10T13:59:26.151635Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 59
2025-10-10T13:59:26.151679Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=60, txId=?
2025-10-10T13:59:26.151696Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 60
2025-10-10T13:59:26.151715Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=61, txId=?
2025-10-10T13:59:26.151731Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 61
2025-10-10T13:59:26.151747Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=62, txId=?
2025-10-10T13:59:26.151761Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 62
2025-10-10T13:59:26.152486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 62 count 38 size 4196 actorID [2:7559592402773786251:2375]
2025-10-10T13:59:26.152541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:26.152578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4028 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:26.152610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-10-10T13:59:26.152665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-10-10T13:59:26.152697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-10-10T13:59:26.152722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-10-10T13:59:26.152748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-10-10T13:59:26.152774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-10-10T13:59:26.152799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-10-10T13:59:26.152885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-10-10T13:59:26.152909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-10-10T13:59:26.152935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-10-10T13:59:26.152959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.152976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-10-10T13:59:26.152986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-10-10T13:59:26.153011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-10-10T13:59:26.153037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-10-10T13:59:26.153064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-10-10T13:59:26.153089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-10-10T13:59:26.153117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-10-10T13:59:26.153160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-10-10T13:59:26.153183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-10-10T13:59:26.153210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-10-10T13:59:26.153242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-10-10T13:59:26.153268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-10-10T13:59:26.153294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-10-10T13:59:26.153318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-10-10T13:59:26.153343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-10-10T13:59:26.153371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.155539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:26.153387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-10-10T13:59:26.153397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-10-10T13:59:26.153422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-10-10T13:59:26.153448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-10-10T13:59:26.153478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-10-10T13:59:26.153506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-10-10T13:59:26.153532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.156886Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:26.153547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-10-10T13:59:26.153556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-10-10T13:59:26.153580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-10-10T13:59:26.153647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-10-10T13:59:26.153676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-10-10T13:59:26.153702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-10-10T13:59:26.153726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:26.153742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-10-10T13:59:26.153889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.153899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.153910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.153954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:26.154242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-10T13:59:26.155283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 62 partno 0 count 38 parts 0 suffix '63' size 4196
2025-10-10T13:59:26.157505Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 63 written { offset: 62 } } acks { seq_no: 64 written { offset: 63 } } acks { seq_no: 65 written { offset: 64 } } acks { seq_no: 66 written { offset: 65 } } acks { seq_no: 67 written { offset: 66 } } acks { seq_no: 68 written { offset: 67 } } acks { seq_no: 69 written { offset: 68 } } acks { seq_no: 70 written { offset: 69 } } acks { seq_no: 71 written { offset: 70 } } acks { seq_no: 72 written { offset: 71 } } acks { seq_no: 73 written { offset: 72 } } acks { seq_no: 74 written { offset: 73 } } acks { seq_no: 75 written { offset: 74 } } acks { seq_no: 76 written { offset: 75 } } acks { seq_no: 77 written { offset: 76 } } acks { seq_no: 78 written { offset: 77 } } acks { seq_no: 79 written { offset: 78 } } acks { seq_no: 80 written { offset: 79 } } acks { seq_no: 81 written { offset: 80 } } acks { seq_no: 82 written { offset: 81 } } acks { seq_no: 83 written { offset: 82 } } acks { seq_no: 84 written { offset: 83 } } acks { seq_no: 85 written { offset: 84 } } acks { seq_no: 86 written { offset: 85 } } acks { seq_no: 87 written { offset: 86 } } acks { seq_no: 88 written { offset: 87 } } acks { seq_no: 89 written { offset: 88 } } acks { seq_no: 90 written { offset: 89 } } acks { seq_no: 91 written { offset: 90 } } acks { seq_no: 92 written { offset: 91 } } acks { seq_no: 93 written { offset: 92 } } acks { seq_no: 94 written { offset: 93 } } acks { seq_no: 95 written { offset: 94 } } acks { seq_no: 96 written { offset: 95 } } acks { seq_no: 97 written { offset: 96 } } acks { seq_no: 98 written { offset: 97 } } acks { seq_no: 99 written { offset: 98 } } acks { seq_no: 100 written { offset: 99 } } write_statistics { persisting_time { nanos: 12000000 } min_queue_wait_time { nanos: 5000000 } max_queue_wait_time { nanos: 9000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T13:59:26.157547Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=63, txId=?
2025-10-10T13:59:26.157571Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 63
2025-10-10T13:59:26.157610Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=64, txId=?
2025-10-10T13:59:26.157634Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 64
2025-10-10T13:59:26.157654Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=65, txId=?
2025-10-10T13:59:26.157673Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 65
2025-10-10T13:59:26.157695Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=66, txId=?
2025-10-10T13:59:26.157715Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 66
2025-10-10T13:59:26.157734Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=67, txId=?
2025-10-10T13:59:26.157767Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 67
2025-10-10T13:59:26.157786Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=68, txId=?
2025-10-10T13:59:26.157806Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 68
2025-10-10T13:59:26.157825Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=69, txId=?
2025-10-10T13:59:26.157845Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 69
2025-10-10T13:59:26.157865Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=70, txId=?
2025-10-10T13:59:26.157889Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 70
2025-10-10T13:59:26.157906Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=71, txId=?
2025-10-10T13:59:26.157947Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 71
2025-10-10T13:59:26.157964Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=72, txId=?
2025-10-10T13:59:26.157983Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 72
2025-10-10T13:59:26.158003Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=73, txId=?
2025-10-10T13:59:26.158017Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 73
2025-10-10T13:59:26.158035Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=74, txId=?
2025-10-10T13:59:26.158053Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 74
2025-10-10T13:59:26.158072Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=75, txId=?
2025-10-10T13:59:26.158087Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 75
2025-10-10T13:59:26.158102Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=76, txId=?
2025-10-10T13:59:26.158123Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 76
2025-10-10T13:59:26.158143Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=77, txId=?
2025-10-10T13:59:26.158162Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 77
2025-10-10T13:59:26.158211Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=78, txId=?
2025-10-10T13:59:26.158231Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 78
2025-10-10T13:59:26.158251Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=79, txId=?
2025-10-10T13:59:26.158270Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 79
2025-10-10T13:59:26.158289Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=80, txId=?
2025-10-10T13:59:26.158307Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 80
2025-10-10T13:59:26.158328Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=81, txId=?
2025-10-10T13:59:26.158348Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 81
2025-10-10T13:59:26.158371Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=82, txId=?
2025-10-10T13:59:26.158389Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 82
2025-10-10T13:59:26.158405Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=83, txId=?
2025-10-10T13:59:26.158421Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 83
2025-10-10T13:59:26.158440Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=84, txId=?
2025-10-10T13:59:26.158453Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 84
2025-10-10T13:59:26.158474Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=85, txId=?
2025-10-10T13:59:26.158486Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 85
2025-10-10T13:59:26.158504Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=86, txId=?
2025-10-10T13:59:26.158521Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 86
2025-10-10T13:59:26.158538Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=87, txId=?
2025-10-10T13:59:26.158554Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 87
2025-10-10T13:59:26.158572Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=88, txId=?
2025-10-10T13:59:26.158592Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 88
2025-10-10T13:59:26.158610Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=89, txId=?
2025-10-10T13:59:26.158625Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 89
2025-10-10T13:59:26.158645Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=90, txId=?
2025-10-10T13:59:26.158658Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 90
2025-10-10T13:59:26.158683Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=91, txId=?
2025-10-10T13:59:26.158701Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 91
2025-10-10T13:59:26.158718Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=92, txId=?
2025-10-10T13:59:26.158735Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 92
2025-10-10T13:59:26.158753Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=93, txId=?
2025-10-10T13:59:26.158768Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 93
2025-10-10T13:59:26.158801Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=94, txId=?
2025-10-10T13:59:26.158818Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 94
2025-10-10T13:59:26.158840Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=95, txId=?
2025-10-10T13:59:26.158858Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 95
2025-10-10T13:59:26.158887Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=96, txId=?
2025-10-10T13:59:26.158903Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 96
2025-10-10T13:59:26.158921Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=97, txId=?
2025-10-10T13:59:26.158941Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 97
2025-10-10T13:59:26.158960Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=98, txId=?
2025-10-10T13:59:26.158974Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 98
2025-10-10T13:59:26.158990Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=99, txId=?
2025-10-10T13:59:26.159011Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 99
2025-10-10T13:59:26.159028Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] OnAck: seqNo=100, txId=?
2025-10-10T13:59:26.159050Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: acknoledged message 100
2025-10-10T13:59:26.159598Z :INFO: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T13:59:26.159632Z :INFO: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T13:59:26.159677Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T13:59:26.160070Z :INFO: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:26.160105Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T13:59:26.160787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0 grpc read done: success: 0 data: 
2025-10-10T13:59:26.160815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0 grpc read failed
2025-10-10T13:59:26.160846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0 grpc closed
2025-10-10T13:59:26.160860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|3e29c8a3-641b871f-2a2e71ae-da809b51_0 is DEAD
2025-10-10T13:59:26.161693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:26.163397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559592405566548997:2495] destroyed
2025-10-10T13:59:26.163440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:26.163470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.163480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.163490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.233232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.233261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.233273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.331081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.331112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.331124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.421248Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T13:59:26.421277Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:26.436893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.436916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.436929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.753200Z :WriteSessionCloseIgnoresWrites INFO: Random seed for debugging is 1760104767753178
2025-10-10T13:59:28.449261Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559592419954201376:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:28.449390Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T13:59:28.528368Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7559592418044738280:2149];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:28.529634Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e9c/r3tmp/tmpmryl6U/pdisk_1.dat
2025-10-10T13:59:28.569902Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:28.581519Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:28.590304Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:28.611619Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:28.768645Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:28.909220Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:29.055202Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:29.075374Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:29.075461Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:29.076198Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:29.076249Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:29.088479Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T13:59:29.088607Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:29.090922Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 62232, node 3
2025-10-10T13:59:29.165698Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:29.334248Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:29.345922Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e9c/r3tmp/yandexudKn4J.tmp
2025-10-10T13:59:29.345948Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e9c/r3tmp/yandexudKn4J.tmp
2025-10-10T13:59:29.346104Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e9c/r3tmp/yandexudKn4J.tmp
2025-10-10T13:59:29.346256Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T13:59:29.381768Z INFO: TTestServer started on Port 9226 GrpcPort 62232
2025-10-10T13:59:29.529292Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:29.536900Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:9226
PQClient connected to localhost:62232
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T13:59:29.710537Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-10T13:59:29.758312Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715658, at schemeshard: 72057594046644480
waiting...
waiting...
2025-10-10T13:59:29.820975Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715660, at schemeshard: 72057594046644480
2025-10-10T13:59:33.429246Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559592419954201376:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:33.429326Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:33.521337Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7559592418044738280:2149];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:33.521415Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:33.643425Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7559592441429038864:2323], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:33.645256Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=YmE4ZTgyNS04YWUzNDJlNi04NzA2YWU2Mi02MTllNDA2Yg==, ActorId: [3:7559592441429038861:2321], ActorState: ExecuteState, TraceId: 01k776pxy95g2y11mj8wsqn9qp, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:33.645705Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:33.660809Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:33.909005Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7559592439519575039:2297], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:33.911832Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=Njg0NDVkMjctZWUyYTUxMzMtZWUwZmVjNDAtZmFmMGJhYw==, ActorId: [4:7559592439519575030:2296], ActorState: ExecuteState, TraceId: 01k776py6120fva082s8ccchg3, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:33.912242Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:33.918538Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:34.203086Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:62232", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T13:59:34.657253Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k776pyqa9nseeaf9px4eth7z, Database: , SessionId: ydb://session/3?node_id=3&id=NDI0YjdjNmMtZTliZjE3YzgtN2U0YTk0M2ItOGY0MzM3YzQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559592445724006581:2945] 
=== CheckClustersList. Ok
2025-10-10T13:59:40.309575Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:62232
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:40.477438Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:62232
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T13:59:40.553180Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559592471493810857:3246] connected; active server actors: 1
2025-10-10T13:59:40.553346Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T13:59:40.555662Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T13:59:40.556158Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T13:59:40.574414Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:40.581519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:40.581781Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T13:59:40.581809Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:40.581841Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T13:59:40.582693Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-10T13:59:40.582531Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592471493810875:2440], now have 1 active actors on pipe
2025-10-10T13:59:40.582561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592471493810856:3245], now have 1 active actors on pipe
2025-10-10T13:59:40.585724Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.598490Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.625328Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592471493810913:3291], now have 1 active actors on pipe
2025-10-10T13:59:40.625595Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.637445Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.638704Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:40.638748Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T13:59:40.639093Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:40.639356Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7559592469584346586:2381]
2025-10-10T13:59:40.642892Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:40.642926Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:40.642947Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7559592469584346586:2381]
2025-10-10T13:59:40.642973Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T13:59:40.644341Z node 4 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T13:59:40.644371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.644442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.644453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:40.644469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:40.644480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.644491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.644501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:40.644532Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:40.644815Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.645016Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:40.673746Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.673887Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760104780658, TxId 281474976715676
2025-10-10T13:59:40.673910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.673919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.674027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.674204Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:40.683130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:40.683420Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:40.683447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.683458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.683469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.683500Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:40.683849Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T13:59:40.683928Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:40.684192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.697626Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.697742Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:40.703343Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:40.741363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.741388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.741407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:40.791287Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01k776q4rn5y78nbecm3775xjc, Database: , SessionId: ydb://session/3?node_id=3&id=YzY0MDIzMzEtMzdiZDc4OWItZTZiMWJkMy1mOWUzM2JlMA==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-10T13:59:40.845315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.845348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.845360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760104780658
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1760104780658
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:62232
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:40.855095Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T13:59:40.873284Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T13:59:40.873799Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T13:59:40.873848Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:62232
2025-10-10T13:59:40.906491Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:40.908176Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:40.908205Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T13:59:40.908793Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:40.908908Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:44906
2025-10-10T13:59:40.908923Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:44906 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:40.908932Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:40.910634Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T13:59:40.910768Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:40.910779Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:40.910812Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:40.910829Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559592471493811027:2461] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:40.913503Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559592471493811027:2461] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:40.954164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:40.954199Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:40.954230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.054297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.054326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.054337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.128745Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559592471493811027:2461] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:41.129298Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592475788778370:2461] connected; active server actors: 1
2025-10-10T13:59:41.129502Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559592471493811027:2461] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T13:59:41.129526Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559592471493811027:2461] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:41.130827Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592475788778370:2461] disconnected; active server actors: 1
2025-10-10T13:59:41.130851Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592475788778370:2461] disconnected no session
2025-10-10T13:59:41.154649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.154681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.154694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.255286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.255333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.255345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.332995Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559592471493811027:2461] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:41.333037Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559592471493811027:2461] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:41.333054Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559592471493811027:2461] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:41.333087Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:41.335208Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T13:59:41.337262Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592475788778397:2461], now have 1 active actors on pipe
2025-10-10T13:59:41.337376Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.337407Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.337503Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|afb7bebc-c473c506-40d6a45-270af95c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T13:59:41.337541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.337558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.337568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:41.337604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.337642Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:41.337691Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:41.339009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:41.339065Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:41.339171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:41.340830Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104781340 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:41.340956Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|afb7bebc-c473c506-40d6a45-270af95c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:41.341230Z :INFO: [] MessageGroupId [src] SessionId [src|afb7bebc-c473c506-40d6a45-270af95c_0] Write session: close. Timeout = 0 ms
2025-10-10T13:59:41.341288Z :INFO: [] MessageGroupId [src] SessionId [src|afb7bebc-c473c506-40d6a45-270af95c_0] Write session will now close
2025-10-10T13:59:41.341337Z :DEBUG: [] MessageGroupId [src] SessionId [src|afb7bebc-c473c506-40d6a45-270af95c_0] Write session: aborting
2025-10-10T13:59:41.341815Z :INFO: [] MessageGroupId [src] SessionId [src|afb7bebc-c473c506-40d6a45-270af95c_0] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:41.341854Z :DEBUG: [] MessageGroupId [src] SessionId [src|afb7bebc-c473c506-40d6a45-270af95c_0] Write session: destroy
2025-10-10T13:59:41.339699Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|afb7bebc-c473c506-40d6a45-270af95c_0
2025-10-10T13:59:41.355873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.355899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.355913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.418123Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|afb7bebc-c473c506-40d6a45-270af95c_0 grpc read done: success: 0 data: 
2025-10-10T13:59:41.418150Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|afb7bebc-c473c506-40d6a45-270af95c_0 grpc read failed
2025-10-10T13:59:41.418180Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|afb7bebc-c473c506-40d6a45-270af95c_0 grpc closed
2025-10-10T13:59:41.418194Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|afb7bebc-c473c506-40d6a45-270af95c_0 is DEAD
2025-10-10T13:59:41.434462Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:41.437772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559592475788778397:2461] destroyed
2025-10-10T13:59:41.437823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:41.437849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.437860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.437869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.457221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.457256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.457267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-10T13:59:41.557553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.557571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.557580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T13:59:41.578960Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: UNAVAILABLE. Description: 
2025-10-10T13:59:41.661313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.661347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.661367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.765306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.765338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.765351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.866894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.866921Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.866933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:41.969274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:41.969317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:41.969342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.069254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.069290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.069304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.173505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.173532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.173547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.277761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.277790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.277803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.381324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.381352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.381367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.483483Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.483508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.483522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.583619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.583642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.583655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.689336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.689369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.689384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.793330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.793363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.793377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:42.899031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:42.899061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:42.899076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.001340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.001368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.001380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.105288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.105315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.105329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.209323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.209351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.209363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.313243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.313278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.313290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.417256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.417288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.417301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.520658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.520690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.520704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.623271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.623299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.623315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.727727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.727757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.727770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.828206Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.828235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.828247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.893442Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T13:59:43.893472Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:43.929443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.929469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.929481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.037770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.037799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.037811Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.140789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.140819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.140832Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.241839Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.241865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.241889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.349896Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.349922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.349935Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.452821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.452857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.452871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.553537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.553559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.553570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.653154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.653183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.653195Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.753800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.753826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.753838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.857375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.857402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.857415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.939473Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7559592488673680503:2516]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-10T13:59:44.985854Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7559592488673680503:2516]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T13:59:45.113916Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7559592488673680503:2516]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T13:59:45.317711Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7559592488673680503:2516]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T13:59:45.539047Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976715690, task: 1, CA Id [3:7559592488673680503:2516]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T13:59:11.775158Z :WriteSessionNoAvailableDatabase INFO: Random seed for debugging is 1760104751775088
2025-10-10T13:59:12.313603Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559592350995766266:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:12.313684Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T13:59:12.467960Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-10T13:59:12.481470Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:12.527425Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-10T13:59:12.531316Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7559592351196664353:2261];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:12.534877Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e95/r3tmp/tmpC9uuy5/pdisk_1.dat
2025-10-10T13:59:12.617543Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:12.920382Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:13.070253Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:13.109286Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:13.403793Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-10T13:59:13.416474Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:13.419378Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:13.422740Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:13.422817Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:13.424299Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:13.461412Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:13.478004Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:13.478073Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:13.482560Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T13:59:13.489589Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:13.522125Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:13.558056Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 13886, node 1
2025-10-10T13:59:13.827523Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e95/r3tmp/yandexQetzwx.tmp
2025-10-10T13:59:13.827550Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e95/r3tmp/yandexQetzwx.tmp
2025-10-10T13:59:13.827698Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e95/r3tmp/yandexQetzwx.tmp
2025-10-10T13:59:13.827856Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T13:59:13.867542Z INFO: TTestServer started on Port 19397 GrpcPort 13886
2025-10-10T13:59:13.893234Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:19397
PQClient connected to localhost:13886
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T13:59:14.641572Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T13:59:17.316773Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559592350995766266:2073];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:17.316850Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:17.531422Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7559592351196664353:2261];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:17.531500Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:19.752552Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7559592376765571063:2325], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:19.754918Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7559592381261435530:2296], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:19.757070Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=MjZhZDIyZWQtY2UwNzhkODEtNzhiNTc2Ni1mN2M2NDY3MA==, ActorId: [2:7559592381261435528:2295], ActorState: ExecuteState, TraceId: 01k776pfpx512s2k50vz9w3h3c, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:19.757582Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=NTIyM2IwOTMtOThiYmU0ZWUtMWMxYzIwZGYtOWI4ZmY1ODE=, ActorId: [1:7559592376765571060:2323], ActorState: ExecuteState, TraceId: 01k776pfk11n2g9snrf1pc8rdn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:19.759829Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:19.760916Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:19.763882Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:19.952954Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:20.160209Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:13886", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T13:59:20.645562Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k776ph1mefwp4w67dedfna66, Database: , SessionId: ydb://session/3?node_id=1&id=MjIwOWZhMjgtYWVkOTMwOGYtN2QzMjVhOTEtMWRkYWQwMDI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559592385355506055:2923] 
=== CheckClustersList. Ok
2025-10-10T13:59:26.928918Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:13886
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:27.076346Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:13886
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T13:59:27.143226Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559592415420277671:3231] connected; active server actors: 1
2025-10-10T13:59:27.143462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T13:59:27.149306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T13:59:27.153296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T13:59:27.162674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:27.166165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:27.166380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T13:59:27.166406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:27.166444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T13:59:27.167337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592415420277670:3230], now have 1 active actors on pipe
2025-10-10T13:59:27.167358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592415420277700:2450], now have 1 active actors on pipe
2025-10-10T13:59:27.167251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T13:59:27.168516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:27.178963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:27.187119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592415420277731:3277], now have 1 active actors on pipe
2025-10-10T13:59:27.188081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:27.192039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:27.193079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:27.193221Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T13:59:27.193474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:27.193852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592415621174501:2401]
2025-10-10T13:59:27.196708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:27.196746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:27.196766Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559592415621174501:2401]
2025-10-10T13:59:27.196796Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T13:59:27.201181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T13:59:27.201245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.201386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.201396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:27.201422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:27.201433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.201448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.201454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:27.201482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:27.201923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:27.202048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:27.210731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:27.210884Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760104767232, TxId 281474976715679
2025-10-10T13:59:27.210903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.210912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.211208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.211438Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:27.214140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:27.214441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:27.214473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.214486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.214496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.214520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:27.214916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T13:59:27.215038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:27.215323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:27.224641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:27.224742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:27.227467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:27.288091Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k776pqn4652mzc0847a65mhs, Database: , SessionId: ydb://session/3?node_id=1&id=ODlkMmI0YTItZTQ5ZDlhZjgtZmQzNWJjYTItMzBkYWNmNjE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T13:59:27.302007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.302031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.302041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760104767232
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760104767232
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:13886
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:27.313393Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T13:59:27.402127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.402151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.402159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.505235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.505261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.505269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.605029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.605053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.605061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.707583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.707610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.707619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.808456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.808487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.808497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13886
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:27.819993Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T13:59:27.909255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.909283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.909291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.009512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.009538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.009547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.061603Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T13:59:28.061645Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:28.114252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.114286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.114297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.218931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.218965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.218974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.317682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.317708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.317717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13886
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:28.330882Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T13:59:28.366192Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T13:59:28.373343Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T13:59:28.381265Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:13886
2025-10-10T13:59:28.399066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:28.399117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T13:59:28.416608Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:28.421054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.421088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.421100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.424038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:28.424219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:53440
2025-10-10T13:59:28.424235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53440 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:28.424245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:28.425885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T13:59:28.426041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:28.426052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:28.426063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:28.426080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592419715245192:2487] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:28.434554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592419715245192:2487] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:28.521643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.521672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.521684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.623003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.623033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.623044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.665789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559592419715245192:2487] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:28.666523Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592419715245236:2487] connected; active server actors: 1
2025-10-10T13:59:28.666650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559592419715245192:2487] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T13:59:28.666668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592419715245192:2487] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:28.669395Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592419715245236:2487] disconnected; active server actors: 1
2025-10-10T13:59:28.669426Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592419715245236:2487] disconnected no session
2025-10-10T13:59:28.724743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.724772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.724782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.829361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.829385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.829396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.900997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592419715245192:2487] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:28.901058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592419715245192:2487] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:28.901075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592419715245192:2487] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:28.901108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:28.902267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592419715245274:2487], now have 1 active actors on pipe
2025-10-10T13:59:28.902842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.902879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.902971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|2d6f0895-d2782faf-5435b695-9a3be9a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T13:59:28.903016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.903038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.903050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:28.903095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.903141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:28.903186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:28.904100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.904123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.904200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:28.902584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T13:59:28.904618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|2d6f0895-d2782faf-5435b695-9a3be9a1_0
2025-10-10T13:59:28.909307Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104768909 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:28.909447Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|2d6f0895-d2782faf-5435b695-9a3be9a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:28.909685Z :INFO: [] MessageGroupId [src] SessionId [src|2d6f0895-d2782faf-5435b695-9a3be9a1_0] Write session: close. Timeout = 0 ms
2025-10-10T13:59:28.909727Z :INFO: [] MessageGroupId [src] SessionId [src|2d6f0895-d2782faf-5435b695-9a3be9a1_0] Write session will now close
2025-10-10T13:59:28.909758Z :DEBUG: [] MessageGroupId [src] SessionId [src|2d6f0895-d2782faf-5435b695-9a3be9a1_0] Write session: aborting
2025-10-10T13:59:28.910141Z :INFO: [] MessageGroupId [src] SessionId [src|2d6f0895-d2782faf-5435b695-9a3be9a1_0] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:28.910175Z :DEBUG: [] MessageGroupId [src] SessionId [src|2d6f0895-d2782faf-5435b695-9a3be9a1_0] Write session: destroy
2025-10-10T13:59:28.917320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|2d6f0895-d2782faf-5435b695-9a3be9a1_0 grpc read done: success: 0 data: 
2025-10-10T13:59:28.917345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|2d6f0895-d2782faf-5435b695-9a3be9a1_0 grpc read failed
2025-10-10T13:59:28.917375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|2d6f0895-d2782faf-5435b695-9a3be9a1_0 grpc closed
2025-10-10T13:59:28.917391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|2d6f0895-d2782faf-5435b695-9a3be9a1_0 is DEAD
2025-10-10T13:59:28.918988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:28.919532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559592419715245274:2487] destroyed
2025-10-10T13:59:28.919572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:28.919598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.919612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.919630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.933224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.933254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.933265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-10T13:59:28.990897Z :ERROR: [/Root] [] [] Failed to select database: no available database. Status: NOT_FOUND
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to select database: no available database " }
2025-10-10T13:59:29.033300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:29.033333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:29.033346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:29.134076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:29.134105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:29.134116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:29.716722Z node 1 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [1:7559592424010212601:2499] TxId: 281474976715688. Ctx: { TraceId: 01k776pss3cs67vsefbsxbj0e1, Database: /Root, SessionId: ydb://session/3?node_id=1&id=NGMwY2JhZWMtZTJlMTExZTgtYzUyMWNiYmQtY2VjYjJmZTY=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 2
2025-10-10T13:59:29.717470Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559592424010212611:2507], TxId: 281474976715688, task: 4. Ctx: { TraceId : 01k776pss3cs67vsefbsxbj0e1.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=1&id=NGMwY2JhZWMtZTJlMTExZTgtYzUyMWNiYmQtY2VjYjJmZTY=.  CurrentExecutionId : .  DatabaseId : /Root.  Database : /Root. }. Handle abort execution event from: [1:7559592424010212601:2499], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T13:59:29.717897Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559592424010212610:2506], TxId: 281474976715688, task: 2. Ctx: { TraceId : 01k776pss3cs67vsefbsxbj0e1.  RunScriptActorId : [0:0:0].  CustomerSuppliedId : .  PoolId : .  SessionId : ydb://session/3?node_id=1&id=NGMwY2JhZWMtZTJlMTExZTgtYzUyMWNiYmQtY2VjYjJmZTY=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7559592424010212601:2499], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T13:59:30.565199Z :WriteSessionSwitchDatabases INFO: Random seed for debugging is 1760104770565180
2025-10-10T13:59:31.223267Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7559592431383705940:2261];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:31.223391Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T13:59:31.248261Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:31.261825Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e95/r3tmp/tmpytBLHw/pdisk_1.dat
2025-10-10T13:59:31.287514Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:31.304037Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:31.304111Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-10T13:59:31.468354Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:31.493228Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:31.493308Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:31.496681Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:31.497839Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:31.497891Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:31.501263Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-10T13:59:31.501416Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:31.506237Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 15964, node 3
2025-10-10T13:59:31.650209Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:31.665751Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e95/r3tmp/yandexaPtxZM.tmp
2025-10-10T13:59:31.665776Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e95/r3tmp/yandexaPtxZM.tmp
2025-10-10T13:59:31.665897Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e95/r3tmp/yandexaPtxZM.tmp
2025-10-10T13:59:31.666050Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T13:59:31.736466Z INFO: TTestServer started on Port 1701 GrpcPort 15964
TClient is connected to server localhost:1701
PQClient connected to localhost:15964
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T13:59:31.998486Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T13:59:32.221560Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:32.274620Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:36.051131Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7559592446726515114:2293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:36.051371Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=Yjk5MTMxYmUtOTljYzU2ZGQtZDI5M2E3ZS1iOTkxYjQxNw==, ActorId: [4:7559592446726515112:2292], ActorState: ExecuteState, TraceId: 01k776q091338se00z2twt8dfk, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:36.051817Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:36.178529Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7559592452858543223:2322], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:36.198150Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:36.198424Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=Y2EwYWUwYzctNjM2ZjA1YmEtNGI1ZTlkMjEtMTEzZWU5ZDA=, ActorId: [3:7559592452858543220:2320], ActorState: ExecuteState, TraceId: 01k776q0cb2a1czsxan4qn8mn7, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:36.198785Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:36.221246Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7559592431383705940:2261];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:36.221321Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:36.405696Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:36.619296Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:15964", true, true, 1000);
2025-10-10T13:59:37.086863Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k776q14vd6mzg2hkvq5ea5km, Database: , SessionId: ydb://session/3?node_id=3&id=MjU2Yjc3NmUtNzE1MjYxNTUtMTg3YTYwNGYtYTlhZGM4YjI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7559592457153510908:2917] 
=== CheckClustersList. Ok
2025-10-10T13:59:42.689082Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710675:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:15964
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:42.856409Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:15964
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T13:59:42.926321Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7559592478628347896:3220] connected; active server actors: 1
2025-10-10T13:59:42.926511Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T13:59:42.930783Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T13:59:42.934468Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T13:59:42.954529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:42.962872Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:42.963120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T13:59:42.963146Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:42.963177Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T13:59:42.964475Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592478628347928:2438], now have 1 active actors on pipe
2025-10-10T13:59:42.964519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592478628347895:3219], now have 1 active actors on pipe
2025-10-10T13:59:42.965057Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:42.965297Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-10T13:59:42.985366Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:42.993543Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592478628347963:3272], now have 1 active actors on pipe
2025-10-10T13:59:42.995045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:42.999037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:43.000013Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:43.000052Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T13:59:43.000280Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:43.000495Z node 4 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7559592476791286701:2374]
2025-10-10T13:59:43.003359Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:43.003378Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:43.003397Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7559592476791286701:2374]
2025-10-10T13:59:43.003417Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T13:59:43.007837Z node 4 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T13:59:43.007872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.007939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.007949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:43.007964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:43.007973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.007981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.007990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:43.008018Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:43.008509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:43.008659Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:43.013793Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:43.013922Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760104783038, TxId 281474976710676
2025-10-10T13:59:43.013943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.013952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.014053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.014232Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:43.016941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:43.017183Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:43.017202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.017212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.017222Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.017247Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:43.017544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T13:59:43.017620Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:43.017823Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:43.028822Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:43.028912Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:43.031776Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:43.113252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.113283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.113293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.174817Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k776q72b0c9rbfc9brj9p8qc, Database: , SessionId: ydb://session/3?node_id=3&id=ZDIwYTI5ZjgtYjM0ZjM0MGMtZmI1Y2YzNmEtZmU5Mjk5Njc=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T13:59:43.217222Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.217251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.217262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760104783038
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1760104783038
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:15964
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:43.297469Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T13:59:43.317955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.317989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.318003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.421449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.421478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.421491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.523939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.523972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.523988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.628056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.628087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.628102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.729039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.729072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.729084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:15964
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:43.806224Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T13:59:43.834451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.834483Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.834496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:43.841844Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T13:59:43.842487Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T13:59:43.842540Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:15964
2025-10-10T13:59:43.876442Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:43.881673Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:43.881713Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T13:59:43.882260Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:43.882388Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:56476
2025-10-10T13:59:43.882404Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56476 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:43.882420Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:43.884281Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T13:59:43.884414Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:43.884423Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:43.884435Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:43.884452Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559592482923315411:2471] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:43.887280Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559592482923315411:2471] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:43.937211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:43.937244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:43.937260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.041378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.041410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.041423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.143467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.143521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.143549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.253252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.253294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.253311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.351851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.351877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.351889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.377118Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559592482923315411:2471] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:44.377775Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592487218282763:2471] connected; active server actors: 1
2025-10-10T13:59:44.377962Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559592482923315411:2471] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T13:59:44.377979Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559592482923315411:2471] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:44.378685Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592487218282763:2471] disconnected; active server actors: 1
2025-10-10T13:59:44.378711Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592487218282763:2471] disconnected no session
2025-10-10T13:59:44.453363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.453396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.453408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.528506Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559592482923315411:2471] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:44.528549Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559592482923315411:2471] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:44.528566Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559592482923315411:2471] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:44.528598Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:44.533557Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592487218282794:2471], now have 1 active actors on pipe
2025-10-10T13:59:44.534235Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:44.534270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:44.534374Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d5b44707-e64f5117-b7250b5-8e5aea68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T13:59:44.534414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.534435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.534444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:44.534487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.534531Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:44.534581Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:44.535453Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:44.535478Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:44.535543Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:44.533948Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T13:59:44.535958Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d5b44707-e64f5117-b7250b5-8e5aea68_0
2025-10-10T13:59:44.537959Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104784537 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:44.538106Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d5b44707-e64f5117-b7250b5-8e5aea68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:44.538416Z :INFO: [] MessageGroupId [src] SessionId [src|d5b44707-e64f5117-b7250b5-8e5aea68_0] Write session: close. Timeout = 0 ms
2025-10-10T13:59:44.538455Z :INFO: [] MessageGroupId [src] SessionId [src|d5b44707-e64f5117-b7250b5-8e5aea68_0] Write session will now close
2025-10-10T13:59:44.538506Z :DEBUG: [] MessageGroupId [src] SessionId [src|d5b44707-e64f5117-b7250b5-8e5aea68_0] Write session: aborting
2025-10-10T13:59:44.538955Z :INFO: [] MessageGroupId [src] SessionId [src|d5b44707-e64f5117-b7250b5-8e5aea68_0] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:44.539012Z :DEBUG: [] MessageGroupId [src] SessionId [src|d5b44707-e64f5117-b7250b5-8e5aea68_0] Write session: destroy
2025-10-10T13:59:44.541220Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d5b44707-e64f5117-b7250b5-8e5aea68_0 grpc read done: success: 0 data: 
2025-10-10T13:59:44.541250Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d5b44707-e64f5117-b7250b5-8e5aea68_0 grpc read failed
2025-10-10T13:59:44.541285Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d5b44707-e64f5117-b7250b5-8e5aea68_0 grpc closed
2025-10-10T13:59:44.541306Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d5b44707-e64f5117-b7250b5-8e5aea68_0 is DEAD
2025-10-10T13:59:44.557549Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:44.556688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.556720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.556736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.561479Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559592487218282794:2471] destroyed
2025-10-10T13:59:44.561521Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:44.561557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.561569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.561583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-10T13:59:44.657242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.657273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.657286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.661764Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:15964" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:15964" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:15964" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T13:59:44.676393Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:44.715831Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T13:59:44.727593Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T13:59:44.736402Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:44.736438Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T13:59:44.757392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.757427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.757440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.759903Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:44.760480Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T13:59:44.761813Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:44.762010Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56496
2025-10-10T13:59:44.762034Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:56496 proto=topic  topic=test-topic durationSec=0
2025-10-10T13:59:44.762047Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:44.763755Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T13:59:44.763876Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:44.763885Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:44.763894Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:44.763912Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:44.766589Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:44.782614Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:44.783643Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592487218282828:2489] connected; active server actors: 1
2025-10-10T13:59:44.783827Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T13:59:44.783846Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:44.785042Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592487218282828:2489] disconnected; active server actors: 1
2025-10-10T13:59:44.785066Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7559592487218282828:2489] disconnected no session
2025-10-10T13:59:44.793965Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:44.794007Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:44.794023Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:44.794057Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:44.795625Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592487218282839:2489], now have 1 active actors on pipe
2025-10-10T13:59:44.795978Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T13:59:44.796340Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:44.796373Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:44.796450Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f43858-94b03660-75ff30fd-3af47a0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:44.796489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.796510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.796526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:44.796569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.796604Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:44.796655Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:44.797487Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:44.797509Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:44.797574Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:44.798028Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|6f43858-94b03660-75ff30fd-3af47a0d_0
2025-10-10T13:59:44.798996Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:44.799067Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104784799 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:44.799207Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|6f43858-94b03660-75ff30fd-3af47a0d_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T13:59:44.799561Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-10T13:59:44.800284Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:44.800346Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-10T13:59:44.801897Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|6f43858-94b03660-75ff30fd-3af47a0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:44.802200Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:44.802803Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:44.802836Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:44.802928Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T13:59:44.803266Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:44.803725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:44.803748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:44.804106Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T13:59:44.804158Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:44.804205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.804245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.804257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:44.804390Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T13:59:44.916772Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-10T13:59:44.921302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.922083Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 160 WTime 1760104784921
2025-10-10T13:59:44.922365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T13:59:44.922385Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:44.922543Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 160
2025-10-10T13:59:44.929661Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 160 actorID [4:7559592476791286684:2374]
2025-10-10T13:59:44.929730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:44.929786Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:44.929822Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:44.929872Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T13:59:44.930126Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:44.930163Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:44.930184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:44.930196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:44.930207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:44.930239Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:44.930280Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T13:59:44.930418Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T13:59:44.930661Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 160 count 1 last offset 0, current partition end offset: 1
2025-10-10T13:59:44.930680Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:44.930735Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 160 accessed 0 times before, last time 2025-10-10T13:59:44.000000Z
2025-10-10T13:59:44.930763Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T13:59:44.930825Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:44.930983Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-10-10T13:59:44.933670Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:44.931068Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104784804 queuesize 0 startOffset 0
2025-10-10T13:59:44.931249Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-10T13:59:44.931309Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T13:59:44.931550Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:44.934418Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 12000000 } min_queue_wait_time { nanos: 110000000 } max_queue_wait_time { nanos: 110000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T13:59:44.934474Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T13:59:44.934513Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-10T13:59:45.025239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.025274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.025288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.131135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.131176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.131193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.233254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.233290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.233305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.333675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.333704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.333717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.437261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.437301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.437315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.537291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.537336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.537352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.641254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.641289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.641303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.741848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.741884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.741901Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.800701Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:45.843551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.843580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.843594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:45.949267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:45.949301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:45.949324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.048600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.048634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.048648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.149472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.149508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.149519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.190580Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-10T13:59:46.190607Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559592487218282809:2489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:46.250050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.250094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.250109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.350238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.350271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.350288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.438719Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T13:59:46.438743Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:46.452087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.452122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.452137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.554989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.555024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.555041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.654802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.654846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.654862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.758229Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.758269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.758282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.857906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.857940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.857957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:46.961282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:46.961318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:46.961332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.061226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.061257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.061269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.161436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.161471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.161485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.261633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.261679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.261706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.362514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.362545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.362561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.463151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.463196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.463210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.564441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.564481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.564493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.664027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.664066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.664082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.764414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.764450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.764465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.869467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.869505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.869521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:47.972506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:47.972554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:47.972570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.009594Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:48.072669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.072703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.072719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.173655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.173696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.173711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.273795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.273827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.273841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.374456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.374486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.374498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.477241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.477275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.477286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.578090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.578120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.578133Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.677773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.677809Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.677823Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.782857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.782911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.782937Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.883295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.883331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.883346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:48.983902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:48.983938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:48.983954Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.084842Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.084877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.084892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.185364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.185397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.185419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.285763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.285799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.285815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.386173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.386204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.386229Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.489333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.489372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.489386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.591300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.591332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.591346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.697359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.697390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.697400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.800148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.800175Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.800186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:49.902954Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:49.902987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:49.903000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.005376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.005405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.005417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.107158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.107188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.107199Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.211490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.211528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.211543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.313705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.313734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.313748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.417291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.417344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.417365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.517484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.517524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.517540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.621290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.621325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.621340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.725189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.725225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.725240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.824976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.825011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.825027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:50.925394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:50.925427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:50.925442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.026669Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.026701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.026715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.129484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.129521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.129541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.228134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.228167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.228181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.332486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.332522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.332537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.433498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.433531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.433545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.537967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.538004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.538019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.641774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.641804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.641815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.742987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.743021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.743046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.845944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.845979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.845993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:51.949448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:51.949479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:51.949492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.053266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.053306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.053322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.153250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.153291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.153306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.257352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.257387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.257405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.357243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.357273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.357287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.457485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.457525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.457541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.557695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.557729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.557744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.658526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.658559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.658573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.762108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.762147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.762164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.864751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.864781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.864793Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:52.965256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:52.965289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:52.965302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.011935Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:53.066032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.066074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.066101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.168189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.168233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.168246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.270363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.270393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.270407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.370781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.370818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.370833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.473436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.473475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.473491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.573006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.573048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.573063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.677270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.677309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.677323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.781468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.781506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.781521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.880223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.880258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.880272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:53.982053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:53.982085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:53.982100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.082448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.082499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.082516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.186355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.186389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.186404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.290822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.290869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.290889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.393486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.393526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.393538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.497221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.497252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.497263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.599774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.599805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.599816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.701561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.701597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.701613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.802214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.802254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.802268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:54.903814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:54.903853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:54.903869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.005164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.005209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.005223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.105071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.105106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.105140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.205258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.205291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.205307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.308537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.308567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.308578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.409118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.409164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.409180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.511132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.511165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.511179Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.613436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.613471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.613486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.713661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.713693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.713706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.817279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.817312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.817325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:55.920597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:55.920632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:55.920646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.020785Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.020820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.020833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.121198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.121232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.121244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.221582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.221613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.221627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.323493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.323525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.323537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.424616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.424653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.424667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.524897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.524923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.524932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.625238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.625270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.625279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.727480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.727524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.727541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.829301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.829339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.829355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:56.929700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:56.929740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:56.929756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.030798Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.030830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.030843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.131374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.131411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.131424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.231727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.231760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.231773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.332100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.332132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.332146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.432466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.432500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.432516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.532811Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.532849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.532862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.633896Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.633938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.633953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.734796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.734828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.734845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.837369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.837404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.837417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:57.938476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:57.938503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:57.938515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.013398Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:58.038745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.038779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.038792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.145252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.145281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.145295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.248730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.248762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.248775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.349140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.349173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.349186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.449387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.449417Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.449430Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.549612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.549640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.549651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.653510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.653544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.653558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.754231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.754264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.754278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.861235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.861273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.861286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:58.965229Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:58.965263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:58.965275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.065629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.065661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.065672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.169272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.169310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.169326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.269455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.269493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.269505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.373306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.373343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.373357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.477248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.477285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.477301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.577322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.577348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.577374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.678069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.678105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.678130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.779731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.779765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.779781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.881053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.881085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.881102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:59.981502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:59.981530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:59.981542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.081548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.081582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.081595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.181916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.181948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.181960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.282872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.282906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.282921Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.383794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.383822Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.383835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.485270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.485308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.485324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.585438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.585475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.585490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.689042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.689078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.689094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.789963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.789996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.790012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.890113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.890154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.890168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:00.990477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:00.990526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:00.990542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.094282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.094312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.094322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.195077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.195111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.195122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.295451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.295481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.295492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.395856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.395886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.395897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.496186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.496213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.496232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.596553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.596599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.596610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.696900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.696934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.696945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.798287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.798322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.798337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.898575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.898606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.898630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:01.998992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:01.999031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:01.999047Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.099312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.099343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.099355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.199721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.199761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.199775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.300777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.300810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.300823Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.400281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.400311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.400326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.500994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.501031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.501046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.601254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.601288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.601303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.701480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.701516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.701533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.805261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.805290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.805302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:02.905799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:02.905827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:02.905838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.006091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.006114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.006123Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.012854Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:03.108596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.108629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.108640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.208803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.208831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.208843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.309146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.309179Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.309192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.413694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.413723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.413735Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.513426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.513462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.513475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.615159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.615197Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.615212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.715744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.715784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.715799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.816066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.816101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.816115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:03.916397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:03.916446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:03.916460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.016811Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.016851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.016867Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.117174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.117216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.117232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.218892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.218923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.218935Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.318853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.318894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.318906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.419166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.419218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.419230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.519585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.519619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.519633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.619925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.619966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.619982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.720258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.720284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.720294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.820813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.820851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.820866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:04.921059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:04.921092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:04.921107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.021392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.021428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.021446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.121687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.121722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.121739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.223565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.223606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.223622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.325231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.325265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.325279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.426315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.426348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.426361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.526670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.526704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.526731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.626929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.626959Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.626971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.729195Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.729237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.729254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.828741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.828772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.828786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:05.933251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:05.933289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:05.933301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.033652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.033689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.033703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.133863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.133898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.133911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.234285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.234314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.234327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.335188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.335223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.335236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.435464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.435514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.435528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.535828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.535861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.535872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.636193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.636232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.636247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.736524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.736576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.736592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.836894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.836931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.836946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:06.937280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:06.937316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:06.937333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.037548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.037584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.037600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.138508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.138538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.138546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.239907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.239945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.239958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.340140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.340170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.340181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.440488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.440513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.440521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.540871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.540903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.540915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.642135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.642167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.642180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.745239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.745279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.745292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.845736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.845766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.845779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:07.945833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:07.945866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:07.945893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.013072Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:08.047016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.047044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.047057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.147169Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.147206Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.147222Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.249384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.249425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.249442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.349813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.349850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.349866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.450284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.450328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.450344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.550514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.550551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.550567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.650966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.651008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.651025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.753007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.753059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.753075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.853107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.853155Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.853165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:08.953445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:08.953476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:08.953487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.054227Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.054250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.054260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.154189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.154220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.154242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.255318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.255344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.255354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.355361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.355420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.355439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.456439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.456470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.456482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.556580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.556621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.556633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.659830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.659860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.659873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.761371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.761405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.761421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.861766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.861797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.861811Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:09.962051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:09.962088Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:09.962101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.062464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.069501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.069532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.162964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.163001Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.163014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.263135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.263187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.263203Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.363481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.363516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.363530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.464853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.464893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.464904Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.566408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.566447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.566461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.666806Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.666851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.666865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.766976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.767019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.767031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.867361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.867400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.867414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:10.967677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:10.967709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:10.967724Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.068027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.068056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.068069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.168460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.168493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.168506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.269256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.269289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.269301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.371389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.371427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.371444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.473266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.473294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.473305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.573543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.573577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.573590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.673806Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.673836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.673846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.774099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.774132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.774145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.875252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.875284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.875298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:11.975723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:11.975753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:11.975766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.076214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.076255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.076275Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.176459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.176496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.176512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.276892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.276934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.276953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.377224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.377258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.377271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.478231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.478269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.478285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.580096Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.580138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.580151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.681564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.681603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.681619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.782177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.782210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.782220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.885256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.885295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.885308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:12.937231Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:00:12.937324Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-10T14:00:12.941057Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:00:12.946375Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:00:12.947055Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:00:12.948407Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-10T14:00:12.989253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:12.989290Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:12.989302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.013380Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:13.093242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.093276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.093287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.197214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.197244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.197254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.297866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.297892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.297905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.398300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.398330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.398343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.499156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.499190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.499201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.600375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.600402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.600413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.700763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.700810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.700826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.801090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.801141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.801158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:13.901815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:13.901855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:13.901874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.005285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.005324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.005340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.105270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.105309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.105328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.206459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.206498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.206515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.307936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.307977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.307989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.410305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.410337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.410351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.510648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.510681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.510693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.611081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.611115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.611128Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:00:14.711357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.711379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.711388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.723619Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was dc1) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:15964" location: "dc1" status: UNAVAILABLE weight: 500 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:15964" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:15964" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T14:00:14.724066Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:00:14.724140Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:00:14.726322Z :INFO: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T14:00:14.726367Z :INFO: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T14:00:14.726441Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:00:14.726615Z :INFO: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T14:00:14.726658Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|6f43858-94b03660-75ff30fd-3af47a0d_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:00:14.727081Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:00:14.727170Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:14.727175Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:00:14.727204Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-10T14:00:14.728259Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:00:14.728296Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|6f43858-94b03660-75ff30fd-3af47a0d_0 grpc read done: success: 0 data: 
2025-10-10T14:00:14.728320Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|6f43858-94b03660-75ff30fd-3af47a0d_0 grpc read failed
2025-10-10T14:00:14.728366Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|6f43858-94b03660-75ff30fd-3af47a0d_0 grpc closed
2025-10-10T14:00:14.728386Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|6f43858-94b03660-75ff30fd-3af47a0d_0 is DEAD
2025-10-10T14:00:14.728404Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:00:14.728513Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56496
2025-10-10T14:00:14.728529Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="topic server" ip=ipv6:[::1]:56496 proto=topic  topic=test-topic durationSec=0
2025-10-10T14:00:14.728537Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:00:14.729462Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:00:14.729627Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-10T14:00:14.729733Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:00:14.729749Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:00:14.729761Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:00:14.729780Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559592616067303248:2750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:00:14.730007Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559592487218282839:2489] destroyed
2025-10-10T14:00:14.730065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:00:14.730108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.730124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.730137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.732868Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559592616067303248:2750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:00:14.741377Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559592616067303248:2750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:14.749229Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559592616067303248:2750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:00:14.749277Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559592616067303248:2750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:00:14.749306Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559592616067303248:2750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:14.749339Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:00:14.750191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592616067303277:2750], now have 1 active actors on pipe
2025-10-10T14:00:14.750666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T14:00:14.750868Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:14.750917Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:14.750991Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0b495ad-b533c592-df818beb-323502ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:00:14.751027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.751051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.751063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:14.751111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.751159Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:00:14.751230Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:14.751714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:14.751743Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:14.751814Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:00:14.752099Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 1 sessionId: src_id|d0b495ad-b533c592-df818beb-323502ae_0
2025-10-10T14:00:14.752870Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:00:14.752927Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104814752 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:00:14.753043Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 1 session_id: "src_id|d0b495ad-b533c592-df818beb-323502ae_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T14:00:14.814112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.814149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.814162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:14.914207Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:14.914254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:14.914267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.026013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.026061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.026081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.123664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.123704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.123720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.224515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.224544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.224556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.324805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.324838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.324855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.429278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.429320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.429336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.530028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.530072Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.530086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.631467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.631500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.631514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.731790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.731839Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.731854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.758805Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559592616067303248:2750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:00:15.798080Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559592616067303248:2750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-10T14:00:15.798107Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559592616067303248:2750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:00:15.832170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.832208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.832224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:15.933721Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:15.933754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:15.933772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.033932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.033967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.033978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.137314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.137348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.137359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.237709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.237744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.237759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.338004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.338031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.338046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.438500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.438540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.438568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.541695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.541739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.541755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.644274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.644311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.644326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.742698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.742749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.742767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.844427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.844459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.844471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:16.949274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:16.949314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:16.949327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.049274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.049310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.049335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.149624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.149660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.149676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.250164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.250202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.250218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.354262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.354292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.354306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.454684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.454716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.454730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.555279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.555311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.555323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.655439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.655473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.655487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.757223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.757258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.757272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.857655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.857686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.857702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:17.958512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:17.958548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:17.958563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.014262Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:18.059495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.059529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.059545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.163875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.163923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.163940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.264479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.264513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.264529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.364515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.364544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.364555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.465314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.465352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.465367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.568484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.568515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.568531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.669632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.669666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.669682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.773424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.773468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.773482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.874076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.874107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.874119Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:18.974225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:18.974256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:18.974265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.074660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.074703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.074716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.175104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.175136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.175149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.275412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.275445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.275469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.375723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.375755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.375771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.477269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.477307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.477322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.577497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.577529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.577544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.678142Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.678170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.678183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.778692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.778726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.778741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.881256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.881295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.881311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:19.982943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:19.982981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:19.982998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.083709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.083748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.083764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.184592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.184634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.184650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.284547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.284580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.284595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.385556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.385591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.385602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.485266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.485301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.485313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.589224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.589258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.589270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.693276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.693322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.693337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.794490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.794524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.794536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.894854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.894888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.894900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:20.995969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:20.996003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:20.996017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.096723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.096756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.096767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.196955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.196997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.197014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.299193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.299235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.299251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.398683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.398720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.398734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.501250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.501288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.501303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.601403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.601434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.601451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.702674Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.702710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.702731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.803166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.803201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.803214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:21.904284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:21.904319Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:21.904333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.004593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.004624Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.004638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.104908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.104952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.104965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.205075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.205114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.205141Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.305534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.305568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.305581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.405796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.405833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.405856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.509372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.509414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.509426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.613259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.613302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.613318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.715159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.715198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.715212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.815352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.815386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.815400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:22.915723Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:22.915766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:22.915778Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.014177Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:23.015974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.015994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.016016Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.117015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.117047Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.117060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.218324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.218361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.218376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.321242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.321281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.321292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.422145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.422177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.422190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.523491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.523527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.523542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.623904Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.623937Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.623952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.724139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.724176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.724189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.825249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.825282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.825296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:23.927231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:23.927267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:23.927282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.027550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.027589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.027607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.128204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.128243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.128259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.228470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.228501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.228515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.329363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.329396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.329410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.429703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.429736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.429749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.531434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.531467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.531482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.632314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.632349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.632363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.732287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.732324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.732337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.833279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.833311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.833325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:24.933505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:24.933541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:24.933554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.037258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.037296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.037310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.141720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.141761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.141773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.245239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.245280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.245294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.347991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.348030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.348047Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.448296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.448336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.448351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.550960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.551004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.551021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.650826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.650864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.650889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.751221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.751258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.751274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.851513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.851543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.851565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:25.952390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:25.952428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:25.952443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.052660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.052703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.052716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.153105Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.153158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.153177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.253807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.253844Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.253860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.353794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.353825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.353840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.454231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.454258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.454267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.554481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.554511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.554523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.654946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.654977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.654987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.756565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.756592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.756607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.856584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.856622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.856636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:26.958801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:26.958827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:26.958838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.062348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.062387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.062402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.162794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.162828Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.162843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.265307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.265346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.265364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.366526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.366563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.366579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.466894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.466944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.466963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.569251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.569289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.569302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.669686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.669725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.669741Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.775419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.775460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.775475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.877244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.877283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.877298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:27.976817Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:27.976851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:27.976865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.019997Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:28.077295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.077333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.077345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.178769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.178812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.178825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.279262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.279293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.279307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.381055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.381090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.381104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.482305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.482347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.482364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.585284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.585326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.585342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.685500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.685543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.685557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.789223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.789254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.789264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.889249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.889284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.889301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:28.991516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:28.991552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:28.991569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.091970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.092013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.092028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.192328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.192360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.192377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.292644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.292679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.292692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.392984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.393014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.393025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.493326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.493354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.493366Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.593757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.593792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.593804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.694070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.694109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.694122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.794837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.794875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.794893Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:29.897920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:29.897957Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:29.897972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.000156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.000189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.000212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.100564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.100598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.100611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.201546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.201579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.201592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.304198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.304240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.304257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.405163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.405198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.405218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.505168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.505200Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.505215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.607064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.607099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.607115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.706809Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.706841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.706858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.807127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.807164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.807180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:30.907739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:30.907780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:30.907794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.009218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.009254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.009264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.115436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.115477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.115491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.216620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.216653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.216665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.317421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.317451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.317463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.417464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.417497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.417510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.518396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.518431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.518446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.618690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.618725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.618743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.719117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.719154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.719170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.819889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.819932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.819949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:31.923979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:31.924018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:31.924035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.027950Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.027991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.028008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.129466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.129513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.129530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.229530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.229575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.229591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.329797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.329831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.329853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.437258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.437296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.437311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.534048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.534092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.534107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.637375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.637413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.637426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.741263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.741301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.741316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.845248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.845284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.845299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:32.948635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:32.948676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:32.948691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.023126Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:33.048254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.048288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.048305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.149318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.149351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.149365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.250159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.250190Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.250204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.353483Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.353515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.353530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.454473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.454508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.454524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.557262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.557303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.557318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.658803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.658840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.658857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.761825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.761866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.761883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.865276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.865334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.865355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:33.964731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:33.964769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:33.964787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.065034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.065070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.065082Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.165775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.165804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.165856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.266225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.266255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.266268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.370527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.370575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.370589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.473254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.473289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.473303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.577095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.577154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.577171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.677248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.677279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.677294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.777419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.777450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.777466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.884539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.884578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.884605Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:34.981720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:34.981757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:34.981773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.085606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.085642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.085657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.185938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.185979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.185993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.289400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.289438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.289457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.389542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.389578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.389594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.489970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.490018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.490035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.593781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.593823Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.593836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.697561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.697599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.697613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.799180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.799216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.799230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:35.903127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:35.903163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:35.903176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.005352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.005383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.005398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.108775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.108816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.108830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.209292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.209334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.209350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.310526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.310562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.310576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.414330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.414365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.414381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.517260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.517299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.517314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.617441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.617480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.617497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.717679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.717730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.717746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.818101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.818137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.818151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:36.918860Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:36.918888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:36.918898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.018747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.018785Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.018797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.119051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.119078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.119087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.219400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.219433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.219445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.322977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.323013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.323029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.423462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.423499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.423513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.523573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.523607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.523621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.623894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.623927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.623940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.725338Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.725378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.725393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.825863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.825904Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.825919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:37.926212Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:37.926249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:37.926265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.024425Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:38.028750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.028777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.028790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.131582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.131619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.131633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.233461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.233499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.233515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.333972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.334007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.334023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.434043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.434094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.434114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.539704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.539738Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.539755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.639719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.639750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.639765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.742009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.742045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.742057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.842747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.842779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.842792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:38.944472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:38.944514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:38.944531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.044240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.044283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.044300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.151726Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.151763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.151777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.253224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.253259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.253274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.351444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.351476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.351488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.451939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.451972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.451986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.553361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.553404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.553419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.653489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.653519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.653533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.757285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.757322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.757336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.860614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.860654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.860670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:39.959128Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:39.959159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:39.959172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.060578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.060622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.060640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.161463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.161502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.161520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.261747Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.261775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.261788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.362234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.362267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.362281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.462454Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.462492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.462506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.565467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.565499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.566522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.669580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.669623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.669637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.769665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.769694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.769707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.870832Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.870864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.870877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:40.973402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:40.973440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:40.973453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.072411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.072459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.072473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.172604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.172641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.172658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.272991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.273031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.273048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.375012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.375048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.375064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.478066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.478099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.478114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.577821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.577866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.577881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.681189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.681228Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.681243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.781516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.781552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.781568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.882438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.882476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.882492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:41.982104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:41.982137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:41.982161Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.085277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.085314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.085329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.185494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.185537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.185547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.289366Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.289399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.289414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.393243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.393279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.393293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.493850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.493883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.493898Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.598410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.598453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.598467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.704912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.704948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.704963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.809262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.809298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.809312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.906527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:42.906561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:42.906576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:42.938004Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:00:42.938063Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-10T14:00:42.942988Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:00:42.945328Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:00:42.945494Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:00:43.006286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.006321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.006337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.029703Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:43.109509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.109550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.109567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.216069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.216110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.216126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.317509Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.317547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.317565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.421491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.421527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.421542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.522857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.522913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.522928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.623055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.623098Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.623113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.725236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.725279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.725294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.825460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.825497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.825511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:43.929286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:43.929321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:43.929334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.033244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.033278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.033291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.133815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.133846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.133861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.241266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.241333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.241359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.345296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.345331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.345347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.445385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.445420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.445435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.550961Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.550998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.551014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.653252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.653292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.653305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.739259Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-10T14:00:44.740387Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:00:44.740432Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-10-10T14:00:44.749930Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.749963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.749978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.769223Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|d0b495ad-b533c592-df818beb-323502ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:00:44.769503Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:00:44.777607Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:44.777669Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:44.777765Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:00:44.780132Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:00:44.780162Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:00:44.780224Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T14:00:44.780259Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:00:44.780305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.780329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.780342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:00:44.780466Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T14:00:44.781368Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 172 count 1 nextOffset 2 batches 1
2025-10-10T14:00:44.781410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.778257Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:44.781869Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 160 WTime 1760104844781
2025-10-10T14:00:44.782028Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:00:44.782135Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 160
2025-10-10T14:00:44.788557Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 160 actorID [4:7559592476791286684:2374]
2025-10-10T14:00:44.788631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:00:44.788692Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:00:44.788730Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:00:44.788766Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T14:00:44.788959Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.788974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.788988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.789022Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:44.789069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 320 CachedBlobs 2
2025-10-10T14:00:44.789098Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:00:44.789404Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-10T14:00:44.789647Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:00:44.793390Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:00:44.793656Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 4000000 } min_queue_wait_time { nanos: 3000000 } max_queue_wait_time { nanos: 3000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:00:44.793719Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T14:00:44.793761Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-10T14:00:44.850310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.850343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.850359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:44.952497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:44.952540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:44.952555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.052676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.052716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.052733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.154546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.154585Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.154600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.253768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.253802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.253815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.357576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.357601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.357611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.461231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.461264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.461276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.561248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.561280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.561291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.661244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.661276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.661288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.769236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.769273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.769284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.866597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.866635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.866650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:45.967029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:45.967068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:45.967081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.067841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.067866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.067876Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.168788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.168821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.168835Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.269041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.269075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.269089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.370195Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.370223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.370237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.474211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.474246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.474260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.581770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.581801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.581814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.686087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.686126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.686140Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.789316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.789354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.789369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.889892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.889923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.889938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:46.993404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:46.993437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:46.993451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.097461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.097493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.097508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.197854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.197894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.197909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.298201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.298235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.298249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.401396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.401433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.401448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.501502Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.501537Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.501552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.605045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.605083Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.605099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.705392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.705428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.705445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.811968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.812008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.812026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:47.913493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:47.913529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:47.913545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.016527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.016579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.016598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.033751Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:48.121376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.121419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.121435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.222356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.222388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.222405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.325387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.325422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.325438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.433285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.433322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.433339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.533271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.533313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.533329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.633421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.633469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.633487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.733994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.734029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.734043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.841428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.841465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.841481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:48.945626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:48.945663Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:48.945678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.054466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.054497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.054511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.154676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.154720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.154734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.255130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.255160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.255174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.359018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.359051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.359065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.546602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.546635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.546646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.645515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.645554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.645569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.746546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.746587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.746602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.853294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.853332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.853349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:49.953648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:49.953691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:49.953707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.057398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.057436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.057455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.158348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.158382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.158399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.265322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.265355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.265369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.367612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.367657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.367675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.469970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.470014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.470029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.577565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.577600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.577614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.679697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.679731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.679743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.782805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.782841Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.782856Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.889262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.889300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.889315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:50.989204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:50.989243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:50.989257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.090048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.090080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.090093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.190403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.190432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.190441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.290730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.290765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.290780Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.391416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.391455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.391469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.493101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.493148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.493162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.593382Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.593422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.593438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.697579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.697617Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.697632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.801278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.801320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.801336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:51.905271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:51.905314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:51.905330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.006579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.006618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.006633Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.108403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.108438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.108448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.207739Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.207767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.207776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.309357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.309392Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.309407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.409588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.409619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.409635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.513374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.513405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.513421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.617299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.617344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.617358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.721381Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.721414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.721428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.823768Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.823803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.823816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:52.925422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:52.925460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:52.925477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.029610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.029652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.029672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.035349Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:53.131373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.131421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.131445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.233006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.233043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.233060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.333208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.333243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.333258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.434112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.434147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.434162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.537432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.537476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.537494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.645653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.645687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.645701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.745927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.745958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.745973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.846197Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.846234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.846247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:53.949221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:53.949251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:53.949262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.053028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.053064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.053078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.153522Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.153563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.153577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.253211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.253245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.253260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.353576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.353606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.353619Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.456492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.456525Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.456539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.561530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.561565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.561580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.661610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.661658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.661689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.764544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.764582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.764600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.870112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.870150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.870166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:54.970770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:54.970807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:54.970827Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.071133Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.071166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.071181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.171355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.171395Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.171412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.278465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.278497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.278513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.377099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.377152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.377170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.479436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.479470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.479487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.579925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.579955Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.579970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.680670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.680702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.680716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.781271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.781305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.781320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.885496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.885530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.885546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:55.987293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:55.987328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:55.987343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.089232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.089264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.089276Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.189561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.189591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.189603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.293301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.293332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.293344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.393824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.393863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.393878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.494436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.494479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.494492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.595540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.595575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.595590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.697252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.697292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.697309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.801339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.801372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.801387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:56.905432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:56.905468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:56.905482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.009272Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.009323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.009339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.113263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.113307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.113324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.217341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.217380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.217397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.317641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.317676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.317691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.421064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.421093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.421107Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.521493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.521528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.521544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.625596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.625629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.625645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.729333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.729379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.729397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.833299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.833347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.833366Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:57.934687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:57.934725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:57.934740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.038175Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.038209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.038225Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.038476Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:00:58.141378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.141416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.141435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.245521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.245568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.245584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.349289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.349331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.349349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.449339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.449372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.449389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.553441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.553486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.553504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.657320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.657356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.657373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.759093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.759133Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.759151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.860164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.860200Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.860216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:58.965374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:58.965408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:58.965423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.065485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.065519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.065535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.165480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.165512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.165526Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.269484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.269517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.269532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.376213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.376246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.376259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.477426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.477462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.477478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.577504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.577538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.577551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.680974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.681005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.681018Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.781708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.781740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.781753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.885384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.885419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.885433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:00:59.989513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:00:59.989545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:00:59.989560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.093441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.093478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.093497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.197479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.197512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.197527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.301855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.301892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.301908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.405271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.405313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.405332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.505464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.505500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.505519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.609362Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.609398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.609416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.716948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.716986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.717002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.817485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.817517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.817533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:00.920951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:00.920991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:00.921006Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.025352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.025389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.025405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.129026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.129054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.129064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.233329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.233365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.233379Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.333773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.337953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.337978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.434639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.434678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.434696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.541327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.541363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.541380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.644783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.644812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.644824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.749340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.749383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.749400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.848804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.848845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.848861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:01.953642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:01.953681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:01.953700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.059591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.059630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.059646Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.160964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.161004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.161023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.262519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.262557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.262573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.364361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.364402Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.364418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.468059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.468088Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.468102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.568680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.568715Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.568730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.669241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.669277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.669292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.769267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.769300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.769315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.877260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.877295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.877308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:02.978687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:02.978718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:02.978731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.040793Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:03.085257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.085297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.085311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.185551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.185590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.185606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.288937Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.288971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.288988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.392371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.392408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.392425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.489760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.489793Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.489809Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.591331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.591367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.591384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.691208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.691248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.691263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.794782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.794819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.794836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.897247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.897289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.897306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:03.997228Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:03.997259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:03.997271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.105620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.105651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.105665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.206181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.206210Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.206220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.313048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.313083Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.313093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.413292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.413322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.413335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.513627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.513650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.513658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.613977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.614009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.614022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.717233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.717271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.717285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.817273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.817307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.817320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:04.921312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:04.921343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:04.921358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.019993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.020031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.020040Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.121865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.121900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.121916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.226944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.226982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.226999Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.331269Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.331306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.331322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.435659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.435700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.435714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.535745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.535783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.535797Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.703056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.703091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.703104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.809546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.809587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.809601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:05.909871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:05.909910Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:05.909925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.010244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.010280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.010297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.112433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.112476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.112490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.214936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.214966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.214977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.314916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.314953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.314968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.415245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.415285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.415302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.515614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.515666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.515683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.617707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.617746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.617762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.717795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.717834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.717853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.818345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.818387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.818405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:06.921268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:06.921307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:06.921323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.025267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.025309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.025327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.122325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.122361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.122374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.223598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.223634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.223649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.324104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.324136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.324148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.424356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.424383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.424396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.526831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.526857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.526869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.628800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.628839Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.628854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.729095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.729150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.729163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.832214Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.832247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.832260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:07.933851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:07.933882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:07.933895Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.034927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.034967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.034984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.041009Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:08.137303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.137349Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.137366Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.237511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.237552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.237571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.338778Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.338815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.338826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.439165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.439204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.439220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.539468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.539498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.539510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.640261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.640299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.640314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.744575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.744613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.744629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.845863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.845894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.845908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:08.947270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:08.947305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:08.947320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.046843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.046877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.046891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.147193Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.147235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.147250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.248226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.248257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.248271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.348695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.348729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.348743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.448838Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.448869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.448882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.550265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.550302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.550318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.650600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.650639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.650656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.755323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.755365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.755383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.855365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.855411Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.855427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:09.960934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:09.960968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:09.960985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.061235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.061278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.061294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.161618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.161652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.161667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.265336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.265374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.265387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.369380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.369420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.369435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.469520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.469556Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.469571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.576023Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.576074Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.576094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.676795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.676829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.676842Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.776948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.776981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.776996Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.877393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.877429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.877443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:10.979583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:10.979616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:10.979630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.079538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.079568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.079580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.179802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.179848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.179862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.281048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.281079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.281095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.381166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.381202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.381216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.481615Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.481648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.481661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.585350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.585389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.585414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.685603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.685639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.685655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.793028Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.793069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.793084Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:11.893371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:11.893410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:11.893426Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.000759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.000796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.000809Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.101267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.101300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.101312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.205111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.205160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.205173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.307312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.307350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.307361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.410713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.410764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.410779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.513262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.513303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.513320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.613554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.613601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.613618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.714433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.714473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.714490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.817303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.817341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.817358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.919250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:12.919291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:12.919310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:12.938546Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:01:12.938603Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-10T14:01:12.942354Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:01:12.943985Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 3 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:01:12.944166Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:01:13.019846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.019875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.019887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.041254Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:13.121968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.122011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.122029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.224790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.224833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.224850Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.325252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.325289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.325305Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.426771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.426805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.426821Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.530451Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.530513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.530545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.629839Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.629873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.629888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.735148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.735194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.735208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.834655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.834695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.834712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:13.935331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:13.935371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:13.935387Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.041253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.041296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.041310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.145144Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.145181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.145195Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.251450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.251494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.251510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.352346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.352383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.352398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.453360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.453399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.453415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.558845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.558886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.558902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.664326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.664363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.664380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.766521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.766557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.766573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-10T14:01:14.873257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.873299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.873317Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:14.977574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:14.977611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:14.977628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.078483Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.078519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.078533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.178544Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.178572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.178582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.284543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.284579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.284593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.389308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.389342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.389354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.489343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.489374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.489388Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.592523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.592558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.592571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.693044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.693085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.693101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.796853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.796888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.796903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:15.897441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:15.897477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:15.897492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.001368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.001405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.001421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.101973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.102008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.102026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.202493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.202538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.202557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.303586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.303623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.303637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.404564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.404608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.404625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.504706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.504744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.504757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.605087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.605135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.605149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.706144Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.706177Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.706189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.807566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.807600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.807613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:16.907657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:16.907697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:16.907712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.011383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.011424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.011441Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.114809Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.114852Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.114867Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.213419Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.213456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.213472Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.322313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.322348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.322361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.421246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.421284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.421298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.521552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.521584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.521601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.621888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.621918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.621932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.726132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.726172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.726186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.826134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.826166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.826178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:17.927674Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:17.927710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:17.927728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.027385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.027421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.027435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.041415Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:18.132712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.132752Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.132769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.235748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.235788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.235804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.337806Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.337846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.337861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.441800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.441839Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.441857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.551331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.551374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.551390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.653375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.653410Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.653424Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.757242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.757279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.757298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.861239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.861274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.861288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:18.961320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:18.961352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:18.961366Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.062504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.062536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.062551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.164405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.164443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.164459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.264443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.264479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.264496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.366494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.366531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.366546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.469299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.469335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.469352Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.569547Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.569582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.569598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.670102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.670143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.670158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.771118Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.771149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.771164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.871636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.871676Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.871693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:19.971959Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:19.971995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:19.972008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.073271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.073307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.073324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.177249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.177294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.177310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.277296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.277330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.277345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.385251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.385289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.385303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.487551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.487586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.487600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.588044Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.588079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.588093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.690058Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.690103Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.690116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.790628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.790661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.790674Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.891188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.891223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.891241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:20.992097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:20.992136Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:20.992153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.092244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.092307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.092326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.192593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.192626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.192639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.296055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.296101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.296115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.396630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.396667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.396683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.497175Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.497213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.497228Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.598335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.598390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.598405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.698375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.698406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.698421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.801020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.801054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.801069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:21.904208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:21.904242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:21.904255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.006731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.006763Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.006777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.107990Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.108027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.108042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.207862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.207900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.207914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.309671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.309703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.309717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.413318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.413357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.413373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.521194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.521239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.521254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.621294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.621330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.621344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.725278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.725314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.725330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.826191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.826231Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.826250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:22.927173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:22.927213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:22.927232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.029254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.029295Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.029311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.045474Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:23.133693Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.133729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.133743Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.233936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.233968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.233984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.337250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.337287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.337313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.441399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.441434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.441449Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.542951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.542985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.542998Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.645390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.645425Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.645439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.743875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.743913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.743928Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.844250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.844298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.844316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:23.945291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:23.945336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:23.945354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.045378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.045414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.045427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.146280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.146314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.146327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.249294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.249328Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.249343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.349566Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.349595Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.349610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.451562Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.451597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.451607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.553237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.553274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.553287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.653366Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.653405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.653422Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.741637Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was dc2) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:15964" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:15964" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:15964" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-10T14:01:24.741974Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:01:24.742039Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T14:01:24.743977Z :INFO: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T14:01:24.744008Z :INFO: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T14:01:24.744070Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:01:24.744492Z :INFO: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-10T14:01:24.744526Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|d0b495ad-b533c592-df818beb-323502ae_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:01:24.745645Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T14:01:24.745743Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:24.747665Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T14:01:24.752467Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559592616067303277:2750] destroyed
2025-10-10T14:01:24.752524Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:01:24.752557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.752570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.752582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.749443Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|d0b495ad-b533c592-df818beb-323502ae_0 grpc read done: success: 0 data: 
2025-10-10T14:01:24.749475Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: src_id|d0b495ad-b533c592-df818beb-323502ae_0 grpc read failed
2025-10-10T14:01:24.749509Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: src_id|d0b495ad-b533c592-df818beb-323502ae_0 grpc closed
2025-10-10T14:01:24.749526Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|d0b495ad-b533c592-df818beb-323502ae_0 is DEAD
2025-10-10T14:01:24.750092Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T14:01:24.750110Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-10T14:01:24.750250Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:01:24.750889Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T14:01:24.751022Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:56496
2025-10-10T14:01:24.751037Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="topic server" ip=ipv6:[::1]:56496 proto=topic  topic=test-topic durationSec=0
2025-10-10T14:01:24.751047Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T14:01:24.752774Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-10T14:01:24.752893Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T14:01:24.752904Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T14:01:24.752915Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T14:01:24.752935Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7559592916715017351:3287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T14:01:24.754260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.754287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.754298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.756532Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7559592916715017351:3287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T14:01:24.765495Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559592916715017351:3287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:24.776471Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559592916715017351:3287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T14:01:24.776515Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7559592916715017351:3287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-10T14:01:24.776534Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559592916715017351:3287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:24.776567Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T14:01:24.778441Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7559592916715017380:3287], now have 1 active actors on pipe
2025-10-10T14:01:24.778741Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-10T14:01:24.779020Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:24.779052Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:24.779132Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T14:01:24.779166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.779183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.779194Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:24.779245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.779293Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T14:01:24.779344Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:24.780120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:24.780145Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:24.780226Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T14:01:24.780658Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 2 sessionId: src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0
2025-10-10T14:01:24.784504Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:01:24.784561Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104884784 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T14:01:24.784674Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 2 session_id: "src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T14:01:24.854921Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.854961Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.854974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:24.955406Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:24.955438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:24.955450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.055643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.055689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.055704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.155978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.156015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.156029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.256636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.256667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.256679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.358239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.358274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.358289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.460571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.460611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.460625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.560722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.560757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.560784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.672429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.672465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.672481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.772757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.772792Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.772808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.782217Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7559592916715017351:3287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T14:01:25.813441Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7559592916715017351:3287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-10T14:01:25.813474Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7559592916715017351:3287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T14:01:25.874565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.874602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.874623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:25.974720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:25.974756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:25.974772Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.075807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.075843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.075858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.176976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.177017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.177033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.280031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.280063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.280075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.381439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.381477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.381492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.486583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.486618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.486632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.701115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.701174Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.701188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.801037Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.801073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.801085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:26.903009Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:26.903052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:26.903068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.003974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.004011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.004026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.104100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.104145Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.104159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.204504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.204539Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.204554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.305363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.305405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.305423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.405718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.405760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.405778Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.506027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.506063Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.506076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.606515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.606578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.606608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.707061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.707097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.707112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.813266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.813308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.813325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:27.916529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:27.916571Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:27.916587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.016474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.016512Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.016527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.045705Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:28.116938Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.116982Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.116997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.223540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.223567Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.223575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.321728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.321754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.321762Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.425264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.425301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.425316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.525389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.525423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.525439Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.625751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.625784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.625800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.729266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.729309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.729326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.831802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.831843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.831858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:28.931947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:28.931986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:28.932000Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.032445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.032498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.032511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.136986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.137030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.137043Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.238452Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.238484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.238497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.345232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.345261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.345273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.449150Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.449191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.449209Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.549455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.549492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.549505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.650341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.650370Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.650384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.750875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.750908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.750922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.851022Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.851056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.851081Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:29.951356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:29.951393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:29.951407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.051709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.051749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.051765Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.152068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.152109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.152126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.252371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.252415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.252431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.352805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.352853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.352872Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.453868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.453905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.453920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.554020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.554066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.554085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.661256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.661298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.661319Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.765243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.765278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.765291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.869254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.869289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.869302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:30.973196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:30.973235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:30.973249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.073446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.073479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.073495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.176757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.176786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.176794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.277691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.277725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.277740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.379199Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.379234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.379248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.481091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.481143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.481157Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.581066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.581100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.581117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.681443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.681480Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.681497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.781865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.781907Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.781924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.885283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.885325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.885340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:31.986065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:31.986101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:31.986115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.086431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.086469Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.086485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.186779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.186818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.186837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.287590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.287626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.287643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.387931Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.387965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.387980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.489359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.489394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.489408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.593254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.593294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.593309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.693712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.693750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.693764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.793947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.793981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.794008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.894590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.894628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.894645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:32.994663Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:32.994706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:32.994718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.048915Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:33.095788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.095814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.095823Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.198706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.198751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.198766Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.298459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.298493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.298504Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.398626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.398670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.398685Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.498984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.499029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.499045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.604135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.604180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.604198Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.709288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.709327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.709343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.809845Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.809883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.809899Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:33.910154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:33.910202Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:33.910219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.013395Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.013432Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.013444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.113924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.113963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.113978Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.217253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.217292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.217309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.319479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.319524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.319540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.419919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.419970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.419988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.520066Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.520103Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.520117Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.621891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.621933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.621952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.722213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.722249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.722265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.822538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.822578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.822594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:34.924639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:34.924672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:34.924687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.025548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.025590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.025606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.125730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.125770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.125786Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.226229Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.226267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.226285Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.326331Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.326367Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.326383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.428682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.428714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.428730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.529368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.529407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.529423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.630720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.630759Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.630774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.735384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.735414Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.735427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.835283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.835318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.835342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:35.935622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:35.935657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:35.935670Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.037661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.037696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.037710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.137847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.137887Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.137903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.238232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.238282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.238299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.338992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.339034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.339051Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.439591Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.439735Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.439755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.539784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.539826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.539840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.641262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.641301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.641314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.740967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.741008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.741027Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.842245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.842287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.842302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:36.944246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:36.944283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:36.944299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.044596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.044651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.044666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.146433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.146468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.146481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.246843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.246878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.246892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.347455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.347496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.347510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.453257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.453293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.453307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.552015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.552053Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.552068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.653318Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.653353Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.653385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.753345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.753386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.753403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.857592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.857629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.857645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:37.961264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:37.961310Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:37.961327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.053475Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:38.061279Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.061320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.061337Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.161912Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.161946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.161960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.262681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.262718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.262732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.363077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.363108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.363122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.465304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.465335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.465347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.569448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.569489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.569505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.669686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.669725Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.669740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.773358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.773386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.773398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.874688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.874718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.874729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:38.977226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:38.977258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:38.977273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.078699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.078736Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.078750Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.181255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.181293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.181309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.285243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.285277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.285291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.386101Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.386134Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.386147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.488342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.488380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.488394Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.594068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.594108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.594124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.694264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.694308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.694334Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.794580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.794621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.794649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.894909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.894948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.894965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:39.995350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:39.995390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:39.995416Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.098325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.098364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.098380Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.200831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.200874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.200892Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.300226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.300264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.300278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.401307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.401341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.401356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.505616Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.505650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.505662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.609252Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.609289Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.609304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.708974Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.709007Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.709019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.809508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.809541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.809553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:40.913263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:40.913298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:40.913314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.015702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.015740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.015755Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.116853Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.116885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.116896Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.217796Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.217831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.217848Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.317958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.317997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.318012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.418173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.418213Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.418230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.521369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.521408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.521423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.622069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.622109Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.622125Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.725253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.725292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.725309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.829068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.829111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.829143Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:41.928030Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:41.928058Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:41.928069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.028503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.028536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.028549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.129340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.129383Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.129398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.230248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.230286Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.230300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.330570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.330606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.330622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.433247Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.433293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.433309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.533180Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.533219Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.533233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.637405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.637437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.637452Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.737479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.737514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.737527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.837960Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.838002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.838020Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.941321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:42.941360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:42.941375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:42.945515Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-10T14:01:42.945581Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-10T14:01:42.952488Z node 4 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-10T14:01:42.955557Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 4 DataSize: 0 UsedReserveSize: 0
2025-10-10T14:01:42.955725Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-10T14:01:43.041794Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.041829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.041846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.053650Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:43.148843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.148875Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.148888Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.249250Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.249291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.249307Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.350916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.350953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.350964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.451688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.451719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.451730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.552122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.552156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.552167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.653434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.653464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.653477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.758343Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.758384Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.758409Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.862576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.862610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.862623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:43.961664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:43.961687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:43.961696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.067729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.067767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.067782Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.168070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.168111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.168125Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.273309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.273350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.273365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.374408Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.374442Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.374456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.476565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.476598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.476610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.576917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.576953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.576968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.676980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.677019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.677034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.777993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.778034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.778050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:44.857636Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-10T14:01:44.858864Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T14:01:44.858911Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 3
2025-10-10T14:01:44.862189Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T14:01:44.862465Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T14:01:44.863075Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:44.863123Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:44.863203Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T14:01:44.863594Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:44.864016Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T14:01:44.864044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T14:01:44.864105Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-10T14:01:44.864141Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T14:01:44.864191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:44.864218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:44.864229Z node 4 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T14:01:44.864356Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-10T14:01:45.003566Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 172 count 1 nextOffset 3 batches 1
2025-10-10T14:01:45.003632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.004043Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 160 WTime 1760104905004
2025-10-10T14:01:45.007748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-10T14:01:45.007786Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T14:01:45.007912Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 160
2025-10-10T14:01:45.016671Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 160 actorID [4:7559592476791286684:2374]
2025-10-10T14:01:45.016733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T14:01:45.016786Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T14:01:45.016834Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T14:01:45.016869Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-10T14:01:45.017048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:45.017059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:45.017070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.017099Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T14:01:45.017148Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 480 CachedBlobs 3
2025-10-10T14:01:45.017177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T14:01:45.017649Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 160
2025-10-10T14:01:45.019577Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T14:01:45.020627Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T14:01:45.020838Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 3 written { offset: 2 } } write_statistics { persisting_time { nanos: 13000000 } min_queue_wait_time { nanos: 139000000 } max_queue_wait_time { nanos: 139000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T14:01:45.020872Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T14:01:45.020901Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-10T14:01:45.028184Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0 grpc read done: success: 0 data: 
2025-10-10T14:01:45.028215Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0 grpc read failed
2025-10-10T14:01:45.028247Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0 grpc closed
2025-10-10T14:01:45.028264Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0 is DEAD
2025-10-10T14:01:45.028686Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T14:01:45.029361Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7559592916715017380:3287] destroyed
2025-10-10T14:01:45.029403Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T14:01:45.029433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:45.029446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:45.029457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.035771Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: Cancelled on the server side, Details: , InternalError: 0
2025-10-10T14:01:45.035886Z :ERROR: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Got error. Status: CLIENT_CANCELLED, Description: <main>: Error: GRpc error: (1): Cancelled on the server side 
2025-10-10T14:01:45.035917Z :ERROR: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write session will not restart after a fatal error
2025-10-10T14:01:45.035952Z :INFO: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T14:01:45.036020Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T14:01:45.067456Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|7d28acd6-178042f8-ac4b5229-6cff55cc_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T14:01:45.109341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:45.109376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:45.109390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.217325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:45.217359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:45.217373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.325240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T14:01:45.325278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T14:01:45.325293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T14:01:45.587525Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710892, task: 1, CA Id [3:7559593006909331628:3461]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-10T14:01:45.626311Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710892, task: 1, CA Id [3:7559593006909331628:3461]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T14:01:45.749835Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710892, task: 1, CA Id [3:7559593006909331628:3461]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T14:01:45.956445Z node 3 :KQP_COMPUTE WARN: kqp_read_actor.cpp:1093: TxId: 281474976710892, task: 1, CA Id [3:7559593006909331628:3461]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-10T13:59:10.569369Z :WriteSessionWriteInHandlers INFO: Random seed for debugging is 1760104750569292
2025-10-10T13:59:11.192774Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7559592345209736566:2076];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:11.192908Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-10T13:59:11.273313Z node 2 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 131077 Duration# 0.007811s
2025-10-10T13:59:11.416637Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/bx9e/002e98/r3tmp/tmpjSSezk/pdisk_1.dat
2025-10-10T13:59:11.628500Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-10T13:59:11.806356Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:11.817291Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:11.829057Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-10T13:59:11.972406Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:11.975795Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:11.975909Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:11.976617Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-10T13:59:11.976688Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-10T13:59:11.981238Z node 1 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [1:7559592340914769219:2082] 1760104751122138 != 1760104751122141
2025-10-10T13:59:11.996736Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-10T13:59:12.013430Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-10T13:59:12.013768Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:12.025413Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-10T13:59:12.027463Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-10T13:59:12.155367Z node 2 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.015531s
TServer::EnableGrpc on GrpcPort 62557, node 1
2025-10-10T13:59:12.356534Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:12.417760Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/bx9e/002e98/r3tmp/yandexJemprx.tmp
2025-10-10T13:59:12.417784Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/bx9e/002e98/r3tmp/yandexJemprx.tmp
2025-10-10T13:59:12.420318Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/bx9e/002e98/r3tmp/yandexJemprx.tmp
2025-10-10T13:59:12.420458Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-10T13:59:12.496153Z INFO: TTestServer started on Port 9012 GrpcPort 62557
2025-10-10T13:59:12.569375Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-10T13:59:12.573185Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:9012
PQClient connected to localhost:62557
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-10T13:59:13.072843Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-10T13:59:16.187528Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7559592345209736566:2076];send_to=[0:7307199536658146131:7762515];
2025-10-10T13:59:16.187648Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-10T13:59:18.046695Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:18.084175Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [2:7559592370293471765:2294], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:18.085391Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=ZTEzMTZjMDYtZmExZTUxNTktMTM3NzhmNTgtYmMxODlhMDA=, ActorId: [2:7559592370293471763:2293], ActorState: ExecuteState, TraceId: 01k776pe6x31hqd5pdc4wqd41x, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:18.094714Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:18.085248Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [1:7559592370979541378:2325], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-10T13:59:18.086798Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=OWI5YTQ1MDUtZDc2NTgwY2MtMTI1MTVkNWUtYjllYzVkMWI=, ActorId: [1:7559592370979541372:2323], ActorState: ExecuteState, TraceId: 01k776ped7avd47j8gw50jfg8f, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-10T13:59:18.094885Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-10T13:59:18.337951Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-10T13:59:18.618045Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:62557", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-10T13:59:19.527150Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715664. Ctx: { TraceId: 01k776pfk774jva8xmapntgx6z, Database: , SessionId: ydb://session/3?node_id=1&id=OGFhNzkxMTAtYjI2MmQ4ZjItYWIyNDNjZS05ZWNkM2JiMQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7559592379569476390:2945] 
=== CheckClustersList. Ok
2025-10-10T13:59:25.972652Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:62557
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:62557
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-10-10T13:59:26.176285Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-10T13:59:26.249240Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7559592409634248032:3271] connected; active server actors: 1
2025-10-10T13:59:26.249497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-10T13:59:26.261460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-10T13:59:26.285379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-10T13:59:26.431639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-10T13:59:26.435189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-10T13:59:26.435489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-10T13:59:26.435529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:26.435573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-10T13:59:26.438125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592409634248040:2460], now have 1 active actors on pipe
2025-10-10T13:59:26.438154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592409634248030:3270], now have 1 active actors on pipe
2025-10-10T13:59:26.439247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-10T13:59:26.442069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:26.455467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:26.470985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592409634248106:3318], now have 1 active actors on pipe
2025-10-10T13:59:26.472238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:26.479551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:26.480690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-10T13:59:26.480780Z node 2 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-10T13:59:26.481090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-10T13:59:26.481486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1090: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7559592408948178048:2392]
2025-10-10T13:59:26.484374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-10T13:59:26.484396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-10T13:59:26.484421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7559592408948178048:2392]
2025-10-10T13:59:26.484463Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-10T13:59:26.491588Z node 2 :PERSQUEUE DEBUG: partition.cpp:4348: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-10T13:59:26.491646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.491797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.491815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:26.496596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:26.496629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.496647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.496663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2345: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-10T13:59:26.496729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:26.497173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:26.497622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:26.522541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:26.522714Z node 2 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760104766511, TxId 281474976715679
2025-10-10T13:59:26.522741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.522752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.522877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.523118Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:26.526820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:26.527118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:26.527153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.527165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.527180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.527209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:26.527590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-10T13:59:26.527691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-10T13:59:26.527974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:26.539676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:26.539794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-10T13:59:26.542743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-10T13:59:26.572762Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715682. Ctx: { TraceId: 01k776pptm98bnbvbhbzevvs1n, Database: , SessionId: ydb://session/3?node_id=1&id=ZjgxODIyZmUtMWVlZGY5NmYtYjk4MTYxYTItYmYwNzgzNzU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-10T13:59:26.596430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.596480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.596495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760104766511
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: ...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1760104766511
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:62557
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:26.616231Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T13:59:26.697270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.697313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.697326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.798457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.798483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.798502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.898401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:26.898425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:26.898436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:26.902730Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-10T13:59:26.902762Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-10T13:59:27.003256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.003284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.003295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.102253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.102285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.102297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:62557
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:27.121434Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-10T13:59:27.205236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.205269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.205282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.309234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.309266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.309275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.413241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.413273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.413284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.514205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.514231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.514240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.614121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.614146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.614168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:62557
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-10T13:59:27.627432Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-10T13:59:27.642638Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-10T13:59:27.649332Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-10T13:59:27.649388Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:62557
2025-10-10T13:59:27.674706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:27.674751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-10T13:59:27.685105Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:27.686122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-10T13:59:27.686320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:53824
2025-10-10T13:59:27.686339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53824 proto=v1  topic=test-topic durationSec=0
2025-10-10T13:59:27.686352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:27.688161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-10T13:59:27.688333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:27.688343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:27.688350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:27.688370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592413929215588:2503] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:27.690785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592413929215588:2503] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:27.714498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.714522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.714531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.817250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.817284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.817296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.919436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:27.919465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:27.919476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:27.924183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559592413929215588:2503] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:27.931316Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592413929215629:2503] connected; active server actors: 1
2025-10-10T13:59:27.931412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559592413929215588:2503] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-10T13:59:27.931441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592413929215588:2503] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:27.935021Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592413929215629:2503] disconnected; active server actors: 1
2025-10-10T13:59:27.935058Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592413929215629:2503] disconnected no session
2025-10-10T13:59:28.023593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.023619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.023630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.066545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592418224182943:2503], now have 1 active actors on pipe
2025-10-10T13:59:28.067375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.067418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.067527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|f05103fd-8a844edd-3d608f2b-449ef24b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-10T13:59:28.067576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.067599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.067612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:28.067660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.067702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:28.067755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:28.068930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.068960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.069038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:28.064560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592413929215588:2503] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:28.064607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592413929215588:2503] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:28.064625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592413929215588:2503] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:28.064659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:28.067052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T13:59:28.069580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|f05103fd-8a844edd-3d608f2b-449ef24b_0
2025-10-10T13:59:28.074324Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104768074 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:28.074462Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|f05103fd-8a844edd-3d608f2b-449ef24b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-10T13:59:28.075024Z :INFO: [] MessageGroupId [src] SessionId [src|f05103fd-8a844edd-3d608f2b-449ef24b_0] Write session: close. Timeout = 0 ms
2025-10-10T13:59:28.075090Z :INFO: [] MessageGroupId [src] SessionId [src|f05103fd-8a844edd-3d608f2b-449ef24b_0] Write session will now close
2025-10-10T13:59:28.075130Z :DEBUG: [] MessageGroupId [src] SessionId [src|f05103fd-8a844edd-3d608f2b-449ef24b_0] Write session: aborting
2025-10-10T13:59:28.075597Z :INFO: [] MessageGroupId [src] SessionId [src|f05103fd-8a844edd-3d608f2b-449ef24b_0] Write session: gracefully shut down, all writes complete
2025-10-10T13:59:28.075642Z :DEBUG: [] MessageGroupId [src] SessionId [src|f05103fd-8a844edd-3d608f2b-449ef24b_0] Write session: destroy
2025-10-10T13:59:28.083009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|f05103fd-8a844edd-3d608f2b-449ef24b_0 grpc read done: success: 0 data: 
2025-10-10T13:59:28.083041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|f05103fd-8a844edd-3d608f2b-449ef24b_0 grpc read failed
2025-10-10T13:59:28.083089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|f05103fd-8a844edd-3d608f2b-449ef24b_0 grpc closed
2025-10-10T13:59:28.083108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|f05103fd-8a844edd-3d608f2b-449ef24b_0 is DEAD
2025-10-10T13:59:28.084019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:28.085844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559592418224182943:2503] destroyed
2025-10-10T13:59:28.085891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:28.085923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.085939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.085953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
=== Before CreateWriteSession
=== Inside ReadyToAcceptHandler
=== Session created
=== Inside ReadyToAcceptHandler
2025-10-10T13:59:28.108511Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-10T13:59:28.109727Z :INFO: [/Root] [] [] Start federated write session to database '' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "" DbInfos: [ { path: "/Root" endpoint: "localhost:62557" status: AVAILABLE weight: 100 } ] ControlPlaneEndpoint: localhost:62557 }
2025-10-10T13:59:28.110209Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:28.110815Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-10T13:59:28.119153Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-10T13:59:28.121351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-10T13:59:28.121386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-10T13:59:28.124184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.124212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.124223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.130355Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:28.130791Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-10T13:59:28.131567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-10T13:59:28.131746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:53852
2025-10-10T13:59:28.131764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:53852 proto=topic  topic=test-topic durationSec=0
2025-10-10T13:59:28.131778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-10T13:59:28.133763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-10T13:59:28.133895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-10T13:59:28.133904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-10T13:59:28.133912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-10T13:59:28.133927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7559592418224182953:2516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-10T13:59:28.136384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7559592418224182953:2516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-10T13:59:28.148808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7559592418224182953:2516] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-10T13:59:28.149366Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592418224182972:2516] connected; active server actors: 1
2025-10-10T13:59:28.149530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7559592418224182953:2516] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-10T13:59:28.149552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7559592418224182953:2516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-10T13:59:28.149783Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592418224182972:2516] disconnected; active server actors: 1
2025-10-10T13:59:28.149802Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7559592418224182972:2516] disconnected no session
2025-10-10T13:59:28.162740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7559592418224182953:2516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-10T13:59:28.162775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7559592418224182953:2516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-10T13:59:28.162790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7559592418224182953:2516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-10T13:59:28.162832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-10T13:59:28.164612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-10T13:59:28.165380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7559592418224182983:2516], now have 1 active actors on pipe
2025-10-10T13:59:28.165442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.165459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.165513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-10T13:59:28.165539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.165551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.165558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:28.165603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.165640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-10T13:59:28.165674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:28.166808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.166831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.166870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-10T13:59:28.167194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0
2025-10-10T13:59:28.169311Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:28.169458Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760104768169 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-10T13:59:28.169673Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-10T13:59:28.173323Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-10T13:59:28.179466Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:28.179550Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-10T13:59:28.181041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:28.181474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:28.182312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.182350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.182444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-10T13:59:28.183175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.183634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.183655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.184006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 115 offset: -1
2025-10-10T13:59:28.184062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:28.184109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.184156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.184169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:28.184287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-10T13:59:28.185148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 189 count 1 nextOffset 1 batches 1
2025-10-10T13:59:28.185185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.185772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 177 WTime 1760104768185
2025-10-10T13:59:28.186938Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:28.187080Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 177
2025-10-10T13:59:28.198455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 177 actorID [2:7559592408948178008:2392]
2025-10-10T13:59:28.198516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:28.198567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 122 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:28.198605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.198655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-10T13:59:28.198883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-10T13:59:28.198918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-10T13:59:28.198938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.198948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.198958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.198990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:28.199032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-10T13:59:28.199149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-10T13:59:28.199373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 177 count 1 last offset 0, current partition end offset: 1
2025-10-10T13:59:28.199392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-10T13:59:28.199446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 177 accessed 0 times before, last time 2025-10-10T13:59:28.000000Z
2025-10-10T13:59:28.199471Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-10T13:59:28.199541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-10-10T13:59:28.199682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 157 from pos 0 cbcount 1
2025-10-10T13:59:28.199754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760104768183 queuesize 0 startOffset 0
2025-10-10T13:59:28.200838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.200409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 177
2025-10-10T13:59:28.200475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-10T13:59:28.205315Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:28.205915Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 13000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T13:59:28.205987Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-10T13:59:28.206022Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: acknoledged message 1
=== Inside AcksHandler
2025-10-10T13:59:28.207739Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
=== Inside ReadyToAcceptHandler
2025-10-10T13:59:28.208169Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-10T13:59:28.208208Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
=== AcksHandler has written a message, closing the session
2025-10-10T13:59:28.208871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-10T13:59:28.209140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-10T13:59:28.209642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.209688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.209831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-10T13:59:28.211291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.211826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-10T13:59:28.211857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-10T13:59:28.211912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 107 offset: -1
2025-10-10T13:59:28.211945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-10T13:59:28.211991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.212013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.212022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2329: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-10T13:59:28.212126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-10T13:59:28.212988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 181 count 1 nextOffset 2 batches 1
2025-10-10T13:59:28.213025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.213409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 169 WTime 1760104768213
2025-10-10T13:59:28.213533Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-10T13:59:28.213630Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 169
2025-10-10T13:59:28.218500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 169 actorID [2:7559592408948178008:2392]
2025-10-10T13:59:28.218558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2143: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-10T13:59:28.218603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 114 WriteNewSizeFromSupportivePartitions# 0
2025-10-10T13:59:28.218639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-10T13:59:28.218680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-10T13:59:28.218849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.218859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.218868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.218900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:182: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-10T13:59:28.218938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-10T13:59:28.219102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 169
2025-10-10T13:59:28.219724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-10T13:59:28.220541Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-10T13:59:28.220718Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 2000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-10T13:59:28.220751Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-10-10T13:59:28.220779Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: acknoledged message 2
=== Inside AcksHandler
=== Inside SessionClosedHandler
2025-10-10T13:59:28.225328Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
=== SessionClosedHandler has 'written' a message
2025-10-10T13:59:28.225454Z :INFO: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-10T13:59:28.225488Z :INFO: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session will now close
2025-10-10T13:59:28.225530Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: aborting
2025-10-10T13:59:28.225910Z :WARNING: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: could not confirm all writes in time or session aborted, perform hard shutdown
2025-10-10T13:59:28.225947Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0]  MessageGroupId [src_id] Write session: destroy
2025-10-10T13:59:28.226929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.226959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.226970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.227053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0 grpc read done: success: 0 data: 
2025-10-10T13:59:28.227080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0 grpc read failed
2025-10-10T13:59:28.227109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0 grpc closed
2025-10-10T13:59:28.227127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|55f8023f-ef302e78-f9313b2d-8dbbdd40_0 is DEAD
2025-10-10T13:59:28.227826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-10T13:59:28.237240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7559592418224182983:2516] destroyed
2025-10-10T13:59:28.237298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-10T13:59:28.237329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.237340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.237359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.327845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.327872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.327883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.429422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.429448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.429458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.536371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2316: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-10T13:59:28.536409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-10T13:59:28.536417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-10T13:59:28.907295Z node 1 :KQP_EXECUTER ERROR: kqp_executer_impl.h:1010: ActorId: [1:7559592418224183039:2521] TxId: 281474976715692. Ctx: { TraceId: 01k776prxb8jcw9p803xa2nsg2, Database: /Root, SessionId: ydb://session/3?node_id=1&id=N2RlODc4NTgtNzVhODc3MWYtZjc4Yzg3NTEtOWQyYmRjMmY=, PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 2
2025-10-10T13:59:28.907923Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559592418224183045:2531], TxId: 281474976715692, task: 2. Ctx: { TraceId : 01k776prxb8jcw9p803xa2nsg2.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=1&id=N2RlODc4NTgtNzVhODc3MWYtZjc4Yzg3NTEtOWQyYmRjMmY=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7559592418224183039:2521], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-10T13:59:28.907939Z node 1 :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1208: SelfId: [1:7559592418224183047:2532], TxId: 281474976715692, task: 4. Ctx: { TraceId : 01k776prxb8jcw9p803xa2nsg2.  CustomerSuppliedId : .  RunScriptActorId : [0:0:0].  PoolId : .  SessionId : ydb://session/3?node_id=1&id=N2RlODc4NTgtNzVhODc3MWYtZjc4Yzg3NTEtOWQyYmRjMmY=.  CurrentExecutionId : .  Database : /Root.  DatabaseId : /Root. }. Handle abort execution event from: [1:7559592418224183039:2521], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
